[S 03/12 20:36] PVFS2 Server on node da1 version 2.7.1pre1-2008-03-12-025908 starting... [D 20:36:40.735797] BMI_ib_initialize: init. [D 20:36:40.735827] openib_ib_initialize: init. [D 20:36:40.737081] openib_ib_initialize: max 65408 completion queue entries. [D 20:36:40.737589] BMI_ib_initialize: done. [D 20:36:40.737621] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 11 [D 20:36:40.737638] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 12 [S 03/12 20:36] PVFS2 Server ready. [D 20:41:02.142373] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 5 [D 20:41:02.142443] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.142458] [BMI CONTROL]: BMI_set_info: incremented ref 6662784 to: 1 [D 20:41:02.142698] BMI_post_send_list: addr: 6662784, count: 1, total_size: 1104, tag: 3 [D 20:41:02.142739] element 0: offset: 0x66e880, size: 1104 [D 20:41:02.142760] openib_post_sr: 10.1.4.240:43794 bh 0 len 1120 wr 0/70. [D 20:41:02.142973] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 6 [D 20:41:02.142994] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.143010] [BMI CONTROL]: BMI_set_info: decremented ref 6662784 to: 0 [D 20:41:07.115699] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 5 [D 20:41:07.115767] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.115782] [BMI CONTROL]: BMI_set_info: incremented ref 6661680 to: 1 [D 20:41:07.115822] BMI_post_send_list: addr: 6661680, count: 1, total_size: 1104, tag: 3 [D 20:41:07.115837] element 0: offset: 0x66e880, size: 1104 [D 20:41:07.115857] openib_post_sr: 10.1.4.240:43797 bh 0 len 1120 wr 1/70. [D 20:41:07.116305] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 6 [D 20:41:07.116320] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.116332] [BMI CONTROL]: BMI_set_info: decremented ref 6661680 to: 0 [D 20:41:09.889162] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.889227] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.889242] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:09.889280] BMI_post_send_list: addr: 6653168, count: 1, total_size: 1104, tag: 3 [D 20:41:09.889295] element 0: offset: 0x66e880, size: 1104 [D 20:41:09.889315] openib_post_sr: 10.1.4.240:43800 bh 0 len 1120 wr 2/70. [D 20:41:09.889496] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:09.889515] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.889528] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:09.898355] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.898375] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.898388] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:10.262057] BMI_post_send_list: addr: 6653168, count: 1, total_size: 72, tag: 10 [D 20:41:10.262124] element 0: offset: 0x65d000, size: 72 [D 20:41:10.262147] openib_post_sr: 10.1.4.240:43800 bh 1 len 88 wr 3/70. [D 20:41:10.265406] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:10.265429] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:10.265465] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:15.048556] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 5 [D 20:41:15.048625] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.048641] [BMI CONTROL]: BMI_set_info: incremented ref 6658032 to: 1 [D 20:41:15.048681] BMI_post_send_list: addr: 6658032, count: 1, total_size: 1104, tag: 3 [D 20:41:15.048697] element 0: offset: 0x66e880, size: 1104 [D 20:41:15.048717] openib_post_sr: 10.1.4.240:43803 bh 0 len 1120 wr 4/70. [D 20:41:15.048874] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 6 [D 20:41:15.048891] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.048905] [BMI CONTROL]: BMI_set_info: decremented ref 6658032 to: 0 [D 20:41:26.988322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:26.988388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:26.988404] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:26.988506] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 3 [D 20:41:26.988521] element 0: offset: 0x622e70, size: 104 [D 20:41:26.988541] openib_post_sr: 10.1.4.240:43806 bh 0 len 120 wr 5/70. [D 20:41:26.988720] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:26.988739] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:26.988752] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:26.993600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:26.993620] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:26.993633] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:26.993667] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 9 [D 20:41:26.993680] element 0: offset: 0x623200, size: 104 [D 20:41:26.993697] openib_post_sr: 10.1.4.240:43806 bh 1 len 120 wr 6/70. [D 20:41:26.994099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:26.994117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:26.994130] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.007183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.007205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.007218] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.016392] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 18 [D 20:41:27.016413] element 0: offset: 0x61e760, size: 24 [D 20:41:27.016428] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 7/70. [D 20:41:27.016548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.016566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.016579] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.019032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.019052] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.019065] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.019097] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 22 [D 20:41:27.019111] element 0: offset: 0x659860, size: 24 [D 20:41:27.019127] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 8/70. [D 20:41:27.025336] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 22 [D 20:41:27.025424] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 9/70. [D 20:41:27.031102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 22 [D 20:41:27.031126] element 0: offset: 0x659860, size: 24 [D 20:41:27.031144] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 10/70. [D 20:41:27.031282] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.031301] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.031314] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.084814] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.084834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.084847] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.087677] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 29 [D 20:41:27.087696] element 0: offset: 0x65d000, size: 72 [D 20:41:27.087712] openib_post_sr: 10.1.4.240:43806 bh 6 len 88 wr 11/70. [D 20:41:27.087869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.087888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.087900] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.088292] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.088311] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.088324] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.088350] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 31 [D 20:41:27.088364] element 0: offset: 0x65a860, size: 24 [D 20:41:27.088381] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 12/70. [D 20:41:27.088916] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 31 [D 20:41:27.088960] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 13/70. [D 20:41:27.089032] openib_post_sr_rdmaw: ibv_post_send wr_id 6231f0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.089264] openib_check_cq: completed rdma wr_id 6231f0, nic_wr_credit 70. [D 20:41:27.089294] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 14/70. [D 20:41:27.089403] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.089424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.089438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.089716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.089737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.089750] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.089773] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 32 [D 20:41:27.089787] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.089802] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 15/70. [D 20:41:27.090163] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 32 [D 20:41:27.090189] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 16/70. [D 20:41:27.090247] openib_post_sr_rdmaw: ibv_post_send wr_id 628cd0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.090374] openib_check_cq: completed rdma wr_id 628cd0, nic_wr_credit 70. [D 20:41:27.090389] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 17/70. [D 20:41:27.090454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.090475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.090488] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.092212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.092233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.092246] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.092268] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 35 [D 20:41:27.092282] element 0: offset: 0x65a860, size: 24 [D 20:41:27.092298] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 18/70. [D 20:41:27.092654] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 35 [D 20:41:27.092677] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 19/70. [D 20:41:27.092737] openib_post_sr_rdmaw: ibv_post_send wr_id 628c20 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.092866] openib_check_cq: completed rdma wr_id 628c20, nic_wr_credit 70. [D 20:41:27.092882] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 20/70. [D 20:41:27.092958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.092979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.092992] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.093420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.093440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.093453] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.093476] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 37 [D 20:41:27.093490] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.093505] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 21/70. [D 20:41:27.093888] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 37 [D 20:41:27.093913] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 22/70. [D 20:41:27.093974] openib_post_sr_rdmaw: ibv_post_send wr_id 628c20 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.094102] openib_check_cq: completed rdma wr_id 628c20, nic_wr_credit 70. [D 20:41:27.094118] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 23/70. [D 20:41:27.094188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.094210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.094223] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.096896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.096916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.096930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.096957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 39 [D 20:41:27.096971] element 0: offset: 0x65d000, size: 72 [D 20:41:27.096986] openib_post_sr: 10.1.4.240:43806 bh 19 len 88 wr 24/70. [D 20:41:27.097117] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.097134] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.097146] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.097569] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.097587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.097600] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.097624] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 42 [D 20:41:27.097638] element 0: offset: 0x65d000, size: 72 [D 20:41:27.097653] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 25/70. [D 20:41:27.097826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.097843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.097855] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.182903] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.182990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.183005] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.183056] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 49 [D 20:41:27.183072] element 0: offset: 0x65d000, size: 72 [D 20:41:27.183091] openib_post_sr: 10.1.4.240:43806 bh 1 len 88 wr 26/70. [D 20:41:27.183394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.183412] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.183425] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.188708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.188777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.188791] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.188835] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 54 [D 20:41:27.188850] element 0: offset: 0x65a860, size: 24 [D 20:41:27.188870] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 27/70. [D 20:41:27.191271] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 54 [D 20:41:27.191406] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 28/70. [D 20:41:27.194468] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6b0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.195396] openib_check_cq: completed rdma wr_id 61f6b0, nic_wr_credit 70. [D 20:41:27.195436] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 29/70. [D 20:41:27.196004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.196055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.196069] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.196492] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.196511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.196524] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.196565] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 56 [D 20:41:27.196580] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.196598] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 30/70. [D 20:41:27.197162] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 56 [D 20:41:27.197188] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 31/70. [D 20:41:27.197377] openib_post_sr_rdmaw: ibv_post_send wr_id 632110 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.198169] openib_check_cq: completed rdma wr_id 632110, nic_wr_credit 70. [D 20:41:27.198212] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 32/70. [D 20:41:27.198413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.198436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.198449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.209799] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.209867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.209882] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.209926] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 60 [D 20:41:27.209942] element 0: offset: 0x6231d0, size: 24 [D 20:41:27.209961] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 33/70. [D 20:41:27.210541] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 60 [D 20:41:27.210566] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 34/70. [D 20:41:27.210738] openib_post_sr_rdmaw: ibv_post_send wr_id 633390 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.211819] openib_check_cq: completed rdma wr_id 633390, nic_wr_credit 70. [D 20:41:27.211878] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 35/70. [D 20:41:27.212101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.212123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.212137] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.212729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.212749] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.212762] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.212785] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 62 [D 20:41:27.212800] element 0: offset: 0x659860, size: 24 [D 20:41:27.212815] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 36/70. [D 20:41:27.214359] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 62 [D 20:41:27.214395] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 37/70. [D 20:41:27.214574] openib_post_sr_rdmaw: ibv_post_send wr_id 634610 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.215436] openib_check_cq: completed rdma wr_id 634610, nic_wr_credit 70. [D 20:41:27.215482] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 38/70. [D 20:41:27.215683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.215705] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.215718] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.218912] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.218933] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.218946] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.218982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 64 [D 20:41:27.218997] element 0: offset: 0x65d000, size: 72 [D 20:41:27.219014] openib_post_sr: 10.1.4.240:43806 bh 14 len 88 wr 39/70. [D 20:41:27.219201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.219276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.219298] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.224822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.224847] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.224860] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.224890] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 68 [D 20:41:27.224905] element 0: offset: 0x65d000, size: 72 [D 20:41:27.225692] openib_post_sr: 10.1.4.240:43806 bh 15 len 88 wr 40/70. [D 20:41:27.225946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.225966] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.225979] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.235285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.235453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.235495] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.235650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 75 [D 20:41:27.235674] element 0: offset: 0x65d000, size: 72 [D 20:41:27.235719] openib_post_sr: 10.1.4.240:43806 bh 16 len 88 wr 41/70. [D 20:41:27.237893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.237995] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.238035] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.238116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.238175] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.238214] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.238310] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 77 [D 20:41:27.238332] element 0: offset: 0x691fe0, size: 24 [D 20:41:27.238379] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 42/70. [D 20:41:27.238830] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 77 [D 20:41:27.238880] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 43/70. [D 20:41:27.239072] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6b0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.239895] openib_check_cq: completed rdma wr_id 61f6b0, nic_wr_credit 70. [D 20:41:27.239938] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 44/70. [D 20:41:27.240137] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.240176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.240212] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.240499] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.240542] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.240561] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.240641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 78 [D 20:41:27.240663] element 0: offset: 0x65a860, size: 24 [D 20:41:27.240729] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 45/70. [D 20:41:27.242310] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 78 [D 20:41:27.242338] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 46/70. [D 20:41:27.242522] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6b0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.243398] openib_check_cq: completed rdma wr_id 61f6b0, nic_wr_credit 70. [D 20:41:27.243461] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 47/70. [D 20:41:27.243700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.243765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.243809] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.248969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.249090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.249131] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.249283] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 82 [D 20:41:27.249318] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.249361] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 48/70. [D 20:41:27.251244] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 82 [D 20:41:27.251278] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 49/70. [D 20:41:27.251456] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6b0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.252172] openib_check_cq: completed rdma wr_id 61f6b0, nic_wr_credit 70. [D 20:41:27.252188] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 50/70. [D 20:41:27.252476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.252520] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.252556] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.253018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.253083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.253104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.253138] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 84 [D 20:41:27.253158] element 0: offset: 0x6231d0, size: 24 [D 20:41:27.253180] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 51/70. [D 20:41:27.253949] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 84 [D 20:41:27.253978] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 52/70. [D 20:41:27.254140] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6b0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.254619] openib_check_cq: completed rdma wr_id 61f6b0, nic_wr_credit 70. [D 20:41:27.254634] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 53/70. [D 20:41:27.255298] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.255327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.255361] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.256421] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.256450] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.256477] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.256535] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 86 [D 20:41:27.256557] element 0: offset: 0x65d000, size: 72 [D 20:41:27.256591] openib_post_sr: 10.1.4.240:43806 bh 9 len 88 wr 54/70. [D 20:41:27.257296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.257329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.257343] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:27.257399] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:27.257442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.257506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:27.257542] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 89 [D 20:41:27.257569] element 0: offset: 0x65d000, size: 72 [D 20:41:27.257604] openib_post_sr: 10.1.4.240:43806 bh 10 len 88 wr 55/70. [D 20:41:27.257888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:27.257907] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:27.257920] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:30.028274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:30.028344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:30.028360] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:30.028438] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 93 [D 20:41:30.028455] element 0: offset: 0x62a010, size: 104 [D 20:41:30.028473] openib_post_sr: 10.1.4.240:43806 bh 11 len 120 wr 56/70. [D 20:41:30.031080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:30.031143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:30.031158] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.845003] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.845070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.845085] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.845155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 99 [D 20:41:36.845171] element 0: offset: 0x62a010, size: 104 [D 20:41:36.845190] openib_post_sr: 10.1.4.240:43806 bh 12 len 120 wr 57/70. [D 20:41:36.845313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.845329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.845342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.851011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.851030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.851043] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.851081] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 105 [D 20:41:36.851095] element 0: offset: 0x65d000, size: 72 [D 20:41:36.851110] openib_post_sr: 10.1.4.240:43806 bh 13 len 88 wr 58/70. [D 20:41:36.851227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.851244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.851256] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.851987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.852004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.852017] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.852192] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 107 [D 20:41:36.852208] element 0: offset: 0x61f0b0, size: 16 [D 20:41:36.852223] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 59/70. [D 20:41:36.852324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.852342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.852354] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.859731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.859750] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.859762] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.859785] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 111 [D 20:41:36.859799] element 0: offset: 0x65d000, size: 72 [D 20:41:36.859815] openib_post_sr: 10.1.4.240:43806 bh 15 len 88 wr 60/70. [D 20:41:36.859889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.859905] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.859918] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.860731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.860748] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.860761] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.860786] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 113 [D 20:41:36.860800] element 0: offset: 0x691fe0, size: 24 [D 20:41:36.860815] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 0/70. [D 20:41:36.860938] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 113 [D 20:41:36.860964] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 1/70. [D 20:41:36.863543] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 113 [D 20:41:36.863562] element 0: offset: 0x691fe0, size: 24 [D 20:41:36.863579] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 2/70. [D 20:41:36.863635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.863650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.863662] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.928884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.928905] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.928917] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.929019] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 120 [D 20:41:36.929034] element 0: offset: 0x65d000, size: 72 [D 20:41:36.929050] openib_post_sr: 10.1.4.240:43806 bh 19 len 88 wr 3/70. [D 20:41:36.929100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.929117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.929129] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.939990] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.940008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.940020] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.940045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 126 [D 20:41:36.940059] element 0: offset: 0x65d000, size: 72 [D 20:41:36.940075] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 4/70. [D 20:41:36.940207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.940224] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.940236] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.940305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.940319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.940332] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.940354] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 128 [D 20:41:36.940368] element 0: offset: 0x659890, size: 24 [D 20:41:36.940383] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 5/70. [D 20:41:36.940539] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 128 [D 20:41:36.940560] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 6/70. [D 20:41:36.940618] openib_post_sr_rdmaw: ibv_post_send wr_id 649350 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.940838] openib_check_cq: completed rdma wr_id 649350, nic_wr_credit 70. [D 20:41:36.940857] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 7/70. [D 20:41:36.940915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.940933] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.940945] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.941239] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.941253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.941265] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.941286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 129 [D 20:41:36.941300] element 0: offset: 0x65a860, size: 24 [D 20:41:36.941315] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 8/70. [D 20:41:36.941443] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 129 [D 20:41:36.941461] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 9/70. [D 20:41:36.941507] openib_post_sr_rdmaw: ibv_post_send wr_id 6480f0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.941632] openib_check_cq: completed rdma wr_id 6480f0, nic_wr_credit 70. [D 20:41:36.941647] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 10/70. [D 20:41:36.941697] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.941715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.941728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.943401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.943419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.943431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.943455] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 132 [D 20:41:36.943469] element 0: offset: 0x6231d0, size: 24 [D 20:41:36.943486] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 11/70. [D 20:41:36.943620] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 132 [D 20:41:36.943639] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 12/70. [D 20:41:36.943687] openib_post_sr_rdmaw: ibv_post_send wr_id 61f810 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.943812] openib_check_cq: completed rdma wr_id 61f810, nic_wr_credit 70. [D 20:41:36.943827] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 13/70. [D 20:41:36.943878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.943896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.943909] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.944089] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.944103] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.944116] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.944136] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 133 [D 20:41:36.944150] element 0: offset: 0x6424e0, size: 24 [D 20:41:36.944165] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 14/70. [D 20:41:36.944296] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 133 [D 20:41:36.944317] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 15/70. [D 20:41:36.944370] openib_post_sr_rdmaw: ibv_post_send wr_id 61f840 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.944495] openib_check_cq: completed rdma wr_id 61f840, nic_wr_credit 70. [D 20:41:36.944509] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 16/70. [D 20:41:36.944556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.944575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.944587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.945259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.945277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.945290] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.945315] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 135 [D 20:41:36.945329] element 0: offset: 0x65d000, size: 72 [D 20:41:36.945346] openib_post_sr: 10.1.4.240:43806 bh 13 len 88 wr 17/70. [D 20:41:36.945388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.945402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.945415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:36.948336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:36.948355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.948367] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:36.948391] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 139 [D 20:41:36.948405] element 0: offset: 0x65d000, size: 72 [D 20:41:36.948419] openib_post_sr: 10.1.4.240:43806 bh 14 len 88 wr 18/70. [D 20:41:36.948553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:36.948569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:36.948581] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.046454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.046527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.046541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.046590] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 146 [D 20:41:37.046606] element 0: offset: 0x65d000, size: 72 [D 20:41:37.046626] openib_post_sr: 10.1.4.240:43806 bh 15 len 88 wr 19/70. [D 20:41:37.046847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.046863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.046876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.065525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.065595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.065609] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.065657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 152 [D 20:41:37.065673] element 0: offset: 0x65d000, size: 72 [D 20:41:37.065693] openib_post_sr: 10.1.4.240:43806 bh 16 len 88 wr 20/70. [D 20:41:37.065883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.065897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.065912] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.067849] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.067867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.067880] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.067907] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 154 [D 20:41:37.067921] element 0: offset: 0x61f0b0, size: 24 [D 20:41:37.067936] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 21/70. [D 20:41:37.071367] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 154 [D 20:41:37.071391] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 22/70. [D 20:41:37.071546] openib_post_sr_rdmaw: ibv_post_send wr_id 61f7a0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.072415] openib_check_cq: completed rdma wr_id 61f7a0, nic_wr_credit 70. [D 20:41:37.072432] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 23/70. [D 20:41:37.075490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.075733] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.075939] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.076017] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.076039] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.076088] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.076188] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 156 [D 20:41:37.076210] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.076362] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 24/70. [D 20:41:37.079709] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 156 [D 20:41:37.079732] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 25/70. [D 20:41:37.079868] openib_post_sr_rdmaw: ibv_post_send wr_id 61f7a0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.080218] openib_check_cq: completed rdma wr_id 61f7a0, nic_wr_credit 70. [D 20:41:37.080232] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 26/70. [D 20:41:37.080332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.080420] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.080436] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.091291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.091468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.091515] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.091638] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 160 [D 20:41:37.091661] element 0: offset: 0x62fbb0, size: 24 [D 20:41:37.095091] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 27/70. [D 20:41:37.098261] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 160 [D 20:41:37.098280] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 28/70. [D 20:41:37.098332] openib_post_sr_rdmaw: ibv_post_send wr_id 61f7a0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.098454] openib_check_cq: completed rdma wr_id 61f7a0, nic_wr_credit 70. [D 20:41:37.098467] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 29/70. [D 20:41:37.104366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.104382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.104395] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.104416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.104430] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.104442] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.104463] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 162 [D 20:41:37.104478] element 0: offset: 0x659890, size: 24 [D 20:41:37.104491] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 30/70. [D 20:41:37.115725] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 162 [D 20:41:37.115801] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 31/70. [D 20:41:37.115990] openib_post_sr_rdmaw: ibv_post_send wr_id 64b7e0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.116930] openib_check_cq: completed rdma wr_id 64b7e0, nic_wr_credit 70. [D 20:41:37.116946] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 32/70. [D 20:41:37.120019] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.120035] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.120048] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.126919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.126936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.126949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.126992] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 165 [D 20:41:37.127007] element 0: offset: 0x65d000, size: 72 [D 20:41:37.127022] openib_post_sr: 10.1.4.240:43806 bh 9 len 88 wr 33/70. [D 20:41:37.127203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.127219] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.127231] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.127730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.127744] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.127757] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.127778] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 168 [D 20:41:37.127808] element 0: offset: 0x65d000, size: 72 [D 20:41:37.127822] openib_post_sr: 10.1.4.240:43806 bh 10 len 88 wr 34/70. [D 20:41:37.127972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.127986] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.127998] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.159310] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.159328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.159341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.159363] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 175 [D 20:41:37.159377] element 0: offset: 0x65d000, size: 72 [D 20:41:37.159391] openib_post_sr: 10.1.4.240:43806 bh 11 len 88 wr 35/70. [D 20:41:37.163066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.163083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.163095] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.163114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.163127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.163139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.163166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 180 [D 20:41:37.163181] element 0: offset: 0x61f0b0, size: 24 [D 20:41:37.163195] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 36/70. [D 20:41:37.166504] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 180 [D 20:41:37.166618] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 37/70. [D 20:41:37.166723] openib_post_sr_rdmaw: ibv_post_send wr_id 61f970 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.167417] openib_check_cq: completed rdma wr_id 61f970, nic_wr_credit 70. [D 20:41:37.167432] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 38/70. [D 20:41:37.167579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.167593] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.167606] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.169448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.169463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.169475] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.169497] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 182 [D 20:41:37.169511] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.169525] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 39/70. [D 20:41:37.170281] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 182 [D 20:41:37.170417] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 40/70. [D 20:41:37.170613] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.171396] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 70. [D 20:41:37.171410] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 41/70. [D 20:41:37.171572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.171586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.171598] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.175481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.175497] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.175509] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.175531] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 186 [D 20:41:37.175545] element 0: offset: 0x62fbb0, size: 24 [D 20:41:37.175559] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 42/70. [D 20:41:37.176066] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 186 [D 20:41:37.176231] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 43/70. [D 20:41:37.176426] openib_post_sr_rdmaw: ibv_post_send wr_id 659890 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.177200] openib_check_cq: completed rdma wr_id 659890, nic_wr_credit 70. [D 20:41:37.177216] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 44/70. [D 20:41:37.179236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.179338] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.179359] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.179431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.179452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.179483] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.179571] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 187 [D 20:41:37.179664] element 0: offset: 0x6480a0, size: 24 [D 20:41:37.179804] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 45/70. [D 20:41:37.180480] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 187 [D 20:41:37.180529] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 46/70. [D 20:41:37.180697] openib_post_sr_rdmaw: ibv_post_send wr_id 650170 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.181213] openib_check_cq: completed rdma wr_id 650170, nic_wr_credit 70. [D 20:41:37.181228] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 47/70. [D 20:41:37.181654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.181768] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.181790] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.182356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.182376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.182390] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.182443] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 190 [D 20:41:37.182460] element 0: offset: 0x65d000, size: 72 [D 20:41:37.182479] openib_post_sr: 10.1.4.240:43806 bh 4 len 88 wr 48/70. [D 20:41:37.182642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.182660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.182674] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.182942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.182963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.182978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.183004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 193 [D 20:41:37.183019] element 0: offset: 0x65d000, size: 72 [D 20:41:37.183035] openib_post_sr: 10.1.4.240:43806 bh 5 len 88 wr 49/70. [D 20:41:37.183085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.183110] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.183123] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.315325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.315396] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.315410] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.315463] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 200 [D 20:41:37.315479] element 0: offset: 0x65d000, size: 72 [D 20:41:37.315497] openib_post_sr: 10.1.4.240:43806 bh 6 len 88 wr 50/70. [D 20:41:37.318708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.318724] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.318736] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.322900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.322918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.322930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.322957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 205 [D 20:41:37.322971] element 0: offset: 0x65a860, size: 24 [D 20:41:37.322986] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 51/70. [D 20:41:37.324802] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 205 [D 20:41:37.324945] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 52/70. [D 20:41:37.325156] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.325950] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 70. [D 20:41:37.325966] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 53/70. [D 20:41:37.327071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.327086] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.327098] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.327119] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.327133] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.327145] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.327167] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 207 [D 20:41:37.327181] element 0: offset: 0x6231d0, size: 24 [D 20:41:37.327195] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 54/70. [D 20:41:37.330684] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 207 [D 20:41:37.330821] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 55/70. [D 20:41:37.330994] openib_post_sr_rdmaw: ibv_post_send wr_id 61e690 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.331748] openib_check_cq: completed rdma wr_id 61e690, nic_wr_credit 70. [D 20:41:37.331763] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 56/70. [D 20:41:37.334951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.334967] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.334979] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.339328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.339500] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.339522] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.339632] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 212 [D 20:41:37.339666] element 0: offset: 0x6424e0, size: 24 [D 20:41:37.339698] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 57/70. [D 20:41:37.340219] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 212 [D 20:41:37.340279] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 58/70. [D 20:41:37.340461] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8a0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.340980] openib_check_cq: completed rdma wr_id 61f8a0, nic_wr_credit 70. [D 20:41:37.340995] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 59/70. [D 20:41:37.341156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.341181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.341199] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.341421] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.341448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.341467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.341497] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 213 [D 20:41:37.341517] element 0: offset: 0x65a860, size: 24 [D 20:41:37.341542] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:41:37.341793] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 32768, tag: 213 [D 20:41:37.341819] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 0/70. [D 20:41:37.341979] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8a0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.342718] openib_check_cq: completed rdma wr_id 61f8a0, nic_wr_credit 70. [D 20:41:37.342733] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 1/70. [D 20:41:37.343979] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.344083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.344119] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.344670] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.344695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.344714] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.344772] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 216 [D 20:41:37.344794] element 0: offset: 0x65d000, size: 72 [D 20:41:37.344818] openib_post_sr: 10.1.4.240:43806 bh 19 len 88 wr 2/70. [D 20:41:37.344993] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.345016] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.345036] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.345360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.345384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.345403] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.345438] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 219 [D 20:41:37.345454] element 0: offset: 0x65d000, size: 72 [D 20:41:37.345475] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 3/70. [D 20:41:37.345596] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.345618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.345681] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.441910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.442024] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.442058] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.442178] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 236 [D 20:41:37.442256] element 0: offset: 0x65d000, size: 72 [D 20:41:37.442299] openib_post_sr: 10.1.4.240:43806 bh 1 len 88 wr 4/70. [D 20:41:37.442464] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.442485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.442504] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.444282] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.444353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.444387] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.444462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 238 [D 20:41:37.444517] element 0: offset: 0x62fbb0, size: 24 [D 20:41:37.444548] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 5/70. [D 20:41:37.445595] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 238 [D 20:41:37.445641] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 6/70. [D 20:41:37.446068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.446143] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.449054] openib_check_cq: completed rdma wr_id 61f8d0, nic_wr_credit 71. [D 20:41:37.449072] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 7/70. [D 20:41:37.449749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.449843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.449882] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.458535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.458722] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.458783] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.458916] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 241 [D 20:41:37.458938] element 0: offset: 0x6480a0, size: 24 [D 20:41:37.458982] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 8/70. [D 20:41:37.463350] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 241 [D 20:41:37.463464] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 9/70. [D 20:41:37.464880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.464948] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.467643] openib_check_cq: completed rdma wr_id 61f8d0, nic_wr_credit 72. [D 20:41:37.467661] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 10/70. [D 20:41:37.470673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.470689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.470702] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.487179] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.487294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.487327] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.487419] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 244 [D 20:41:37.487453] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.487534] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 11/70. [D 20:41:37.487784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.487806] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.487843] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.491378] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.491453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.491467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.491513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 247 [D 20:41:37.491529] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.491548] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 12/70. [D 20:41:37.491918] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 247 [D 20:41:37.491940] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 13/70. [D 20:41:37.491990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.492020] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.492498] openib_check_cq: completed rdma wr_id 61f8d0, nic_wr_credit 73. [D 20:41:37.492516] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 14/70. [D 20:41:37.492603] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.492626] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.492640] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.515109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.515233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.515272] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.515348] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 250 [D 20:41:37.515388] element 0: offset: 0x62fbb0, size: 24 [D 20:41:37.515448] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 15/70. [D 20:41:37.515770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.515812] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.515832] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.524543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.524656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.524695] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.524768] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 253 [D 20:41:37.524807] element 0: offset: 0x6424e0, size: 24 [D 20:41:37.524845] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 16/70. [D 20:41:37.525740] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 253 [D 20:41:37.525777] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 17/70. [D 20:41:37.525973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.526028] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.528909] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 74. [D 20:41:37.528927] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 18/70. [D 20:41:37.529224] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.529343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.529381] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.547705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.547837] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.547853] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.547937] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 256 [D 20:41:37.547978] element 0: offset: 0x65a860, size: 24 [D 20:41:37.548037] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 19/70. [D 20:41:37.551159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.551224] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.551238] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.556247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.556265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.556278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.556318] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 259 [D 20:41:37.556333] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.556351] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 20/70. [D 20:41:37.557303] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 259 [D 20:41:37.557464] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 21/70. [D 20:41:37.557646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.557672] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.560801] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 75. [D 20:41:37.560823] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 22/70. [D 20:41:37.563841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.563857] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.563870] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.575134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.575152] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.575164] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.575186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 262 [D 20:41:37.575201] element 0: offset: 0x623260, size: 24 [D 20:41:37.575215] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 23/70. [D 20:41:37.579308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.579470] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.579529] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:37.579617] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.579719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.579739] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:37.579809] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 264 [D 20:41:37.579847] element 0: offset: 0x623260, size: 24 [D 20:41:37.579873] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 24/70. [D 20:41:37.582499] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 264 [D 20:41:37.582650] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 25/70. [D 20:41:37.582830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.582853] openib_post_sr_rdmaw: ibv_post_send wr_id 650170 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.585611] openib_check_cq: completed rdma wr_id 650170, nic_wr_credit 76. [D 20:41:37.585629] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 26/70. [D 20:41:37.585885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.586002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.586024] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.602982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.603131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.603154] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.603221] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 267 [D 20:41:37.603249] element 0: offset: 0x6424e0, size: 24 [D 20:41:37.603278] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 27/70. [D 20:41:37.603397] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.603414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.603428] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.610195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.610305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.610343] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.610417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 270 [D 20:41:37.610466] element 0: offset: 0x6480a0, size: 24 [D 20:41:37.610548] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 28/70. [D 20:41:37.611529] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 270 [D 20:41:37.611597] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 29/70. [D 20:41:37.611783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.611854] openib_post_sr_rdmaw: ibv_post_send wr_id 650170 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.614733] openib_check_cq: completed rdma wr_id 650170, nic_wr_credit 77. [D 20:41:37.614752] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 30/70. [D 20:41:37.614985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.615125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.615146] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.629773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.629910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.629948] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.630063] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 273 [D 20:41:37.630113] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.630145] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 31/70. [D 20:41:37.630445] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.630480] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.630565] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.687133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.687202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.687216] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.689736] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 281 [D 20:41:37.689756] element 0: offset: 0x623260, size: 24 [D 20:41:37.689775] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 32/70. [D 20:41:37.693956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.693973] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.693986] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.751098] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.751166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.751180] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.751223] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 286 [D 20:41:37.751239] element 0: offset: 0x62fbb0, size: 24 [D 20:41:37.751257] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 33/70. [D 20:41:37.755028] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 286 [D 20:41:37.755205] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 34/70. [D 20:41:37.755399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.755424] openib_post_sr_rdmaw: ibv_post_send wr_id 61f770 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.758320] openib_check_cq: completed rdma wr_id 61f770, nic_wr_credit 78. [D 20:41:37.758337] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 35/70. [D 20:41:37.761517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.761532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.761544] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.780104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.780160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.780174] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.780218] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 289 [D 20:41:37.780233] element 0: offset: 0x65a860, size: 24 [D 20:41:37.780251] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 36/70. [D 20:41:37.783459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.783476] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.783489] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.790811] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.790868] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.790881] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.790923] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 292 [D 20:41:37.790938] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.790957] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 37/70. [D 20:41:37.794881] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 292 [D 20:41:37.794915] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 38/70. [D 20:41:37.795147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.795170] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.798039] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 79. [D 20:41:37.798054] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 39/70. [D 20:41:37.799088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.799104] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.799117] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.818957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.818983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.818995] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.819034] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 295 [D 20:41:37.819049] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.819069] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 40/70. [D 20:41:37.819255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.819272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.819285] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.829597] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.829662] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.829676] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.829722] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 298 [D 20:41:37.829737] element 0: offset: 0x623260, size: 24 [D 20:41:37.829755] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 41/70. [D 20:41:37.833243] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 298 [D 20:41:37.833266] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 42/70. [D 20:41:37.833402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.833422] openib_post_sr_rdmaw: ibv_post_send wr_id 64b860 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.836345] openib_check_cq: completed rdma wr_id 64b860, nic_wr_credit 80. [D 20:41:37.836362] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 43/70. [D 20:41:37.839085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.839100] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.839113] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.857960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.858011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.858024] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.858066] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 301 [D 20:41:37.858099] element 0: offset: 0x65a860, size: 24 [D 20:41:37.858117] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 44/70. [D 20:41:37.859323] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.859457] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.859490] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.865989] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.866096] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.866117] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.866218] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 304 [D 20:41:37.866242] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.866301] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 45/70. [D 20:41:37.871113] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 304 [D 20:41:37.871192] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 46/70. [D 20:41:37.871419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.871438] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7e0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.874476] openib_check_cq: completed rdma wr_id 63c7e0, nic_wr_credit 81. [D 20:41:37.874492] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 47/70. [D 20:41:37.874729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.874772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.874793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.901661] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.901886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.901923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.902016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 307 [D 20:41:37.902047] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.902077] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 48/70. [D 20:41:37.907085] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 307 [D 20:41:37.907162] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 49/70. [D 20:41:37.907329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.907350] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7e0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.910298] openib_check_cq: completed rdma wr_id 63c7e0, nic_wr_credit 82. [D 20:41:37.910316] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 50/70. [D 20:41:37.910599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.910698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.910726] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.935466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.935523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.935536] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.935586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 310 [D 20:41:37.935601] element 0: offset: 0x65a860, size: 24 [D 20:41:37.935620] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 51/70. [D 20:41:37.937836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.937851] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.937863] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.944271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.944330] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.944343] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.944385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 313 [D 20:41:37.944400] element 0: offset: 0x62fce0, size: 24 [D 20:41:37.944419] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 52/70. [D 20:41:37.945037] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 313 [D 20:41:37.945062] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 53/70. [D 20:41:37.945285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.945409] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7e0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.948289] openib_check_cq: completed rdma wr_id 63c7e0, nic_wr_credit 83. [D 20:41:37.948323] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 54/70. [D 20:41:37.948575] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.948625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.948639] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.968008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.968076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.968091] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.968134] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 316 [D 20:41:37.968150] element 0: offset: 0x633460, size: 24 [D 20:41:37.968170] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 55/70. [D 20:41:37.971245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.971400] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.971422] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.979136] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:37.979206] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.979220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:37.979263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 319 [D 20:41:37.979278] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.979297] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 56/70. [D 20:41:37.979808] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 319 [D 20:41:37.979833] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 57/70. [D 20:41:37.980018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.980068] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7e0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 84. [D 20:41:37.982633] openib_check_cq: completed rdma wr_id 63c7e0, nic_wr_credit 84. [D 20:41:37.982663] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 58/70. [D 20:41:37.982844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:37.982884] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:37.982897] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:37.999941] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.000009] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.000024] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.000069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 322 [D 20:41:38.000085] element 0: offset: 0x65a860, size: 24 [D 20:41:38.000105] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 59/70. [D 20:41:38.000351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.000368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.000381] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.002979] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.002996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.003009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.003031] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 324 [D 20:41:38.003046] element 0: offset: 0x62fce0, size: 24 [D 20:41:38.003095] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 60/70. [D 20:41:38.004466] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 324 [D 20:41:38.004516] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 0/70. [D 20:41:38.004696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 84. [D 20:41:38.004820] openib_post_sr_rdmaw: ibv_post_send wr_id 64cad0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.007802] openib_check_cq: completed rdma wr_id 64cad0, nic_wr_credit 85. [D 20:41:38.007842] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 1/70. [D 20:41:38.008623] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.008675] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.008688] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.026162] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.026200] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.026217] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.026259] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 327 [D 20:41:38.026274] element 0: offset: 0x633460, size: 24 [D 20:41:38.026293] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 2/70. [D 20:41:38.027803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.027821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.027834] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.029729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.029747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.029760] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.029782] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 329 [D 20:41:38.029796] element 0: offset: 0x61f0e0, size: 24 [D 20:41:38.029811] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 3/70. [D 20:41:38.030397] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 329 [D 20:41:38.030425] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 4/70. [D 20:41:38.030591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.030697] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.033128] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 86. [D 20:41:38.033279] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 5/70. [D 20:41:38.033525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.033545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.033558] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.054287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.054354] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.054369] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.054413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 332 [D 20:41:38.054429] element 0: offset: 0x65a860, size: 24 [D 20:41:38.054448] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 6/70. [D 20:41:38.054765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.054783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.054796] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.057277] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.057294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.057307] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.057330] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 334 [D 20:41:38.057344] element 0: offset: 0x62fce0, size: 24 [D 20:41:38.057384] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 7/70. [D 20:41:38.061357] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 334 [D 20:41:38.061384] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 8/70. [D 20:41:38.061542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.061562] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.064253] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 87. [D 20:41:38.064269] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 9/70. [D 20:41:38.067524] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.067670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.067692] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.084171] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.084242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.084257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.084303] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 337 [D 20:41:38.084319] element 0: offset: 0x633460, size: 24 [D 20:41:38.084337] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:41:38.084660] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.084678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.084690] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.093919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.093965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.093979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.094016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 340 [D 20:41:38.094031] element 0: offset: 0x61f0e0, size: 24 [D 20:41:38.094051] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 11/70. [D 20:41:38.094516] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 340 [D 20:41:38.094538] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 12/70. [D 20:41:38.095975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.096081] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.098693] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 88. [D 20:41:38.098827] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 13/70. [D 20:41:38.099025] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.099047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.099060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.119202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.119220] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.119233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.119255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 343 [D 20:41:38.119270] element 0: offset: 0x65a860, size: 24 [D 20:41:38.119284] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 14/70. [D 20:41:38.119430] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.119446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.119459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.127298] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.127419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.127440] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.127547] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 346 [D 20:41:38.127585] element 0: offset: 0x62fce0, size: 24 [D 20:41:38.127607] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 15/70. [D 20:41:38.128854] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 346 [D 20:41:38.128931] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 16/70. [D 20:41:38.129107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.129132] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 89. [D 20:41:38.132051] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 89. [D 20:41:38.132068] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 17/70. [D 20:41:38.132324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:38.132435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.132469] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:38.152195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:38.152268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:38.152282] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:38.152331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 349 [D 20:41:39.633142] element 0: offset: 0x633460, size: 24 [D 20:41:39.633210] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 18/70. [D 20:41:39.634711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.634732] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.634746] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.639011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.639031] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.639044] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.639086] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 352 [D 20:41:39.639101] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.639119] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 19/70. [D 20:41:39.642851] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 352 [D 20:41:39.642928] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 20/70. [D 20:41:39.642989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 89. [D 20:41:39.643008] openib_post_sr_rdmaw: ibv_post_send wr_id 6480d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.643485] openib_check_cq: completed rdma wr_id 6480d0, nic_wr_credit 90. [D 20:41:39.643502] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 21/70. [D 20:41:39.646491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.646511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.646525] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.664956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.665002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.665017] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.665060] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 355 [D 20:41:39.665083] element 0: offset: 0x65a860, size: 24 [D 20:41:39.665101] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 22/70. [D 20:41:39.667189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.667241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.667256] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.670264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.670284] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.670297] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.670333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 358 [D 20:41:39.670348] element 0: offset: 0x62fce0, size: 24 [D 20:41:39.670367] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 23/70. [D 20:41:39.673382] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 358 [D 20:41:39.673411] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 24/70. [D 20:41:39.673461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.673479] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.673992] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 91. [D 20:41:39.674010] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 25/70. [D 20:41:39.674080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.674096] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.674110] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.695805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.695827] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.695843] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.695867] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 361 [D 20:41:39.695882] element 0: offset: 0x633460, size: 24 [D 20:41:39.695897] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 26/70. [D 20:41:39.695986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.696006] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.696020] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.704264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.704289] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.704303] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.704325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 364 [D 20:41:39.704340] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.704355] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 27/70. [D 20:41:39.704694] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 364 [D 20:41:39.704715] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 28/70. [D 20:41:39.704763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.704780] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.705255] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 92. [D 20:41:39.705274] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 29/70. [D 20:41:39.705322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.705337] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.705350] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.723103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.723133] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.723150] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.723178] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 367 [D 20:41:39.723193] element 0: offset: 0x65a860, size: 24 [D 20:41:39.723209] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 30/70. [D 20:41:39.726258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.726278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.726295] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.728263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.728293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.728306] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.728329] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 370 [D 20:41:39.728344] element 0: offset: 0x62fce0, size: 24 [D 20:41:39.728360] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 31/70. [D 20:41:39.731515] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 370 [D 20:41:39.731545] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 32/70. [D 20:41:39.731603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.731660] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.732161] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 93. [D 20:41:39.732178] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 33/70. [D 20:41:39.732241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.732263] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.732276] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.750411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.750432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.750449] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.750473] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 373 [D 20:41:39.750488] element 0: offset: 0x633460, size: 24 [D 20:41:39.750504] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 34/70. [D 20:41:39.753799] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.753819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.753833] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.758361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.758381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.758395] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.758417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 376 [D 20:41:39.758432] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.758447] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 35/70. [D 20:41:39.759230] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 376 [D 20:41:39.759262] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 36/70. [D 20:41:39.759315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.759340] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.759854] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 94. [D 20:41:39.759870] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 37/70. [D 20:41:39.762791] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.762807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.762821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.775315] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.775340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.775354] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.775391] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 379 [D 20:41:39.775406] element 0: offset: 0x65a860, size: 24 [D 20:41:39.775422] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 38/70. [D 20:41:39.775624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.775645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.775658] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.778142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.778160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.778173] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.778195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 381 [D 20:41:39.778209] element 0: offset: 0x62fce0, size: 24 [D 20:41:39.778225] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 39/70. [D 20:41:39.779112] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 381 [D 20:41:39.779139] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 40/70. [D 20:41:39.779198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.779225] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.779752] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 95. [D 20:41:39.779768] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 41/70. [D 20:41:39.779827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.779848] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.779861] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.793011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.793033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.793046] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.793069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 384 [D 20:41:39.793083] element 0: offset: 0x633460, size: 24 [D 20:41:39.793099] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 42/70. [D 20:41:39.793587] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.793606] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.793618] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.795775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.795790] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.795803] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.795825] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 386 [D 20:41:39.795839] element 0: offset: 0x65a860, size: 24 [D 20:41:39.795854] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 43/70. [D 20:41:39.796494] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 386 [D 20:41:39.796519] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 44/70. [D 20:41:39.796571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.796607] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.797114] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 96. [D 20:41:39.797129] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 45/70. [D 20:41:39.797186] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.797207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.797220] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.814093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.814120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.814133] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.814165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 389 [D 20:41:39.814179] element 0: offset: 0x62fde0, size: 24 [D 20:41:39.814210] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 46/70. [D 20:41:39.819216] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.819286] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.819301] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:39.819353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.819368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.819381] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:39.819415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 392 [D 20:41:39.819430] element 0: offset: 0x62fde0, size: 24 [D 20:41:39.819450] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 47/70. [D 20:41:39.820526] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 392 [D 20:41:39.820557] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 48/70. [D 20:41:39.820604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.820624] openib_post_sr_rdmaw: ibv_post_send wr_id 6500b0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.821119] openib_check_cq: completed rdma wr_id 6500b0, nic_wr_credit 97. [D 20:41:39.821138] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 49/70. [D 20:41:39.821215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.821242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.821256] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.835134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.835158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.835174] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.835198] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 395 [D 20:41:39.835213] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.835228] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 50/70. [D 20:41:39.835452] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.835471] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.835484] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.839985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.840005] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.840018] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.840041] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 398 [D 20:41:39.840055] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.840072] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:41:39.843643] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 398 [D 20:41:39.843671] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 52/70. [D 20:41:39.843740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.843807] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.844308] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 98. [D 20:41:39.844328] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 53/70. [D 20:41:39.844414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.844438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.844451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.857750] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.857821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.857836] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.857880] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 401 [D 20:41:39.857895] element 0: offset: 0x65a860, size: 24 [D 20:41:39.857915] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 54/70. [D 20:41:39.858235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.858254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.858266] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.862718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.862738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.862752] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.862774] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 403 [D 20:41:39.862788] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.862804] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 55/70. [D 20:41:39.866289] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 403 [D 20:41:39.866316] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 56/70. [D 20:41:39.866370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.866418] openib_post_sr_rdmaw: ibv_post_send wr_id 64c9f0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.866931] openib_check_cq: completed rdma wr_id 64c9f0, nic_wr_credit 99. [D 20:41:39.866951] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 57/70. [D 20:41:39.867024] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.867045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.867058] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.880333] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.880353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.880366] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.880388] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 406 [D 20:41:39.880402] element 0: offset: 0x623260, size: 24 [D 20:41:39.880418] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 58/70. [D 20:41:39.880609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.880627] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.880640] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.885192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.885211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.885224] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.885247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 408 [D 20:41:39.885261] element 0: offset: 0x65a860, size: 24 [D 20:41:39.885276] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 59/70. [D 20:41:39.887342] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 408 [D 20:41:39.887366] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 60/70. [D 20:41:39.887416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.887440] openib_post_sr_rdmaw: ibv_post_send wr_id 6480d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.888047] openib_check_cq: completed rdma wr_id 6480d0, nic_wr_credit 100. [D 20:41:39.888066] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 0/70. [D 20:41:39.888237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.888259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.888272] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.902765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.902836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.902852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.902897] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 411 [D 20:41:39.902913] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.902934] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 1/70. [D 20:41:39.903403] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.903422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.903435] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.908527] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.908547] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.908560] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.908584] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 414 [D 20:41:39.908598] element 0: offset: 0x623260, size: 24 [D 20:41:39.908614] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 2/70. [D 20:41:39.909196] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 414 [D 20:41:39.909223] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 3/70. [D 20:41:39.909320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.909468] openib_post_sr_rdmaw: ibv_post_send wr_id 6480d0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.911801] openib_check_cq: completed rdma wr_id 6480d0, nic_wr_credit 101. [D 20:41:39.911934] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 4/70. [D 20:41:39.912278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.912301] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.912315] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.925350] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.925371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.925384] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.925408] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 417 [D 20:41:39.925423] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.925439] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 5/70. [D 20:41:39.925634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.925653] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.925666] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.930011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.930032] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.930045] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.930616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 424 [D 20:41:39.930637] element 0: offset: 0x623260, size: 24 [D 20:41:39.930655] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 6/70. [D 20:41:39.930701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.930716] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.930729] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.934567] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.934587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.934601] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.935018] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 431 [D 20:41:39.935039] element 0: offset: 0x64ca80, size: 24 [D 20:41:39.935056] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 7/70. [D 20:41:39.935234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.935254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.935267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.938942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.938962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.938976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.939381] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 437 [D 20:41:39.939402] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.939418] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 8/70. [D 20:41:39.939560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.939579] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.939592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.943050] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.943071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.943089] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.943361] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 443 [D 20:41:39.943381] element 0: offset: 0x623260, size: 24 [D 20:41:39.943397] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 9/70. [D 20:41:39.943556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.943574] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.943587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.947721] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.947741] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.947755] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.947780] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 448 [D 20:41:39.947795] element 0: offset: 0x65a860, size: 24 [D 20:41:39.947812] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 10/70. [D 20:41:39.948068] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 448 [D 20:41:39.948097] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 11/70. [D 20:41:39.949716] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 448 [D 20:41:39.949739] element 0: offset: 0x65a860, size: 24 [D 20:41:39.949755] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 12/70. [D 20:41:39.949808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.949825] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.949838] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.951348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.951369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.951382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.951464] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 450 [D 20:41:39.951481] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.951499] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 13/70. [D 20:41:39.952012] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 163408, tag: 450 [D 20:41:39.952039] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 14/70. [D 20:41:39.952088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.952115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ff4030 rkey 4a40042 nic_wr_credit 102. [D 20:41:39.952130] openib_post_sr_rdmaw: ibv_post_send wr_id 6358d0 to 10.1.4.240:43806 remote addr f4014030 rkey 4a40044 nic_wr_credit 103. [D 20:41:39.953230] openib_check_cq: completed rdma wr_id 6358d0, nic_wr_credit 103. [D 20:41:39.953249] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 15/70. [D 20:41:39.953327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.953350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.953363] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:39.962772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:39.962792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.962805] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:39.962830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 453 [D 20:41:39.962845] element 0: offset: 0x623260, size: 24 [D 20:41:39.962860] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 16/70. [D 20:41:39.963049] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 453 [D 20:41:39.963076] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 17/70. [D 20:41:39.964750] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 453 [D 20:41:39.964772] element 0: offset: 0x623260, size: 24 [D 20:41:39.964790] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 18/70. [D 20:41:39.964917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:39.964940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:39.964955] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.051449] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.051522] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.051537] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.051832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 456 [D 20:41:40.051852] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.051871] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 19/70. [D 20:41:40.054987] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 456 [D 20:41:40.055012] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 20/70. [D 20:41:40.055413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 456 [D 20:41:40.055434] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.055453] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 21/70. [D 20:41:40.059635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.059656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.059673] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.059698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.059712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.059726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.059991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 458 [D 20:41:40.060014] element 0: offset: 0x623260, size: 24 [D 20:41:40.060031] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 22/70. [D 20:41:40.060103] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 458 [D 20:41:40.060124] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 23/70. [D 20:41:40.061098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 458 [D 20:41:40.061118] element 0: offset: 0x623260, size: 24 [D 20:41:40.061137] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 24/70. [D 20:41:40.063130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.063188] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.063202] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.063234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.063248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.063261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.063346] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 460 [D 20:41:40.063363] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.063383] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 25/70. [D 20:41:40.063457] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 460 [D 20:41:40.063482] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 26/70. [D 20:41:40.064006] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 460 [D 20:41:40.064026] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.064043] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 27/70. [D 20:41:40.064100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.064117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.064130] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.064873] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.064893] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.064907] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.065034] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 462 [D 20:41:40.065052] element 0: offset: 0x623260, size: 24 [D 20:41:40.065069] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 28/70. [D 20:41:40.065137] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 462 [D 20:41:40.065158] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 29/70. [D 20:41:40.066084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 462 [D 20:41:40.066104] element 0: offset: 0x623260, size: 24 [D 20:41:40.066122] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 30/70. [D 20:41:40.066179] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.066196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.066209] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.068394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.068414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.068427] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.068495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 464 [D 20:41:40.068511] element 0: offset: 0x64ca80, size: 24 [D 20:41:40.068526] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:41:40.068577] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 464 [D 20:41:40.068601] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 32/70. [D 20:41:40.069043] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 464 [D 20:41:40.069062] element 0: offset: 0x64ca80, size: 24 [D 20:41:40.069097] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 33/70. [D 20:41:40.069206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.069224] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.069237] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.069671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.069692] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.069705] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.069770] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 465 [D 20:41:40.069785] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.069800] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 34/70. [D 20:41:40.069954] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 465 [D 20:41:40.069976] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 35/70. [D 20:41:40.071350] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 465 [D 20:41:40.071370] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.071388] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 36/70. [D 20:41:40.071454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.071476] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.071494] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.072026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.072045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.072062] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.072103] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 468 [D 20:41:40.072133] element 0: offset: 0x64ca80, size: 24 [D 20:41:40.072161] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 37/70. [D 20:41:40.072604] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 468 [D 20:41:40.072635] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 38/70. [D 20:41:40.072686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 103. [D 20:41:40.072724] openib_post_sr_rdmaw: ibv_post_send wr_id 6491e0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.073514] openib_check_cq: completed rdma wr_id 6491e0, nic_wr_credit 104. [D 20:41:40.073533] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 39/70. [D 20:41:40.073588] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.073604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.073617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.090964] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.090985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.091002] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.091024] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 471 [D 20:41:40.091039] element 0: offset: 0x623260, size: 24 [D 20:41:40.091054] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 40/70. [D 20:41:40.091194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.091211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.091225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.093463] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.093483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.093499] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.093521] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 474 [D 20:41:40.093549] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.093564] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 41/70. [D 20:41:40.093930] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 474 [D 20:41:40.093959] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 42/70. [D 20:41:40.094006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.094029] openib_post_sr_rdmaw: ibv_post_send wr_id 662e10 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 105. [D 20:41:40.094405] openib_check_cq: completed rdma wr_id 662e10, nic_wr_credit 105. [D 20:41:40.094425] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 43/70. [D 20:41:40.094477] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.094494] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.094507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.111532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.111557] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.111570] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.111600] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 477 [D 20:41:40.111615] element 0: offset: 0x64ca80, size: 24 [D 20:41:40.111631] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 44/70. [D 20:41:40.111928] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.111948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.111961] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.113910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.113930] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.113943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.114028] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 480 [D 20:41:40.114044] element 0: offset: 0x65a860, size: 24 [D 20:41:40.114060] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 45/70. [D 20:41:40.114127] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 480 [D 20:41:40.114150] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 46/70. [D 20:41:40.114588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 480 [D 20:41:40.114608] element 0: offset: 0x65a860, size: 24 [D 20:41:40.114624] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 47/70. [D 20:41:40.114671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.114688] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.114700] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.114865] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.114883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.114896] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.114960] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 481 [D 20:41:40.114975] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.114990] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 48/70. [D 20:41:40.115861] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 261376, tag: 481 [D 20:41:40.115903] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 49/70. [D 20:41:40.115952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 105. [D 20:41:40.115975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ff4630 rkey 4a40042 nic_wr_credit 106. [D 20:41:40.115990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4014630 rkey 4a40044 nic_wr_credit 107. [D 20:41:40.116017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4034630 rkey 4a40044 nic_wr_credit 108. [D 20:41:40.116033] openib_post_sr_rdmaw: ibv_post_send wr_id 6630a0 to 10.1.4.240:43806 remote addr f4054630 rkey 4a40044 nic_wr_credit 109. [D 20:41:40.117090] openib_check_cq: completed rdma wr_id 6630a0, nic_wr_credit 109. [D 20:41:40.117112] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 50/70. [D 20:41:40.117336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.117360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.117374] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.123105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.123126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.123143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.123167] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 484 [D 20:41:40.123183] element 0: offset: 0x623260, size: 24 [D 20:41:40.125732] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 51/70. [D 20:41:40.126762] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 620720, tag: 484 [D 20:41:40.126842] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 52/70. [D 20:41:40.126997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 109. [D 20:41:40.127020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec1e0 rkey 4a40044 nic_wr_credit 110. [D 20:41:40.127035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c1e0 rkey 4a40044 nic_wr_credit 111. [D 20:41:40.127050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c1e0 rkey 4a40044 nic_wr_credit 112. [D 20:41:40.127065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c1e0 rkey 4a40044 nic_wr_credit 113. [D 20:41:40.127079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c1e0 rkey 4a40044 nic_wr_credit 114. [D 20:41:40.127098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c1e0 rkey 4a40044 nic_wr_credit 115. [D 20:41:40.127113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac1e0 rkey 4a40044 nic_wr_credit 116. [D 20:41:40.127128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc1e0 rkey 4a40044 nic_wr_credit 117. [D 20:41:40.127155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec1e0 rkey 4a40044 nic_wr_credit 118. [D 20:41:40.127170] openib_post_sr_rdmaw: ibv_post_send wr_id 649130 to 10.1.4.240:43806 remote addr f410c1e0 rkey 4a40044 nic_wr_credit 119. [D 20:41:40.129718] openib_check_cq: completed rdma wr_id 649130, nic_wr_credit 119. [D 20:41:40.129743] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 53/70. [D 20:41:40.129799] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.129815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.129828] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.326433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.326455] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.326472] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.326495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 487 [D 20:41:40.326510] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.326525] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 54/70. [D 20:41:40.326689] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 487 [D 20:41:40.326710] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 55/70. [D 20:41:40.328443] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 487 [D 20:41:40.328464] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.328484] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 56/70. [D 20:41:40.331110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.331131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.331147] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.331169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.331183] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.331196] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.331218] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 490 [D 20:41:40.331244] element 0: offset: 0x623260, size: 24 [D 20:41:40.331259] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 57/70. [D 20:41:40.334716] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 131072, tag: 490 [D 20:41:40.334759] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 58/70. [D 20:41:40.334811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 119. [D 20:41:40.334834] openib_post_sr_rdmaw: ibv_post_send wr_id 64dbc0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 120. [D 20:41:40.335533] openib_check_cq: completed rdma wr_id 64dbc0, nic_wr_credit 120. [D 20:41:40.335552] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 59/70. [D 20:41:40.335603] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.335619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.335632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.504924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.504945] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.504961] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.505123] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 493 [D 20:41:40.505139] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.505154] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 60/70. [D 20:41:40.505215] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 493 [D 20:41:40.505235] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 0/70. [D 20:41:40.505614] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 493 [D 20:41:40.505634] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.505652] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 1/70. [D 20:41:40.507147] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.507174] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.507188] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.507218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.507232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.507245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.507331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 494 [D 20:41:40.507347] element 0: offset: 0x635960, size: 24 [D 20:41:40.507364] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 2/70. [D 20:41:40.507433] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 494 [D 20:41:40.507458] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 3/70. [D 20:41:40.509495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 494 [D 20:41:40.509519] element 0: offset: 0x635960, size: 24 [D 20:41:40.509536] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 4/70. [D 20:41:40.509681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.509699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.509714] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.511106] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.511126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.511139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.511217] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 497 [D 20:41:40.511233] element 0: offset: 0x65a860, size: 24 [D 20:41:40.511248] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 5/70. [D 20:41:40.511302] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 497 [D 20:41:40.511327] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 6/70. [D 20:41:40.511887] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 497 [D 20:41:40.511908] element 0: offset: 0x65a860, size: 24 [D 20:41:40.511923] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 7/70. [D 20:41:40.511975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.511990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.512002] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.512877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.512898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.512910] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.512976] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 498 [D 20:41:40.512992] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.513067] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 8/70. [D 20:41:40.513199] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 498 [D 20:41:40.513221] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 9/70. [D 20:41:40.515306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 498 [D 20:41:40.515329] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.515347] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 10/70. [D 20:41:40.515475] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.515492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.515504] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.517250] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.517270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.517283] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.517359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 501 [D 20:41:40.517374] element 0: offset: 0x61f970, size: 24 [D 20:41:40.517390] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 11/70. [D 20:41:40.517443] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 501 [D 20:41:40.517464] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 12/70. [D 20:41:40.517912] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 501 [D 20:41:40.517932] element 0: offset: 0x61f970, size: 24 [D 20:41:40.517948] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 13/70. [D 20:41:40.517999] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.518013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.518025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.518173] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.518192] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.518205] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.518384] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 502 [D 20:41:40.518402] element 0: offset: 0x64dde0, size: 24 [D 20:41:40.518417] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 14/70. [D 20:41:40.519852] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 519776, tag: 502 [D 20:41:40.519911] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 15/70. [D 20:41:40.519966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdcc00 rkey 4a40042 nic_wr_credit 120. [D 20:41:40.519995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffcc00 rkey 4a40042 nic_wr_credit 121. [D 20:41:40.520010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401cc00 rkey 4a40044 nic_wr_credit 122. [D 20:41:40.520025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403cc00 rkey 4a40044 nic_wr_credit 123. [D 20:41:40.520041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405cc00 rkey 4a40044 nic_wr_credit 124. [D 20:41:40.520057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407cc00 rkey 4a40044 nic_wr_credit 125. [D 20:41:40.520072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409cc00 rkey 4a40044 nic_wr_credit 126. [D 20:41:40.520087] openib_post_sr_rdmaw: ibv_post_send wr_id 660690 to 10.1.4.240:43806 remote addr f40bcc00 rkey 4a40044 nic_wr_credit 127. [D 20:41:40.522484] openib_check_cq: completed rdma wr_id 660690, nic_wr_credit 127. [D 20:41:40.522509] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 16/70. [D 20:41:40.522672] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.522692] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.522706] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.607107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.607128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.607145] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.607169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 505 [D 20:41:40.607184] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.607211] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 17/70. [D 20:41:40.610629] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 505 [D 20:41:40.610654] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 18/70. [D 20:41:40.612241] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 505 [D 20:41:40.612261] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.612280] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 19/70. [D 20:41:40.615820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.615840] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.615857] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.615877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.615891] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.615904] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.616019] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 508 [D 20:41:40.616044] element 0: offset: 0x64dcc0, size: 24 [D 20:41:40.616059] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 20/70. [D 20:41:40.617115] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 519776, tag: 508 [D 20:41:40.617190] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 21/70. [D 20:41:40.617329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdcc00 rkey 4a40044 nic_wr_credit 127. [D 20:41:40.617353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffcc00 rkey 4a40044 nic_wr_credit 128. [D 20:41:40.617368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401cc00 rkey 4a40044 nic_wr_credit 129. [D 20:41:40.617383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403cc00 rkey 4a40044 nic_wr_credit 130. [D 20:41:40.617398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405cc00 rkey 4a40044 nic_wr_credit 131. [D 20:41:40.617424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407cc00 rkey 4a40044 nic_wr_credit 132. [D 20:41:40.617438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409cc00 rkey 4a40044 nic_wr_credit 133. [D 20:41:40.617453] openib_post_sr_rdmaw: ibv_post_send wr_id 649130 to 10.1.4.240:43806 remote addr f40bcc00 rkey 4a40044 nic_wr_credit 134. [D 20:41:40.619790] openib_check_cq: completed rdma wr_id 649130, nic_wr_credit 134. [D 20:41:40.619810] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 22/70. [D 20:41:40.619866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.619881] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.619894] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.627156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.627181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.627195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.627237] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 511 [D 20:41:40.627253] element 0: offset: 0x61f970, size: 24 [D 20:41:40.627269] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 23/70. [D 20:41:40.629301] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 1012880, tag: 511 [D 20:41:40.629370] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 24/70. [D 20:41:40.629422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 134. [D 20:41:40.629459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ff4630 rkey 4a40044 nic_wr_credit 135. [D 20:41:40.629475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4014630 rkey 4a40044 nic_wr_credit 136. [D 20:41:40.629489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4034630 rkey 4a40044 nic_wr_credit 137. [D 20:41:40.629504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4054630 rkey 4a40044 nic_wr_credit 138. [D 20:41:40.629521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4074630 rkey 4a40044 nic_wr_credit 139. [D 20:41:40.629535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4094630 rkey 4a40044 nic_wr_credit 140. [D 20:41:40.629550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40b4630 rkey 4a40044 nic_wr_credit 141. [D 20:41:40.629584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40d4630 rkey 4a40044 nic_wr_credit 142. [D 20:41:40.629598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40f4630 rkey 4a40044 nic_wr_credit 143. [D 20:41:40.629613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4114630 rkey 4a40044 nic_wr_credit 144. [D 20:41:40.629631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4134630 rkey 4a40044 nic_wr_credit 145. [D 20:41:40.629646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4154630 rkey 4a40044 nic_wr_credit 146. [D 20:41:40.629660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4174630 rkey 4a40044 nic_wr_credit 147. [D 20:41:40.629675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4194630 rkey 4a40044 nic_wr_credit 148. [D 20:41:40.629690] openib_post_sr_rdmaw: ibv_post_send wr_id 663100 to 10.1.4.240:43806 remote addr f41b4630 rkey 4a40044 nic_wr_credit 149. [D 20:41:40.635519] openib_check_cq: completed rdma wr_id 663100, nic_wr_credit 149. [D 20:41:40.635540] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 25/70. [D 20:41:40.635695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.635718] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.635732] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.647956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.647977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.647990] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.648028] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 514 [D 20:41:40.648043] element 0: offset: 0x64dde0, size: 24 [D 20:41:40.648060] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 26/70. [D 20:41:40.648281] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 514 [D 20:41:40.648617] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 514 [D 20:41:40.648637] element 0: offset: 0x64dde0, size: 24 [D 20:41:40.648654] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 27/70. [D 20:41:40.648706] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.648721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.648734] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.691107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.691126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.691139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.691245] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 517 [D 20:41:40.691260] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.691275] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 28/70. [D 20:41:40.691341] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 517 [D 20:41:40.691363] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 29/70. [D 20:41:40.691811] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 517 [D 20:41:40.691831] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.691846] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 30/70. [D 20:41:40.691898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.691913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.691925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.692971] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.692990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.693003] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.693068] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 518 [D 20:41:40.693084] element 0: offset: 0x635960, size: 24 [D 20:41:40.693099] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:41:40.693150] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 518 [D 20:41:40.693181] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 32/70. [D 20:41:40.694747] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 518 [D 20:41:40.694772] element 0: offset: 0x635960, size: 24 [D 20:41:40.694788] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 33/70. [D 20:41:40.694848] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.694863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.694875] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.701607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.701627] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.701640] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.701716] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 521 [D 20:41:40.701732] element 0: offset: 0x64dde0, size: 24 [D 20:41:40.701750] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 34/70. [D 20:41:40.701987] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 521 [D 20:41:40.702010] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 35/70. [D 20:41:40.703331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 521 [D 20:41:40.703352] element 0: offset: 0x64dde0, size: 24 [D 20:41:40.703367] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 36/70. [D 20:41:40.703426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.703442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.703455] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.703683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.703703] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.703716] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.703837] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 523 [D 20:41:40.703855] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.703872] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 37/70. [D 20:41:40.703980] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 523 [D 20:41:40.704002] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 38/70. [D 20:41:40.704474] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 523 [D 20:41:40.704494] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.704511] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 39/70. [D 20:41:40.704560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.704576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.704589] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.770866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.770886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.770899] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.770930] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 529 [D 20:41:40.770944] element 0: offset: 0x65d000, size: 72 [D 20:41:40.770961] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 40/70. [D 20:41:40.771174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.771194] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.771207] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.771229] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.771242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.771254] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.771277] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 531 [D 20:41:40.771291] element 0: offset: 0x65d000, size: 72 [D 20:41:40.771306] openib_post_sr: 10.1.4.240:43806 bh 1 len 88 wr 41/70. [D 20:41:40.774597] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.774621] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.774638] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.774662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.774675] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.774688] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.774718] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 534 [D 20:41:40.774736] element 0: offset: 0x65d000, size: 72 [D 20:41:40.774751] openib_post_sr: 10.1.4.240:43806 bh 2 len 88 wr 42/70. [D 20:41:40.774776] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.774799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.774813] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:40.778084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 535 [D 20:41:40.778110] element 0: offset: 0x661650, size: 72 [D 20:41:40.778129] openib_post_sr: 10.1.4.240:43806 bh 3 len 88 wr 43/70. [D 20:41:40.778154] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.778176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.778189] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:40.781483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.781504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.781520] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.819110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.819129] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.819143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.819292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 538 [D 20:41:40.819309] element 0: offset: 0x635960, size: 24 [D 20:41:40.819324] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 44/70. [D 20:41:40.819390] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 538 [D 20:41:40.819422] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 45/70. [D 20:41:40.819770] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 538 [D 20:41:40.819790] element 0: offset: 0x635960, size: 24 [D 20:41:40.819808] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 46/70. [D 20:41:40.823144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.823167] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.823180] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:40.823205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:40.823218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.823231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:40.823299] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 539 [D 20:41:40.823315] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.823331] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 47/70. [D 20:41:40.823518] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 539 [D 20:41:40.823543] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 48/70. [D 20:41:40.823993] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 539 [D 20:41:40.824014] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.824029] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 49/70. [D 20:41:40.824078] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:40.824093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:40.824106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:41.573050] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.573074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.573088] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:41.573116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 542 [D 20:41:41.573130] element 0: offset: 0x623260, size: 24 [D 20:41:41.573146] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 50/70. [D 20:41:41.573436] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 542 [D 20:41:41.573464] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 51/70. [D 20:41:41.591493] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 542 [D 20:41:41.591561] element 0: offset: 0x623260, size: 24 [D 20:41:41.591582] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 52/70. [D 20:41:41.591880] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.591899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.591912] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:41.599747] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.599766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.599779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:41.599814] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 547 [D 20:41:41.599828] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.599844] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 53/70. [D 20:41:41.600078] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 547 [D 20:41:41.603526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.603546] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.603559] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:41.603664] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 548 [D 20:41:41.603680] element 0: offset: 0x6449e0, size: 24 [D 20:41:41.603695] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 54/70. [D 20:41:41.605445] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 55/70. [D 20:41:41.606749] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 548 [D 20:41:41.606980] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 56/70. [D 20:41:41.631663] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.631684] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.631698] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.631740] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 551 [D 20:41:41.631754] element 0: offset: 0x691fe0, size: 24 [D 20:41:41.636550] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 57/70. [D 20:41:41.636672] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.636689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.636702] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.636748] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 554 [D 20:41:41.636763] element 0: offset: 0x2aaaab001e60, size: 24 [D 20:41:41.636779] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 58/70. [D 20:41:41.640229] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 551 [D 20:41:41.640345] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 59/70. [D 20:41:41.640491] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 554 [D 20:41:41.640517] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 60/70. [D 20:41:41.640637] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 547 [D 20:41:41.640741] element 0: offset: 0x2aaaab001e80, size: 24 [D 20:41:41.640852] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 0/70. [D 20:41:41.643158] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.643211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.643225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.649380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 548 [D 20:41:41.649403] element 0: offset: 0x2aaaab001e80, size: 24 [D 20:41:41.649422] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 1/70. [D 20:41:41.649600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.649618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.649631] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.666760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.666781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.666794] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.846629] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.846707] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.846722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.847331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 558 [D 20:41:41.847354] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:41:41.847373] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 2/70. [D 20:41:41.847399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 560 [D 20:41:41.847412] element 0: offset: 0x2aaaab008ff0, size: 24 [D 20:41:41.847426] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 3/70. [D 20:41:41.847446] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 551 [D 20:41:41.847460] element 0: offset: 0x2aaaab002810, size: 24 [D 20:41:41.847475] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 4/70. [D 20:41:41.847543] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 558 [D 20:41:41.847603] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 560 [D 20:41:41.847630] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 5/70. [D 20:41:41.847802] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 6/70. [D 20:41:41.847855] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.847869] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.847882] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.853310] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 554 [D 20:41:41.853331] element 0: offset: 0x2aaaab001e60, size: 24 [D 20:41:41.853346] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 7/70. [D 20:41:41.853515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.853533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.853545] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.880606] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.880681] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.880696] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.880745] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.880758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.880771] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.881148] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 563 [D 20:41:41.881167] element 0: offset: 0x2aaaab000a10, size: 24 [D 20:41:41.881186] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 8/70. [D 20:41:41.881211] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 566 [D 20:41:41.881225] element 0: offset: 0x2aaaab002940, size: 24 [D 20:41:41.881238] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 9/70. [D 20:41:41.881306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 558 [D 20:41:41.881321] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:41:41.881337] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 10/70. [D 20:41:41.881393] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 563 [D 20:41:41.881417] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 11/70. [D 20:41:41.881473] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 566 [D 20:41:41.881525] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 12/70. [D 20:41:41.881566] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.881581] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.881593] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.887623] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 560 [D 20:41:41.887644] element 0: offset: 0x2aaaab008ff0, size: 24 [D 20:41:41.887659] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 13/70. [D 20:41:41.887903] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.887923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.887936] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.905575] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.905595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.905608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.905654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.905668] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.905681] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.910404] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 570 [D 20:41:41.910462] element 0: offset: 0x64dcc0, size: 24 [D 20:41:41.910482] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 14/70. [D 20:41:41.910509] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 572 [D 20:41:41.910524] element 0: offset: 0x61f0e0, size: 24 [D 20:41:41.910538] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 15/70. [D 20:41:41.910672] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 570 [D 20:41:41.910756] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 16/70. [D 20:41:41.914062] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 572 [D 20:41:41.914087] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 17/70. [D 20:41:41.914115] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 563 [D 20:41:41.914131] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.914147] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 18/70. [D 20:41:41.914249] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.914271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.914286] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.917900] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 566 [D 20:41:41.917921] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.917938] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 19/70. [D 20:41:41.918053] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.918069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.918082] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.933986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.934008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.934022] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.937058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.937075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.937089] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.939234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 575 [D 20:41:41.939252] element 0: offset: 0x691fe0, size: 24 [D 20:41:41.939268] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 20/70. [D 20:41:41.939287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 578 [D 20:41:41.939302] element 0: offset: 0x61f970, size: 24 [D 20:41:41.939316] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 21/70. [D 20:41:41.939385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 570 [D 20:41:41.939401] element 0: offset: 0x64dcc0, size: 24 [D 20:41:41.939415] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 22/70. [D 20:41:41.939508] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 575 [D 20:41:41.939528] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 23/70. [D 20:41:41.942848] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 578 [D 20:41:41.942867] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 24/70. [D 20:41:41.942891] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.942941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.942959] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.943836] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 572 [D 20:41:41.943857] element 0: offset: 0x61f0e0, size: 24 [D 20:41:41.946307] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 25/70. [D 20:41:41.946417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.946436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.946451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.964456] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.964478] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.964495] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.964563] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 582 [D 20:41:41.964580] element 0: offset: 0x62d7a0, size: 24 [D 20:41:41.964597] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 26/70. [D 20:41:41.964679] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.964696] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.964709] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.964777] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 584 [D 20:41:41.964793] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.964808] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 27/70. [D 20:41:41.968101] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 582 [D 20:41:41.968120] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 28/70. [D 20:41:41.974366] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 584 [D 20:41:41.974433] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 29/70. [D 20:41:41.977742] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 575 [D 20:41:41.977765] element 0: offset: 0x691fe0, size: 24 [D 20:41:41.977788] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 30/70. [D 20:41:41.977811] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 578 [D 20:41:41.977826] element 0: offset: 0x61f970, size: 24 [D 20:41:41.977841] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 31/70. [D 20:41:41.981122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.981143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.981158] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:41.981181] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:41.981195] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.981208] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:41.995132] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.995153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.995167] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:41.995207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:41.995221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:41.995234] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:41.997291] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 587 [D 20:41:41.997309] element 0: offset: 0x61f0e0, size: 24 [D 20:41:41.997323] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 32/70. [D 20:41:41.997342] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 590 [D 20:41:41.997357] element 0: offset: 0x65a860, size: 24 [D 20:41:41.997371] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 33/70. [D 20:41:41.997440] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 587 [D 20:41:41.997479] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 34/70. [D 20:41:42.000899] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 590 [D 20:41:42.000921] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 35/70. [D 20:41:42.003676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 582 [D 20:41:42.003697] element 0: offset: 0x62d7a0, size: 24 [D 20:41:42.003716] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 36/70. [D 20:41:42.003736] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 584 [D 20:41:42.003751] element 0: offset: 0x64dde0, size: 24 [D 20:41:42.003767] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 37/70. [D 20:41:42.006972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.006991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.007006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.007026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.007039] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.007054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.027815] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.027836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.027850] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.027876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.027890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.027904] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.028155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 594 [D 20:41:42.028174] element 0: offset: 0x63dc40, size: 24 [D 20:41:42.028190] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 38/70. [D 20:41:42.028209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 596 [D 20:41:42.028223] element 0: offset: 0x61f970, size: 24 [D 20:41:42.028238] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 39/70. [D 20:41:42.031139] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 594 [D 20:41:42.031656] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 40/70. [D 20:41:42.031693] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 596 [D 20:41:42.031710] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 41/70. [D 20:41:42.031729] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 587 [D 20:41:42.031749] element 0: offset: 0x61f0e0, size: 24 [D 20:41:42.031763] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 42/70. [D 20:41:42.031846] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.031862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.031875] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.035082] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 590 [D 20:41:42.035102] element 0: offset: 0x65a860, size: 24 [D 20:41:42.035139] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 43/70. [D 20:41:42.035238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.035254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.035267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.061442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.061463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.061477] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.061503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.061517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.061530] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.061626] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 599 [D 20:41:42.061644] element 0: offset: 0x64dcc0, size: 24 [D 20:41:42.061659] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 44/70. [D 20:41:42.061678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 602 [D 20:41:42.061692] element 0: offset: 0x64dde0, size: 24 [D 20:41:42.061706] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 45/70. [D 20:41:42.065066] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 599 [D 20:41:42.065085] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 46/70. [D 20:41:42.065118] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 602 [D 20:41:42.065135] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 47/70. [D 20:41:42.068016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 594 [D 20:41:42.068038] element 0: offset: 0x63dc40, size: 24 [D 20:41:42.068467] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 48/70. [D 20:41:42.068498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 596 [D 20:41:42.068515] element 0: offset: 0x61f970, size: 24 [D 20:41:42.068529] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 49/70. [D 20:41:42.071748] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.071768] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.071783] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.071803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.071817] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.071832] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.093928] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.093950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.093967] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.093994] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.094008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.094021] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.097113] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 606 [D 20:41:42.097134] element 0: offset: 0x64c9c0, size: 24 [D 20:41:42.097149] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 50/70. [D 20:41:42.097169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 608 [D 20:41:42.097183] element 0: offset: 0x65a860, size: 24 [D 20:41:42.097197] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 51/70. [D 20:41:42.102335] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 606 [D 20:41:42.102382] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 52/70. [D 20:41:42.102425] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 608 [D 20:41:42.102444] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 53/70. [D 20:41:42.102467] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 599 [D 20:41:42.102488] element 0: offset: 0x64dcc0, size: 24 [D 20:41:42.102504] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 54/70. [D 20:41:42.102602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.102624] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.102638] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.105920] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 602 [D 20:41:42.105941] element 0: offset: 0x64dde0, size: 24 [D 20:41:42.105957] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 55/70. [D 20:41:42.106080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.106095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.106109] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.127130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.127152] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.127166] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.127204] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.127218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.127233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.129377] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 611 [D 20:41:42.129398] element 0: offset: 0x623260, size: 24 [D 20:41:42.129418] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 56/70. [D 20:41:42.129438] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 614 [D 20:41:42.129454] element 0: offset: 0x5b0030, size: 24 [D 20:41:42.129469] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 57/70. [D 20:41:42.129543] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 611 [D 20:41:42.129577] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 58/70. [D 20:41:42.129625] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 614 [D 20:41:42.129660] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 59/70. [D 20:41:42.135230] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 606 [D 20:41:42.135252] element 0: offset: 0x64c9c0, size: 24 [D 20:41:42.135269] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 60/70. [D 20:41:42.138502] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.138521] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.138534] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.138553] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 608 [D 20:41:42.138567] element 0: offset: 0x65a860, size: 24 [D 20:41:42.138582] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 0/70. [D 20:41:42.138810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.138829] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.138843] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.157879] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.157900] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.157913] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.157942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.157956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.157969] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.158096] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 618 [D 20:41:42.158114] element 0: offset: 0x62d7a0, size: 24 [D 20:41:42.158129] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 1/70. [D 20:41:42.158148] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 620 [D 20:41:42.158163] element 0: offset: 0x61f0e0, size: 24 [D 20:41:42.158177] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 2/70. [D 20:41:42.161522] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 618 [D 20:41:42.161541] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 3/70. [D 20:41:42.161573] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 620 [D 20:41:42.161590] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 4/70. [D 20:41:42.161609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 611 [D 20:41:42.161628] element 0: offset: 0x623260, size: 24 [D 20:41:42.161642] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 5/70. [D 20:41:42.163884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.163946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.163961] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.169544] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 614 [D 20:41:42.169566] element 0: offset: 0x5b0030, size: 24 [D 20:41:42.169586] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 6/70. [D 20:41:42.169764] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.169782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.169795] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.186632] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.186653] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.186667] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.186929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.186949] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.186962] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:42.187014] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 623 [D 20:41:42.187029] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:42.187095] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 7/70. [D 20:41:42.187145] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 626 [D 20:41:42.187159] element 0: offset: 0x2aaaab602050, size: 24 [D 20:41:42.187174] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 8/70. [D 20:41:42.187436] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 623 [D 20:41:42.187464] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 9/70. [D 20:41:42.187518] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 626 [D 20:41:42.187536] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 10/70. [D 20:41:42.192740] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 620 [D 20:41:42.192810] element 0: offset: 0x2aaaab607720, size: 24 [D 20:41:42.192830] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 11/70. [D 20:41:42.193025] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.193045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.193057] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:42.197686] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 618 [D 20:41:42.197752] element 0: offset: 0x2aaaab607720, size: 24 [D 20:41:42.197773] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 12/70. [D 20:41:42.197957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.197976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.197989] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.212625] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.212645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.212659] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.215758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 630 [D 20:41:42.215825] element 0: offset: 0x2aaaab608ae0, size: 24 [D 20:41:42.215846] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 13/70. [D 20:41:42.216018] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 630 [D 20:41:42.216043] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 14/70. [D 20:41:42.219206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 626 [D 20:41:42.219271] element 0: offset: 0x2aaaab602050, size: 24 [D 20:41:42.219296] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 15/70. [D 20:41:42.219646] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.219666] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.219679] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.223462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 623 [D 20:41:42.223526] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:42.223547] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 16/70. [D 20:41:42.223771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.223791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.223804] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:42.227977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.227998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.228010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:42.229854] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.229902] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.229916] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:42.232733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 630 [D 20:41:42.232794] element 0: offset: 0x2aaaab608ae0, size: 24 [D 20:41:42.232816] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 17/70. [D 20:41:42.233229] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 632 [D 20:41:42.233249] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:42.233265] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 18/70. [D 20:41:42.233289] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 635 [D 20:41:42.233303] element 0: offset: 0x2aaaab601f50, size: 24 [D 20:41:42.233319] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 19/70. [D 20:41:42.233362] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.233377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.233390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:42.233446] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 632 [D 20:41:42.233496] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 635 [D 20:41:42.237455] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 20/70. [D 20:41:42.237534] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 21/70. [D 20:41:42.267704] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 635 [D 20:41:42.267776] element 0: offset: 0x2aaaab601f50, size: 24 [D 20:41:42.267798] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 22/70. [D 20:41:42.267990] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.268010] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.268023] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:42.274743] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 632 [D 20:41:42.274764] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:42.274779] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 23/70. [D 20:41:42.274903] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:42.274921] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.274933] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:42.997638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.997658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.997671] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:42.999290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:42.999309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:42.999322] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:42.999353] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 638 [D 20:41:42.999367] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:42.999383] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 24/70. [D 20:41:42.999659] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 638 [D 20:41:42.999687] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 25/70. [D 20:41:42.999712] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 642 [D 20:41:42.999726] element 0: offset: 0x2aaaab604970, size: 24 [D 20:41:42.999744] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 26/70. [D 20:41:42.999888] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 642 [D 20:41:43.013331] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 27/70. [D 20:41:43.018249] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 638 [D 20:41:43.018273] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.018292] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 28/70. [D 20:41:43.021441] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.021461] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.021475] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.031560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.031580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.031594] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.031637] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.031651] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.031664] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.035882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 644 [D 20:41:43.035903] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.035919] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 29/70. [D 20:41:43.035940] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 647 [D 20:41:43.035955] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.035969] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 30/70. [D 20:41:43.035992] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 642 [D 20:41:43.036012] element 0: offset: 0x2aaaab604970, size: 24 [D 20:41:43.036027] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 31/70. [D 20:41:43.039255] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 644 [D 20:41:43.039334] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 32/70. [D 20:41:43.039402] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 647 [D 20:41:43.039426] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 33/70. [D 20:41:43.039463] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.039478] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.039491] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.068369] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.068391] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.068405] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.068457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.068472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.068485] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.075141] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 651 [D 20:41:43.075166] element 0: offset: 0x2aaaab607720, size: 24 [D 20:41:43.075182] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 34/70. [D 20:41:43.075204] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 653 [D 20:41:43.075224] element 0: offset: 0x2aaaab604800, size: 24 [D 20:41:43.075239] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 35/70. [D 20:41:43.078968] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 651 [D 20:41:43.078998] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 36/70. [D 20:41:43.079055] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 653 [D 20:41:43.079073] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 37/70. [D 20:41:43.079098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 647 [D 20:41:43.079113] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.082183] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 38/70. [D 20:41:43.082203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 644 [D 20:41:43.082218] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.082233] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 39/70. [D 20:41:43.082496] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.082517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.082534] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.085999] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.086019] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.086033] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.110756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.110778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.110792] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.110824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.110838] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.110852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.110959] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 657 [D 20:41:43.110976] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.110991] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 40/70. [D 20:41:43.111011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 659 [D 20:41:43.111026] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.111041] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 41/70. [D 20:41:43.114345] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 657 [D 20:41:43.114368] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 42/70. [D 20:41:43.114414] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 659 [D 20:41:43.114431] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 43/70. [D 20:41:43.114456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 651 [D 20:41:43.114471] element 0: offset: 0x2aaaab607720, size: 24 [D 20:41:43.114486] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 44/70. [D 20:41:43.119171] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.119233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.119249] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.119282] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 653 [D 20:41:43.119300] element 0: offset: 0x2aaaab604800, size: 24 [D 20:41:43.119320] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 45/70. [D 20:41:43.122482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.122502] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.122518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.139341] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.139362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.139376] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.139420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.139436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.139449] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.139552] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 663 [D 20:41:43.139569] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:43.139584] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 46/70. [D 20:41:43.139605] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 665 [D 20:41:43.139620] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.139634] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 47/70. [D 20:41:43.142995] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 663 [D 20:41:43.143020] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 48/70. [D 20:41:43.143083] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 665 [D 20:41:43.143107] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 49/70. [D 20:41:43.143131] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 657 [D 20:41:43.143146] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.143160] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 50/70. [D 20:41:43.143240] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.143257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.143270] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.151054] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 659 [D 20:41:43.151119] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.151141] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 51/70. [D 20:41:43.154335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.154397] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.154412] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.170136] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.170168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.170182] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.170228] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.170243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.170257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.170437] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 668 [D 20:41:43.170457] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:43.170477] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 52/70. [D 20:41:43.170506] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 671 [D 20:41:43.170521] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.170536] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 53/70. [D 20:41:43.173927] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 668 [D 20:41:43.173952] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 54/70. [D 20:41:43.173998] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 671 [D 20:41:43.174016] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 55/70. [D 20:41:43.177154] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 663 [D 20:41:43.177174] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:43.177288] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 56/70. [D 20:41:43.177414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.177431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.177449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.177698] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 665 [D 20:41:43.177721] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.177740] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 57/70. [D 20:41:43.177839] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.177856] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.177873] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.201697] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.201719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.201734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.201765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.201780] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.201796] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.202140] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 675 [D 20:41:43.202160] element 0: offset: 0x2aaaab6101f0, size: 24 [D 20:41:43.202176] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 58/70. [D 20:41:43.202196] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 677 [D 20:41:43.202210] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.202226] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 59/70. [D 20:41:43.204426] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 675 [D 20:41:43.204504] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 60/70. [D 20:41:43.204555] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 677 [D 20:41:43.204573] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 0/70. [D 20:41:43.204597] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 668 [D 20:41:43.204612] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:43.204628] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 1/70. [D 20:41:43.210234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.210255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.210268] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.210316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 671 [D 20:41:43.210331] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.210345] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 2/70. [D 20:41:43.211176] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.211194] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.211207] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.229574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.229595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.229608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.229648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.229662] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.229674] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.229778] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 680 [D 20:41:43.229794] element 0: offset: 0x2aaaab60deb0, size: 24 [D 20:41:43.229809] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 3/70. [D 20:41:43.229832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 683 [D 20:41:43.229846] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:43.229860] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 4/70. [D 20:41:43.229978] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 680 [D 20:41:43.229999] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 5/70. [D 20:41:43.230061] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 683 [D 20:41:43.230084] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 6/70. [D 20:41:43.235596] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 677 [D 20:41:43.235667] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.235689] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 7/70. [D 20:41:43.235893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.235913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.235926] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.241378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 675 [D 20:41:43.241399] element 0: offset: 0x2aaaab6101f0, size: 24 [D 20:41:43.241414] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 8/70. [D 20:41:43.241579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.241598] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.241610] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.257817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.257837] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.257850] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.257896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.257910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.257923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.258034] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 686 [D 20:41:43.258049] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.258064] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 9/70. [D 20:41:43.258087] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 690 [D 20:41:43.258101] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.258115] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 10/70. [D 20:41:43.258214] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 686 [D 20:41:43.258238] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 11/70. [D 20:41:43.258303] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 690 [D 20:41:43.258324] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 12/70. [D 20:41:43.263833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 680 [D 20:41:43.263905] element 0: offset: 0x2aaaab60deb0, size: 24 [D 20:41:43.263926] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 13/70. [D 20:41:43.264129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.264148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.264161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.269698] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 683 [D 20:41:43.269719] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:43.269735] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 14/70. [D 20:41:43.269909] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.269927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.269939] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.283344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.283364] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.283377] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.283418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.283432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.283444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.283556] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 692 [D 20:41:43.283572] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:43.283586] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 15/70. [D 20:41:43.283610] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 695 [D 20:41:43.283625] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:43.283642] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 16/70. [D 20:41:43.283923] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 692 [D 20:41:43.283952] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 17/70. [D 20:41:43.284033] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 695 [D 20:41:43.284055] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 18/70. [D 20:41:43.289188] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 686 [D 20:41:43.289258] element 0: offset: 0x2aaaab606090, size: 24 [D 20:41:43.289280] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 19/70. [D 20:41:43.289513] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.289533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.289546] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.293732] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 690 [D 20:41:43.293798] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.293820] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 20/70. [D 20:41:43.294046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.294066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.294079] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.309565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.309585] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.309598] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.309639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.309653] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.309666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.309777] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 698 [D 20:41:43.309793] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.309808] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 21/70. [D 20:41:43.309831] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 702 [D 20:41:43.309845] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:43.309860] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 22/70. [D 20:41:43.309973] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 698 [D 20:41:43.309999] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 23/70. [D 20:41:43.310069] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 702 [D 20:41:43.310091] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 24/70. [D 20:41:43.319378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 692 [D 20:41:43.319448] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:43.319469] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 25/70. [D 20:41:43.322781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.322852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.322868] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.322895] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 695 [D 20:41:43.322911] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:43.322928] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 26/70. [D 20:41:43.323034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.323051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.323064] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.339103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.339130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.339144] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:43.339393] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 704 [D 20:41:43.339422] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.339437] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 27/70. [D 20:41:43.343185] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 704 [D 20:41:43.343262] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 28/70. [D 20:41:43.343302] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 698 [D 20:41:43.343316] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.343333] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 29/70. [D 20:41:43.343364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.343379] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.343392] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:43.343453] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.343467] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.343480] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:43.343568] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 707 [D 20:41:43.343583] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.343598] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 30/70. [D 20:41:43.343900] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 707 [D 20:41:43.351468] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 702 [D 20:41:43.351488] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:43.351503] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 31/70. [D 20:41:43.351671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.351690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.351702] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:43.356349] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 32/70. [D 20:41:43.361369] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 704 [D 20:41:43.361439] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.361461] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 33/70. [D 20:41:43.366148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.366169] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.366182] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.368373] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.368393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.368407] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.368531] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 710 [D 20:41:43.368547] element 0: offset: 0x2aaaab614fb0, size: 24 [D 20:41:43.368562] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 34/70. [D 20:41:43.368743] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 710 [D 20:41:43.368768] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 35/70. [D 20:41:43.376859] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 707 [D 20:41:43.376879] element 0: offset: 0x2aaaab600be0, size: 24 [D 20:41:43.376895] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 36/70. [D 20:41:43.377064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.377082] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.377095] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.382133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.382154] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.382168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.382236] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 714 [D 20:41:43.382252] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:43.382267] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 37/70. [D 20:41:43.382432] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 714 [D 20:41:43.382456] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 38/70. [D 20:41:43.387462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 710 [D 20:41:43.387529] element 0: offset: 0x2aaaab614fb0, size: 24 [D 20:41:43.387551] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 39/70. [D 20:41:43.387738] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.387758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.387771] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.396323] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.396344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.396357] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.396477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 716 [D 20:41:43.396493] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.396508] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 40/70. [D 20:41:43.396709] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 716 [D 20:41:43.396735] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 41/70. [D 20:41:43.404765] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 714 [D 20:41:43.404786] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:43.404801] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 42/70. [D 20:41:43.404966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.404984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.404997] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.410276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.410297] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.410310] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.410380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 719 [D 20:41:43.410396] element 0: offset: 0x2aaaab601f80, size: 24 [D 20:41:43.410410] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 43/70. [D 20:41:43.410589] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 719 [D 20:41:43.410612] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 44/70. [D 20:41:43.415653] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 716 [D 20:41:43.415719] element 0: offset: 0x2aaaab611670, size: 24 [D 20:41:43.415740] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 45/70. [D 20:41:43.419867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.419888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.419901] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.424877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.424898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.424912] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.425035] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 723 [D 20:41:43.425052] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:43.425066] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 46/70. [D 20:41:43.425244] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 723 [D 20:41:43.425272] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 47/70. [D 20:41:43.432037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 719 [D 20:41:43.432103] element 0: offset: 0x2aaaab601f80, size: 24 [D 20:41:43.432123] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 48/70. [D 20:41:43.432314] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.432333] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.432347] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.439640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.439660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.439675] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.439795] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 725 [D 20:41:43.439811] element 0: offset: 0x61f0e0, size: 24 [D 20:41:43.439827] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 49/70. [D 20:41:43.440021] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 725 [D 20:41:43.440048] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 50/70. [D 20:41:43.445243] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 723 [D 20:41:43.445311] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.445334] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 51/70. [D 20:41:43.447090] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.447111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.447142] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.456155] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.456194] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.456208] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:43.456341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 728 [D 20:41:43.456358] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.456378] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 52/70. [D 20:41:43.456606] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 728 [D 20:41:43.456634] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 53/70. [D 20:41:43.460306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 725 [D 20:41:43.460368] element 0: offset: 0x61f0e0, size: 24 [D 20:41:43.460390] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 54/70. [D 20:41:43.460591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.460611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.460624] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:43.476397] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 728 [D 20:41:43.476465] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.476489] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 55/70. [D 20:41:43.478207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.478228] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.478241] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:43.495780] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:43.495800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.495813] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:43.495929] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 731 [D 20:41:43.495944] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.495960] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:41:43.496048] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 731 [D 20:41:43.496139] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 57/70. [D 20:41:43.515194] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 731 [D 20:41:43.515264] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.515285] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 58/70. [D 20:41:43.518382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:43.518408] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:43.518426] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:44.174565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.174629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.174644] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:44.174822] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 734 [D 20:41:44.174840] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.174859] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 59/70. [D 20:41:44.175173] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 734 [D 20:41:44.178180] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 60/70. [D 20:41:44.195379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 734 [D 20:41:44.195405] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.195422] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 0/70. [D 20:41:44.198490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.198511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.198526] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:44.206825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.206846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.206862] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:44.207077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 737 [D 20:41:44.207096] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.207111] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 1/70. [D 20:41:44.210345] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 737 [D 20:41:44.210367] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 2/70. [D 20:41:44.225527] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 737 [D 20:41:44.225548] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.225564] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 3/70. [D 20:41:44.227143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.227162] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.227179] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:44.239183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.239244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.239259] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:44.239302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.239316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.239328] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.239442] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 742 [D 20:41:44.239458] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.239480] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 4/70. [D 20:41:44.239509] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 743 [D 20:41:44.239523] element 0: offset: 0x62d7a0, size: 24 [D 20:41:44.239537] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 5/70. [D 20:41:44.239665] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 742 [D 20:41:44.239691] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 6/70. [D 20:41:44.239732] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 743 [D 20:41:44.239752] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 7/70. [D 20:41:44.275436] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.275467] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.275482] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.275671] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 746 [D 20:41:44.275690] element 0: offset: 0x61f0e0, size: 24 [D 20:41:44.275708] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 8/70. [D 20:41:44.278939] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 746 [D 20:41:44.278962] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 9/70. [D 20:41:44.279022] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 742 [D 20:41:44.279043] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.279058] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 10/70. [D 20:41:44.279077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 743 [D 20:41:44.279092] element 0: offset: 0x62d7a0, size: 24 [D 20:41:44.279107] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 11/70. [D 20:41:44.282493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.282513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.282527] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.282548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.282562] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.282575] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.296139] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.296158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.296176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.296205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.296219] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.296232] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.296310] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 750 [D 20:41:44.296326] element 0: offset: 0x61e630, size: 24 [D 20:41:44.296341] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 12/70. [D 20:41:44.296359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 752 [D 20:41:44.296374] element 0: offset: 0x691fe0, size: 24 [D 20:41:44.296389] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 13/70. [D 20:41:44.299163] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 750 [D 20:41:44.299186] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 14/70. [D 20:41:44.299221] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 752 [D 20:41:44.299241] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 15/70. [D 20:41:44.299264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.299278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.299312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.299645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 746 [D 20:41:44.299709] element 0: offset: 0x61f0e0, size: 24 [D 20:41:44.299730] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 16/70. [D 20:41:44.299762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 755 [D 20:41:44.299776] element 0: offset: 0x64cb10, size: 24 [D 20:41:44.299790] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 17/70. [D 20:41:44.301810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.301831] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.301845] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.301898] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 755 [D 20:41:44.328018] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 18/70. [D 20:41:44.331322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.331393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.331408] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.331658] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 758 [D 20:41:44.331683] element 0: offset: 0x630b40, size: 24 [D 20:41:44.331700] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 19/70. [D 20:41:44.334814] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 758 [D 20:41:44.335030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 750 [D 20:41:44.335052] element 0: offset: 0x61e630, size: 24 [D 20:41:44.335068] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 20/70. [D 20:41:44.338375] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.338396] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.338416] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.343205] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 21/70. [D 20:41:44.343386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.343466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.343482] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.343871] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 762 [D 20:41:44.343891] element 0: offset: 0x61e740, size: 24 [D 20:41:44.343914] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 22/70. [D 20:41:44.344054] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 762 [D 20:41:44.351249] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 752 [D 20:41:44.351331] element 0: offset: 0x691fe0, size: 24 [D 20:41:44.351354] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 23/70. [D 20:41:44.351535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.351553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.351567] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.352011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 755 [D 20:41:44.352029] element 0: offset: 0x64cb10, size: 24 [D 20:41:44.352046] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 24/70. [D 20:41:44.352136] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.352152] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.352169] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.356802] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 25/70. [D 20:41:44.365016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 758 [D 20:41:44.365095] element 0: offset: 0x630b40, size: 24 [D 20:41:44.365118] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 26/70. [D 20:41:44.365290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.365309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.365324] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.366845] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.366865] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.366879] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.366929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.366944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.366957] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.367076] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 765 [D 20:41:44.367092] element 0: offset: 0x62d7a0, size: 24 [D 20:41:44.367119] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 27/70. [D 20:41:44.367159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 767 [D 20:41:44.367175] element 0: offset: 0x63ed60, size: 24 [D 20:41:44.367190] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 28/70. [D 20:41:44.367301] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 765 [D 20:41:44.367346] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 29/70. [D 20:41:44.370916] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 767 [D 20:41:44.370941] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 30/70. [D 20:41:44.379301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 762 [D 20:41:44.379379] element 0: offset: 0x61e740, size: 24 [D 20:41:44.379401] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 31/70. [D 20:41:44.382607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.382628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.382644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.396913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.396935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.396951] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.396993] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.397007] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.397021] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.397265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 770 [D 20:41:44.397286] element 0: offset: 0x6447a0, size: 24 [D 20:41:44.397301] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 32/70. [D 20:41:44.397325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 774 [D 20:41:44.397352] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.397367] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 33/70. [D 20:41:44.400786] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 770 [D 20:41:44.400811] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 34/70. [D 20:41:44.400848] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 774 [D 20:41:44.400872] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 35/70. [D 20:41:44.407209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 765 [D 20:41:44.407231] element 0: offset: 0x62d7a0, size: 24 [D 20:41:44.407247] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 36/70. [D 20:41:44.410536] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.410556] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.410574] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.410616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 767 [D 20:41:44.410632] element 0: offset: 0x63ed60, size: 24 [D 20:41:44.410647] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 37/70. [D 20:41:44.410759] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.410776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.410791] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.430818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.430840] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.430854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.430881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.430896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.430912] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.431078] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 776 [D 20:41:44.431098] element 0: offset: 0x691fe0, size: 24 [D 20:41:44.431113] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 38/70. [D 20:41:44.431143] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 779 [D 20:41:44.431184] element 0: offset: 0x61e630, size: 24 [D 20:41:44.431199] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 39/70. [D 20:41:44.434611] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 776 [D 20:41:44.434635] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 40/70. [D 20:41:44.434670] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 779 [D 20:41:44.434687] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 41/70. [D 20:41:44.437990] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 770 [D 20:41:44.438013] element 0: offset: 0x6447a0, size: 24 [D 20:41:44.438049] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 42/70. [D 20:41:44.438073] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 774 [D 20:41:44.438088] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.438102] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 43/70. [D 20:41:44.439215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.439277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.439292] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.439318] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.439331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.439344] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.460752] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.460774] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.460787] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.460836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.460850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.460863] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.464038] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 783 [D 20:41:44.464109] element 0: offset: 0x62d7a0, size: 24 [D 20:41:44.464131] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 44/70. [D 20:41:44.464159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 785 [D 20:41:44.464173] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.464189] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 45/70. [D 20:41:44.464254] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 783 [D 20:41:44.464277] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 46/70. [D 20:41:44.464323] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 785 [D 20:41:44.464342] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 47/70. [D 20:41:44.467053] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 776 [D 20:41:44.467105] element 0: offset: 0x691fe0, size: 24 [D 20:41:44.467139] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 48/70. [D 20:41:44.471639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.471660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.471674] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.474902] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 779 [D 20:41:44.474922] element 0: offset: 0x61e630, size: 24 [D 20:41:44.474939] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 49/70. [D 20:41:44.475103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.475122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.475139] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.490193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.490218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.490232] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.490281] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.490295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.490308] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.493575] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 788 [D 20:41:44.493654] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.493676] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 50/70. [D 20:41:44.493706] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 791 [D 20:41:44.493721] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:44.494097] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 51/70. [D 20:41:44.494172] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 788 [D 20:41:44.494197] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 52/70. [D 20:41:44.494682] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 791 [D 20:41:44.494707] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 53/70. [D 20:41:44.496572] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 783 [D 20:41:44.496614] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.496636] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 54/70. [D 20:41:44.496803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.496822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.496835] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.504158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 785 [D 20:41:44.504226] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.504248] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 55/70. [D 20:41:44.507188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.507259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.507275] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.520721] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.520747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.520779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.520829] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.520844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.520857] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.521125] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 795 [D 20:41:44.521142] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.521161] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 56/70. [D 20:41:44.521191] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 797 [D 20:41:44.521206] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:44.521225] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 57/70. [D 20:41:44.524604] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 795 [D 20:41:44.524629] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 58/70. [D 20:41:44.524698] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 797 [D 20:41:44.524723] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 59/70. [D 20:41:44.524745] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 791 [D 20:41:44.524760] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:44.524777] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 60/70. [D 20:41:44.524867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.524883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.524911] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.528756] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 788 [D 20:41:44.528777] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.528793] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 0/70. [D 20:41:44.531144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.531164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.531177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.555435] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.555458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.555472] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.555501] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.555516] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.555533] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.555830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 800 [D 20:41:44.555851] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:44.555865] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 1/70. [D 20:41:44.555889] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 803 [D 20:41:44.555905] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.555927] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 2/70. [D 20:41:44.559340] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 800 [D 20:41:44.559369] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 3/70. [D 20:41:44.559421] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 803 [D 20:41:44.559447] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 4/70. [D 20:41:44.562793] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 795 [D 20:41:44.562814] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.562835] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 5/70. [D 20:41:44.563007] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.563028] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.563041] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.563441] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 797 [D 20:41:44.563469] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:44.566321] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 6/70. [D 20:41:44.566434] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.566452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.566467] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.591394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.591416] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.591430] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.591459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.591474] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.591491] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:41:44.591844] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 807 [D 20:41:44.591867] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:44.591882] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 7/70. [D 20:41:44.591902] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 809 [D 20:41:44.591916] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.591932] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 8/70. [D 20:41:44.595269] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 807 [D 20:41:44.595350] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 9/70. [D 20:41:44.595397] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 809 [D 20:41:44.595415] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 10/70. [D 20:41:44.595439] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 800 [D 20:41:44.595454] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:44.595470] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 11/70. [D 20:41:44.602205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.602226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.602239] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:41:44.602286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 803 [D 20:41:44.602301] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.602316] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 12/70. [D 20:41:44.603194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.603211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.603224] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.621631] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.621652] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.621665] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.621775] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 812 [D 20:41:44.621791] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.621805] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 13/70. [D 20:41:44.621970] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 812 [D 20:41:44.621993] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 14/70. [D 20:41:44.627049] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 807 [D 20:41:44.627119] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:44.627153] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 15/70. [D 20:41:44.630419] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.630488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.630505] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.635601] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.635645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.635660] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.636075] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 816 [D 20:41:44.636097] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:44.636144] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 16/70. [D 20:41:44.639201] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 816 [D 20:41:44.639276] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 17/70. [D 20:41:44.639316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 812 [D 20:41:44.639330] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.639346] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 18/70. [D 20:41:44.639527] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.639547] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.639560] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.643415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 809 [D 20:41:44.643436] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.643452] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 19/70. [D 20:41:44.643574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.643592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.643605] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.651111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.651138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.651151] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.651199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.651213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.651225] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:44.651320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 818 [D 20:41:44.651336] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.651351] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 20/70. [D 20:41:44.651374] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 821 [D 20:41:44.651388] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:44.651402] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 21/70. [D 20:41:44.651449] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 818 [D 20:41:44.651499] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 821 [D 20:41:44.651507] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 22/70. [D 20:41:44.651717] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 23/70. [D 20:41:44.656841] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 816 [D 20:41:44.656907] element 0: offset: 0x2aaaab6129e0, size: 24 [D 20:41:44.656929] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 24/70. [D 20:41:44.657124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.657144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.657157] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:44.683525] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 818 [D 20:41:44.683597] element 0: offset: 0x2aaaab60daa0, size: 24 [D 20:41:44.683620] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 25/70. [D 20:41:44.683809] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.683828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.683842] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.689334] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.689354] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.689367] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.689487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 824 [D 20:41:44.689502] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.689517] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 26/70. [D 20:41:44.689605] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 824 [D 20:41:44.689640] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 27/70. [D 20:41:44.693375] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 821 [D 20:41:44.693395] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:44.693410] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 28/70. [D 20:41:44.693537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.693555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.693568] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.701128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:44.701153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.701166] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:44.701238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 827 [D 20:41:44.701254] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.701270] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 29/70. [D 20:41:44.701433] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 827 [D 20:41:44.701456] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 30/70. [D 20:41:44.706425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 824 [D 20:41:44.706494] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:41:44.706515] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 31/70. [D 20:41:44.706729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.706748] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.706761] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:44.737625] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 827 [D 20:41:44.737694] element 0: offset: 0x2aaaab617320, size: 24 [D 20:41:44.737715] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 32/70. [D 20:41:44.737785] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:44.737800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:44.737813] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.242680] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.242701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.242714] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.242832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 830 [D 20:41:45.242848] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:45.242863] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 33/70. [D 20:41:45.242952] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 830 [D 20:41:45.243010] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 34/70. [D 20:41:45.259498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 830 [D 20:41:45.259567] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:45.259588] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 35/70. [D 20:41:45.259960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.259981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.259995] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.270874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.270895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.270908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.274077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 833 [D 20:41:45.274097] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:45.274113] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 36/70. [D 20:41:45.274366] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 833 [D 20:41:45.274393] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 37/70. [D 20:41:45.292878] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 833 [D 20:41:45.292946] element 0: offset: 0x2aaaab61c380, size: 24 [D 20:41:45.292966] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 38/70. [D 20:41:45.293321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.293342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.293355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.303418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.303438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.303452] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.306710] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 836 [D 20:41:45.306731] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:45.306746] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 39/70. [D 20:41:45.306956] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 836 [D 20:41:45.306983] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 40/70. [D 20:41:45.325833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 836 [D 20:41:45.325903] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:45.325924] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 41/70. [D 20:41:45.327191] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.327239] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.327255] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.335910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.335931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.335949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.336311] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 839 [D 20:41:45.336332] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.336351] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 42/70. [D 20:41:45.339230] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 839 [D 20:41:45.339267] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 43/70. [D 20:41:45.355609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 839 [D 20:41:45.355675] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.355695] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 44/70. [D 20:41:45.358711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.358742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.358761] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.363156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.363176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.363192] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.365229] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 842 [D 20:41:45.365252] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.365268] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 45/70. [D 20:41:45.365512] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 842 [D 20:41:45.365542] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 46/70. [D 20:41:45.382588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 842 [D 20:41:45.382656] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.382678] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 47/70. [D 20:41:45.382891] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.382910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.382923] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.388859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.388880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.388893] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.391904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 845 [D 20:41:45.391924] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:45.391939] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 48/70. [D 20:41:45.392182] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 845 [D 20:41:45.392209] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 49/70. [D 20:41:45.410813] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 845 [D 20:41:45.410880] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:45.410901] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 50/70. [D 20:41:45.411294] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.411315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.411328] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.416700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.416721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.416734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.419699] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 848 [D 20:41:45.419718] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.419734] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 51/70. [D 20:41:45.419976] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 848 [D 20:41:45.420004] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 52/70. [D 20:41:45.436214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.436283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.436299] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.438064] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 848 [D 20:41:45.438095] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.438117] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 53/70. [D 20:41:45.438189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.438203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.438216] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.438238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 852 [D 20:41:45.438251] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.438266] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 54/70. [D 20:41:45.439110] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 852 [D 20:41:45.442607] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 55/70. [D 20:41:45.457142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.457166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.457179] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.461558] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 854 [D 20:41:45.461623] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.461645] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 56/70. [D 20:41:45.461752] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 854 [D 20:41:45.461776] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 57/70. [D 20:41:45.463252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 852 [D 20:41:45.463275] element 0: offset: 0x2aaaab6271d0, size: 24 [D 20:41:45.463292] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 58/70. [D 20:41:45.463442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.463482] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.463497] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.475165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.475188] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.475202] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.475241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.475256] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.475269] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.479645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 858 [D 20:41:45.479672] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.479695] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 59/70. [D 20:41:45.479721] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 860 [D 20:41:45.479739] element 0: offset: 0x2aaaab6173e0, size: 24 [D 20:41:45.479756] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 60/70. [D 20:41:45.479776] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 854 [D 20:41:45.479798] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.479813] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 0/70. [D 20:41:45.483323] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 858 [D 20:41:45.483348] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 1/70. [D 20:41:45.483392] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 860 [D 20:41:45.483412] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 2/70. [D 20:41:45.483441] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.483463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.483479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.519254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.519276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.519290] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.519399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 863 [D 20:41:45.519416] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:45.519449] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 3/70. [D 20:41:45.519534] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 863 [D 20:41:45.519567] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 4/70. [D 20:41:45.523279] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 858 [D 20:41:45.523302] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.523317] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 5/70. [D 20:41:45.526611] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.526629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.526643] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.527355] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 860 [D 20:41:45.527374] element 0: offset: 0x2aaaab6173e0, size: 24 [D 20:41:45.527390] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 6/70. [D 20:41:45.530622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.530641] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.530654] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.535420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.535439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.535453] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.535622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.535641] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.535655] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.535773] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 867 [D 20:41:45.535790] element 0: offset: 0x2aaaab60aa00, size: 24 [D 20:41:45.538813] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 7/70. [D 20:41:45.538842] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 869 [D 20:41:45.538862] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.538877] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 8/70. [D 20:41:45.538900] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 863 [D 20:41:45.538914] element 0: offset: 0x2aaaab617730, size: 24 [D 20:41:45.538932] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 9/70. [D 20:41:45.539027] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 867 [D 20:41:45.539051] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 10/70. [D 20:41:45.539218] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 869 [D 20:41:45.539255] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 11/70. [D 20:41:45.539284] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.539299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.539312] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.567114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.567134] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.567153] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.567266] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 872 [D 20:41:45.567284] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.567299] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 12/70. [D 20:41:45.568838] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 867 [D 20:41:45.568914] element 0: offset: 0x2aaaab60aa00, size: 24 [D 20:41:45.568936] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 13/70. [D 20:41:45.574715] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 872 [D 20:41:45.574742] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 14/70. [D 20:41:45.574778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.574793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.574806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.577941] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 869 [D 20:41:45.577961] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.577980] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 15/70. [D 20:41:45.578096] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.578118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.578131] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.587582] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.587604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.587617] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.587666] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.587680] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.587693] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.590744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 876 [D 20:41:45.590797] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.590817] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 16/70. [D 20:41:45.590845] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 878 [D 20:41:45.590859] element 0: offset: 0x2aaaab60aa00, size: 24 [D 20:41:45.590873] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 17/70. [D 20:41:45.591329] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 876 [D 20:41:45.591359] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 18/70. [D 20:41:45.591414] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 878 [D 20:41:45.591442] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 19/70. [D 20:41:45.592902] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 872 [D 20:41:45.592930] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.592948] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 20/70. [D 20:41:45.593366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.593387] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.593401] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.617420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.617441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.617454] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.620655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 881 [D 20:41:45.620725] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.620747] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 21/70. [D 20:41:45.621194] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 881 [D 20:41:45.621224] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 22/70. [D 20:41:45.623636] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 876 [D 20:41:45.623685] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.623705] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 23/70. [D 20:41:45.623905] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.623925] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.623938] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.632030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 878 [D 20:41:45.632051] element 0: offset: 0x2aaaab60aa00, size: 24 [D 20:41:45.632067] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 24/70. [D 20:41:45.632300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.632318] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.632331] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.632723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.632744] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.632756] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.636469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 885 [D 20:41:45.636492] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:45.636509] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 25/70. [D 20:41:45.636684] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 885 [D 20:41:45.637497] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 26/70. [D 20:41:45.642549] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 881 [D 20:41:45.642618] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.642639] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 27/70. [D 20:41:45.642860] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.642880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.642892] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.649629] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.649650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.649663] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.649724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.649738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.649751] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.651295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 887 [D 20:41:45.651315] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.651331] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 28/70. [D 20:41:45.651355] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 890 [D 20:41:45.651369] element 0: offset: 0x63ed60, size: 24 [D 20:41:45.651383] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 29/70. [D 20:41:45.651692] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 887 [D 20:41:45.651723] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 30/70. [D 20:41:45.651762] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 890 [D 20:41:45.651782] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 31/70. [D 20:41:45.659655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 885 [D 20:41:45.659675] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.659690] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 32/70. [D 20:41:45.659877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.659896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.659908] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.676468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.676488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.676501] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.676571] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 894 [D 20:41:45.676586] element 0: offset: 0x6302c0, size: 24 [D 20:41:45.676604] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 33/70. [D 20:41:45.676805] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 894 [D 20:41:45.676829] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 34/70. [D 20:41:45.681955] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 887 [D 20:41:45.682027] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.682049] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 35/70. [D 20:41:45.682284] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.682304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.682317] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.686064] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 890 [D 20:41:45.686131] element 0: offset: 0x63ed60, size: 24 [D 20:41:45.686153] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 36/70. [D 20:41:45.686405] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.686424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.686437] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.688132] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.688153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.688166] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.688288] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 896 [D 20:41:45.688304] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.688319] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 37/70. [D 20:41:45.688408] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 896 [D 20:41:45.688434] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 38/70. [D 20:41:45.694242] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 894 [D 20:41:45.694311] element 0: offset: 0x6302c0, size: 24 [D 20:41:45.694330] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 39/70. [D 20:41:45.694565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.694585] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.694598] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.702069] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.702089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.702103] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.702230] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 899 [D 20:41:45.702246] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.702263] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 40/70. [D 20:41:45.702473] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 899 [D 20:41:45.702501] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 41/70. [D 20:41:45.707926] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 896 [D 20:41:45.707997] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.708017] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 42/70. [D 20:41:45.708166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.708183] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.708196] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.718977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.719052] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.719067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.719229] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 903 [D 20:41:45.719247] element 0: offset: 0x6448d0, size: 24 [D 20:41:45.719266] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 43/70. [D 20:41:45.719433] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 903 [D 20:41:45.719512] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 44/70. [D 20:41:45.721571] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 899 [D 20:41:45.721597] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.723125] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 45/70. [D 20:41:45.723247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.723266] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.723280] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.735116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.735229] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.735253] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.735408] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 905 [D 20:41:45.735426] element 0: offset: 0x6302c0, size: 24 [D 20:41:45.735441] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 46/70. [D 20:41:45.739185] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 905 [D 20:41:45.740062] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 47/70. [D 20:41:45.740092] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 903 [D 20:41:45.740113] element 0: offset: 0x6448d0, size: 24 [D 20:41:45.740128] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 48/70. [D 20:41:45.740258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.740278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.740292] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.757631] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.757654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.757668] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.758082] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 908 [D 20:41:45.758098] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.758119] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 49/70. [D 20:41:45.761380] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 908 [D 20:41:45.761403] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 50/70. [D 20:41:45.761427] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 905 [D 20:41:45.761442] element 0: offset: 0x6302c0, size: 24 [D 20:41:45.761457] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 51/70. [D 20:41:45.761544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.761560] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.761574] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.777655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 908 [D 20:41:45.777681] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.777697] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 52/70. [D 20:41:45.779267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.779328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.779342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.779377] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.779390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.779403] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.779531] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 912 [D 20:41:45.779548] element 0: offset: 0x63fdc0, size: 24 [D 20:41:45.779569] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 53/70. [D 20:41:45.779829] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 912 [D 20:41:45.779857] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 54/70. [D 20:41:45.792616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.792636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.792649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.792694] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.792709] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.792721] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:45.792793] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 914 [D 20:41:45.792808] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.792824] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 55/70. [D 20:41:45.792848] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 917 [D 20:41:45.792862] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:45.792876] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 56/70. [D 20:41:45.792924] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 914 [D 20:41:45.792978] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 917 [D 20:41:45.792980] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 57/70. [D 20:41:45.793272] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 58/70. [D 20:41:45.798864] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 912 [D 20:41:45.798932] element 0: offset: 0x2aaaab612960, size: 24 [D 20:41:45.798953] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 59/70. [D 20:41:45.799189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.799210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.799223] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:45.823279] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 914 [D 20:41:45.823348] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:45.823369] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 60/70. [D 20:41:45.826689] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.826715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.826730] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.826754] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 917 [D 20:41:45.826772] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:45.826791] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 0/70. [D 20:41:45.827017] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.827038] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.827051] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:45.829164] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.829185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.829207] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:45.829352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 920 [D 20:41:45.829374] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:45.829389] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 1/70. [D 20:41:45.829589] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 920 [D 20:41:45.829615] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 2/70. [D 20:41:45.845283] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:45.845304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.845318] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:45.845490] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 923 [D 20:41:45.845511] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.845526] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 3/70. [D 20:41:45.847174] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 923 [D 20:41:45.848989] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 4/70. [D 20:41:45.849027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 920 [D 20:41:45.849048] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:45.849063] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 5/70. [D 20:41:45.849251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.849283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.849300] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:45.865144] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 923 [D 20:41:45.865168] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:45.865185] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 6/70. [D 20:41:45.867252] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:45.867313] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:45.867327] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.166797] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.166819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.166832] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.166957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 926 [D 20:41:46.166974] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.166993] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 7/70. [D 20:41:46.167072] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 926 [D 20:41:46.167124] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 8/70. [D 20:41:46.183359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 926 [D 20:41:46.183384] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.183403] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 9/70. [D 20:41:46.186472] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.186494] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.186510] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.202870] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.202891] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.202908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.203270] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 929 [D 20:41:46.203290] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:46.203309] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 10/70. [D 20:41:46.206492] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 929 [D 20:41:46.206518] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 11/70. [D 20:41:46.223668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 929 [D 20:41:46.223691] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:46.223707] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 12/70. [D 20:41:46.226777] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.226799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.226821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.231164] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.231186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.231205] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.233832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 932 [D 20:41:46.233855] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.233874] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 13/70. [D 20:41:46.237040] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 932 [D 20:41:46.237064] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 14/70. [D 20:41:46.253441] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 932 [D 20:41:46.253464] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.253480] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 15/70. [D 20:41:46.255165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.255184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.255200] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.263276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.263337] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.263352] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.263496] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 935 [D 20:41:46.263515] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.263535] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 16/70. [D 20:41:46.263725] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 935 [D 20:41:46.263752] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 17/70. [D 20:41:46.282536] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 935 [D 20:41:46.282608] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.282629] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 18/70. [D 20:41:46.286066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.286086] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.286100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.289128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.289149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.289162] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.289286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 938 [D 20:41:46.289302] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:46.289317] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 19/70. [D 20:41:46.289434] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 938 [D 20:41:46.289459] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 20/70. [D 20:41:46.306029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 938 [D 20:41:46.306098] element 0: offset: 0x2aaaab6066b0, size: 24 [D 20:41:46.306119] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 21/70. [D 20:41:46.306557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.306578] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.306591] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.317103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.317125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.317138] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.317262] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 941 [D 20:41:46.317278] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.317293] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 22/70. [D 20:41:46.317366] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 941 [D 20:41:46.317411] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 23/70. [D 20:41:46.334053] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 941 [D 20:41:46.334125] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.334146] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 24/70. [D 20:41:46.334580] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.334601] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.334614] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.342966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.342987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.343000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.343120] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 944 [D 20:41:46.343136] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.343158] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 25/70. [D 20:41:46.346500] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 944 [D 20:41:46.346531] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 26/70. [D 20:41:46.363916] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 944 [D 20:41:46.363940] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.363958] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 27/70. [D 20:41:46.366976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.366998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.367014] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.373101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.373122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.373139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.373401] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 947 [D 20:41:46.373422] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.373438] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 28/70. [D 20:41:46.376641] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 947 [D 20:41:46.376664] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 29/70. [D 20:41:46.392864] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 947 [D 20:41:46.392887] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.392904] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 30/70. [D 20:41:46.395916] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.395937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.395953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.509458] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.509521] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.509536] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.509668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 950 [D 20:41:46.509684] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.509704] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 31/70. [D 20:41:46.509948] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 950 [D 20:41:46.509975] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 32/70. [D 20:41:46.527244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.527315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.527330] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.527893] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 954 [D 20:41:46.527912] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.527931] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 33/70. [D 20:41:46.528059] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 954 [D 20:41:46.528085] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 34/70. [D 20:41:46.528185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 950 [D 20:41:46.528204] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.528218] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 35/70. [D 20:41:46.531665] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.531734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.531753] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.543851] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 954 [D 20:41:46.543876] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.543897] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 36/70. [D 20:41:46.547424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.547484] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.547498] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.547532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.547546] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.547558] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.547686] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 956 [D 20:41:46.547703] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.547724] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 37/70. [D 20:41:46.548013] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 956 [D 20:41:46.548041] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 38/70. [D 20:41:46.561487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.561507] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.561520] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.561592] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 960 [D 20:41:46.561607] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.561622] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 39/70. [D 20:41:46.561820] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 960 [D 20:41:46.561845] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 40/70. [D 20:41:46.567205] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 956 [D 20:41:46.567274] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.567295] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 41/70. [D 20:41:46.570615] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.570698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.570716] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.578650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.578672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.578688] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.578736] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 960 [D 20:41:46.578753] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.578769] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 42/70. [D 20:41:46.578885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.578903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.578919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.579130] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 962 [D 20:41:46.579174] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.579191] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 43/70. [D 20:41:46.579325] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 962 [D 20:41:46.579361] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 44/70. [D 20:41:46.598079] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.598102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.598117] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.598155] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.598174] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.598188] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:46.598220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 962 [D 20:41:46.598236] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.598253] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 45/70. [D 20:41:46.598400] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.598418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.598431] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:46.598513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 966 [D 20:41:46.598536] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.598552] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 46/70. [D 20:41:46.598578] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 969 [D 20:41:46.598594] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.598630] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 47/70. [D 20:41:46.603419] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 966 [D 20:41:46.603494] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 48/70. [D 20:41:46.603572] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 969 [D 20:41:46.603594] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 49/70. [D 20:41:46.629962] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.629985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.629999] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:46.630088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 971 [D 20:41:46.630104] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.630121] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 50/70. [D 20:41:46.630251] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 971 [D 20:41:46.630296] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 51/70. [D 20:41:46.635336] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 966 [D 20:41:46.635360] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.635378] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 52/70. [D 20:41:46.638770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.638791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.638806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:46.641721] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 969 [D 20:41:46.641748] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.641767] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 53/70. [D 20:41:46.643359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.643424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.643438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.649047] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 971 [D 20:41:46.649119] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.649143] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 54/70. [D 20:41:46.649426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.649446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.649459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.651182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.651202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.651215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.651340] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 975 [D 20:41:46.651356] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.651373] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 55/70. [D 20:41:46.651589] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 975 [D 20:41:46.651623] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 56/70. [D 20:41:46.651653] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.651667] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.651679] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.652064] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 977 [D 20:41:46.652083] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.652099] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 57/70. [D 20:41:46.652332] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 977 [D 20:41:46.663024] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 58/70. [D 20:41:46.667972] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 975 [D 20:41:46.668040] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.668060] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 59/70. [D 20:41:46.668284] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.668304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.668318] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.676128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.676149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.676163] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.676286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 980 [D 20:41:46.676302] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.676317] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 60/70. [D 20:41:46.676528] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 980 [D 20:41:46.676555] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 0/70. [D 20:41:46.681678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 977 [D 20:41:46.681747] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.681769] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 1/70. [D 20:41:46.682021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.682040] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.682054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.693513] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.693583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.693598] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.693740] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 984 [D 20:41:46.693756] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.693777] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 2/70. [D 20:41:46.694043] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 984 [D 20:41:46.694074] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 3/70. [D 20:41:46.694770] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 980 [D 20:41:46.694791] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.694807] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 4/70. [D 20:41:46.694965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.694983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.694996] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.705100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.705121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.705135] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.705206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 986 [D 20:41:46.705222] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.705237] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 5/70. [D 20:41:46.705437] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 986 [D 20:41:46.705460] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 6/70. [D 20:41:46.710479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 984 [D 20:41:46.710547] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.710568] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 7/70. [D 20:41:46.710788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.710808] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.710821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.719929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.719950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.719963] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.720085] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 989 [D 20:41:46.720100] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.720116] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 8/70. [D 20:41:46.720328] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 989 [D 20:41:46.720354] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 9/70. [D 20:41:46.725480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 986 [D 20:41:46.725549] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.725570] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 10/70. [D 20:41:46.725824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.725843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.725856] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.737457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 989 [D 20:41:46.737526] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.737548] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 11/70. [D 20:41:46.737951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.737971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.737985] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.740050] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.740071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.740084] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.740208] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 993 [D 20:41:46.740223] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.740239] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 12/70. [D 20:41:46.740472] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 993 [D 20:41:46.740499] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 13/70. [D 20:41:46.752831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.752851] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.752864] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.752934] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 995 [D 20:41:46.752949] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.752964] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 14/70. [D 20:41:46.753025] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 995 [D 20:41:46.753090] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 15/70. [D 20:41:46.758627] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 993 [D 20:41:46.758698] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.758719] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 16/70. [D 20:41:46.758959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.758978] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.758991] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.765402] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.765423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.765437] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.765561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 998 [D 20:41:46.765577] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.765592] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 17/70. [D 20:41:46.765804] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 998 [D 20:41:46.765832] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 18/70. [D 20:41:46.770948] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 995 [D 20:41:46.771017] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.771038] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 19/70. [D 20:41:46.771305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.771324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.771337] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.784861] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 998 [D 20:41:46.784929] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.784952] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 20/70. [D 20:41:46.785393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.785414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.785428] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.792201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.792222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.792235] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.792359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1002 [D 20:41:46.792375] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.792390] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 21/70. [D 20:41:46.792603] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1002 [D 20:41:46.792630] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 22/70. [D 20:41:46.804907] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.804928] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.804941] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.805009] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1004 [D 20:41:46.805025] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.805040] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 23/70. [D 20:41:46.805102] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1004 [D 20:41:46.805152] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 24/70. [D 20:41:46.810733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1002 [D 20:41:46.810804] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:46.810825] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 25/70. [D 20:41:46.811063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.811083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.811096] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.817287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.817308] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.817322] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.817446] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1007 [D 20:41:46.817461] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.817476] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 26/70. [D 20:41:46.817687] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1007 [D 20:41:46.817715] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 27/70. [D 20:41:46.822859] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1004 [D 20:41:46.822928] element 0: offset: 0x2aaaab6207e0, size: 24 [D 20:41:46.822950] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 28/70. [D 20:41:46.823220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.823239] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.823253] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.835695] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1007 [D 20:41:46.835763] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:46.835785] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 29/70. [D 20:41:46.836225] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.836246] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.836260] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.841693] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.841714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.841727] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.841849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1011 [D 20:41:46.841866] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.841882] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 30/70. [D 20:41:46.841956] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1011 [D 20:41:46.841994] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 31/70. [D 20:41:46.855664] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.855687] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.855701] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:46.855769] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1013 [D 20:41:46.855785] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.855801] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 32/70. [D 20:41:46.856001] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1013 [D 20:41:46.856027] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 33/70. [D 20:41:46.861314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1011 [D 20:41:46.861382] element 0: offset: 0x2aaaab604450, size: 24 [D 20:41:46.861403] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 34/70. [D 20:41:46.861649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.861669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.861682] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:46.874139] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1013 [D 20:41:46.874209] element 0: offset: 0x2aaaab6271b0, size: 24 [D 20:41:46.874231] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 35/70. [D 20:41:46.874474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.874493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.874507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.908833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.908854] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.908867] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.908989] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1016 [D 20:41:46.909005] element 0: offset: 0x2aaaab60dd50, size: 24 [D 20:41:46.909021] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 36/70. [D 20:41:46.909112] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1016 [D 20:41:46.909151] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 37/70. [D 20:41:46.925396] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1016 [D 20:41:46.925468] element 0: offset: 0x2aaaab60dd50, size: 24 [D 20:41:46.925489] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 38/70. [D 20:41:46.925933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.925954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.925968] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:46.935889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:46.935910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.935923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:46.936045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1019 [D 20:41:46.936061] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:46.936076] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 39/70. [D 20:41:46.936148] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1019 [D 20:41:46.936194] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 40/70. [D 20:41:46.953054] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1019 [D 20:41:46.953125] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:46.953146] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 41/70. [D 20:41:46.953580] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:46.953601] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:46.953615] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.278789] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.278810] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.278823] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.278941] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1022 [D 20:41:47.278957] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.278975] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 42/70. [D 20:41:47.279048] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1022 [D 20:41:47.279106] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 43/70. [D 20:41:47.295304] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1022 [D 20:41:47.295371] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.295392] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 44/70. [D 20:41:47.295844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.295865] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.295878] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.311243] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.311264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.311277] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.311396] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1025 [D 20:41:47.311412] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:47.311427] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 45/70. [D 20:41:47.311500] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1025 [D 20:41:47.311544] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 46/70. [D 20:41:47.329447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1025 [D 20:41:47.329514] element 0: offset: 0x2aaaab628460, size: 24 [D 20:41:47.329535] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 47/70. [D 20:41:47.329986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.330008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.330021] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.336533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.336553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.336566] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.336819] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1028 [D 20:41:47.336837] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.336853] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 48/70. [D 20:41:47.336926] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1028 [D 20:41:47.336970] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 49/70. [D 20:41:47.353803] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1028 [D 20:41:47.353872] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.353893] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 50/70. [D 20:41:47.354354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.354375] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.354389] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.362504] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.362524] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.362537] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.362655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1031 [D 20:41:47.362670] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.362686] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 51/70. [D 20:41:47.362757] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1031 [D 20:41:47.362798] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 52/70. [D 20:41:47.380573] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1031 [D 20:41:47.380642] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.380663] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 53/70. [D 20:41:47.381124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.381146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.381159] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.387355] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.387376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.387389] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.387506] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1034 [D 20:41:47.387522] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.387538] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 54/70. [D 20:41:47.387626] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1034 [D 20:41:47.387657] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 55/70. [D 20:41:47.405550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1034 [D 20:41:47.405619] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.405640] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 56/70. [D 20:41:47.406099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.406120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.406134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.414523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.414544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.414557] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.414675] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1037 [D 20:41:47.414690] element 0: offset: 0x2aaaab6294c0, size: 24 [D 20:41:47.414707] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 57/70. [D 20:41:47.414778] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1037 [D 20:41:47.414823] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 58/70. [D 20:41:47.432763] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1037 [D 20:41:47.432831] element 0: offset: 0x2aaaab6294c0, size: 24 [D 20:41:47.432852] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 59/70. [D 20:41:47.433313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.433334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.433347] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.439141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.439170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.439183] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.439374] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1040 [D 20:41:47.439391] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.439406] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 60/70. [D 20:41:47.439495] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1040 [D 20:41:47.439526] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 0/70. [D 20:41:47.457391] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1040 [D 20:41:47.457459] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.457480] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 1/70. [D 20:41:47.457932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.457954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.457967] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.468096] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.468116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.468129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.468247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1043 [D 20:41:47.468263] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.468282] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 2/70. [D 20:41:47.468354] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1043 [D 20:41:47.468394] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 3/70. [D 20:41:47.486249] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1043 [D 20:41:47.486320] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.486340] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 4/70. [D 20:41:47.486798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.486820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.486833] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.558761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.558781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.558794] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.558914] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1047 [D 20:41:47.558929] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.558944] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 5/70. [D 20:41:47.559018] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1047 [D 20:41:47.559070] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 6/70. [D 20:41:47.575192] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1047 [D 20:41:47.575262] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.575283] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 7/70. [D 20:41:47.578372] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.578399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.578416] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.590338] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.590361] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.590379] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.590426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.590442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.590456] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:47.590844] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1049 [D 20:41:47.590868] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.590890] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 8/70. [D 20:41:47.590914] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1053 [D 20:41:47.590938] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.590953] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 9/70. [D 20:41:47.591207] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1049 [D 20:41:47.591237] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 10/70. [D 20:41:47.591275] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1053 [D 20:41:47.591293] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 11/70. [D 20:41:47.628617] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1049 [D 20:41:47.628693] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.628713] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 12/70. [D 20:41:47.631303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.631362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.631377] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:47.631678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1053 [D 20:41:47.631699] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.631721] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 13/70. [D 20:41:47.631766] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.631781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.631793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.640258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.640278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.640291] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.640448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.640468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.640481] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:47.643485] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1056 [D 20:41:47.643506] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.643521] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 14/70. [D 20:41:47.643541] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1059 [D 20:41:47.643555] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.643569] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 15/70. [D 20:41:47.643625] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1056 [D 20:41:47.643647] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 16/70. [D 20:41:47.643716] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1059 [D 20:41:47.643736] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 17/70. [D 20:41:47.677443] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1056 [D 20:41:47.677512] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.677533] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 18/70. [D 20:41:47.678032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.678051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.678065] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:47.679264] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1059 [D 20:41:47.679285] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.679302] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 19/70. [D 20:41:47.679361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.679378] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.679391] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.685889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.685910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.685923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.686252] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.686272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.686285] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:47.686726] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1061 [D 20:41:47.686747] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:47.686764] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 20/70. [D 20:41:47.686788] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1065 [D 20:41:47.686802] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.686817] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 21/70. [D 20:41:47.686873] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1061 [D 20:41:47.686898] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 22/70. [D 20:41:47.687011] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1065 [D 20:41:47.687035] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 23/70. [D 20:41:47.719380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1061 [D 20:41:47.719451] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:47.719470] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 24/70. [D 20:41:47.722437] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.722456] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.722470] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:47.722747] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1065 [D 20:41:47.722768] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.722784] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 25/70. [D 20:41:47.723230] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.723247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.723264] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.733157] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.733178] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.733191] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.733232] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.733247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.733260] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:47.733464] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1067 [D 20:41:47.733530] element 0: offset: 0x2aaaab6228a0, size: 24 [D 20:41:47.733550] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 26/70. [D 20:41:47.733578] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1070 [D 20:41:47.733594] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:47.733615] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 27/70. [D 20:41:47.733975] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1067 [D 20:41:47.734005] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 28/70. [D 20:41:47.734074] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1070 [D 20:41:47.734093] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 29/70. [D 20:41:47.734142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.734158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.734171] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:47.734364] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1074 [D 20:41:47.734382] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.734399] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 30/70. [D 20:41:47.734637] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1074 [D 20:41:47.762304] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 31/70. [D 20:41:47.767488] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1067 [D 20:41:47.767561] element 0: offset: 0x2aaaab6228a0, size: 24 [D 20:41:47.767581] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 32/70. [D 20:41:47.767735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.767754] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.767767] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:47.779227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.779297] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.779312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:47.779640] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1076 [D 20:41:47.779659] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.779678] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 33/70. [D 20:41:47.779753] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1074 [D 20:41:47.779768] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.779782] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 34/70. [D 20:41:47.781029] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1076 [D 20:41:47.781056] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 35/70. [D 20:41:47.781094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.781108] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.781121] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:47.784210] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1070 [D 20:41:47.784231] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:47.784249] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 36/70. [D 20:41:47.784572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.784591] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.784604] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:47.799703] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1076 [D 20:41:47.799774] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:47.799794] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 37/70. [D 20:41:47.802889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.802910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.802925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.823351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.823373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.823390] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.823611] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1079 [D 20:41:47.823637] element 0: offset: 0x2aaaab62e7f0, size: 24 [D 20:41:47.823653] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 38/70. [D 20:41:47.826915] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1079 [D 20:41:47.826940] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 39/70. [D 20:41:47.845222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1079 [D 20:41:47.845244] element 0: offset: 0x2aaaab62e7f0, size: 24 [D 20:41:47.845260] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 40/70. [D 20:41:47.847403] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.847463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.847477] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.851362] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.851383] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.851396] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.854548] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1082 [D 20:41:47.854570] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:41:47.854589] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 41/70. [D 20:41:47.854766] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1082 [D 20:41:47.854795] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 42/70. [D 20:41:47.872347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1082 [D 20:41:47.872413] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:41:47.872434] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 43/70. [D 20:41:47.872848] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.872870] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.872883] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.878766] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.878789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.878803] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.879312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1085 [D 20:41:47.879332] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.879349] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 44/70. [D 20:41:47.879427] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1085 [D 20:41:47.879464] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 45/70. [D 20:41:47.896953] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1085 [D 20:41:47.897023] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:47.897044] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 46/70. [D 20:41:47.897483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.897504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.897517] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.905379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.905401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.905414] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.905538] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1088 [D 20:41:47.905554] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:47.905569] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 47/70. [D 20:41:47.905643] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1088 [D 20:41:47.905681] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 48/70. [D 20:41:47.921928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1088 [D 20:41:47.921997] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:47.922018] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 49/70. [D 20:41:47.922456] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.922477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.922491] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.932684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.932705] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.932718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.932841] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1091 [D 20:41:47.932857] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.932874] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 50/70. [D 20:41:47.932946] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1091 [D 20:41:47.932982] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 51/70. [D 20:41:47.950027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1091 [D 20:41:47.950099] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:47.950119] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 52/70. [D 20:41:47.950559] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.950580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.950594] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.956682] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.956704] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.956717] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.956948] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1095 [D 20:41:47.956966] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.956983] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 53/70. [D 20:41:47.957056] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1095 [D 20:41:47.957092] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 54/70. [D 20:41:47.972618] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1095 [D 20:41:47.972689] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:47.972709] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 55/70. [D 20:41:47.972957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.972977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.972991] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:47.982798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.982818] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.982831] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:47.982952] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1098 [D 20:41:47.982968] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.982983] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 56/70. [D 20:41:47.983056] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1098 [D 20:41:47.983089] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 57/70. [D 20:41:47.993245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:47.993267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.993281] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:47.993352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1100 [D 20:41:47.993367] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:47.993382] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 58/70. [D 20:41:47.993582] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1100 [D 20:41:47.993605] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 59/70. [D 20:41:47.998860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1098 [D 20:41:47.998932] element 0: offset: 0x2aaaab611420, size: 24 [D 20:41:47.998953] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 60/70. [D 20:41:47.999221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:47.999241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:47.999255] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:48.011656] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1100 [D 20:41:48.011727] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:48.011748] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 0/70. [D 20:41:48.011969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.011990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.012003] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.015100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.015121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.015134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.015340] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1104 [D 20:41:48.015358] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:48.015373] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 1/70. [D 20:41:48.015513] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1104 [D 20:41:48.015562] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 2/70. [D 20:41:48.030575] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.030598] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.030621] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:48.031011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1106 [D 20:41:48.031028] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.031044] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 3/70. [D 20:41:48.034273] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1106 [D 20:41:48.034296] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 4/70. [D 20:41:48.034321] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1104 [D 20:41:48.034340] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:48.034355] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 5/70. [D 20:41:48.034455] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.034470] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.034483] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:48.053065] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1106 [D 20:41:48.053088] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.053103] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 6/70. [D 20:41:48.055182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.055201] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.055214] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.200836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.200899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.200914] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.201158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1109 [D 20:41:48.201177] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:48.201195] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 7/70. [D 20:41:48.203234] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1109 [D 20:41:48.203307] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 8/70. [D 20:41:48.219809] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1109 [D 20:41:48.219879] element 0: offset: 0x2aaaab625b90, size: 24 [D 20:41:48.219900] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 9/70. [D 20:41:48.220336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.220358] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.220371] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.254276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.254297] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.254311] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.254429] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1112 [D 20:41:48.254445] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.254461] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 10/70. [D 20:41:48.254532] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1112 [D 20:41:48.254568] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 11/70. [D 20:41:48.270729] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1112 [D 20:41:48.270799] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.270820] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 12/70. [D 20:41:48.271364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.271384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.271398] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.281693] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.281714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.281727] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.281846] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1115 [D 20:41:48.281861] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.281877] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 13/70. [D 20:41:48.281948] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1115 [D 20:41:48.281986] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 14/70. [D 20:41:48.298129] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1115 [D 20:41:48.298200] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.298220] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 15/70. [D 20:41:48.298658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.298679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.298692] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.458384] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.458405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.458418] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.458540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1118 [D 20:41:48.458555] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:48.458571] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 16/70. [D 20:41:48.458645] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1118 [D 20:41:48.458682] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 17/70. [D 20:41:48.474982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1118 [D 20:41:48.475053] element 0: offset: 0x2aaaab6066a0, size: 24 [D 20:41:48.475074] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 18/70. [D 20:41:48.475565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.475587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.475600] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.492820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.492841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.492854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.492978] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1121 [D 20:41:48.492994] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:48.493010] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 19/70. [D 20:41:48.493086] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1121 [D 20:41:48.493134] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 20/70. [D 20:41:48.509413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1121 [D 20:41:48.509482] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:48.509503] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 21/70. [D 20:41:48.509964] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.509985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.509999] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.519853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.519874] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.519887] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.520006] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1124 [D 20:41:48.520022] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.520037] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 22/70. [D 20:41:48.520109] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1124 [D 20:41:48.520153] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 23/70. [D 20:41:48.536274] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1124 [D 20:41:48.536343] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.536363] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 24/70. [D 20:41:48.536822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.536843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.536856] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.545579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.545600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.545613] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.545733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1127 [D 20:41:48.545749] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.545764] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 25/70. [D 20:41:48.545836] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1127 [D 20:41:48.545885] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 26/70. [D 20:41:48.562011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1127 [D 20:41:48.562082] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:48.562103] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 27/70. [D 20:41:48.562575] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.562596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.562610] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.572083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.572103] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.572116] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.572237] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1130 [D 20:41:48.572253] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:48.572268] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 28/70. [D 20:41:48.572340] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1130 [D 20:41:48.572379] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 29/70. [D 20:41:48.588545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1130 [D 20:41:48.588617] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:48.588638] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 30/70. [D 20:41:48.588918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.588938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.588951] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.599363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.599384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.599397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.599517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1133 [D 20:41:48.599533] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.599548] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 31/70. [D 20:41:48.599636] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1133 [D 20:41:48.599668] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 32/70. [D 20:41:48.617481] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1133 [D 20:41:48.617550] element 0: offset: 0x2aaaab61c2a0, size: 24 [D 20:41:48.617571] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 33/70. [D 20:41:48.619219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.619259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.619276] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.627247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.627272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.627286] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.627408] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1136 [D 20:41:48.627424] element 0: offset: 0x2aaaab6067a0, size: 24 [D 20:41:48.627441] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 34/70. [D 20:41:48.627656] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1136 [D 20:41:48.627685] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 35/70. [D 20:41:48.646520] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1136 [D 20:41:48.646585] element 0: offset: 0x2aaaab6067a0, size: 24 [D 20:41:48.646604] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 36/70. [D 20:41:48.647094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.647115] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.647128] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:48.652452] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:48.652473] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.652485] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:48.652604] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1139 [D 20:41:48.652619] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:48.652635] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 37/70. [D 20:41:48.652706] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1139 [D 20:41:48.652747] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 38/70. [D 20:41:48.669355] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1139 [D 20:41:48.669424] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:48.669445] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 39/70. [D 20:41:48.669907] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:48.669928] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:48.669942] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.074851] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.074876] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.074890] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.075011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1142 [D 20:41:49.075027] element 0: offset: 0x2aaaab623900, size: 24 [D 20:41:49.075044] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 40/70. [D 20:41:49.075119] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1142 [D 20:41:49.075180] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 41/70. [D 20:41:49.092023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1142 [D 20:41:49.092094] element 0: offset: 0x2aaaab623900, size: 24 [D 20:41:49.092115] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 42/70. [D 20:41:49.092578] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.092599] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.092613] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.105694] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.105714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.105728] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.105847] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1145 [D 20:41:49.105863] element 0: offset: 0x2aaaab611520, size: 24 [D 20:41:49.105879] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 43/70. [D 20:41:49.105968] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1145 [D 20:41:49.106003] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 44/70. [D 20:41:49.121982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1145 [D 20:41:49.122052] element 0: offset: 0x2aaaab611520, size: 24 [D 20:41:49.122073] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 45/70. [D 20:41:49.122537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.122558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.122571] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.135126] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.135147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.135160] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.135295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1148 [D 20:41:49.135311] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:49.135327] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 46/70. [D 20:41:49.135398] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1148 [D 20:41:49.135447] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 47/70. [D 20:41:49.153280] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1148 [D 20:41:49.153348] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:49.153368] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 48/70. [D 20:41:49.153829] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.153850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.153864] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.160633] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.160654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.160667] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.160785] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1151 [D 20:41:49.160801] element 0: offset: 0x2aaaab623900, size: 24 [D 20:41:49.160819] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 49/70. [D 20:41:49.160890] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1151 [D 20:41:49.160931] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 50/70. [D 20:41:49.179152] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1151 [D 20:41:49.179233] element 0: offset: 0x2aaaab623900, size: 24 [D 20:41:49.179253] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 51/70. [D 20:41:49.182309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.182335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.182351] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.189203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.189224] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.189241] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.189513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1154 [D 20:41:49.189546] element 0: offset: 0x2aaaab611520, size: 24 [D 20:41:49.189563] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 52/70. [D 20:41:49.192754] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1154 [D 20:41:49.192778] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 53/70. [D 20:41:49.209455] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1154 [D 20:41:49.209477] element 0: offset: 0x2aaaab611520, size: 24 [D 20:41:49.209493] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 54/70. [D 20:41:49.211317] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.211376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.211390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.215551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.215572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.215585] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.215713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1157 [D 20:41:49.215729] element 0: offset: 0x2aaaab60ac30, size: 24 [D 20:41:49.215748] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 55/70. [D 20:41:49.215817] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1157 [D 20:41:49.215878] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 56/70. [D 20:41:49.228102] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.228126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.228141] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.231478] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1161 [D 20:41:49.231500] element 0: offset: 0x2aaaab000ac0, size: 24 [D 20:41:49.231516] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 57/70. [D 20:41:49.236164] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1161 [D 20:41:49.236186] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 58/70. [D 20:41:49.237588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1157 [D 20:41:49.237608] element 0: offset: 0x2aaaab000ae0, size: 24 [D 20:41:49.237624] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 59/70. [D 20:41:49.237718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.237734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.237747] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.251062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.251084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.251098] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.251228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1163 [D 20:41:49.251277] element 0: offset: 0x2aaaab0011c0, size: 24 [D 20:41:49.251294] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 60/70. [D 20:41:49.254596] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1163 [D 20:41:49.254617] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 0/70. [D 20:41:49.256577] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1161 [D 20:41:49.256607] element 0: offset: 0x2aaaab000ac0, size: 24 [D 20:41:49.258104] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 1/70. [D 20:41:49.258341] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.258361] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.258375] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.270600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.270623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.270637] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.270725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1167 [D 20:41:49.270742] element 0: offset: 0x2aaaab0015c0, size: 24 [D 20:41:49.270757] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 2/70. [D 20:41:49.274055] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1167 [D 20:41:49.274078] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 3/70. [D 20:41:49.274288] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1163 [D 20:41:49.274307] element 0: offset: 0x2aaaab0011c0, size: 24 [D 20:41:49.274322] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 4/70. [D 20:41:49.275335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.275400] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.275414] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.287429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.287448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.287465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.291201] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1169 [D 20:41:49.291223] element 0: offset: 0x63fdc0, size: 24 [D 20:41:49.291239] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 5/70. [D 20:41:49.294357] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1169 [D 20:41:49.294380] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 6/70. [D 20:41:49.294600] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1167 [D 20:41:49.294622] element 0: offset: 0x636c90, size: 24 [D 20:41:49.294638] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 7/70. [D 20:41:49.295212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.295232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.295249] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.307731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.307753] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.307766] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.307884] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1173 [D 20:41:49.307901] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.307916] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 8/70. [D 20:41:49.308033] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1173 [D 20:41:49.308076] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 9/70. [D 20:41:49.309514] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1169 [D 20:41:49.309536] element 0: offset: 0x63fdc0, size: 24 [D 20:41:49.309585] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 10/70. [D 20:41:49.309687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.309710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.309723] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.322804] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.322825] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.322839] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.323251] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1175 [D 20:41:49.323269] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.323284] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 11/70. [D 20:41:49.326496] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1175 [D 20:41:49.326518] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 12/70. [D 20:41:49.326622] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1173 [D 20:41:49.326640] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.326655] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 13/70. [D 20:41:49.330014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.330034] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.330047] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.339206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.339238] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.339251] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:49.342533] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1179 [D 20:41:49.342553] element 0: offset: 0x61f0e0, size: 24 [D 20:41:49.342571] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 14/70. [D 20:41:49.342799] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1175 [D 20:41:49.342820] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.342835] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 15/70. [D 20:41:49.346172] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1179 [D 20:41:49.346195] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 16/70. [D 20:41:49.346234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.346249] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.346263] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:49.360130] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1179 [D 20:41:49.360151] element 0: offset: 0x61f0e0, size: 24 [D 20:41:49.360168] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 17/70. [D 20:41:49.363274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.363294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.363307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.367222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.367293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.367307] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.367445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1182 [D 20:41:49.367462] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.367481] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 18/70. [D 20:41:49.367766] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1182 [D 20:41:49.367795] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 19/70. [D 20:41:49.384303] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1182 [D 20:41:49.384372] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.384394] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 20/70. [D 20:41:49.384654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.384673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.384686] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.392129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.392150] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.392163] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.392282] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1185 [D 20:41:49.392297] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.392314] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 21/70. [D 20:41:49.392590] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1185 [D 20:41:49.392617] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 22/70. [D 20:41:49.410438] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1185 [D 20:41:49.410508] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.410530] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 23/70. [D 20:41:49.410792] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.410811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.410824] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.416934] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.416955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.416968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.417086] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1188 [D 20:41:49.417102] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.417119] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 24/70. [D 20:41:49.417393] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1188 [D 20:41:49.417419] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 25/70. [D 20:41:49.434207] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1188 [D 20:41:49.434278] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.434299] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 26/70. [D 20:41:49.434560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.434578] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.434591] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.443946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.443967] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.443979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.444097] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1191 [D 20:41:49.444113] element 0: offset: 0x65a860, size: 24 [D 20:41:49.444129] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 27/70. [D 20:41:49.444403] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1191 [D 20:41:49.444430] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 28/70. [D 20:41:49.461457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1191 [D 20:41:49.461527] element 0: offset: 0x65a860, size: 24 [D 20:41:49.461550] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 29/70. [D 20:41:49.461810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.461829] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.461841] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.489172] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.489192] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.489206] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.489322] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1193 [D 20:41:49.489338] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.489353] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 30/70. [D 20:41:49.489630] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1193 [D 20:41:49.489656] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 31/70. [D 20:41:49.505802] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1193 [D 20:41:49.505871] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.505892] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 32/70. [D 20:41:49.506122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.506140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.506153] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.726586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.726607] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.726621] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.726739] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1196 [D 20:41:49.726755] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.726770] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 33/70. [D 20:41:49.726855] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1196 [D 20:41:49.727054] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 34/70. [D 20:41:49.742992] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1196 [D 20:41:49.743064] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.743086] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 35/70. [D 20:41:49.743469] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.743489] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.743501] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.755344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.755365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.755378] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.755498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1199 [D 20:41:49.755514] element 0: offset: 0x65a860, size: 24 [D 20:41:49.755529] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 36/70. [D 20:41:49.755811] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1199 [D 20:41:49.755837] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 37/70. [D 20:41:49.772717] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1199 [D 20:41:49.772788] element 0: offset: 0x65a860, size: 24 [D 20:41:49.772811] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 38/70. [D 20:41:49.773076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.773094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.773107] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.781861] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.781883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.781895] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.782032] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1202 [D 20:41:49.782048] element 0: offset: 0x62d7a0, size: 24 [D 20:41:49.782063] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 39/70. [D 20:41:49.782136] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1202 [D 20:41:49.782177] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 40/70. [D 20:41:49.799071] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1202 [D 20:41:49.799140] element 0: offset: 0x62d7a0, size: 24 [D 20:41:49.799161] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 41/70. [D 20:41:49.799259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:49.799275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.799288] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:49.991608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:49.991630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:49.991643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:49.991758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1205 [D 20:41:49.991774] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.991789] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 42/70. [D 20:41:49.991973] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1205 [D 20:41:49.992000] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 43/70. [D 20:41:50.009939] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1205 [D 20:41:50.010008] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.010029] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 44/70. [D 20:41:50.013202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.013269] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.013284] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.067217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.067242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.067255] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.067525] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1208 [D 20:41:50.067543] element 0: offset: 0x62d7a0, size: 24 [D 20:41:50.067558] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 45/70. [D 20:41:50.067789] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1208 [D 20:41:50.067816] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 46/70. [D 20:41:50.084724] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1208 [D 20:41:50.084792] element 0: offset: 0x62d7a0, size: 24 [D 20:41:50.084813] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 47/70. [D 20:41:50.085263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.085284] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.085297] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.092427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.092448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.092461] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.092579] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1211 [D 20:41:50.092595] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.092611] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 48/70. [D 20:41:50.092684] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1211 [D 20:41:50.092728] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 49/70. [D 20:41:50.109458] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1211 [D 20:41:50.109527] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.109548] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 50/70. [D 20:41:50.112564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.112590] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.112608] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.123231] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.123253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.123267] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.123479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1214 [D 20:41:50.123497] element 0: offset: 0x62d7a0, size: 24 [D 20:41:50.123521] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 51/70. [D 20:41:50.126751] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1214 [D 20:41:50.126775] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 52/70. [D 20:41:50.141984] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.142004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.142018] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:50.143418] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1218 [D 20:41:50.143437] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.143452] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 53/70. [D 20:41:50.146601] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1218 [D 20:41:50.146624] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 54/70. [D 20:41:50.146676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1214 [D 20:41:50.146695] element 0: offset: 0x62d7a0, size: 24 [D 20:41:50.146717] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 55/70. [D 20:41:50.150130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.150150] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.150164] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:50.162171] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1218 [D 20:41:50.162193] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.162209] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 56/70. [D 20:41:50.163207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.163228] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.163249] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.491133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.491344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.491365] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.491650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1220 [D 20:41:50.491672] element 0: offset: 0x65a860, size: 24 [D 20:41:50.491693] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 57/70. [D 20:41:50.494978] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1220 [D 20:41:50.495004] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 58/70. [D 20:41:50.511957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1220 [D 20:41:50.511980] element 0: offset: 0x65a860, size: 24 [D 20:41:50.511996] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 59/70. [D 20:41:50.516152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.516175] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.516191] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.519231] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.519297] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.519312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.519693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1223 [D 20:41:50.519713] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.519733] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 60/70. [D 20:41:50.519816] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1223 [D 20:41:50.519852] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 0/70. [D 20:41:50.536665] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1223 [D 20:41:50.536734] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.536754] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 1/70. [D 20:41:50.538123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.538144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.538158] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.545141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.545163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.545176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.545298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1226 [D 20:41:50.545315] element 0: offset: 0x65a860, size: 24 [D 20:41:50.545329] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 2/70. [D 20:41:50.545419] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1226 [D 20:41:50.545444] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 3/70. [D 20:41:50.561628] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1226 [D 20:41:50.561699] element 0: offset: 0x65a860, size: 24 [D 20:41:50.561719] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 4/70. [D 20:41:50.562144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.562166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.562179] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.571724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.571745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.571757] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.571878] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1229 [D 20:41:50.571894] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.571911] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 5/70. [D 20:41:50.571985] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1229 [D 20:41:50.572022] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 6/70. [D 20:41:50.588765] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1229 [D 20:41:50.588835] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.588855] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 7/70. [D 20:41:50.589313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.589334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.589348] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.888069] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.888090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.888103] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.888221] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1232 [D 20:41:50.888237] element 0: offset: 0x65a860, size: 24 [D 20:41:50.888252] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 8/70. [D 20:41:50.888341] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1232 [D 20:41:50.888373] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 9/70. [D 20:41:50.906277] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1232 [D 20:41:50.906346] element 0: offset: 0x65a860, size: 24 [D 20:41:50.906366] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 10/70. [D 20:41:50.906831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.906852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.906865] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.916982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.917002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.917015] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.917186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1235 [D 20:41:50.917203] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.917219] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 11/70. [D 20:41:50.917450] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1235 [D 20:41:50.917477] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 12/70. [D 20:41:50.936401] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1235 [D 20:41:50.936470] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.936491] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 13/70. [D 20:41:50.936682] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.936699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.936713] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.942922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.942944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.942956] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.943077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1238 [D 20:41:50.943093] element 0: offset: 0x62fcb0, size: 24 [D 20:41:50.943108] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 14/70. [D 20:41:50.943180] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1238 [D 20:41:50.943250] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 15/70. [D 20:41:50.961655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1238 [D 20:41:50.961723] element 0: offset: 0x62fcb0, size: 24 [D 20:41:50.961743] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 16/70. [D 20:41:50.962193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.962214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.962228] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.969070] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.969092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.969105] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.969224] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1241 [D 20:41:50.969240] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.969255] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 17/70. [D 20:41:50.969329] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1241 [D 20:41:50.969369] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 18/70. [D 20:41:50.988580] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1241 [D 20:41:50.988653] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.988674] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 19/70. [D 20:41:50.989116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:50.989136] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.989150] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:50.996150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:50.996171] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:50.996184] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:50.996555] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1244 [D 20:41:50.996575] element 0: offset: 0x62d7a0, size: 24 [D 20:41:50.996591] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 20/70. [D 20:41:50.996678] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1244 [D 20:41:50.996739] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 21/70. [D 20:41:51.006041] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.006066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.006079] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:51.010814] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1247 [D 20:41:51.010871] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:51.010892] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 22/70. [D 20:41:51.011027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1244 [D 20:41:51.011047] element 0: offset: 0x2aaaab601d80, size: 24 [D 20:41:51.011062] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 23/70. [D 20:41:51.011362] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1247 [D 20:41:51.011401] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 24/70. [D 20:41:51.011447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.011466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.011495] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:51.028869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.028892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.028905] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:51.030359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1251 [D 20:41:51.030377] element 0: offset: 0x2aaaab60d670, size: 24 [D 20:41:51.030406] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 25/70. [D 20:41:51.030613] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1247 [D 20:41:51.030636] element 0: offset: 0x2aaaab6272b0, size: 24 [D 20:41:51.030653] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 26/70. [D 20:41:51.033952] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1251 [D 20:41:51.033979] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 27/70. [D 20:41:51.034004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.034030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.034048] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:51.049875] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1251 [D 20:41:51.049897] element 0: offset: 0x2aaaab60d670, size: 24 [D 20:41:51.049915] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 28/70. [D 20:41:51.053065] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.053086] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.053107] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.539373] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.539446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.539461] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.539751] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1253 [D 20:41:51.539772] element 0: offset: 0x2aaaab60d670, size: 24 [D 20:41:51.539792] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 29/70. [D 20:41:51.542988] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1253 [D 20:41:51.543014] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 30/70. [D 20:41:51.560853] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1253 [D 20:41:51.560878] element 0: offset: 0x2aaaab60d670, size: 24 [D 20:41:51.560894] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 31/70. [D 20:41:51.563884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.563903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.563919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.567219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.567239] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.567253] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.569828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1256 [D 20:41:51.569848] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.569866] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 32/70. [D 20:41:51.569980] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1256 [D 20:41:51.570013] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 33/70. [D 20:41:51.587414] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1256 [D 20:41:51.587436] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.587452] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 34/70. [D 20:41:51.590427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.590447] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.590462] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.596002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.596023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.596039] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.596280] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1259 [D 20:41:51.596299] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.596324] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 35/70. [D 20:41:51.599235] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1259 [D 20:41:51.599259] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 36/70. [D 20:41:51.615407] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1259 [D 20:41:51.615429] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.615446] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 37/70. [D 20:41:51.618542] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.618563] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.618584] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.722904] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.722968] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.722988] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.723380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1262 [D 20:41:51.723403] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.723431] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 38/70. [D 20:41:51.726753] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1262 [D 20:41:51.726780] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 39/70. [D 20:41:51.742881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.742903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.742917] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:51.742986] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1266 [D 20:41:51.743003] element 0: offset: 0x2aaaab6126b0, size: 24 [D 20:41:51.743018] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 40/70. [D 20:41:51.743137] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1266 [D 20:41:51.743181] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 41/70. [D 20:41:51.744881] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1262 [D 20:41:51.744904] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.744926] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 42/70. [D 20:41:51.745195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.745216] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.745237] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:51.758275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.758296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.758310] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:51.758480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1268 [D 20:41:51.758508] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.758524] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 43/70. [D 20:41:51.761729] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1268 [D 20:41:51.761754] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 44/70. [D 20:41:51.761984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1266 [D 20:41:51.762003] element 0: offset: 0x2aaaab6126b0, size: 24 [D 20:41:51.762019] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 45/70. [D 20:41:51.765227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.765247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.765264] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:51.775222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.775243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.775257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:51.777854] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1272 [D 20:41:51.777871] element 0: offset: 0x2aaaab61c3b0, size: 24 [D 20:41:51.777886] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 46/70. [D 20:41:51.777956] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1272 [D 20:41:51.777995] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 47/70. [D 20:41:51.779976] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1268 [D 20:41:51.780016] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.781684] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 48/70. [D 20:41:51.781838] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.781859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.781873] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:51.795427] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1272 [D 20:41:51.795449] element 0: offset: 0x2aaaab61c3b0, size: 24 [D 20:41:51.795466] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 49/70. [D 20:41:51.798583] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.798603] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.798618] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.803221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.803243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.803262] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.805119] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1275 [D 20:41:51.805141] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.805157] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 50/70. [D 20:41:51.807393] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1275 [D 20:41:51.807473] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 51/70. [D 20:41:51.824616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1275 [D 20:41:51.824682] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.824703] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 52/70. [D 20:41:51.824808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.824827] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.824840] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.830537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.830557] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.830570] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.831352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1278 [D 20:41:51.831372] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.831387] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 53/70. [D 20:41:51.831462] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1278 [D 20:41:51.831501] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 54/70. [D 20:41:51.848508] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1278 [D 20:41:51.848576] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.848596] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 55/70. [D 20:41:51.848699] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.848718] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.848731] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.858366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.858386] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.858399] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.858522] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1281 [D 20:41:51.858538] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.858553] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 56/70. [D 20:41:51.858626] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1281 [D 20:41:51.858668] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 57/70. [D 20:41:51.876713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1281 [D 20:41:51.876782] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.876802] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 58/70. [D 20:41:51.877240] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.877261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.877274] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:51.885138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:51.885159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.885172] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:51.885294] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1284 [D 20:41:51.885310] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.885325] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 59/70. [D 20:41:51.885397] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1284 [D 20:41:51.885453] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 60/70. [D 20:41:51.902165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1284 [D 20:41:51.902236] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:51.902257] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 0/70. [D 20:41:51.902697] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:51.902718] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:51.902732] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.019766] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.019793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.019807] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.019928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1286 [D 20:41:52.019944] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:52.019960] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 1/70. [D 20:41:52.020036] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1286 [D 20:41:52.020082] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 2/70. [D 20:41:52.036994] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1286 [D 20:41:52.037064] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:52.037084] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 3/70. [D 20:41:52.037548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.037570] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.037583] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.047242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.047263] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.047276] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.047394] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1289 [D 20:41:52.047410] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:52.047424] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 4/70. [D 20:41:52.047497] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1289 [D 20:41:52.047535] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 5/70. [D 20:41:52.065828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1289 [D 20:41:52.065898] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:52.065919] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 6/70. [D 20:41:52.066377] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.066399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.066413] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.108427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.108448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.108461] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.108581] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1292 [D 20:41:52.108597] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.108612] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 7/70. [D 20:41:52.108686] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1292 [D 20:41:52.108729] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 8/70. [D 20:41:52.127294] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1292 [D 20:41:52.127365] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.127386] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 9/70. [D 20:41:52.128743] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.128765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.128778] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.135363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.135384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.135397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.135517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1295 [D 20:41:52.135533] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.135548] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 10/70. [D 20:41:52.135636] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1295 [D 20:41:52.135676] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 11/70. [D 20:41:52.152118] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1295 [D 20:41:52.152186] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.152207] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 12/70. [D 20:41:52.155245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.155272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.155288] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.163428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.163452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.163466] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.163587] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1298 [D 20:41:52.163602] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.163617] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 13/70. [D 20:41:52.163834] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1298 [D 20:41:52.163863] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 14/70. [D 20:41:52.181457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1298 [D 20:41:52.181524] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.181544] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 15/70. [D 20:41:52.181940] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.181961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.181974] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.370731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.370752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.370765] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.370882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1301 [D 20:41:52.370898] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.370914] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 16/70. [D 20:41:52.370986] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1301 [D 20:41:52.371045] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 17/70. [D 20:41:52.387128] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1301 [D 20:41:52.387197] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.387239] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 18/70. [D 20:41:52.387328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.387345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.387358] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.399004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.399026] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.399039] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.401688] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1304 [D 20:41:52.401707] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.401722] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 19/70. [D 20:41:52.401970] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1304 [D 20:41:52.401999] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 20/70. [D 20:41:52.415893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.415915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.415928] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:52.419785] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1307 [D 20:41:52.419811] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.419830] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 21/70. [D 20:41:52.423022] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1307 [D 20:41:52.423044] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 22/70. [D 20:41:52.423209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1304 [D 20:41:52.423347] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.423367] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 23/70. [D 20:41:52.426722] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.426743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.426758] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:52.438940] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.438961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.438975] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:52.439057] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1310 [D 20:41:52.439074] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.439089] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 24/70. [D 20:41:52.442521] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1310 [D 20:41:52.442544] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 25/70. [D 20:41:52.442565] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1307 [D 20:41:52.442580] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.442594] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 26/70. [D 20:41:52.443241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.443262] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.443284] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:52.458942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.458964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.458978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:52.459233] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1313 [D 20:41:52.459250] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.459266] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 27/70. [D 20:41:52.462595] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1313 [D 20:41:52.462619] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 28/70. [D 20:41:52.462759] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1310 [D 20:41:52.462777] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:52.462792] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 29/70. [D 20:41:52.466196] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.466215] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.466229] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:52.476668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1313 [D 20:41:52.476688] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.476704] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 30/70. [D 20:41:52.479836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.479855] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.479869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.535464] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.535527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.535542] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.535923] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1316 [D 20:41:52.535943] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.535963] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 31/70. [D 20:41:52.536148] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1316 [D 20:41:52.536174] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 32/70. [D 20:41:52.554233] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1316 [D 20:41:52.554302] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.554322] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 33/70. [D 20:41:52.554776] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.554797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.554811] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.807690] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.807710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.807723] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.807858] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1320 [D 20:41:52.807874] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.807889] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 34/70. [D 20:41:52.807979] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1320 [D 20:41:52.808026] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 35/70. [D 20:41:52.825767] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1320 [D 20:41:52.825835] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.825855] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 36/70. [D 20:41:52.826256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.826277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.826290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.831674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.831695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.831708] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.831826] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1323 [D 20:41:52.831841] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.831856] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 37/70. [D 20:41:52.831930] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1323 [D 20:41:52.831980] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 38/70. [D 20:41:52.850999] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1323 [D 20:41:52.851068] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.851087] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 39/70. [D 20:41:52.851494] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.851515] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.851529] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:52.856435] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:52.856456] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.856469] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:52.856587] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1326 [D 20:41:52.856603] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.856618] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 40/70. [D 20:41:52.856690] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1326 [D 20:41:52.856738] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 41/70. [D 20:41:52.875446] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1326 [D 20:41:52.875471] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:52.875490] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 42/70. [D 20:41:52.878559] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:52.878580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:52.878596] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.012683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.012711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.012728] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.013196] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1328 [D 20:41:53.013258] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.013279] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 43/70. [D 20:41:53.014956] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1328 [D 20:41:53.014987] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 44/70. [D 20:41:53.032379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1328 [D 20:41:53.032449] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.032470] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 45/70. [D 20:41:53.035733] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.035766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.035781] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.199195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.199250] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.199267] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.199561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1331 [D 20:41:53.199594] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.199613] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 46/70. [D 20:41:53.202853] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1331 [D 20:41:53.202878] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 47/70. [D 20:41:53.218370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.218392] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.218406] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.219413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1335 [D 20:41:53.219433] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.219448] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 48/70. [D 20:41:53.222565] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1335 [D 20:41:53.222588] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 49/70. [D 20:41:53.222864] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1331 [D 20:41:53.222886] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.222901] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 50/70. [D 20:41:53.223382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.223404] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.223418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.236794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.236816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.236830] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.236989] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1337 [D 20:41:53.237007] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.237022] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 51/70. [D 20:41:53.239288] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1337 [D 20:41:53.239363] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 52/70. [D 20:41:53.239402] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1335 [D 20:41:53.239418] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.239434] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 53/70. [D 20:41:53.239626] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.239646] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.239659] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.255244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.255268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.255282] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.255313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.255328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.255341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:53.255695] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1342 [D 20:41:53.255717] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.255737] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 54/70. [D 20:41:53.255759] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1343 [D 20:41:53.255780] element 0: offset: 0x2aaaab61bf60, size: 24 [D 20:41:53.255795] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 55/70. [D 20:41:53.255819] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1337 [D 20:41:53.255839] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.255854] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 56/70. [D 20:41:53.259065] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1342 [D 20:41:53.259086] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 57/70. [D 20:41:53.259122] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1343 [D 20:41:53.259139] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 58/70. [D 20:41:53.259169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.259184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.259197] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:53.287237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.287259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.287273] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:53.291612] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1346 [D 20:41:53.291636] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.291652] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 59/70. [D 20:41:53.294958] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1346 [D 20:41:53.294980] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 60/70. [D 20:41:53.295251] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1342 [D 20:41:53.295270] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.295289] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 0/70. [D 20:41:53.295309] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1343 [D 20:41:53.295323] element 0: offset: 0x2aaaab61bf60, size: 24 [D 20:41:53.295337] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 1/70. [D 20:41:53.298876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.298896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.298910] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:53.298930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.298944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.298957] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.311665] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1346 [D 20:41:53.311711] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.311731] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 2/70. [D 20:41:53.314864] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.314882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.314896] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.677534] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.677604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.677619] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.677967] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1350 [D 20:41:53.677987] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.678006] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 3/70. [D 20:41:53.681152] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1350 [D 20:41:53.681174] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 4/70. [D 20:41:53.697613] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1350 [D 20:41:53.697635] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.697651] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 5/70. [D 20:41:53.699279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.699346] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.699360] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.702893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.702914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.702927] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.705850] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1353 [D 20:41:53.705871] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.705890] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 6/70. [D 20:41:53.706140] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1353 [D 20:41:53.706167] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 7/70. [D 20:41:53.723347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1353 [D 20:41:53.723373] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.723390] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 8/70. [D 20:41:53.726550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.726570] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.726584] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.731435] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.731456] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.731470] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.731617] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1356 [D 20:41:53.731637] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.731653] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 9/70. [D 20:41:53.731741] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1356 [D 20:41:53.731763] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 10/70. [D 20:41:53.748481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.748501] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.748515] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.749464] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1358 [D 20:41:53.749484] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.749499] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 11/70. [D 20:41:53.751452] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1358 [D 20:41:53.751526] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 12/70. [D 20:41:53.751569] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1356 [D 20:41:53.751587] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.751604] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 13/70. [D 20:41:53.751788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.751807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.751820] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.772827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.772902] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.772918] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.773374] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1361 [D 20:41:53.773396] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.773418] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 14/70. [D 20:41:53.773545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1358 [D 20:41:53.773562] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:53.773578] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 15/70. [D 20:41:53.773630] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1361 [D 20:41:53.773658] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 16/70. [D 20:41:53.773785] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.773802] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.773815] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.787347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.787369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.787382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.791502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1364 [D 20:41:53.791527] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.791544] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 17/70. [D 20:41:53.795763] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1364 [D 20:41:53.795831] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 18/70. [D 20:41:53.795881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.795899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.795912] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:53.795952] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1361 [D 20:41:53.795967] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.795984] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 19/70. [D 20:41:53.796286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.796304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.796317] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:53.796339] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1367 [D 20:41:53.796353] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.796370] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 20/70. [D 20:41:53.799269] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1367 [D 20:41:53.808487] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 21/70. [D 20:41:53.811241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.811260] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.811273] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:53.813409] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1370 [D 20:41:53.813430] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.813446] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 22/70. [D 20:41:53.815670] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1370 [D 20:41:53.815760] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1364 [D 20:41:53.815778] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.815798] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 23/70. [D 20:41:53.815972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.815991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.816005] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:53.821339] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 24/70. [D 20:41:53.826433] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1367 [D 20:41:53.826502] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.826532] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 25/70. [D 20:41:53.826814] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.826836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.826849] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.834327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.834350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.834364] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.839263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1373 [D 20:41:53.839286] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:53.839304] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 26/70. [D 20:41:53.839370] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1370 [D 20:41:53.839391] element 0: offset: 0x2aaaab604550, size: 24 [D 20:41:53.839408] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 27/70. [D 20:41:53.842577] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1373 [D 20:41:53.842596] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 28/70. [D 20:41:53.842623] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.842638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.842652] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.858193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.858214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.858227] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:53.859540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1376 [D 20:41:53.859564] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.859580] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 29/70. [D 20:41:53.863165] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1376 [D 20:41:53.863188] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 30/70. [D 20:41:53.863257] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1373 [D 20:41:53.863274] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:53.863296] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 31/70. [D 20:41:53.863395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.863411] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.863431] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:53.877108] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1376 [D 20:41:53.877153] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:53.877172] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 32/70. [D 20:41:53.879244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.879265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.879281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.930131] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.930177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.930193] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.930498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1379 [D 20:41:53.930520] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.930538] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 33/70. [D 20:41:53.933778] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1379 [D 20:41:53.933802] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 34/70. [D 20:41:53.948921] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1379 [D 20:41:53.948944] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:53.948960] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 35/70. [D 20:41:53.951244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.951264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.951279] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:53.955459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:53.955521] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.955536] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:53.955885] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1382 [D 20:41:53.955906] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:53.955926] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 36/70. [D 20:41:53.956107] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1382 [D 20:41:53.956135] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 37/70. [D 20:41:53.974469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1382 [D 20:41:53.974537] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:53.974558] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 38/70. [D 20:41:53.975020] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:53.975041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:53.975055] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:54.407032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.407053] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.407066] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:54.407186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1385 [D 20:41:54.407202] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:54.407217] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 39/70. [D 20:41:54.410708] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1385 [D 20:41:54.410780] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 40/70. [D 20:41:54.428138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.428205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.428219] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:54.428267] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1385 [D 20:41:54.428283] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:54.428303] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 41/70. [D 20:41:54.428428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.428443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.428456] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:54.428824] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1388 [D 20:41:54.428844] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:54.428861] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 42/70. [D 20:41:54.429051] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1388 [D 20:41:54.429080] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 43/70. [D 20:41:54.445717] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1388 [D 20:41:54.445785] element 0: offset: 0x2aaaab60d2b0, size: 24 [D 20:41:54.445806] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 44/70. [D 20:41:54.445897] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.445913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.445926] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:54.451628] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.451649] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.451662] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:54.451780] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1391 [D 20:41:54.451796] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:54.451811] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 45/70. [D 20:41:54.451883] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1391 [D 20:41:54.451928] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 46/70. [D 20:41:54.470184] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1391 [D 20:41:54.470257] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:54.470278] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 47/70. [D 20:41:54.471291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.471312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.471326] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:54.478505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.478530] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.478543] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:54.478665] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1394 [D 20:41:54.478681] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:54.478697] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 48/70. [D 20:41:54.478786] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1394 [D 20:41:54.478831] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 49/70. [D 20:41:54.497976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.498050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.498065] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:54.498245] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1398 [D 20:41:54.498264] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:54.498282] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 50/70. [D 20:41:54.498361] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1394 [D 20:41:54.498376] element 0: offset: 0x2aaaab61b9d0, size: 24 [D 20:41:54.498390] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 51/70. [D 20:41:54.498540] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1398 [D 20:41:54.498567] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 52/70. [D 20:41:54.498607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.498621] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.498634] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:54.513562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.513582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.513595] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:54.517007] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1400 [D 20:41:54.517067] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:54.517086] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 53/70. [D 20:41:54.520396] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1400 [D 20:41:54.520420] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 54/70. [D 20:41:54.520444] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1398 [D 20:41:54.520459] element 0: offset: 0x2aaaab6088f0, size: 24 [D 20:41:54.520473] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 55/70. [D 20:41:54.520585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.520663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.520678] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:54.536379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.536448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.536462] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:54.536509] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1400 [D 20:41:54.536524] element 0: offset: 0x2aaaab60af90, size: 24 [D 20:41:54.536543] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 56/70. [D 20:41:54.537196] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1404 [D 20:41:54.537217] element 0: offset: 0x2aaaab630bb0, size: 24 [D 20:41:54.537236] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 57/70. [D 20:41:54.537280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.537295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.537307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:54.537365] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1404 [D 20:41:54.537402] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 58/70. [D 20:41:54.549591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.549614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.549627] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:54.552971] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1406 [D 20:41:54.552995] element 0: offset: 0x2aaaab000c60, size: 24 [D 20:41:54.553013] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 59/70. [D 20:41:54.555275] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1406 [D 20:41:54.555299] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 60/70. [D 20:41:54.558478] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1404 [D 20:41:54.558496] element 0: offset: 0x2aaaab000c10, size: 24 [D 20:41:54.558511] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 0/70. [D 20:41:54.558631] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.558650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.558664] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:54.569371] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1406 [D 20:41:54.569392] element 0: offset: 0x2aaaab000c60, size: 24 [D 20:41:54.569407] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 1/70. [D 20:41:54.572450] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.572468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.572480] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:54.575279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:54.575344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.575359] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:54.575504] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1409 [D 20:41:54.575520] element 0: offset: 0x2aaaab0017d0, size: 24 [D 20:41:54.575540] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 2/70. [D 20:41:54.575629] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1409 [D 20:41:54.575665] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 3/70. [D 20:41:54.592232] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1409 [D 20:41:54.592303] element 0: offset: 0x2aaaab0017d0, size: 24 [D 20:41:54.592331] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 4/70. [D 20:41:54.592765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:54.592787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:54.592801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.000883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.000904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.000918] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.001037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1413 [D 20:41:55.001054] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.001069] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 5/70. [D 20:41:55.001143] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1413 [D 20:41:55.001262] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 6/70. [D 20:41:55.018970] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1413 [D 20:41:55.019038] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.019058] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 7/70. [D 20:41:55.019148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.019164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.019177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.025906] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.025927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.025940] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.026060] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1416 [D 20:41:55.026076] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.026091] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 8/70. [D 20:41:55.026327] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1416 [D 20:41:55.026355] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 9/70. [D 20:41:55.045267] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1416 [D 20:41:55.045337] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.045358] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 10/70. [D 20:41:55.045450] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.045467] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.045480] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.051668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.051689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.051701] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.051827] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1419 [D 20:41:55.051842] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.051857] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 11/70. [D 20:41:55.052096] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1419 [D 20:41:55.052124] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 12/70. [D 20:41:55.070784] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1419 [D 20:41:55.070850] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.070871] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 13/70. [D 20:41:55.070958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.070973] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.070986] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.076836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.076858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.076871] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.076988] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1422 [D 20:41:55.077004] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.077019] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 14/70. [D 20:41:55.077108] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1422 [D 20:41:55.077139] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 15/70. [D 20:41:55.092748] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.092768] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.092782] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:55.097494] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1424 [D 20:41:55.097551] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.097571] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 16/70. [D 20:41:55.097704] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1422 [D 20:41:55.097723] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.097737] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 17/70. [D 20:41:55.097959] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1424 [D 20:41:55.097985] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 18/70. [D 20:41:55.098026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.098041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.098055] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:55.113816] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.113835] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.113848] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:55.118446] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1428 [D 20:41:55.118500] element 0: offset: 0x2aaaab00b000, size: 24 [D 20:41:55.118520] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 19/70. [D 20:41:55.118656] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1424 [D 20:41:55.118676] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.118690] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 20/70. [D 20:41:55.118785] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1428 [D 20:41:55.118809] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 21/70. [D 20:41:55.118852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.118866] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.118880] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:55.129872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.129892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.129905] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:55.134560] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1430 [D 20:41:55.134616] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.134636] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 22/70. [D 20:41:55.138005] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1430 [D 20:41:55.138080] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 23/70. [D 20:41:55.138114] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1428 [D 20:41:55.138135] element 0: offset: 0x2aaaab00b000, size: 24 [D 20:41:55.138154] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 24/70. [D 20:41:55.138250] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.138267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.138281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:55.155679] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1430 [D 20:41:55.155705] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.155722] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 25/70. [D 20:41:55.158792] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.158811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.158827] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.207666] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.207719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.207736] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.208013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1433 [D 20:41:55.208048] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.208066] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 26/70. [D 20:41:55.211243] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1433 [D 20:41:55.211267] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 27/70. [D 20:41:55.230790] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1433 [D 20:41:55.230812] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.230828] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 28/70. [D 20:41:55.231256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.231276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.231291] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.239568] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.239631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.239646] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.239775] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1436 [D 20:41:55.239792] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.239811] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 29/70. [D 20:41:55.240030] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1436 [D 20:41:55.240058] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 30/70. [D 20:41:55.259156] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1436 [D 20:41:55.259224] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.259258] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 31/70. [D 20:41:55.259581] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.259600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.259613] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.265432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.265452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.265465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.265588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1439 [D 20:41:55.265604] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:55.265621] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 32/70. [D 20:41:55.265846] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1439 [D 20:41:55.265871] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 33/70. [D 20:41:55.282746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1439 [D 20:41:55.282818] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:55.282838] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 34/70. [D 20:41:55.283381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.283402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.283415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.290927] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.290948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.290961] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.291085] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1442 [D 20:41:55.291102] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.291117] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 35/70. [D 20:41:55.291192] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1442 [D 20:41:55.291231] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 36/70. [D 20:41:55.309957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1442 [D 20:41:55.310028] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.310049] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 37/70. [D 20:41:55.310302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.310322] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.310335] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.315701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.315721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.315734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.315855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1445 [D 20:41:55.315871] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.315886] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 38/70. [D 20:41:55.315959] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1445 [D 20:41:55.316055] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 39/70. [D 20:41:55.335329] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1445 [D 20:41:55.335398] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.335420] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 40/70. [D 20:41:55.335861] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.335882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.335895] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.421898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.421919] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.421932] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.422051] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1449 [D 20:41:55.422067] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.422082] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 41/70. [D 20:41:55.422182] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1449 [D 20:41:55.422213] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 42/70. [D 20:41:55.438071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.438092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.438105] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:55.442726] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.442780] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.442794] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:55.443641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1451 [D 20:41:55.443664] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:55.443684] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 43/70. [D 20:41:55.443716] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1454 [D 20:41:55.443730] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.443744] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 44/70. [D 20:41:55.443763] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1449 [D 20:41:55.443777] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.443791] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 45/70. [D 20:41:55.443913] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1451 [D 20:41:55.443948] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 46/70. [D 20:41:55.443992] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1454 [D 20:41:55.444008] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 47/70. [D 20:41:55.444184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.444202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.444215] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:55.473737] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1451 [D 20:41:55.473809] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:55.473830] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 48/70. [D 20:41:55.473924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.473940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.473953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:55.478507] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1454 [D 20:41:55.478574] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.478598] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 49/70. [D 20:41:55.479035] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.479056] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.479069] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.479765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.479785] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.479799] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.479921] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1457 [D 20:41:55.479937] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.479952] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 50/70. [D 20:41:55.480125] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1457 [D 20:41:55.480203] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 51/70. [D 20:41:55.498356] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1457 [D 20:41:55.498383] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:55.498401] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 52/70. [D 20:41:55.501594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.501615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.501629] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.864892] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.864964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.864979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.865208] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1460 [D 20:41:55.865226] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.865244] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 53/70. [D 20:41:55.867312] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1460 [D 20:41:55.867385] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 54/70. [D 20:41:55.883696] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1460 [D 20:41:55.883720] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:55.883738] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 55/70. [D 20:41:55.886825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.886844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.886858] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:55.891544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:55.891608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.891623] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:55.891767] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1463 [D 20:41:55.891784] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.891804] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 56/70. [D 20:41:55.892148] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1463 [D 20:41:55.892179] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 57/70. [D 20:41:55.911067] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1463 [D 20:41:55.911136] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:55.911164] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 58/70. [D 20:41:55.911248] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:55.911266] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:55.911280] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.104770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.104792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.104805] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.104925] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1467 [D 20:41:56.104941] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:56.104958] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 59/70. [D 20:41:56.105144] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1467 [D 20:41:56.105173] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 60/70. [D 20:41:56.122201] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1467 [D 20:41:56.122268] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:56.122289] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 0/70. [D 20:41:56.123550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.123571] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.123585] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.128423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.128444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.128457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.128576] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1470 [D 20:41:56.128591] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:56.128607] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 1/70. [D 20:41:56.128730] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1470 [D 20:41:56.128756] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 2/70. [D 20:41:56.146832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1470 [D 20:41:56.146900] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:56.146921] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 3/70. [D 20:41:56.147393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.147415] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.147428] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.152658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.152678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.152691] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.152812] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1473 [D 20:41:56.152828] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:56.152844] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 4/70. [D 20:41:56.152966] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1473 [D 20:41:56.152993] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 5/70. [D 20:41:56.170900] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1473 [D 20:41:56.170968] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:56.170989] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 6/70. [D 20:41:56.171512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.171533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.171547] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.176739] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.176759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.176772] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.176894] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1476 [D 20:41:56.176909] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:56.176925] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 7/70. [D 20:41:56.177051] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1476 [D 20:41:56.177076] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 8/70. [D 20:41:56.194227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1476 [D 20:41:56.194293] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:56.194314] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 9/70. [D 20:41:56.194776] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.194797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.194811] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.199754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.199774] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.199788] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.199907] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1479 [D 20:41:56.199923] element 0: offset: 0x2aaaab001820, size: 24 [D 20:41:56.199938] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 10/70. [D 20:41:56.200171] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1479 [D 20:41:56.200198] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 11/70. [D 20:41:56.217956] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1479 [D 20:41:56.218024] element 0: offset: 0x2aaaab001820, size: 24 [D 20:41:56.218044] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 12/70. [D 20:41:56.218506] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.218527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.218541] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.465933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.465954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.465967] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.466087] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1481 [D 20:41:56.466103] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:56.466118] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 13/70. [D 20:41:56.466367] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1481 [D 20:41:56.466394] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 14/70. [D 20:41:56.484514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.484584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.484599] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:56.484771] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1484 [D 20:41:56.484789] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:56.484809] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 15/70. [D 20:41:56.485099] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1484 [D 20:41:56.485125] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 16/70. [D 20:41:56.485233] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1481 [D 20:41:56.485250] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:56.485268] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 17/70. [D 20:41:56.485610] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.485628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.485641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:56.497488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.497509] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.497522] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:56.502224] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1487 [D 20:41:56.502279] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:56.502299] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 18/70. [D 20:41:56.503316] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1487 [D 20:41:56.503394] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 19/70. [D 20:41:56.503430] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1484 [D 20:41:56.503451] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:56.503469] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 20/70. [D 20:41:56.506590] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.506611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.506628] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:56.519724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.519745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.519760] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:56.521411] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1490 [D 20:41:56.521428] element 0: offset: 0x2aaaab001820, size: 24 [D 20:41:56.521447] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 21/70. [D 20:41:56.523402] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1490 [D 20:41:56.523473] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 22/70. [D 20:41:56.523512] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1487 [D 20:41:56.523528] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:56.523545] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 23/70. [D 20:41:56.523736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.523756] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.523769] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:56.538449] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1490 [D 20:41:56.538517] element 0: offset: 0x2aaaab001820, size: 24 [D 20:41:56.538538] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 24/70. [D 20:41:56.538988] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.539010] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.539023] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:56.671260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:56.671281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.671294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:56.671414] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1493 [D 20:41:56.671429] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:56.671444] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 25/70. [D 20:41:56.671691] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1493 [D 20:41:56.671719] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 26/70. [D 20:41:56.689786] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1493 [D 20:41:56.689852] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:56.689873] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 27/70. [D 20:41:56.690335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:56.690356] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:56.690370] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.066519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.066540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.066553] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.066673] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1497 [D 20:41:57.066689] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:57.066705] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 28/70. [D 20:41:57.066979] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1497 [D 20:41:57.067006] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 29/70. [D 20:41:57.085181] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1497 [D 20:41:57.085246] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:57.085267] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 30/70. [D 20:41:57.085719] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.085740] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.085754] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.091523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.091545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.091558] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.091676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1500 [D 20:41:57.091692] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:57.091707] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 31/70. [D 20:41:57.091953] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1500 [D 20:41:57.091980] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 32/70. [D 20:41:57.109823] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1500 [D 20:41:57.109890] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:57.109910] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 33/70. [D 20:41:57.110370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.110391] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.110405] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.115722] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.115743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.115756] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.115875] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1503 [D 20:41:57.115891] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:57.115907] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 34/70. [D 20:41:57.116043] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1503 [D 20:41:57.116080] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 35/70. [D 20:41:57.134601] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1503 [D 20:41:57.134667] element 0: offset: 0x2aaaab002070, size: 24 [D 20:41:57.134688] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 36/70. [D 20:41:57.135301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.135322] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.135336] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.148094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.148114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.148127] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.148247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1505 [D 20:41:57.148263] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:57.148281] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 37/70. [D 20:41:57.148531] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1505 [D 20:41:57.148559] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 38/70. [D 20:41:57.170543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.170612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.170628] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.170912] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1508 [D 20:41:57.170930] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:57.170949] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 39/70. [D 20:41:57.174446] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1508 [D 20:41:57.174525] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 40/70. [D 20:41:57.174561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1505 [D 20:41:57.174580] element 0: offset: 0x2aaaab001f90, size: 24 [D 20:41:57.174598] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 41/70. [D 20:41:57.177839] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.177861] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.177878] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.190562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.190583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.190597] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.191445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1511 [D 20:41:57.191464] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:57.191480] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 42/70. [D 20:41:57.194739] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1511 [D 20:41:57.194762] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 43/70. [D 20:41:57.194861] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1508 [D 20:41:57.194882] element 0: offset: 0x2aaaab001610, size: 24 [D 20:41:57.194897] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 44/70. [D 20:41:57.198193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.198212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.198226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.207274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.207294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.207308] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.209824] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1514 [D 20:41:57.209843] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:57.209858] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 45/70. [D 20:41:57.210105] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1514 [D 20:41:57.210128] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 46/70. [D 20:41:57.211581] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1511 [D 20:41:57.211601] element 0: offset: 0x2aaaab0166c0, size: 24 [D 20:41:57.213719] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 47/70. [D 20:41:57.213898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.213918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.213953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.225273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.225293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.225306] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.225616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1517 [D 20:41:57.225634] element 0: offset: 0x2aaaab001110, size: 24 [D 20:41:57.225650] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 48/70. [D 20:41:57.227545] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1517 [D 20:41:57.227626] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 49/70. [D 20:41:57.227671] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1514 [D 20:41:57.227687] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:41:57.227704] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 50/70. [D 20:41:57.227932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.227951] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.227965] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.240032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.240057] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.240071] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.243653] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1520 [D 20:41:57.243696] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.243716] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 51/70. [D 20:41:57.247134] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1520 [D 20:41:57.247158] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 52/70. [D 20:41:57.247222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1517 [D 20:41:57.247245] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.247266] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 53/70. [D 20:41:57.250618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.250638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.250652] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.261947] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1520 [D 20:41:57.261969] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.261985] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 54/70. [D 20:41:57.265115] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.265134] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.265147] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.299338] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.299408] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.299423] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.299564] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1523 [D 20:41:57.299581] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.299600] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 55/70. [D 20:41:57.299710] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1523 [D 20:41:57.299747] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 56/70. [D 20:41:57.317042] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1523 [D 20:41:57.317107] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.317129] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 57/70. [D 20:41:57.317297] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.317313] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.317327] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.780442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.780463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.780477] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.780598] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1526 [D 20:41:57.780614] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.780630] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 58/70. [D 20:41:57.780718] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1526 [D 20:41:57.780768] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 59/70. [D 20:41:57.800884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.800955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.800970] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.801108] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1529 [D 20:41:57.801127] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.801146] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:41:57.801222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1526 [D 20:41:57.801240] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.801254] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 0/70. [D 20:41:57.801348] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1529 [D 20:41:57.801372] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 1/70. [D 20:41:57.801411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.801425] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.801438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.823071] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1529 [D 20:41:57.823135] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.823157] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 2/70. [D 20:41:57.823570] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.823592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.823605] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:57.830539] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.830560] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.830573] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:57.830695] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1532 [D 20:41:57.830711] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.830739] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 3/70. [D 20:41:57.830827] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1532 [D 20:41:57.830869] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 4/70. [D 20:41:57.843194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.843215] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.843230] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.846356] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1536 [D 20:41:57.846380] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.846397] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 5/70. [D 20:41:57.849743] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1536 [D 20:41:57.849768] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 6/70. [D 20:41:57.849869] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1532 [D 20:41:57.849888] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.849903] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 7/70. [D 20:41:57.851293] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.851313] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.851327] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.867447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.867467] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.867480] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.867560] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1538 [D 20:41:57.867576] element 0: offset: 0x645d60, size: 24 [D 20:41:57.867591] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 8/70. [D 20:41:57.870902] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1538 [D 20:41:57.870924] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 9/70. [D 20:41:57.871037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1536 [D 20:41:57.871054] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.871069] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 10/70. [D 20:41:57.874450] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.874469] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.874482] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.884298] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.884317] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.884331] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.884396] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1542 [D 20:41:57.884412] element 0: offset: 0x6302c0, size: 24 [D 20:41:57.884427] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 11/70. [D 20:41:57.887297] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1542 [D 20:41:57.887320] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 12/70. [D 20:41:57.887340] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1538 [D 20:41:57.887355] element 0: offset: 0x645d60, size: 24 [D 20:41:57.887370] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 13/70. [D 20:41:57.890548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.890567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.890584] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.901910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.901931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.901944] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.902668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1544 [D 20:41:57.902687] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.902701] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 14/70. [D 20:41:57.905951] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1544 [D 20:41:57.905974] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 15/70. [D 20:41:57.905997] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1542 [D 20:41:57.906016] element 0: offset: 0x6302c0, size: 24 [D 20:41:57.906033] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 16/70. [D 20:41:57.906124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.906140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.906153] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.919280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.919300] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.919314] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.922016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1548 [D 20:41:57.922034] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.922049] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 17/70. [D 20:41:57.923377] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1548 [D 20:41:57.923450] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 18/70. [D 20:41:57.923489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1544 [D 20:41:57.923504] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.923521] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 19/70. [D 20:41:57.923714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.923734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.923748] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.936225] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:57.936245] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.936260] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:57.939616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1550 [D 20:41:57.939647] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.939672] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 20/70. [D 20:41:57.943048] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1550 [D 20:41:57.943073] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 21/70. [D 20:41:57.943176] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1548 [D 20:41:57.943193] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.943212] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 22/70. [D 20:41:57.946401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.946421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.946438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:57.960472] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1550 [D 20:41:57.960495] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.960510] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 23/70. [D 20:41:57.963642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:57.963663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:57.963683] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.095286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.095324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.095339] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.097203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1554 [D 20:41:58.097224] element 0: offset: 0x645d60, size: 24 [D 20:41:58.097245] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 24/70. [D 20:41:58.097408] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1554 [D 20:41:58.097429] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 25/70. [D 20:41:58.115202] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1554 [D 20:41:58.115231] element 0: offset: 0x645d60, size: 24 [D 20:41:58.115247] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 26/70. [D 20:41:58.118344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.118363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.118379] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.124361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.124381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.124398] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.124619] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1557 [D 20:41:58.124637] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.124652] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 27/70. [D 20:41:58.127333] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1557 [D 20:41:58.127404] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 28/70. [D 20:41:58.144232] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1557 [D 20:41:58.144300] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.144321] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 29/70. [D 20:41:58.147244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.147271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.147285] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.151300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.151323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.151337] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.151462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1560 [D 20:41:58.151478] element 0: offset: 0x645d60, size: 24 [D 20:41:58.151493] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 30/70. [D 20:41:58.151568] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1560 [D 20:41:58.151614] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 31/70. [D 20:41:58.168305] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1560 [D 20:41:58.168374] element 0: offset: 0x645d60, size: 24 [D 20:41:58.168396] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 32/70. [D 20:41:58.168528] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.168548] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.168561] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.176634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.176654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.176666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.176787] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1563 [D 20:41:58.176802] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.176820] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 33/70. [D 20:41:58.176896] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1563 [D 20:41:58.176932] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 34/70. [D 20:41:58.193132] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1563 [D 20:41:58.193202] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.193223] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 35/70. [D 20:41:58.193685] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.193706] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.193720] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.201431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.201452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.201465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.201584] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1566 [D 20:41:58.201601] element 0: offset: 0x645d60, size: 24 [D 20:41:58.201616] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 36/70. [D 20:41:58.201690] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1566 [D 20:41:58.201724] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 37/70. [D 20:41:58.218222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1566 [D 20:41:58.218292] element 0: offset: 0x645d60, size: 24 [D 20:41:58.218313] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 38/70. [D 20:41:58.218789] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.218811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.218825] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.401679] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.401703] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.401717] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.401837] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1568 [D 20:41:58.401853] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.401870] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 39/70. [D 20:41:58.401944] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1568 [D 20:41:58.401999] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 40/70. [D 20:41:58.418164] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1568 [D 20:41:58.418234] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.418256] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 41/70. [D 20:41:58.418718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.418739] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.418753] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.658637] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.658657] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.658671] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.658790] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1571 [D 20:41:58.658806] element 0: offset: 0x645d60, size: 24 [D 20:41:58.658822] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 42/70. [D 20:41:58.658895] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1571 [D 20:41:58.658936] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 43/70. [D 20:41:58.676642] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1571 [D 20:41:58.676709] element 0: offset: 0x645d60, size: 24 [D 20:41:58.676730] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 44/70. [D 20:41:58.677184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.677205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.677219] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.683119] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.683140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.683153] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.683278] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1574 [D 20:41:58.683294] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.683309] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 45/70. [D 20:41:58.686638] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1574 [D 20:41:58.686670] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 46/70. [D 20:41:58.705217] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1574 [D 20:41:58.705241] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.705259] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 47/70. [D 20:41:58.707406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.707464] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.707479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.710973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.710993] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.711007] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.711133] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1577 [D 20:41:58.711149] element 0: offset: 0x645d60, size: 24 [D 20:41:58.711169] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 48/70. [D 20:41:58.711237] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1577 [D 20:41:58.711282] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 49/70. [D 20:41:58.729482] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1577 [D 20:41:58.729551] element 0: offset: 0x645d60, size: 24 [D 20:41:58.729572] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 50/70. [D 20:41:58.730039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.730061] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.730074] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.736514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.736535] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.736549] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.736667] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1580 [D 20:41:58.736683] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.736700] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 51/70. [D 20:41:58.736774] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1580 [D 20:41:58.736811] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 52/70. [D 20:41:58.753822] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1580 [D 20:41:58.753894] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.753915] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 53/70. [D 20:41:58.754593] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.754615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.754628] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.761876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.761897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.761911] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.762032] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1583 [D 20:41:58.762048] element 0: offset: 0x64ca80, size: 24 [D 20:41:58.762068] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 54/70. [D 20:41:58.762142] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1583 [D 20:41:58.762189] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 55/70. [D 20:41:58.778654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1583 [D 20:41:58.778723] element 0: offset: 0x64ca80, size: 24 [D 20:41:58.778743] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 56/70. [D 20:41:58.779210] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.779231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.779245] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.786915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.786936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.786949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.787068] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1586 [D 20:41:58.787084] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.787100] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 57/70. [D 20:41:58.787189] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1586 [D 20:41:58.787216] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 58/70. [D 20:41:58.805032] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1586 [D 20:41:58.805099] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.805119] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 59/70. [D 20:41:58.805568] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.805589] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.805603] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.810784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.810805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.810818] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.810936] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1589 [D 20:41:58.810952] element 0: offset: 0x645d60, size: 24 [D 20:41:58.810967] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 60/70. [D 20:41:58.811039] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1589 [D 20:41:58.811077] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 0/70. [D 20:41:58.827984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1589 [D 20:41:58.828052] element 0: offset: 0x645d60, size: 24 [D 20:41:58.828073] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 1/70. [D 20:41:58.828533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.828555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.828568] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.907236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.907257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.907276] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.907406] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1592 [D 20:41:58.907422] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.907438] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 2/70. [D 20:41:58.907527] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1592 [D 20:41:58.907572] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 3/70. [D 20:41:58.924234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1592 [D 20:41:58.924303] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.924324] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 4/70. [D 20:41:58.924786] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.924807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.924821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:58.935328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:58.935349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.935362] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:58.935480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1595 [D 20:41:58.935496] element 0: offset: 0x64ca80, size: 24 [D 20:41:58.935512] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 5/70. [D 20:41:58.935585] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1595 [D 20:41:58.935623] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 6/70. [D 20:41:58.952619] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1595 [D 20:41:58.952688] element 0: offset: 0x64ca80, size: 24 [D 20:41:58.952709] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 7/70. [D 20:41:58.955454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:58.955475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:58.955489] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.219642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.219663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.219676] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.219795] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1598 [D 20:41:59.219811] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.219826] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 8/70. [D 20:41:59.219898] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1598 [D 20:41:59.219947] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 9/70. [D 20:41:59.236216] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1598 [D 20:41:59.236284] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.236304] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:41:59.236756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.236777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.236791] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.323021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.323042] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.323055] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.323173] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1601 [D 20:41:59.323189] element 0: offset: 0x645d60, size: 24 [D 20:41:59.323205] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 11/70. [D 20:41:59.323283] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1601 [D 20:41:59.323328] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 12/70. [D 20:41:59.339529] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1601 [D 20:41:59.339599] element 0: offset: 0x645d60, size: 24 [D 20:41:59.339620] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 13/70. [D 20:41:59.339895] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.339916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.339929] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.451028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.451049] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.451062] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.451185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1604 [D 20:41:59.451200] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.451216] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 14/70. [D 20:41:59.452150] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1604 [D 20:41:59.452179] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 15/70. [D 20:41:59.468487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1604 [D 20:41:59.468556] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.468577] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 16/70. [D 20:41:59.469033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.469055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.469068] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.479109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.479130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.479143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.479260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1607 [D 20:41:59.479285] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.479301] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 17/70. [D 20:41:59.479374] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1607 [D 20:41:59.479429] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 18/70. [D 20:41:59.497326] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1607 [D 20:41:59.497395] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.497416] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 19/70. [D 20:41:59.497794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.497815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.497829] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.504775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.504796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.504809] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.504928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1610 [D 20:41:59.504944] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.504962] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 20/70. [D 20:41:59.505036] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1610 [D 20:41:59.505073] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 21/70. [D 20:41:59.521753] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1610 [D 20:41:59.521825] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.521846] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 22/70. [D 20:41:59.523030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.523051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.523065] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.531423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.531443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.531457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.531576] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1613 [D 20:41:59.531592] element 0: offset: 0x645d60, size: 24 [D 20:41:59.531607] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 23/70. [D 20:41:59.531681] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1613 [D 20:41:59.531724] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 24/70. [D 20:41:59.549789] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1613 [D 20:41:59.549860] element 0: offset: 0x645d60, size: 24 [D 20:41:59.549882] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 25/70. [D 20:41:59.550274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.550294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.550308] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.627825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.627845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.627858] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.627976] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1616 [D 20:41:59.627992] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.628008] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 26/70. [D 20:41:59.628097] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1616 [D 20:41:59.628143] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 27/70. [D 20:41:59.641618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.641640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.641654] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.644955] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1620 [D 20:41:59.644980] element 0: offset: 0x61fa30, size: 24 [D 20:41:59.644998] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 28/70. [D 20:41:59.647328] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1620 [D 20:41:59.647351] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 29/70. [D 20:41:59.647495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1616 [D 20:41:59.647554] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.647575] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 30/70. [D 20:41:59.648000] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.648022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.648035] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.664644] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.664717] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.664733] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.664863] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1620 [D 20:41:59.664880] element 0: offset: 0x61fa30, size: 24 [D 20:41:59.664900] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 31/70. [D 20:41:59.664984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1622 [D 20:41:59.665000] element 0: offset: 0x645d60, size: 24 [D 20:41:59.665015] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 32/70. [D 20:41:59.665058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.665072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.665085] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.665138] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1622 [D 20:41:59.665163] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 33/70. [D 20:41:59.676574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.676594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.676607] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.676640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.676654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.676666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:41:59.681253] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1625 [D 20:41:59.681312] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.681334] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 34/70. [D 20:41:59.681365] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1629 [D 20:41:59.681381] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.681395] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 35/70. [D 20:41:59.681496] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1625 [D 20:41:59.681519] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 36/70. [D 20:41:59.681545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1622 [D 20:41:59.681559] element 0: offset: 0x645d60, size: 24 [D 20:41:59.681574] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 37/70. [D 20:41:59.681617] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1629 [D 20:41:59.681635] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 38/70. [D 20:41:59.684813] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.684834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.684851] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:41:59.711415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1625 [D 20:41:59.711442] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.711460] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 39/70. [D 20:41:59.714662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.714682] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.714696] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.715377] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1629 [D 20:41:59.715398] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.715415] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 40/70. [D 20:41:59.718515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.718535] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.718548] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:41:59.727134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.727155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.727168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:41:59.727495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1631 [D 20:41:59.727515] element 0: offset: 0x647750, size: 24 [D 20:41:59.727530] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 41/70. [D 20:41:59.731672] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1631 [D 20:41:59.731745] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 42/70. [D 20:41:59.731797] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.731815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.731829] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.732076] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1635 [D 20:41:59.732095] element 0: offset: 0x647630, size: 24 [D 20:41:59.732112] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 43/70. [D 20:41:59.732279] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1635 [D 20:41:59.743409] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 44/70. [D 20:41:59.748449] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1631 [D 20:41:59.748513] element 0: offset: 0x647750, size: 24 [D 20:41:59.748541] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 45/70. [D 20:41:59.748736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.748759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.748772] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.756220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.756244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.756257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.759301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1637 [D 20:41:59.759325] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.759344] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 46/70. [D 20:41:59.759436] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1637 [D 20:41:59.759470] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 47/70. [D 20:41:59.761389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1635 [D 20:41:59.761412] element 0: offset: 0x647630, size: 24 [D 20:41:59.761428] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 48/70. [D 20:41:59.761519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.761535] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.761548] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.774254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:41:59.774273] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.774287] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:41:59.774407] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1641 [D 20:41:59.774426] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.774441] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 49/70. [D 20:41:59.774557] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1641 [D 20:41:59.774608] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 50/70. [D 20:41:59.776253] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1637 [D 20:41:59.776270] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.776285] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:41:59.776374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.776389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.776403] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:41:59.791206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1641 [D 20:41:59.791227] element 0: offset: 0x64ca80, size: 24 [D 20:41:59.791243] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 52/70. [D 20:41:59.794329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:41:59.794347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:41:59.794361] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.060659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.060721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.060736] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.061077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1643 [D 20:42:00.061097] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.061116] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 53/70. [D 20:42:00.063456] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1643 [D 20:42:00.063533] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 54/70. [D 20:42:00.081029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1643 [D 20:42:00.081099] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.081125] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 55/70. [D 20:42:00.081370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.081388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.081402] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.092651] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.092672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.092685] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.092735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.092750] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.092762] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:00.095561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1647 [D 20:42:00.095581] element 0: offset: 0x647750, size: 24 [D 20:42:00.095597] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 56/70. [D 20:42:00.095621] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1649 [D 20:42:00.095635] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.095650] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 57/70. [D 20:42:00.095706] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1647 [D 20:42:00.095729] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 58/70. [D 20:42:00.095771] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1649 [D 20:42:00.095800] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 59/70. [D 20:42:00.128156] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1647 [D 20:42:00.128233] element 0: offset: 0x647750, size: 24 [D 20:42:00.128254] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 60/70. [D 20:42:00.128358] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.128376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.128389] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:00.134345] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1649 [D 20:42:00.134413] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.134434] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 0/70. [D 20:42:00.134788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.134809] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.134822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.281716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.281736] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.281750] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.281867] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1652 [D 20:42:00.281883] element 0: offset: 0x64b840, size: 24 [D 20:42:00.281898] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 1/70. [D 20:42:00.281987] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1652 [D 20:42:00.282033] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 2/70. [D 20:42:00.298773] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1652 [D 20:42:00.298844] element 0: offset: 0x64b840, size: 24 [D 20:42:00.298865] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 3/70. [D 20:42:00.299244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.299265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.299278] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.308395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.308417] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.308431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.308550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1655 [D 20:42:00.308565] element 0: offset: 0x61fa30, size: 24 [D 20:42:00.308581] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 4/70. [D 20:42:00.308655] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1655 [D 20:42:00.308692] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 5/70. [D 20:42:00.324843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1655 [D 20:42:00.324913] element 0: offset: 0x61fa30, size: 24 [D 20:42:00.324934] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 6/70. [D 20:42:00.325272] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.325293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.325307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.333774] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.333794] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.333807] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.333927] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1658 [D 20:42:00.333943] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.333960] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 7/70. [D 20:42:00.334032] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1658 [D 20:42:00.334067] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 8/70. [D 20:42:00.350959] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1658 [D 20:42:00.351030] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.351050] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 9/70. [D 20:42:00.351426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.351447] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.351460] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.359599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.359620] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.359634] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.359752] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1661 [D 20:42:00.359768] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.359783] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 10/70. [D 20:42:00.359855] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1661 [D 20:42:00.359889] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 11/70. [D 20:42:00.376712] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1661 [D 20:42:00.376783] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.376804] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 12/70. [D 20:42:00.377144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.377165] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.377178] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.383182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.383202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.383215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.383340] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1664 [D 20:42:00.383356] element 0: offset: 0x647630, size: 24 [D 20:42:00.383371] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 13/70. [D 20:42:00.383445] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1664 [D 20:42:00.383478] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 14/70. [D 20:42:00.400860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1664 [D 20:42:00.400930] element 0: offset: 0x647630, size: 24 [D 20:42:00.400950] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 15/70. [D 20:42:00.401327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.401347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.401360] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.574835] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.574859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.574872] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.574992] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1667 [D 20:42:00.575008] element 0: offset: 0x64f010, size: 24 [D 20:42:00.575025] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 16/70. [D 20:42:00.575101] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1667 [D 20:42:00.575151] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 17/70. [D 20:42:00.593114] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1667 [D 20:42:00.593183] element 0: offset: 0x64f010, size: 24 [D 20:42:00.593204] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 18/70. [D 20:42:00.593571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.593591] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.593605] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.601086] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.601107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.601120] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.601237] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1670 [D 20:42:00.601253] element 0: offset: 0x61fad0, size: 24 [D 20:42:00.601269] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 19/70. [D 20:42:00.601342] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1670 [D 20:42:00.601387] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 20/70. [D 20:42:00.618411] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1670 [D 20:42:00.618481] element 0: offset: 0x61fad0, size: 24 [D 20:42:00.618502] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 21/70. [D 20:42:00.618868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.618891] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.618904] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.626386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.626407] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.626420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.626537] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1673 [D 20:42:00.626553] element 0: offset: 0x64ca80, size: 24 [D 20:42:00.626569] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 22/70. [D 20:42:00.626641] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1673 [D 20:42:00.626682] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 23/70. [D 20:42:00.643457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1673 [D 20:42:00.643526] element 0: offset: 0x64ca80, size: 24 [D 20:42:00.643546] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 24/70. [D 20:42:00.643913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.643933] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.643947] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.651665] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.651685] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.651698] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.651816] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1676 [D 20:42:00.651832] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.651847] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 25/70. [D 20:42:00.651919] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1676 [D 20:42:00.651957] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 26/70. [D 20:42:00.668642] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1676 [D 20:42:00.668712] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.668732] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 27/70. [D 20:42:00.669100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.669121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.669134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.677384] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.677405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.677418] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.677535] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1679 [D 20:42:00.677551] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.677566] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 28/70. [D 20:42:00.677638] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1679 [D 20:42:00.677678] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 29/70. [D 20:42:00.693030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1679 [D 20:42:00.693098] element 0: offset: 0x62d7a0, size: 24 [D 20:42:00.693118] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 30/70. [D 20:42:00.693365] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.693384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.693398] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:00.695381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.695402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.695415] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:00.695533] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1683 [D 20:42:00.695549] element 0: offset: 0x62fd50, size: 24 [D 20:42:00.695565] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:42:00.695743] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1683 [D 20:42:00.695937] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 32/70. [D 20:42:00.695976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.695991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.696004] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:00.696192] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1685 [D 20:42:00.696210] element 0: offset: 0x647750, size: 24 [D 20:42:00.696228] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 33/70. [D 20:42:00.696416] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1685 [D 20:42:00.709160] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 34/70. [D 20:42:00.709258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.709281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.709294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:00.709417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1688 [D 20:42:00.709434] element 0: offset: 0x64b840, size: 24 [D 20:42:00.709452] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 35/70. [D 20:42:00.709619] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1688 [D 20:42:00.715154] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1683 [D 20:42:00.715220] element 0: offset: 0x62fd50, size: 24 [D 20:42:00.715240] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 36/70. [D 20:42:00.715446] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.715466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.715479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:00.724402] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 37/70. [D 20:42:00.724463] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:00.724485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.724499] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:00.729451] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1691 [D 20:42:00.729513] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.729538] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 38/70. [D 20:42:00.729863] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1691 [D 20:42:00.729904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1685 [D 20:42:00.729919] element 0: offset: 0x647750, size: 24 [D 20:42:00.729934] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 39/70. [D 20:42:00.730065] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.730083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.730096] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:00.738854] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 40/70. [D 20:42:00.743537] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1688 [D 20:42:00.743562] element 0: offset: 0x64b840, size: 24 [D 20:42:00.743580] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 41/70. [D 20:42:00.746764] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.746787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.746806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:00.756656] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1691 [D 20:42:00.756678] element 0: offset: 0x6491c0, size: 24 [D 20:42:00.756696] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 42/70. [D 20:42:00.759976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:00.760001] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:00.760125] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.147339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.147415] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.147432] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.149011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1695 [D 20:42:01.149035] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.149057] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 43/70. [D 20:42:01.149195] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1695 [D 20:42:01.149226] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 44/70. [D 20:42:01.168405] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1695 [D 20:42:01.168441] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.168460] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 45/70. [D 20:42:01.171522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.171544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.171560] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.174934] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.174999] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.175014] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.175144] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1698 [D 20:42:01.175161] element 0: offset: 0x64f010, size: 24 [D 20:42:01.175183] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 46/70. [D 20:42:01.175387] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1698 [D 20:42:01.175416] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 47/70. [D 20:42:01.190541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.190562] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.190575] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.190642] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1700 [D 20:42:01.190658] element 0: offset: 0x647630, size: 24 [D 20:42:01.190675] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 48/70. [D 20:42:01.190842] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1700 [D 20:42:01.193404] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 49/70. [D 20:42:01.198291] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1698 [D 20:42:01.198353] element 0: offset: 0x64f010, size: 24 [D 20:42:01.198374] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 50/70. [D 20:42:01.198554] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.198575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.198588] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:01.207965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.207986] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.208000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.208046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.208059] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.208072] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:01.211645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1703 [D 20:42:01.211670] element 0: offset: 0x691fe0, size: 24 [D 20:42:01.211688] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 51/70. [D 20:42:01.211713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1707 [D 20:42:01.211728] element 0: offset: 0x654370, size: 24 [D 20:42:01.211743] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 52/70. [D 20:42:01.215250] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1703 [D 20:42:01.215277] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 53/70. [D 20:42:01.215319] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1707 [D 20:42:01.215344] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 54/70. [D 20:42:01.215375] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1700 [D 20:42:01.215400] element 0: offset: 0x647630, size: 24 [D 20:42:01.215418] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 55/70. [D 20:42:01.218833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.218855] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.218877] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:01.243319] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.243341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.243356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:01.244413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1709 [D 20:42:01.244431] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.244446] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 56/70. [D 20:42:01.244521] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1709 [D 20:42:01.244553] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 57/70. [D 20:42:01.247712] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1703 [D 20:42:01.247730] element 0: offset: 0x691fe0, size: 24 [D 20:42:01.247745] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 58/70. [D 20:42:01.247856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.247873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.247886] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:01.250567] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1707 [D 20:42:01.250591] element 0: offset: 0x654370, size: 24 [D 20:42:01.250608] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 59/70. [D 20:42:01.250770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.250799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.250817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:01.254199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.254221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.254236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.254304] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1712 [D 20:42:01.254321] element 0: offset: 0x645d60, size: 24 [D 20:42:01.254336] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 60/70. [D 20:42:01.254393] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1712 [D 20:42:01.254451] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 0/70. [D 20:42:01.258717] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1709 [D 20:42:01.258742] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.258765] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 1/70. [D 20:42:01.258933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.258954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.258976] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:01.267933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.267954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.267968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.268147] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1715 [D 20:42:01.268166] element 0: offset: 0x62fd50, size: 24 [D 20:42:01.268181] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 2/70. [D 20:42:01.268304] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1715 [D 20:42:01.268353] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 3/70. [D 20:42:01.268904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1712 [D 20:42:01.268930] element 0: offset: 0x645d60, size: 24 [D 20:42:01.268946] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 4/70. [D 20:42:01.269027] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.269043] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.269057] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:01.284560] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1715 [D 20:42:01.284584] element 0: offset: 0x62fd50, size: 24 [D 20:42:01.284602] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 5/70. [D 20:42:01.287630] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.287650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.287666] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.835346] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.835424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.835440] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.835821] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1718 [D 20:42:01.835864] element 0: offset: 0x645c70, size: 24 [D 20:42:01.835885] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 6/70. [D 20:42:01.836059] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1718 [D 20:42:01.836090] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 7/70. [D 20:42:01.853246] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1718 [D 20:42:01.853314] element 0: offset: 0x645c70, size: 24 [D 20:42:01.853335] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 8/70. [D 20:42:01.853698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.853719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.853732] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.864294] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.864315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.864329] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.864447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1721 [D 20:42:01.864463] element 0: offset: 0x647750, size: 24 [D 20:42:01.864478] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 9/70. [D 20:42:01.864550] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1721 [D 20:42:01.864597] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 10/70. [D 20:42:01.882483] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1721 [D 20:42:01.882552] element 0: offset: 0x647750, size: 24 [D 20:42:01.882572] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 11/70. [D 20:42:01.882939] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.882963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.882977] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.892055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.892076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.892089] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.892207] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1724 [D 20:42:01.892223] element 0: offset: 0x647630, size: 24 [D 20:42:01.892241] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 12/70. [D 20:42:01.892314] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1724 [D 20:42:01.892357] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 13/70. [D 20:42:01.909918] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1724 [D 20:42:01.909988] element 0: offset: 0x647630, size: 24 [D 20:42:01.910009] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 14/70. [D 20:42:01.910376] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.910397] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.910410] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:01.918161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.918182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.918195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:01.918314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1727 [D 20:42:01.918330] element 0: offset: 0x654370, size: 24 [D 20:42:01.918345] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 15/70. [D 20:42:01.918418] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1727 [D 20:42:01.918465] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 16/70. [D 20:42:01.935755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.935826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.935841] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.935970] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1730 [D 20:42:01.935987] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.936007] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 17/70. [D 20:42:01.936080] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1730 [D 20:42:01.936128] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 18/70. [D 20:42:01.936160] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1727 [D 20:42:01.936179] element 0: offset: 0x654370, size: 24 [D 20:42:01.936195] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 19/70. [D 20:42:01.936515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.936534] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.936547] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:01.947381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.947402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.947416] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:01.947449] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.947462] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.947475] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:01.951509] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1733 [D 20:42:01.951533] element 0: offset: 0x6492c0, size: 24 [D 20:42:01.951551] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 20/70. [D 20:42:01.951576] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1737 [D 20:42:01.951591] element 0: offset: 0x645d60, size: 24 [D 20:42:01.951606] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 21/70. [D 20:42:01.955184] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1733 [D 20:42:01.955211] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 22/70. [D 20:42:01.955254] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1737 [D 20:42:01.955275] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 23/70. [D 20:42:01.955300] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1730 [D 20:42:01.955329] element 0: offset: 0x62d7a0, size: 24 [D 20:42:01.955348] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 24/70. [D 20:42:01.958796] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.958817] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.958834] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:01.983900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.983923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.983937] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:01.983969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:01.983983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.983997] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:01.984070] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1739 [D 20:42:01.984087] element 0: offset: 0x64b940, size: 24 [D 20:42:01.984102] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 25/70. [D 20:42:01.984122] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1742 [D 20:42:01.984137] element 0: offset: 0x647630, size: 24 [D 20:42:01.984152] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 26/70. [D 20:42:01.985933] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1733 [D 20:42:01.985969] element 0: offset: 0x6492c0, size: 24 [D 20:42:01.985989] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 27/70. [D 20:42:01.987455] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1739 [D 20:42:01.987495] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 28/70. [D 20:42:01.987539] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1742 [D 20:42:01.987559] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 29/70. [D 20:42:01.987602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.987618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.987632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:01.990933] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1737 [D 20:42:01.990983] element 0: offset: 0x645d60, size: 24 [D 20:42:01.991004] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 30/70. [D 20:42:01.991267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:01.991286] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:01.991332] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.015311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.015335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.015348] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.015390] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.015404] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.015417] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.017121] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1745 [D 20:42:02.017175] element 0: offset: 0x62fd50, size: 24 [D 20:42:02.017194] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:42:02.017222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1749 [D 20:42:02.017237] element 0: offset: 0x657310, size: 24 [D 20:42:02.017263] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 32/70. [D 20:42:02.017300] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1739 [D 20:42:02.017319] element 0: offset: 0x64b940, size: 24 [D 20:42:02.017337] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 33/70. [D 20:42:02.020750] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1745 [D 20:42:02.020776] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 34/70. [D 20:42:02.020819] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1749 [D 20:42:02.020838] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 35/70. [D 20:42:02.020869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.020887] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.020901] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.024339] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1742 [D 20:42:02.024361] element 0: offset: 0x647630, size: 24 [D 20:42:02.024377] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 36/70. [D 20:42:02.027359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.027423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.027438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.047386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.047409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.047423] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.047458] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.047472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.047485] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.047579] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1751 [D 20:42:02.047596] element 0: offset: 0x647750, size: 24 [D 20:42:02.047611] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 37/70. [D 20:42:02.047630] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1754 [D 20:42:02.047645] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.047659] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 38/70. [D 20:42:02.051051] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1751 [D 20:42:02.051070] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 39/70. [D 20:42:02.051123] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1754 [D 20:42:02.051141] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 40/70. [D 20:42:02.054575] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1745 [D 20:42:02.054596] element 0: offset: 0x62fd50, size: 24 [D 20:42:02.054611] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 41/70. [D 20:42:02.054630] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1749 [D 20:42:02.054645] element 0: offset: 0x657310, size: 24 [D 20:42:02.054659] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 42/70. [D 20:42:02.058114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.058133] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.058147] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.058166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.058180] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.058193] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.075326] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.075347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.075370] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.075398] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.075413] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.075426] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.076968] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1757 [D 20:42:02.076986] element 0: offset: 0x645d60, size: 24 [D 20:42:02.077001] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 43/70. [D 20:42:02.077021] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1761 [D 20:42:02.077036] element 0: offset: 0x6492c0, size: 24 [D 20:42:02.077050] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 44/70. [D 20:42:02.078357] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1751 [D 20:42:02.078430] element 0: offset: 0x647750, size: 24 [D 20:42:02.078451] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 45/70. [D 20:42:02.081728] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1757 [D 20:42:02.081751] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 46/70. [D 20:42:02.081790] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1761 [D 20:42:02.081806] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 47/70. [D 20:42:02.081841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.081857] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.081869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.085731] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1754 [D 20:42:02.085754] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.085770] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 48/70. [D 20:42:02.087448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.087514] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.087530] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.111339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.111387] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.111402] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.111447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.111462] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.111475] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.113865] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1763 [D 20:42:02.113899] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.113919] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 49/70. [D 20:42:02.113947] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1766 [D 20:42:02.113962] element 0: offset: 0x657310, size: 24 [D 20:42:02.113976] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 50/70. [D 20:42:02.114151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1757 [D 20:42:02.114217] element 0: offset: 0x645d60, size: 24 [D 20:42:02.114238] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 51/70. [D 20:42:02.114328] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 1763 [D 20:42:02.114353] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 52/70. [D 20:42:02.114398] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1766 [D 20:42:02.114416] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 53/70. [D 20:42:02.114462] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.114477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.114490] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.119038] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1761 [D 20:42:02.119107] element 0: offset: 0x6492c0, size: 24 [D 20:42:02.119129] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 54/70. [D 20:42:02.119349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.119369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.119382] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.147337] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.147362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.147376] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.147414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.147428] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.147441] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.147843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1770 [D 20:42:02.147868] element 0: offset: 0x62fd80, size: 24 [D 20:42:02.147885] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 55/70. [D 20:42:02.147906] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1772 [D 20:42:02.147925] element 0: offset: 0x64b790, size: 24 [D 20:42:02.147940] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 56/70. [D 20:42:02.151638] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1770 [D 20:42:02.151667] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 57/70. [D 20:42:02.151709] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 1772 [D 20:42:02.151726] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 58/70. [D 20:42:02.154989] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1763 [D 20:42:02.155008] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.155023] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 59/70. [D 20:42:02.155044] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1766 [D 20:42:02.155058] element 0: offset: 0x657310, size: 24 [D 20:42:02.155072] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 60/70. [D 20:42:02.158493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.158513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.158527] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.158548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.158561] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.158574] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.182752] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.182782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.182797] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.182829] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.182844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.182856] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:02.182944] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1775 [D 20:42:02.182961] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.182981] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 0/70. [D 20:42:02.183002] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1778 [D 20:42:02.183022] element 0: offset: 0x64ca80, size: 24 [D 20:42:02.183036] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 1/70. [D 20:42:02.186950] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1775 [D 20:42:02.186974] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 2/70. [D 20:42:02.187017] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1778 [D 20:42:02.187035] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 3/70. [D 20:42:02.187057] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1770 [D 20:42:02.187071] element 0: offset: 0x62fd80, size: 24 [D 20:42:02.187085] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 4/70. [D 20:42:02.192094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.192170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.192185] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:02.195203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1772 [D 20:42:02.195223] element 0: offset: 0x64b790, size: 24 [D 20:42:02.195244] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 5/70. [D 20:42:02.195380] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.195397] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.195410] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.216832] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.216859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.216873] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.218491] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1782 [D 20:42:02.218531] element 0: offset: 0x64b940, size: 24 [D 20:42:02.218549] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 6/70. [D 20:42:02.221971] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1782 [D 20:42:02.221996] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 7/70. [D 20:42:02.222020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1775 [D 20:42:02.222040] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.222056] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 8/70. [D 20:42:02.222158] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.222180] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.222193] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.226076] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1778 [D 20:42:02.226097] element 0: offset: 0x64ca80, size: 24 [D 20:42:02.226114] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 9/70. [D 20:42:02.227321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.227340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.227357] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:02.237754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.237775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.237789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:02.237828] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.237844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.237857] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:02.237879] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1782 [D 20:42:02.237893] element 0: offset: 0x64b940, size: 24 [D 20:42:02.237908] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 10/70. [D 20:42:02.238084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.238119] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.238132] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:02.238155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1784 [D 20:42:02.238169] element 0: offset: 0x64b940, size: 24 [D 20:42:02.238184] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 11/70. [D 20:42:02.238203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1787 [D 20:42:02.238218] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.238232] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 12/70. [D 20:42:02.239374] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1784 [D 20:42:02.239449] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 13/70. [D 20:42:02.239501] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1787 [D 20:42:02.239520] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 14/70. [D 20:42:02.268982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1787 [D 20:42:02.269052] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.269073] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 15/70. [D 20:42:02.269148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.269164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.269177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:02.274165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1784 [D 20:42:02.274232] element 0: offset: 0x64b940, size: 24 [D 20:42:02.274252] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 16/70. [D 20:42:02.274579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.274600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.274613] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.281368] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.281389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.281402] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.284352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1790 [D 20:42:02.284372] element 0: offset: 0x654370, size: 24 [D 20:42:02.284390] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 17/70. [D 20:42:02.284607] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1790 [D 20:42:02.284635] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 18/70. [D 20:42:02.298480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.298501] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.298514] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:02.303155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1793 [D 20:42:02.303213] element 0: offset: 0x62fd80, size: 24 [D 20:42:02.303233] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 19/70. [D 20:42:02.306452] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1793 [D 20:42:02.306482] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 20/70. [D 20:42:02.306505] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1790 [D 20:42:02.306520] element 0: offset: 0x654370, size: 24 [D 20:42:02.306535] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 21/70. [D 20:42:02.306649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.306672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.306685] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:02.321835] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.321857] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.321871] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:02.322158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1796 [D 20:42:02.322177] element 0: offset: 0x657310, size: 24 [D 20:42:02.322192] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 22/70. [D 20:42:02.325410] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1796 [D 20:42:02.325432] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 23/70. [D 20:42:02.325458] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1793 [D 20:42:02.325472] element 0: offset: 0x62fd80, size: 24 [D 20:42:02.325487] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 24/70. [D 20:42:02.325584] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.325600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.325613] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:02.335328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.335349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.335363] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:02.339422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1799 [D 20:42:02.339441] element 0: offset: 0x64b940, size: 24 [D 20:42:02.339456] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 25/70. [D 20:42:02.342646] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1799 [D 20:42:02.342668] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 26/70. [D 20:42:02.342760] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1796 [D 20:42:02.342777] element 0: offset: 0x657310, size: 24 [D 20:42:02.342793] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 27/70. [D 20:42:02.346040] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.346059] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.346072] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:02.357505] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1799 [D 20:42:02.357527] element 0: offset: 0x64b940, size: 24 [D 20:42:02.357541] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 28/70. [D 20:42:02.360653] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.360672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.360686] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.750925] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.750996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.751014] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.751411] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1803 [D 20:42:02.751436] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.751453] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 29/70. [D 20:42:02.754716] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1803 [D 20:42:02.754739] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 30/70. [D 20:42:02.771156] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1803 [D 20:42:02.771179] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.771194] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 31/70. [D 20:42:02.774269] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.774288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.774303] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.780187] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.780207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.780224] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.780351] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1806 [D 20:42:02.780371] element 0: offset: 0x6492c0, size: 24 [D 20:42:02.780386] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 32/70. [D 20:42:02.780501] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1806 [D 20:42:02.780539] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 33/70. [D 20:42:02.798916] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1806 [D 20:42:02.798938] element 0: offset: 0x6492c0, size: 24 [D 20:42:02.798953] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 34/70. [D 20:42:02.802038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.802058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.802074] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.807825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.807844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.807861] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.807985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1809 [D 20:42:02.808003] element 0: offset: 0x64ca80, size: 24 [D 20:42:02.808022] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 35/70. [D 20:42:02.808132] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1809 [D 20:42:02.808180] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 36/70. [D 20:42:02.825471] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1809 [D 20:42:02.825492] element 0: offset: 0x64ca80, size: 24 [D 20:42:02.825507] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 37/70. [D 20:42:02.828556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.828575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.828592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.880204] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.880225] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.880241] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.880484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1811 [D 20:42:02.880520] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.880536] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 38/70. [D 20:42:02.883673] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1811 [D 20:42:02.883696] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 39/70. [D 20:42:02.899873] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1811 [D 20:42:02.899896] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.899911] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 40/70. [D 20:42:02.902937] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.902958] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.902978] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.907340] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.907362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.907381] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.909873] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1814 [D 20:42:02.909894] element 0: offset: 0x645c70, size: 24 [D 20:42:02.909910] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 41/70. [D 20:42:02.911385] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1814 [D 20:42:02.911460] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 42/70. [D 20:42:02.928165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1814 [D 20:42:02.928231] element 0: offset: 0x645c70, size: 24 [D 20:42:02.928252] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 43/70. [D 20:42:02.928354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.928373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.928387] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:02.934487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:02.934506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.934520] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:02.937369] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1817 [D 20:42:02.937388] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.937404] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 44/70. [D 20:42:02.937559] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1817 [D 20:42:02.937586] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 45/70. [D 20:42:02.955005] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1817 [D 20:42:02.955073] element 0: offset: 0x62d7a0, size: 24 [D 20:42:02.955093] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 46/70. [D 20:42:02.955467] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:02.955488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:02.955502] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.129872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.129893] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.129906] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.129953] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.129967] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.129980] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:03.130090] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1821 [D 20:42:03.130106] element 0: offset: 0x6492c0, size: 24 [D 20:42:03.130122] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 47/70. [D 20:42:03.130145] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1823 [D 20:42:03.130160] element 0: offset: 0x64f010, size: 24 [D 20:42:03.130175] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 48/70. [D 20:42:03.130230] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1821 [D 20:42:03.130254] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 49/70. [D 20:42:03.130297] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1823 [D 20:42:03.130337] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 50/70. [D 20:42:03.163476] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1821 [D 20:42:03.163500] element 0: offset: 0x6492c0, size: 24 [D 20:42:03.163518] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 51/70. [D 20:42:03.166628] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.166647] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.166660] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:03.166773] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1823 [D 20:42:03.166791] element 0: offset: 0x64f010, size: 24 [D 20:42:03.166810] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 52/70. [D 20:42:03.169862] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.169880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.169893] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.181148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.181174] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.181187] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.181308] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1826 [D 20:42:03.181324] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.181338] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 53/70. [D 20:42:03.181469] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1826 [D 20:42:03.181508] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 54/70. [D 20:42:03.199863] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1826 [D 20:42:03.199884] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.199899] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 55/70. [D 20:42:03.202978] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.202995] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.203009] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.209586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.209604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.209618] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.209693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1829 [D 20:42:03.209710] element 0: offset: 0x645c70, size: 24 [D 20:42:03.209724] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 56/70. [D 20:42:03.209838] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1829 [D 20:42:03.209878] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 57/70. [D 20:42:03.227379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1829 [D 20:42:03.227401] element 0: offset: 0x645c70, size: 24 [D 20:42:03.227415] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 58/70. [D 20:42:03.230465] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.230484] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.230500] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.236856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.236876] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.236893] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.236983] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1832 [D 20:42:03.237000] element 0: offset: 0x62d7a0, size: 24 [D 20:42:03.237015] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 59/70. [D 20:42:03.237127] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1832 [D 20:42:03.237174] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 60/70. [D 20:42:03.255915] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1832 [D 20:42:03.255937] element 0: offset: 0x62d7a0, size: 24 [D 20:42:03.255952] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 0/70. [D 20:42:03.259029] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.259052] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.259068] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.265876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.265895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.265911] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.266001] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1835 [D 20:42:03.266019] element 0: offset: 0x656ab0, size: 24 [D 20:42:03.266034] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 1/70. [D 20:42:03.266114] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1835 [D 20:42:03.266183] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 2/70. [D 20:42:03.283844] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1835 [D 20:42:03.283865] element 0: offset: 0x656ab0, size: 24 [D 20:42:03.283881] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 3/70. [D 20:42:03.286969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.286988] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.287005] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.523687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.523752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.523767] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.524344] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1839 [D 20:42:03.524364] element 0: offset: 0x6492c0, size: 24 [D 20:42:03.524383] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 4/70. [D 20:42:03.524521] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1839 [D 20:42:03.524548] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 5/70. [D 20:42:03.541758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1839 [D 20:42:03.541780] element 0: offset: 0x6492c0, size: 24 [D 20:42:03.541795] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 6/70. [D 20:42:03.544833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.544853] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.544868] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.551983] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.552046] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.552061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.552342] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1842 [D 20:42:03.552362] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.552384] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 7/70. [D 20:42:03.552548] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1842 [D 20:42:03.552576] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 8/70. [D 20:42:03.571156] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1842 [D 20:42:03.571221] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.571241] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 9/70. [D 20:42:03.571612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.571633] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.571646] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.577909] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.577930] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.577943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.578063] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1845 [D 20:42:03.578079] element 0: offset: 0x64b940, size: 24 [D 20:42:03.578094] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 10/70. [D 20:42:03.578284] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1845 [D 20:42:03.578311] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 11/70. [D 20:42:03.596331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1845 [D 20:42:03.596401] element 0: offset: 0x64b940, size: 24 [D 20:42:03.596421] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 12/70. [D 20:42:03.596812] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.596833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.596846] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.606025] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.606045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.606059] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.606183] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1848 [D 20:42:03.606199] element 0: offset: 0x657310, size: 24 [D 20:42:03.606214] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 13/70. [D 20:42:03.606407] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1848 [D 20:42:03.606434] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 14/70. [D 20:42:03.623456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1848 [D 20:42:03.623527] element 0: offset: 0x657310, size: 24 [D 20:42:03.623548] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 15/70. [D 20:42:03.626913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.626954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.626970] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.637788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.637824] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.637841] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.637991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1851 [D 20:42:03.638010] element 0: offset: 0x656ab0, size: 24 [D 20:42:03.638032] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 16/70. [D 20:42:03.639411] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1851 [D 20:42:03.639440] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 17/70. [D 20:42:03.654640] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1851 [D 20:42:03.654663] element 0: offset: 0x656ab0, size: 24 [D 20:42:03.654679] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 18/70. [D 20:42:03.657684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.657704] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.657721] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.663547] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.663608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.663623] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.663749] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1854 [D 20:42:03.663765] element 0: offset: 0x64ca80, size: 24 [D 20:42:03.663785] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 19/70. [D 20:42:03.663972] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1854 [D 20:42:03.664000] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 20/70. [D 20:42:03.682747] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1854 [D 20:42:03.682816] element 0: offset: 0x64ca80, size: 24 [D 20:42:03.682836] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 21/70. [D 20:42:03.683185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.683206] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.683220] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.689378] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.689399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.689411] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.689533] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1857 [D 20:42:03.689548] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.689564] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 22/70. [D 20:42:03.689754] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1857 [D 20:42:03.689781] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 23/70. [D 20:42:03.707855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1857 [D 20:42:03.707924] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.707945] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 24/70. [D 20:42:03.708294] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.708315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.708329] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.717818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.717839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.717852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.717969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.717984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.717997] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:03.718282] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1860 [D 20:42:03.718302] element 0: offset: 0x63fff0, size: 24 [D 20:42:03.718318] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 25/70. [D 20:42:03.718341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1863 [D 20:42:03.718355] element 0: offset: 0x62d7a0, size: 24 [D 20:42:03.718369] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 26/70. [D 20:42:03.718684] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1860 [D 20:42:03.718712] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 27/70. [D 20:42:03.718754] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1863 [D 20:42:03.718773] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 28/70. [D 20:42:03.751112] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1860 [D 20:42:03.751188] element 0: offset: 0x63fff0, size: 24 [D 20:42:03.751209] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 29/70. [D 20:42:03.751358] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.751377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.751390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:03.757439] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1863 [D 20:42:03.757460] element 0: offset: 0x62d7a0, size: 24 [D 20:42:03.757475] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 30/70. [D 20:42:03.757599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.757617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.757630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.771571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.771591] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.771604] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.771721] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1865 [D 20:42:03.771737] element 0: offset: 0x645d60, size: 24 [D 20:42:03.771751] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 31/70. [D 20:42:03.771964] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1865 [D 20:42:03.771990] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 32/70. [D 20:42:03.790904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1865 [D 20:42:03.790969] element 0: offset: 0x645d60, size: 24 [D 20:42:03.790989] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 33/70. [D 20:42:03.791176] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.791196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.791209] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.798048] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.798069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.798081] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.798203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1868 [D 20:42:03.798219] element 0: offset: 0x6492f0, size: 24 [D 20:42:03.798233] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 34/70. [D 20:42:03.798425] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1868 [D 20:42:03.798452] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 35/70. [D 20:42:03.819245] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1868 [D 20:42:03.819266] element 0: offset: 0x6492f0, size: 24 [D 20:42:03.819280] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 36/70. [D 20:42:03.822239] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.822309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.822324] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.830956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.830977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.830993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.831150] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1871 [D 20:42:03.831170] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.831188] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 37/70. [D 20:42:03.831369] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1871 [D 20:42:03.834450] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 38/70. [D 20:42:03.850010] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1871 [D 20:42:03.850033] element 0: offset: 0x5b0030, size: 24 [D 20:42:03.850048] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 39/70. [D 20:42:03.851380] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.851440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.851454] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.856033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.856054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.856067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.856194] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1874 [D 20:42:03.856211] element 0: offset: 0x66e6f0, size: 24 [D 20:42:03.856231] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 40/70. [D 20:42:03.856342] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1874 [D 20:42:03.856368] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 41/70. [D 20:42:03.875828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1874 [D 20:42:03.875897] element 0: offset: 0x66e6f0, size: 24 [D 20:42:03.875918] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 42/70. [D 20:42:03.876267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.876288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.876301] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.884134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.884154] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.884167] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.884289] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1877 [D 20:42:03.884304] element 0: offset: 0x63fff0, size: 24 [D 20:42:03.884320] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 43/70. [D 20:42:03.884511] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1877 [D 20:42:03.884538] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 44/70. [D 20:42:03.903446] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1877 [D 20:42:03.903516] element 0: offset: 0x63fff0, size: 24 [D 20:42:03.903536] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 45/70. [D 20:42:03.906914] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.906939] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.906956] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.911342] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.911363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.911377] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.912534] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1880 [D 20:42:03.912555] element 0: offset: 0x657310, size: 24 [D 20:42:03.912572] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 46/70. [D 20:42:03.912722] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1880 [D 20:42:03.912747] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 47/70. [D 20:42:03.931659] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1880 [D 20:42:03.931691] element 0: offset: 0x657310, size: 24 [D 20:42:03.931707] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 48/70. [D 20:42:03.934806] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.934826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.934841] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:03.940439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:03.940458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.940474] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:03.940644] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1883 [D 20:42:03.940664] element 0: offset: 0x645c70, size: 24 [D 20:42:03.940678] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 49/70. [D 20:42:03.943352] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1883 [D 20:42:03.943374] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 50/70. [D 20:42:03.960633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1883 [D 20:42:03.960657] element 0: offset: 0x645c70, size: 24 [D 20:42:03.960672] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 51/70. [D 20:42:03.963377] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:03.963439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:03.963453] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.185868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.185888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.185901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.186024] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1886 [D 20:42:04.186041] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.186060] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 52/70. [D 20:42:04.186262] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1886 [D 20:42:04.186289] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 53/70. [D 20:42:04.203462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1886 [D 20:42:04.203529] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.203550] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 54/70. [D 20:42:04.203898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.203918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.203932] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.216071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.216092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.216105] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.216227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1889 [D 20:42:04.216243] element 0: offset: 0x66e6f0, size: 24 [D 20:42:04.216258] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 55/70. [D 20:42:04.216451] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1889 [D 20:42:04.216479] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 56/70. [D 20:42:04.234124] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1889 [D 20:42:04.234193] element 0: offset: 0x66e6f0, size: 24 [D 20:42:04.234213] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 57/70. [D 20:42:04.234596] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.234617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.234630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.240499] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.240519] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.240533] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.240652] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1892 [D 20:42:04.240668] element 0: offset: 0x63fff0, size: 24 [D 20:42:04.240683] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 58/70. [D 20:42:04.240804] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1892 [D 20:42:04.240829] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 59/70. [D 20:42:04.258199] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1892 [D 20:42:04.258267] element 0: offset: 0x63fff0, size: 24 [D 20:42:04.258287] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 60/70. [D 20:42:04.258662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.258683] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.258697] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.265649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.265670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.265683] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.265803] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1895 [D 20:42:04.265819] element 0: offset: 0x645d60, size: 24 [D 20:42:04.265834] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 0/70. [D 20:42:04.265948] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1895 [D 20:42:04.265973] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 1/70. [D 20:42:04.284529] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1895 [D 20:42:04.284596] element 0: offset: 0x645d60, size: 24 [D 20:42:04.284616] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 2/70. [D 20:42:04.284686] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.284701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.284714] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.289824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.289845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.289858] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.289979] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1898 [D 20:42:04.289995] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.290010] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 3/70. [D 20:42:04.290123] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1898 [D 20:42:04.290151] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 4/70. [D 20:42:04.302795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.302814] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.302827] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.307441] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1898 [D 20:42:04.307499] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.307521] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 5/70. [D 20:42:04.307742] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1901 [D 20:42:04.307760] element 0: offset: 0x64b740, size: 24 [D 20:42:04.307777] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 6/70. [D 20:42:04.307818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.307834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.307847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.307907] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1901 [D 20:42:04.308062] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 7/70. [D 20:42:04.325934] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1901 [D 20:42:04.325999] element 0: offset: 0x64b740, size: 24 [D 20:42:04.326021] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 8/70. [D 20:42:04.326178] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.326197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.326210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.328401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.328416] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.328428] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.328554] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1904 [D 20:42:04.328570] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.328585] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 9/70. [D 20:42:04.328670] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1904 [D 20:42:04.328713] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 10/70. [D 20:42:04.342808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.342831] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.342844] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.347484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1907 [D 20:42:04.347545] element 0: offset: 0x645d60, size: 24 [D 20:42:04.347568] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 11/70. [D 20:42:04.347633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1904 [D 20:42:04.347648] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.347678] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 12/70. [D 20:42:04.347737] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1907 [D 20:42:04.347759] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 13/70. [D 20:42:04.347802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.347816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.347829] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.364402] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.364421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.364434] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.369186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1910 [D 20:42:04.369247] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.369267] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 14/70. [D 20:42:04.369348] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1907 [D 20:42:04.369364] element 0: offset: 0x645d60, size: 24 [D 20:42:04.369379] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 15/70. [D 20:42:04.369470] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1910 [D 20:42:04.369493] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 16/70. [D 20:42:04.369535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.369549] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.369562] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.381483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.381503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.381517] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.386116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1913 [D 20:42:04.386176] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.386196] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 17/70. [D 20:42:04.386276] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1910 [D 20:42:04.386291] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.386306] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 18/70. [D 20:42:04.386398] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1913 [D 20:42:04.386423] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 19/70. [D 20:42:04.386465] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.386480] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.386493] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.405623] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.405644] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.405657] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.405734] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1916 [D 20:42:04.405749] element 0: offset: 0x645c70, size: 24 [D 20:42:04.405763] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 20/70. [D 20:42:04.405957] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1916 [D 20:42:04.406030] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 21/70. [D 20:42:04.410596] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1913 [D 20:42:04.410624] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.410643] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 22/70. [D 20:42:04.414094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.414122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.414137] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.419349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.419371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.419385] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.421636] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1919 [D 20:42:04.421667] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.421683] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 23/70. [D 20:42:04.424657] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1919 [D 20:42:04.424734] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 24/70. [D 20:42:04.424775] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1916 [D 20:42:04.424791] element 0: offset: 0x645c70, size: 24 [D 20:42:04.424808] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 25/70. [D 20:42:04.424984] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.425003] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.425016] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.435312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.435339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.435352] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.435461] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1922 [D 20:42:04.435477] element 0: offset: 0x645d60, size: 24 [D 20:42:04.435495] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 26/70. [D 20:42:04.438885] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1922 [D 20:42:04.438913] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 27/70. [D 20:42:04.440609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1919 [D 20:42:04.440632] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.440650] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 28/70. [D 20:42:04.440754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.440771] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.440787] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.455579] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1922 [D 20:42:04.455603] element 0: offset: 0x645d60, size: 24 [D 20:42:04.455620] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 29/70. [D 20:42:04.458562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.458582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.458597] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.465029] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.465050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.465067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.465263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1925 [D 20:42:04.465292] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.465307] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 30/70. [D 20:42:04.467402] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1925 [D 20:42:04.467474] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 31/70. [D 20:42:04.484179] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1925 [D 20:42:04.484245] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.484266] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 32/70. [D 20:42:04.484587] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.484608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.484621] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.490406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.490426] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.490439] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.490561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1928 [D 20:42:04.490577] element 0: offset: 0x645d60, size: 24 [D 20:42:04.490594] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 33/70. [D 20:42:04.490786] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1928 [D 20:42:04.490814] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 34/70. [D 20:42:04.508452] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1928 [D 20:42:04.508519] element 0: offset: 0x645d60, size: 24 [D 20:42:04.508540] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 35/70. [D 20:42:04.508882] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.508903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.508916] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.515269] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.515289] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.515302] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.515439] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1931 [D 20:42:04.515456] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.515471] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 36/70. [D 20:42:04.515578] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1931 [D 20:42:04.515603] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 37/70. [D 20:42:04.532931] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1931 [D 20:42:04.533003] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.533024] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 38/70. [D 20:42:04.533381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.533402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.533416] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.746708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.746735] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.746748] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.746963] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1935 [D 20:42:04.746982] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.747001] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 39/70. [D 20:42:04.747077] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1935 [D 20:42:04.747126] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 40/70. [D 20:42:04.764353] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1935 [D 20:42:04.764425] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.764446] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 41/70. [D 20:42:04.764841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.764862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.764875] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.772990] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.773011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.773024] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.773142] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1938 [D 20:42:04.773157] element 0: offset: 0x6400b0, size: 24 [D 20:42:04.773173] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 42/70. [D 20:42:04.773247] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1938 [D 20:42:04.773289] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 43/70. [D 20:42:04.789938] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1938 [D 20:42:04.790008] element 0: offset: 0x6400b0, size: 24 [D 20:42:04.790029] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 44/70. [D 20:42:04.790403] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.790424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.790437] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.807128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.807149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.807163] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.807280] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1941 [D 20:42:04.807295] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.807311] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 45/70. [D 20:42:04.807387] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1941 [D 20:42:04.807428] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 46/70. [D 20:42:04.824020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1941 [D 20:42:04.824090] element 0: offset: 0x691fe0, size: 24 [D 20:42:04.824117] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 47/70. [D 20:42:04.824466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.824488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.824502] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.832977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.832998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.833012] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.833130] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1944 [D 20:42:04.833146] element 0: offset: 0x64f010, size: 24 [D 20:42:04.833162] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 48/70. [D 20:42:04.833280] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1944 [D 20:42:04.833305] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 49/70. [D 20:42:04.850267] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1944 [D 20:42:04.850336] element 0: offset: 0x64f010, size: 24 [D 20:42:04.850357] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 50/70. [D 20:42:04.850732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.850753] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.850766] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.860594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.860614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.860627] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.860746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1947 [D 20:42:04.860762] element 0: offset: 0x6301f0, size: 24 [D 20:42:04.860777] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 51/70. [D 20:42:04.860850] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1947 [D 20:42:04.860891] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 52/70. [D 20:42:04.878982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1947 [D 20:42:04.879049] element 0: offset: 0x6301f0, size: 24 [D 20:42:04.879070] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 53/70. [D 20:42:04.879462] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.879483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.879496] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.885806] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.885827] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.885840] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.885958] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1950 [D 20:42:04.885974] element 0: offset: 0x62d7a0, size: 24 [D 20:42:04.885989] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 54/70. [D 20:42:04.886061] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1950 [D 20:42:04.886096] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 55/70. [D 20:42:04.902961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1950 [D 20:42:04.903031] element 0: offset: 0x62d7a0, size: 24 [D 20:42:04.903052] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:42:04.903438] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.903459] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.903472] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.913829] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.913849] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.913862] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.913981] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1953 [D 20:42:04.913997] element 0: offset: 0x645c70, size: 24 [D 20:42:04.914013] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 57/70. [D 20:42:04.914086] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1953 [D 20:42:04.914128] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 58/70. [D 20:42:04.926533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.926557] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.926570] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.931243] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1955 [D 20:42:04.931299] element 0: offset: 0x64f010, size: 24 [D 20:42:04.931319] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 59/70. [D 20:42:04.931461] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1955 [D 20:42:04.931489] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 60/70. [D 20:42:04.935055] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1953 [D 20:42:04.935074] element 0: offset: 0x645c70, size: 24 [D 20:42:04.935089] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 0/70. [D 20:42:04.935280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.935299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.935313] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.945288] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.945307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.945320] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.949956] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1959 [D 20:42:04.950012] element 0: offset: 0x636c60, size: 24 [D 20:42:04.950032] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 1/70. [D 20:42:04.951859] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1959 [D 20:42:04.951889] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 2/70. [D 20:42:04.951918] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1955 [D 20:42:04.951932] element 0: offset: 0x64f010, size: 24 [D 20:42:04.951947] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 3/70. [D 20:42:04.952105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.952124] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.952138] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.972992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.973065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.973079] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:04.973346] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1961 [D 20:42:04.973365] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.973384] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 4/70. [D 20:42:04.973462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1959 [D 20:42:04.973477] element 0: offset: 0x636c60, size: 24 [D 20:42:04.973498] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 5/70. [D 20:42:04.973555] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1961 [D 20:42:04.973578] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 6/70. [D 20:42:04.973620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.973634] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.973646] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:04.990787] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1961 [D 20:42:04.990856] element 0: offset: 0x5b0030, size: 24 [D 20:42:04.990877] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 7/70. [D 20:42:04.990966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:04.990982] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.990995] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:04.999380] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:04.999401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:04.999414] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:04.999532] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1964 [D 20:42:04.999548] element 0: offset: 0x6492f0, size: 24 [D 20:42:04.999565] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 8/70. [D 20:42:04.999637] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1964 [D 20:42:04.999684] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 9/70. [D 20:42:05.015732] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1964 [D 20:42:05.015758] element 0: offset: 0x6492f0, size: 24 [D 20:42:05.015777] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 10/70. [D 20:42:05.018853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.018874] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.018889] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.027354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.027390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.027405] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.028343] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1967 [D 20:42:05.028365] element 0: offset: 0x645d60, size: 24 [D 20:42:05.028381] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 11/70. [D 20:42:05.028701] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1967 [D 20:42:05.028729] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 12/70. [D 20:42:05.247484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1967 [D 20:42:05.247556] element 0: offset: 0x645d60, size: 24 [D 20:42:05.247577] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 13/70. [D 20:42:05.250592] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.250614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.250630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.256940] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.256962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.256978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.257380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1970 [D 20:42:05.257405] element 0: offset: 0x64b770, size: 24 [D 20:42:05.257421] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 14/70. [D 20:42:05.259376] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1970 [D 20:42:05.259400] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 15/70. [D 20:42:05.278067] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1970 [D 20:42:05.278089] element 0: offset: 0x64b770, size: 24 [D 20:42:05.278106] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 16/70. [D 20:42:05.281094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.281114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.281129] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.287250] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.287270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.287288] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.287580] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1973 [D 20:42:05.287600] element 0: offset: 0x5b0030, size: 24 [D 20:42:05.287615] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 17/70. [D 20:42:05.290750] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1973 [D 20:42:05.290772] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 18/70. [D 20:42:05.310615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1973 [D 20:42:05.310690] element 0: offset: 0x5b0030, size: 24 [D 20:42:05.310711] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 19/70. [D 20:42:05.313709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.313730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.313746] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.319987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.320008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.320025] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.320392] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1976 [D 20:42:05.320414] element 0: offset: 0x636c60, size: 24 [D 20:42:05.320429] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 20/70. [D 20:42:05.323423] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1976 [D 20:42:05.323496] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 21/70. [D 20:42:05.343435] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1976 [D 20:42:05.343505] element 0: offset: 0x636c60, size: 24 [D 20:42:05.343526] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 22/70. [D 20:42:05.346473] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.346490] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.346503] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.351360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.351380] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.351393] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.351545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1979 [D 20:42:05.351608] element 0: offset: 0x691fe0, size: 24 [D 20:42:05.351630] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 23/70. [D 20:42:05.351733] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1979 [D 20:42:05.352137] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 24/70. [D 20:42:05.371962] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1979 [D 20:42:05.371989] element 0: offset: 0x691fe0, size: 24 [D 20:42:05.372005] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 25/70. [D 20:42:05.375018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.375038] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.375054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.533602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.533623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.533640] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.533852] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1982 [D 20:42:05.533871] element 0: offset: 0x645c70, size: 24 [D 20:42:05.533887] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 26/70. [D 20:42:05.535368] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1982 [D 20:42:05.535395] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 27/70. [D 20:42:05.553169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1982 [D 20:42:05.553190] element 0: offset: 0x645c70, size: 24 [D 20:42:05.553206] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 28/70. [D 20:42:05.556289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.556309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.556326] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:05.567389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.567452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.567467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:05.567593] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1985 [D 20:42:05.567610] element 0: offset: 0x5b0030, size: 24 [D 20:42:05.567630] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 29/70. [D 20:42:05.567815] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1985 [D 20:42:05.567843] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 30/70. [D 20:42:05.581681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.581701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.581714] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.586283] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1988 [D 20:42:05.586339] element 0: offset: 0x6492f0, size: 24 [D 20:42:05.586359] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 31/70. [D 20:42:05.586495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1985 [D 20:42:05.586515] element 0: offset: 0x5b0030, size: 24 [D 20:42:05.586530] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 32/70. [D 20:42:05.586625] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1988 [D 20:42:05.586648] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 33/70. [D 20:42:05.586692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.586706] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.586720] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.605112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.605131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.605144] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.609757] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1991 [D 20:42:05.609813] element 0: offset: 0x645d60, size: 24 [D 20:42:05.609833] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 34/70. [D 20:42:05.613059] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1991 [D 20:42:05.613091] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 35/70. [D 20:42:05.613117] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1988 [D 20:42:05.613138] element 0: offset: 0x6492f0, size: 24 [D 20:42:05.613153] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 36/70. [D 20:42:05.615505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.615528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.615541] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.622648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.622669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.622683] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.627292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1994 [D 20:42:05.627359] element 0: offset: 0x62d7a0, size: 24 [D 20:42:05.627380] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 37/70. [D 20:42:05.627812] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1991 [D 20:42:05.627833] element 0: offset: 0x645d60, size: 24 [D 20:42:05.627849] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 38/70. [D 20:42:05.627909] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 1994 [D 20:42:05.627932] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 39/70. [D 20:42:05.627976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.627991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.628004] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.646234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.646255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.646269] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.651462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1997 [D 20:42:05.651507] element 0: offset: 0x636c60, size: 24 [D 20:42:05.651526] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 40/70. [D 20:42:05.654817] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 1997 [D 20:42:05.654839] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 41/70. [D 20:42:05.870395] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1994 [D 20:42:05.870451] element 0: offset: 0x62d7a0, size: 24 [D 20:42:05.870471] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 42/70. [D 20:42:05.873447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.873465] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.873479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.879381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.879401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.879415] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.880491] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2000 [D 20:42:05.880511] element 0: offset: 0x691fe0, size: 24 [D 20:42:05.880541] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 43/70. [D 20:42:05.882293] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2000 [D 20:42:05.882369] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 44/70. [D 20:42:05.902864] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2000 [D 20:42:05.902887] element 0: offset: 0x691fe0, size: 24 [D 20:42:05.902904] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 45/70. [D 20:42:05.903043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.903062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.903075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.909010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.909030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.909044] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.912149] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2003 [D 20:42:05.912170] element 0: offset: 0x6301f0, size: 24 [D 20:42:05.912185] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 46/70. [D 20:42:05.912319] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2003 [D 20:42:05.912343] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 47/70. [D 20:42:05.932758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2003 [D 20:42:05.932779] element 0: offset: 0x6301f0, size: 24 [D 20:42:05.932794] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 48/70. [D 20:42:05.932918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:05.932936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.932949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:05.938718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:05.938738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:05.938751] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:05.939000] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2006 [D 20:42:05.939020] element 0: offset: 0x62d7a0, size: 24 [D 20:42:05.939035] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 49/70. [D 20:42:05.939173] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2006 [D 20:42:05.939196] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 50/70. [D 20:42:06.011538] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.011559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.011572] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:06.011637] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2010 [D 20:42:06.011653] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.011668] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 51/70. [D 20:42:06.011747] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2010 [D 20:42:06.011795] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 52/70. [D 20:42:06.032040] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2010 [D 20:42:06.032111] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.032131] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 53/70. [D 20:42:06.032480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.032501] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.032514] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:06.038688] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.038709] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.038722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:06.038843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2013 [D 20:42:06.038860] element 0: offset: 0x645c70, size: 24 [D 20:42:06.038877] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 54/70. [D 20:42:06.038950] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2013 [D 20:42:06.038989] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 55/70. [D 20:42:06.055756] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2013 [D 20:42:06.055827] element 0: offset: 0x645c70, size: 24 [D 20:42:06.055847] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 56/70. [D 20:42:06.056190] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.056210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.056224] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:06.064381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.064402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.064415] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:06.064532] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2016 [D 20:42:06.064548] element 0: offset: 0x645d60, size: 24 [D 20:42:06.064564] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 57/70. [D 20:42:06.064636] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2016 [D 20:42:06.064677] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 58/70. [D 20:42:06.422501] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.422566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.422581] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.422707] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2018 [D 20:42:06.422724] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.422743] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 59/70. [D 20:42:06.422829] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2018 [D 20:42:06.422875] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 60/70. [D 20:42:06.442985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2018 [D 20:42:06.443008] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.443024] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 0/70. [D 20:42:06.443156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.443175] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.443188] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.449257] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.449278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.449291] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.449358] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2021 [D 20:42:06.449373] element 0: offset: 0x645c70, size: 24 [D 20:42:06.449390] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 1/70. [D 20:42:06.449448] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2021 [D 20:42:06.449507] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 2/70. [D 20:42:06.468014] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2021 [D 20:42:06.468084] element 0: offset: 0x645c70, size: 24 [D 20:42:06.468106] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 3/70. [D 20:42:06.468451] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.468472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.468485] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.475307] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.475327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.475341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.475544] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2024 [D 20:42:06.475560] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.475576] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 4/70. [D 20:42:06.475648] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2024 [D 20:42:06.475682] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 5/70. [D 20:42:06.491964] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2024 [D 20:42:06.492032] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.492053] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 6/70. [D 20:42:06.492388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.492408] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.492422] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.500530] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.500551] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.500564] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.500682] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2027 [D 20:42:06.500698] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.500713] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 7/70. [D 20:42:06.500786] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2027 [D 20:42:06.500820] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 8/70. [D 20:42:06.517866] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2027 [D 20:42:06.517936] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.517957] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 9/70. [D 20:42:06.518304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.518324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.518338] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.526295] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.526316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.526329] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.526450] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2030 [D 20:42:06.526466] element 0: offset: 0x645c70, size: 24 [D 20:42:06.526481] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 10/70. [D 20:42:06.526553] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2030 [D 20:42:06.526588] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 11/70. [D 20:42:06.542616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2030 [D 20:42:06.542686] element 0: offset: 0x645c70, size: 24 [D 20:42:06.542707] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 12/70. [D 20:42:06.543056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.543077] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.543091] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.551279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.551299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.551312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.551434] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2033 [D 20:42:06.551450] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.551467] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 13/70. [D 20:42:06.551540] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2033 [D 20:42:06.551575] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 14/70. [D 20:42:06.568469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2033 [D 20:42:06.568540] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.568561] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 15/70. [D 20:42:06.568907] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.568928] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.568941] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.576692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.576713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.576726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.576847] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2036 [D 20:42:06.576863] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.576880] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 16/70. [D 20:42:06.576955] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2036 [D 20:42:06.576992] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 17/70. [D 20:42:06.594365] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2006 [D 20:42:06.594440] element 0: offset: 0x62d7a0, size: 24 [D 20:42:06.594461] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 18/70. [D 20:42:06.594694] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.594714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.594728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.596021] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2036 [D 20:42:06.596048] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.596065] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 19/70. [D 20:42:06.596286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.596305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.596318] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:06.601296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.601324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.601337] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:06.601466] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2039 [D 20:42:06.601482] element 0: offset: 0x61e580, size: 24 [D 20:42:06.601499] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 20/70. [D 20:42:06.601577] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2039 [D 20:42:06.601634] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 21/70. [D 20:42:06.613409] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.613483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.613498] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.613645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2042 [D 20:42:06.613662] element 0: offset: 0x62d7a0, size: 24 [D 20:42:06.613682] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 22/70. [D 20:42:06.613946] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2042 [D 20:42:06.613973] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 23/70. [D 20:42:06.863765] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2016 [D 20:42:06.863834] element 0: offset: 0x645d60, size: 24 [D 20:42:06.863856] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 24/70. [D 20:42:06.864084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.864104] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.864118] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.869732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.869753] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.869766] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.869889] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2046 [D 20:42:06.869905] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.869921] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 25/70. [D 20:42:06.870013] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2046 [D 20:42:06.870062] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 26/70. [D 20:42:06.890822] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2046 [D 20:42:06.890891] element 0: offset: 0x5b0030, size: 24 [D 20:42:06.890912] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 27/70. [D 20:42:06.891108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.891127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.891141] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.896341] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.896362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.896375] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.896497] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2049 [D 20:42:06.896513] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.896531] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 28/70. [D 20:42:06.896605] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2049 [D 20:42:06.896640] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 29/70. [D 20:42:06.914324] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2049 [D 20:42:06.914395] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.914416] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 30/70. [D 20:42:06.914767] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.914788] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.914801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.922192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.922213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.922226] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.922347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2052 [D 20:42:06.922363] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.922379] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 31/70. [D 20:42:06.922453] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2052 [D 20:42:06.922488] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 32/70. [D 20:42:06.939084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2052 [D 20:42:06.939154] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.939175] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 33/70. [D 20:42:06.939639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.939660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.939674] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.946304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.946325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.946338] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.946457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2055 [D 20:42:06.946473] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.946488] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 34/70. [D 20:42:06.946562] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2055 [D 20:42:06.946596] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 35/70. [D 20:42:06.963670] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2055 [D 20:42:06.963739] element 0: offset: 0x6492f0, size: 24 [D 20:42:06.963760] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 36/70. [D 20:42:06.964103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.964123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.964137] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:06.971791] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:06.971812] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.971825] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:06.971943] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2058 [D 20:42:06.971959] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.971974] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 37/70. [D 20:42:06.972047] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 2058 [D 20:42:06.972081] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 38/70. [D 20:42:06.988986] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2058 [D 20:42:06.989053] element 0: offset: 0x691fe0, size: 24 [D 20:42:06.989074] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 39/70. [D 20:42:06.989416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:06.989436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:06.989449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:07.093008] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 1997 [D 20:42:07.093084] element 0: offset: 0x636c60, size: 24 [D 20:42:07.093106] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 40/70. [D 20:42:07.093474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.093496] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.093510] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.099859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.099880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.099893] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:07.100013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2060 [D 20:42:07.100029] element 0: offset: 0x6400e0, size: 24 [D 20:42:07.100045] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 41/70. [D 20:42:07.100120] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2060 [D 20:42:07.100156] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 42/70. [D 20:42:07.118184] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2060 [D 20:42:07.118254] element 0: offset: 0x6400e0, size: 24 [D 20:42:07.118275] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 43/70. [D 20:42:07.118626] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.118647] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.118660] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.126695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.126716] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.126729] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:07.126850] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2063 [D 20:42:07.126867] element 0: offset: 0x5b0030, size: 24 [D 20:42:07.126884] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 44/70. [D 20:42:07.126956] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2063 [D 20:42:07.126992] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 45/70. [D 20:42:07.144567] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2063 [D 20:42:07.144637] element 0: offset: 0x5b0030, size: 24 [D 20:42:07.144658] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 46/70. [D 20:42:07.145008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.145029] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.145042] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.151210] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.151231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.151244] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:07.151368] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2066 [D 20:42:07.151384] element 0: offset: 0x691fe0, size: 24 [D 20:42:07.151399] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 47/70. [D 20:42:07.151472] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2066 [D 20:42:07.151507] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 48/70. [D 20:42:07.350697] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2039 [D 20:42:07.350768] element 0: offset: 0x61e580, size: 24 [D 20:42:07.350788] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 49/70. [D 20:42:07.351022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.351042] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.351056] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.356986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.357007] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.357020] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:07.357141] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2069 [D 20:42:07.357156] element 0: offset: 0x645d60, size: 24 [D 20:42:07.357171] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 50/70. [D 20:42:07.357245] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2069 [D 20:42:07.357284] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 51/70. [D 20:42:07.373219] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2069 [D 20:42:07.373287] element 0: offset: 0x645d60, size: 24 [D 20:42:07.373307] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 52/70. [D 20:42:07.373673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.373693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.373707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.382090] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.382111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.382124] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:07.382260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2072 [D 20:42:07.382276] element 0: offset: 0x6492f0, size: 24 [D 20:42:07.382291] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 53/70. [D 20:42:07.382365] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2072 [D 20:42:07.382400] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 54/70. [D 20:42:07.744812] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2042 [D 20:42:07.744885] element 0: offset: 0x62d7a0, size: 24 [D 20:42:07.744907] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 55/70. [D 20:42:07.745144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.745164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.745177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:07.906982] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2066 [D 20:42:07.907056] element 0: offset: 0x691fe0, size: 24 [D 20:42:07.907077] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 56/70. [D 20:42:07.907481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.907502] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.907516] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:07.913487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:07.913508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.913521] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:07.913644] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2075 [D 20:42:07.913660] element 0: offset: 0x636c60, size: 24 [D 20:42:07.913676] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 57/70. [D 20:42:07.913877] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2075 [D 20:42:07.913901] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 58/70. [D 20:42:07.920962] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2072 [D 20:42:07.921028] element 0: offset: 0x6492f0, size: 24 [D 20:42:07.921053] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 59/70. [D 20:42:07.921247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.921265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.921278] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:07.945800] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2075 [D 20:42:07.945868] element 0: offset: 0x636c60, size: 24 [D 20:42:07.945897] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 60/70. [D 20:42:07.946175] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:07.946196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:07.946210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.038193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.038214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.038227] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.038347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2079 [D 20:42:08.038362] element 0: offset: 0x691fe0, size: 24 [D 20:42:08.038378] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 0/70. [D 20:42:08.038569] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2079 [D 20:42:08.038597] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 1/70. [D 20:42:08.055609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2079 [D 20:42:08.055679] element 0: offset: 0x691fe0, size: 24 [D 20:42:08.055700] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 2/70. [D 20:42:08.059188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.059253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.059342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.067530] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.067554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.067568] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.067691] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2082 [D 20:42:08.067707] element 0: offset: 0x5b0030, size: 24 [D 20:42:08.067724] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 3/70. [D 20:42:08.067800] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2082 [D 20:42:08.067838] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 4/70. [D 20:42:08.085676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2082 [D 20:42:08.085751] element 0: offset: 0x5b0030, size: 24 [D 20:42:08.086160] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 5/70. [D 20:42:08.086335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.086383] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.086399] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.094919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.094955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.094972] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.095194] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2085 [D 20:42:08.095215] element 0: offset: 0x6492f0, size: 24 [D 20:42:08.095245] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 6/70. [D 20:42:08.098396] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2085 [D 20:42:08.098421] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 7/70. [D 20:42:08.114885] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2085 [D 20:42:08.114912] element 0: offset: 0x6492f0, size: 24 [D 20:42:08.114930] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 8/70. [D 20:42:08.115379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.115399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.115415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.123589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.123652] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.123666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.123796] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2088 [D 20:42:08.123813] element 0: offset: 0x61e5b0, size: 24 [D 20:42:08.123834] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 9/70. [D 20:42:08.124024] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2088 [D 20:42:08.124051] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 10/70. [D 20:42:08.141869] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2088 [D 20:42:08.141939] element 0: offset: 0x61e5b0, size: 24 [D 20:42:08.141960] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 11/70. [D 20:42:08.143397] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.143432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.143447] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.150239] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.150263] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.150276] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.150398] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2091 [D 20:42:08.150414] element 0: offset: 0x62d7a0, size: 24 [D 20:42:08.150430] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 12/70. [D 20:42:08.150609] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2091 [D 20:42:08.150639] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 13/70. [D 20:42:08.167990] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2091 [D 20:42:08.168065] element 0: offset: 0x62d7a0, size: 24 [D 20:42:08.168086] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 14/70. [D 20:42:08.171202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.171233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.171252] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.176618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.176643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.176656] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.176775] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2094 [D 20:42:08.176791] element 0: offset: 0x645c70, size: 24 [D 20:42:08.176806] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 15/70. [D 20:42:08.176988] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2094 [D 20:42:08.177015] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 16/70. [D 20:42:08.194512] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2094 [D 20:42:08.194577] element 0: offset: 0x645c70, size: 24 [D 20:42:08.194597] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 17/70. [D 20:42:08.194900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.194920] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.194934] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.200027] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.200048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.200061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.200263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2097 [D 20:42:08.200281] element 0: offset: 0x6400e0, size: 24 [D 20:42:08.200298] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 18/70. [D 20:42:08.200369] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2097 [D 20:42:08.200416] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 19/70. [D 20:42:08.218362] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2097 [D 20:42:08.218432] element 0: offset: 0x6400e0, size: 24 [D 20:42:08.218453] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 20/70. [D 20:42:08.218805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.218826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.218839] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.226223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.226243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.226256] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.226455] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2100 [D 20:42:08.226473] element 0: offset: 0x691fe0, size: 24 [D 20:42:08.226492] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 21/70. [D 20:42:08.226563] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2100 [D 20:42:08.226599] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 22/70. [D 20:42:08.243511] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2100 [D 20:42:08.243580] element 0: offset: 0x691fe0, size: 24 [D 20:42:08.243601] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 23/70. [D 20:42:08.246632] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.246656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.246673] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.919414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.919488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.919506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.922231] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2102 [D 20:42:08.922252] element 0: offset: 0x5b0030, size: 24 [D 20:42:08.922274] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 24/70. [D 20:42:08.922415] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2102 [D 20:42:08.922443] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 25/70. [D 20:42:08.939854] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2102 [D 20:42:08.939877] element 0: offset: 0x5b0030, size: 24 [D 20:42:08.939893] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 26/70. [D 20:42:08.942931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.942953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.942973] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.955169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.955190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.955211] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.955572] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2105 [D 20:42:08.955594] element 0: offset: 0x6492f0, size: 24 [D 20:42:08.955609] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 27/70. [D 20:42:08.958767] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2105 [D 20:42:08.958789] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 28/70. [D 20:42:08.975333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2105 [D 20:42:08.975354] element 0: offset: 0x6492f0, size: 24 [D 20:42:08.975371] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 29/70. [D 20:42:08.978416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:08.978436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.978451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:08.985264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:08.985327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:08.985342] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:08.985489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2108 [D 20:42:08.985510] element 0: offset: 0x645d60, size: 24 [D 20:42:08.985530] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 30/70. [D 20:42:08.985666] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2108 [D 20:42:08.985702] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 31/70. [D 20:42:09.004091] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2108 [D 20:42:09.004160] element 0: offset: 0x645d60, size: 24 [D 20:42:09.004181] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 32/70. [D 20:42:09.004561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.004582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.004595] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:09.011116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.011137] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.011150] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:09.014014] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2111 [D 20:42:09.014033] element 0: offset: 0x61e5b0, size: 24 [D 20:42:09.014050] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 33/70. [D 20:42:09.014202] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2111 [D 20:42:09.014230] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 34/70. [D 20:42:09.033214] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2111 [D 20:42:09.033283] element 0: offset: 0x61e5b0, size: 24 [D 20:42:09.033304] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 35/70. [D 20:42:09.033491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.033511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.033524] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:09.041231] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.041252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.041265] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:09.041385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2114 [D 20:42:09.041401] element 0: offset: 0x645c70, size: 24 [D 20:42:09.041418] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 36/70. [D 20:42:09.041610] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2114 [D 20:42:09.041637] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 37/70. [D 20:42:09.054068] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.054089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.054103] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.058764] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2117 [D 20:42:09.058821] element 0: offset: 0x6400e0, size: 24 [D 20:42:09.058840] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 38/70. [D 20:42:09.062212] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2117 [D 20:42:09.062290] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 39/70. [D 20:42:09.062328] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2114 [D 20:42:09.062344] element 0: offset: 0x645c70, size: 24 [D 20:42:09.062361] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 40/70. [D 20:42:09.063406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.063429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.063446] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.079683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.079704] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.079718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.081242] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2120 [D 20:42:09.081261] element 0: offset: 0x62d7a0, size: 24 [D 20:42:09.081276] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 41/70. [D 20:42:09.084432] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2120 [D 20:42:09.084455] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 42/70. [D 20:42:09.084479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2117 [D 20:42:09.084494] element 0: offset: 0x6400e0, size: 24 [D 20:42:09.084509] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 43/70. [D 20:42:09.084627] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.084644] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.084657] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.098959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.098981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.098994] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.099224] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2123 [D 20:42:09.099243] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.099258] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 44/70. [D 20:42:09.099404] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2123 [D 20:42:09.099425] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 45/70. [D 20:42:09.102583] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2120 [D 20:42:09.102603] element 0: offset: 0x62d7a0, size: 24 [D 20:42:09.102621] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 46/70. [D 20:42:09.102719] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.102736] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.102749] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.115365] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.115483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.115500] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.115682] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2126 [D 20:42:09.115698] element 0: offset: 0x657310, size: 24 [D 20:42:09.115713] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 47/70. [D 20:42:09.118946] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2126 [D 20:42:09.118968] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 48/70. [D 20:42:09.118990] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2123 [D 20:42:09.119005] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.119021] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 49/70. [D 20:42:09.119111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.119127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.119147] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.133856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.133877] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.133891] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.133920] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.133935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.133948] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:09.135305] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2130 [D 20:42:09.135340] element 0: offset: 0x6400e0, size: 24 [D 20:42:09.135356] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 50/70. [D 20:42:09.135382] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2132 [D 20:42:09.135401] element 0: offset: 0x636ca0, size: 24 [D 20:42:09.135416] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 51/70. [D 20:42:09.139465] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2130 [D 20:42:09.140224] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 52/70. [D 20:42:09.140269] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2132 [D 20:42:09.140287] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 53/70. [D 20:42:09.140312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2126 [D 20:42:09.140328] element 0: offset: 0x657310, size: 24 [D 20:42:09.140343] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 54/70. [D 20:42:09.140445] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.140463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.140477] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:09.167300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.167334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.167348] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:09.167489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2135 [D 20:42:09.167507] element 0: offset: 0x645c70, size: 24 [D 20:42:09.167522] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 55/70. [D 20:42:09.170838] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2135 [D 20:42:09.170857] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 56/70. [D 20:42:09.173870] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2130 [D 20:42:09.173891] element 0: offset: 0x6400e0, size: 24 [D 20:42:09.173910] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 57/70. [D 20:42:09.173929] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2132 [D 20:42:09.173946] element 0: offset: 0x636ca0, size: 24 [D 20:42:09.173962] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 58/70. [D 20:42:09.177232] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.177252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.177269] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:09.177289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.177303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.177316] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.183395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.183416] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.183430] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.187055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.187076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.187090] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:09.187116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2135 [D 20:42:09.187131] element 0: offset: 0x645c70, size: 24 [D 20:42:09.187146] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 59/70. [D 20:42:09.187166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2138 [D 20:42:09.187181] element 0: offset: 0x62d7a0, size: 24 [D 20:42:09.187195] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 60/70. [D 20:42:09.187279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.187296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.187309] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:09.187355] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2141 [D 20:42:09.187371] element 0: offset: 0x645c70, size: 24 [D 20:42:09.187398] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 0/70. [D 20:42:09.190481] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2138 [D 20:42:09.190520] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2141 [D 20:42:09.195149] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 1/70. [D 20:42:09.195264] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 2/70. [D 20:42:09.223508] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2138 [D 20:42:09.223529] element 0: offset: 0x62d7a0, size: 24 [D 20:42:09.223544] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 3/70. [D 20:42:09.226592] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.226608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.226621] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.227803] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2141 [D 20:42:09.227823] element 0: offset: 0x645c70, size: 24 [D 20:42:09.227839] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 4/70. [D 20:42:09.233088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.233107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.233121] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:09.233143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.233156] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.233169] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:09.233599] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2144 [D 20:42:09.233619] element 0: offset: 0x636ca0, size: 24 [D 20:42:09.233634] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 5/70. [D 20:42:09.235414] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2144 [D 20:42:09.235436] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 6/70. [D 20:42:09.238722] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.238743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.238758] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.238977] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2147 [D 20:42:09.239019] element 0: offset: 0x61e5b0, size: 24 [D 20:42:09.239036] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 7/70. [D 20:42:09.239144] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2147 [D 20:42:09.248069] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 8/70. [D 20:42:09.252812] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2144 [D 20:42:09.252835] element 0: offset: 0x636ca0, size: 24 [D 20:42:09.252851] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 9/70. [D 20:42:09.256067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.256087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.256102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.264738] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.264758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.264772] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.266332] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2150 [D 20:42:09.266350] element 0: offset: 0x645c70, size: 24 [D 20:42:09.266369] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 10/70. [D 20:42:09.269585] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2150 [D 20:42:09.269608] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 11/70. [D 20:42:09.269630] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2147 [D 20:42:09.269645] element 0: offset: 0x61e5b0, size: 24 [D 20:42:09.269660] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 12/70. [D 20:42:09.269817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.269834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.269848] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.285987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.286009] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.286023] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.286252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2153 [D 20:42:09.286270] element 0: offset: 0x657310, size: 24 [D 20:42:09.286286] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 13/70. [D 20:42:09.289542] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2153 [D 20:42:09.289564] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 14/70. [D 20:42:09.289587] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2150 [D 20:42:09.289602] element 0: offset: 0x645c70, size: 24 [D 20:42:09.289616] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 15/70. [D 20:42:09.289735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.289758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.289771] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.303393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.303417] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.303430] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.307317] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2156 [D 20:42:09.307347] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.307362] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 16/70. [D 20:42:09.310570] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2156 [D 20:42:09.310593] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 17/70. [D 20:42:09.310615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2153 [D 20:42:09.310630] element 0: offset: 0x657310, size: 24 [D 20:42:09.310646] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 18/70. [D 20:42:09.310736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:09.310752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.310772] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:09.323453] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.323474] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.323487] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:09.323620] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2159 [D 20:42:09.323636] element 0: offset: 0x62d7a0, size: 24 [D 20:42:09.323650] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 19/70. [D 20:42:09.323766] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2159 [D 20:42:09.323815] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 20/70. [D 20:42:09.372497] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:09.372519] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:09.372536] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:09.372723] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2163 [D 20:42:09.372741] element 0: offset: 0x645d60, size: 24 [D 20:42:09.372760] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 21/70. [D 20:42:09.375407] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2163 [D 20:42:09.376031] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 22/70. [D 20:42:10.001338] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2156 [D 20:42:10.001417] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.001439] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 23/70. [D 20:42:10.003454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.003518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.003533] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:10.008745] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.008766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.008779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:10.008900] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2165 [D 20:42:10.008917] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.008936] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 24/70. [D 20:42:10.009137] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2165 [D 20:42:10.009165] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 25/70. [D 20:42:10.017556] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2163 [D 20:42:10.017633] element 0: offset: 0x645d60, size: 24 [D 20:42:10.017654] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 26/70. [D 20:42:10.017891] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.017911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.017924] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:10.022355] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2159 [D 20:42:10.022423] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.022445] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 27/70. [D 20:42:10.022671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.022690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.022703] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:10.028517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.028537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.028549] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:10.028598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.028612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.028625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:10.028733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2170 [D 20:42:10.028749] element 0: offset: 0x61e5b0, size: 24 [D 20:42:10.028766] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 28/70. [D 20:42:10.028791] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2171 [D 20:42:10.028805] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.028819] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 29/70. [D 20:42:10.033848] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2170 [D 20:42:10.033877] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 30/70. [D 20:42:10.033919] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 2171 [D 20:42:10.033939] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 31/70. [D 20:42:10.034190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2165 [D 20:42:10.034210] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.034225] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 32/70. [D 20:42:10.034350] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.034369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.034382] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:10.061615] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.061636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.061649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:10.061717] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2174 [D 20:42:10.061733] element 0: offset: 0x645d60, size: 24 [D 20:42:10.061748] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 33/70. [D 20:42:10.061821] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2174 [D 20:42:10.061862] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 34/70. [D 20:42:10.067494] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2171 [D 20:42:10.067547] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.067568] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 35/70. [D 20:42:10.067768] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.067787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.067801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:10.071780] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2170 [D 20:42:10.071835] element 0: offset: 0x61e5b0, size: 24 [D 20:42:10.071857] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 36/70. [D 20:42:10.072052] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.072071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.072084] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:10.078103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.078122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.078135] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:10.078256] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2178 [D 20:42:10.078272] element 0: offset: 0x645c70, size: 24 [D 20:42:10.078289] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 37/70. [D 20:42:10.079463] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2178 [D 20:42:10.079489] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 38/70. [D 20:42:10.086564] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2174 [D 20:42:10.086585] element 0: offset: 0x645d60, size: 24 [D 20:42:10.086600] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 39/70. [D 20:42:10.086771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.086789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.086802] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:10.093454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.093474] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.093487] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:10.093558] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2180 [D 20:42:10.093573] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.093588] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 40/70. [D 20:42:10.093753] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2180 [D 20:42:10.093778] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 41/70. [D 20:42:10.099049] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2178 [D 20:42:10.099117] element 0: offset: 0x645c70, size: 24 [D 20:42:10.099137] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 42/70. [D 20:42:10.099326] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.099346] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.099359] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:10.109800] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2180 [D 20:42:10.109867] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.109889] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 43/70. [D 20:42:10.110082] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.110102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.110115] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.112010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.112030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.112043] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.112161] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2184 [D 20:42:10.112177] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.112194] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 44/70. [D 20:42:10.112284] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2184 [D 20:42:10.112310] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 45/70. [D 20:42:10.132043] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2184 [D 20:42:10.132063] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.132078] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 46/70. [D 20:42:10.132201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.132220] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.132232] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.139279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.139299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.139312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.139384] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2187 [D 20:42:10.139400] element 0: offset: 0x6492f0, size: 24 [D 20:42:10.139415] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 47/70. [D 20:42:10.142650] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2187 [D 20:42:10.142727] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 48/70. [D 20:42:10.338456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2187 [D 20:42:10.338531] element 0: offset: 0x6492f0, size: 24 [D 20:42:10.338553] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 49/70. [D 20:42:10.339420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.339442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.339466] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.349084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.349107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.349124] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.349347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2190 [D 20:42:10.349367] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.349386] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 50/70. [D 20:42:10.352677] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2190 [D 20:42:10.352704] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 51/70. [D 20:42:10.372465] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2190 [D 20:42:10.372515] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.372535] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 52/70. [D 20:42:10.372622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.372640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.372654] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.379451] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.379514] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.379529] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.379656] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2193 [D 20:42:10.379673] element 0: offset: 0x657310, size: 24 [D 20:42:10.379693] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 53/70. [D 20:42:10.379766] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2193 [D 20:42:10.379810] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 54/70. [D 20:42:10.399683] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2193 [D 20:42:10.399706] element 0: offset: 0x657310, size: 24 [D 20:42:10.399721] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 55/70. [D 20:42:10.399855] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.399873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.399887] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.407110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.407130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.407143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.407211] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2196 [D 20:42:10.407227] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.407243] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 56/70. [D 20:42:10.407301] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2196 [D 20:42:10.407372] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 57/70. [D 20:42:10.419985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.420007] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.420021] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:10.420092] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2198 [D 20:42:10.420108] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.420127] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 58/70. [D 20:42:10.420294] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2198 [D 20:42:10.420319] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 59/70. [D 20:42:10.428428] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2196 [D 20:42:10.428448] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.428463] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 60/70. [D 20:42:10.428633] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.428651] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.428664] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:10.438477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2198 [D 20:42:10.438548] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.438571] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 0/70. [D 20:42:10.438802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.438822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.438836] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.453058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.453078] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.453091] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.453208] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2201 [D 20:42:10.453224] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.453239] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 1/70. [D 20:42:10.453314] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2201 [D 20:42:10.453369] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 2/70. [D 20:42:10.473146] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2201 [D 20:42:10.473168] element 0: offset: 0x5b0030, size: 24 [D 20:42:10.473183] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 3/70. [D 20:42:10.473307] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.473326] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.473338] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.481581] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.481601] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.481614] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.481680] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2204 [D 20:42:10.481696] element 0: offset: 0x657310, size: 24 [D 20:42:10.481711] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 4/70. [D 20:42:10.481768] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2204 [D 20:42:10.481837] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 5/70. [D 20:42:10.559078] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2204 [D 20:42:10.559100] element 0: offset: 0x657310, size: 24 [D 20:42:10.559115] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 6/70. [D 20:42:10.559258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.559277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.559290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.565621] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.565642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.565654] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.565721] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2207 [D 20:42:10.565736] element 0: offset: 0x691fe0, size: 24 [D 20:42:10.565752] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 7/70. [D 20:42:10.565809] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2207 [D 20:42:10.565877] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 8/70. [D 20:42:10.582955] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2207 [D 20:42:10.583023] element 0: offset: 0x691fe0, size: 24 [D 20:42:10.583043] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 9/70. [D 20:42:10.583416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.583436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.583450] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.592036] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.592057] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.592070] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.592190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2210 [D 20:42:10.592206] element 0: offset: 0x645c70, size: 24 [D 20:42:10.592221] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 10/70. [D 20:42:10.592339] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2210 [D 20:42:10.592368] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 11/70. [D 20:42:10.612938] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2210 [D 20:42:10.612958] element 0: offset: 0x645c70, size: 24 [D 20:42:10.612973] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 12/70. [D 20:42:10.613096] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.613114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.613127] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.619303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.619323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.619336] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.619405] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2213 [D 20:42:10.619422] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.619436] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 13/70. [D 20:42:10.619511] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2213 [D 20:42:10.619670] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 14/70. [D 20:42:10.809334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2213 [D 20:42:10.809356] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.809371] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 15/70. [D 20:42:10.809495] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.809513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.809526] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.815795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.815815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.815828] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.815894] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2216 [D 20:42:10.815910] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.815926] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 16/70. [D 20:42:10.816009] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2216 [D 20:42:10.816054] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 17/70. [D 20:42:10.832985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2216 [D 20:42:10.833056] element 0: offset: 0x62d7a0, size: 24 [D 20:42:10.833077] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 18/70. [D 20:42:10.833462] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.833483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.833497] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:10.839821] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:10.839842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.839855] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:10.839973] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2219 [D 20:42:10.839989] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.840004] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 19/70. [D 20:42:10.840123] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2219 [D 20:42:10.840149] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 20/70. [D 20:42:10.860665] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2219 [D 20:42:10.860686] element 0: offset: 0x636ca0, size: 24 [D 20:42:10.860701] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 21/70. [D 20:42:10.863563] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:10.863630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:10.863645] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.203657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.203730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.203746] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.203920] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2222 [D 20:42:11.203984] element 0: offset: 0x62d7a0, size: 24 [D 20:42:11.204005] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 22/70. [D 20:42:11.204432] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2222 [D 20:42:11.204459] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 23/70. [D 20:42:11.226325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.226348] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.226361] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.227472] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2222 [D 20:42:11.227550] element 0: offset: 0x62d7a0, size: 24 [D 20:42:11.227572] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 24/70. [D 20:42:11.232059] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.232083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.232100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.232127] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2225 [D 20:42:11.232142] element 0: offset: 0x62d7a0, size: 24 [D 20:42:11.232158] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 25/70. [D 20:42:11.232267] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2225 [D 20:42:11.232319] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 26/70. [D 20:42:11.244980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.245002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.245017] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.246517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2228 [D 20:42:11.246536] element 0: offset: 0x636ca0, size: 24 [D 20:42:11.246557] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 27/70. [D 20:42:11.247484] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2228 [D 20:42:11.247559] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 28/70. [D 20:42:11.247599] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2225 [D 20:42:11.247615] element 0: offset: 0x62d7a0, size: 24 [D 20:42:11.247634] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 29/70. [D 20:42:11.247798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.247817] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.247831] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.259843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.259864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.259878] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.263528] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2231 [D 20:42:11.263547] element 0: offset: 0x657310, size: 24 [D 20:42:11.263563] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 30/70. [D 20:42:11.270351] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2231 [D 20:42:11.270376] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 31/70. [D 20:42:11.270425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2228 [D 20:42:11.270439] element 0: offset: 0x636ca0, size: 24 [D 20:42:11.270454] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 32/70. [D 20:42:11.271406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.271421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.271434] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.279969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.279988] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.280001] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.280078] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2234 [D 20:42:11.280094] element 0: offset: 0x62d7a0, size: 24 [D 20:42:11.280108] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 33/70. [D 20:42:11.286690] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2234 [D 20:42:11.286713] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 34/70. [D 20:42:11.286757] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2231 [D 20:42:11.286772] element 0: offset: 0x657310, size: 24 [D 20:42:11.286786] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 35/70. [D 20:42:11.289948] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.289963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.289975] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.297385] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.297407] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.297420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.300476] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2237 [D 20:42:11.300546] element 0: offset: 0x2aaaab604400, size: 24 [D 20:42:11.300566] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 36/70. [D 20:42:11.300710] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2237 [D 20:42:11.300736] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 37/70. [D 20:42:11.302373] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2234 [D 20:42:11.302389] element 0: offset: 0x2aaaab604990, size: 24 [D 20:42:11.302410] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 38/70. [D 20:42:11.302507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.302523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.302537] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.315695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.315715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.315728] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.315867] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2240 [D 20:42:11.315888] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.315903] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 39/70. [D 20:42:11.319129] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2240 [D 20:42:11.319156] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 40/70. [D 20:42:11.323882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2237 [D 20:42:11.323903] element 0: offset: 0x2aaaab604400, size: 24 [D 20:42:11.323922] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 41/70. [D 20:42:11.327115] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.327135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.327149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.336052] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.336115] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.336130] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.336406] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2243 [D 20:42:11.336427] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.336448] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 42/70. [D 20:42:11.339656] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2243 [D 20:42:11.339682] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 43/70. [D 20:42:11.339705] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2240 [D 20:42:11.339719] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.339733] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 44/70. [D 20:42:11.339867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.339936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.339951] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.353663] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.353685] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.353699] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.355091] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2246 [D 20:42:11.355111] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.355130] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 45/70. [D 20:42:11.355436] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2246 [D 20:42:11.355457] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 46/70. [D 20:42:11.358586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2243 [D 20:42:11.358606] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.358625] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 47/70. [D 20:42:11.358723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.358739] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.358752] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.370825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.370845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.370859] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:11.370996] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2249 [D 20:42:11.371015] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.371034] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 48/70. [D 20:42:11.374293] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2249 [D 20:42:11.374316] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 49/70. [D 20:42:11.374362] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2246 [D 20:42:11.374377] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.374391] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 50/70. [D 20:42:11.374480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.374500] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.374513] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:11.392093] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2249 [D 20:42:11.392168] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.392190] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 51/70. [D 20:42:11.392414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.392438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.392452] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.398473] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.398493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.398507] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.398776] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2252 [D 20:42:11.398795] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.398815] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 52/70. [D 20:42:11.398898] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2252 [D 20:42:11.398957] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 53/70. [D 20:42:11.417073] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2252 [D 20:42:11.417101] element 0: offset: 0x2aaaab603fb0, size: 24 [D 20:42:11.417118] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 54/70. [D 20:42:11.419418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.419438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.419454] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.430079] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.430104] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.430122] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.430373] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2255 [D 20:42:11.430393] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.430408] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 55/70. [D 20:42:11.431603] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2255 [D 20:42:11.431677] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 56/70. [D 20:42:11.448880] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2255 [D 20:42:11.448946] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.448968] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 57/70. [D 20:42:11.449287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.449308] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.449321] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.454826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.454847] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.454860] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.455464] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2258 [D 20:42:11.455484] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.455499] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 58/70. [D 20:42:11.455605] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2258 [D 20:42:11.455632] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 59/70. [D 20:42:11.476013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2258 [D 20:42:11.476080] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.476101] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 60/70. [D 20:42:11.476448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.476469] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.476482] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.559075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.559119] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.559133] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.562392] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2261 [D 20:42:11.562414] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.562433] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 0/70. [D 20:42:11.562629] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2261 [D 20:42:11.562656] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 1/70. [D 20:42:11.581162] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2261 [D 20:42:11.581228] element 0: offset: 0x2aaaab604130, size: 24 [D 20:42:11.581248] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 2/70. [D 20:42:11.581551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.581572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.581585] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.587206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.587227] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.587239] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.590328] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2264 [D 20:42:11.590349] element 0: offset: 0x2aaaab614ef0, size: 24 [D 20:42:11.590364] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 3/70. [D 20:42:11.590644] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2264 [D 20:42:11.590672] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 4/70. [D 20:42:11.609462] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2264 [D 20:42:11.609527] element 0: offset: 0x2aaaab614ef0, size: 24 [D 20:42:11.609548] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 5/70. [D 20:42:11.609852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.609873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.609886] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.615551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.615573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.615587] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.618838] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2267 [D 20:42:11.618858] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.618875] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 6/70. [D 20:42:11.619160] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2267 [D 20:42:11.619187] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 7/70. [D 20:42:11.637287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2267 [D 20:42:11.637352] element 0: offset: 0x2aaaab605c70, size: 24 [D 20:42:11.637373] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 8/70. [D 20:42:11.637716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.637737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.637751] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:11.709508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:11.709529] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.709542] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:11.711502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2271 [D 20:42:11.711522] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:11.711539] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 9/70. [D 20:42:11.711624] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2271 [D 20:42:11.711668] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 10/70. [D 20:42:11.731166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2271 [D 20:42:11.731233] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:11.731253] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 11/70. [D 20:42:11.731639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:11.731660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:11.731674] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.096031] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.096068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.096082] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.096207] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2274 [D 20:42:12.096224] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:12.096242] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 12/70. [D 20:42:12.096349] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2274 [D 20:42:12.096374] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 13/70. [D 20:42:12.115899] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2274 [D 20:42:12.115967] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:12.115988] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 14/70. [D 20:42:12.119371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.119446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.119461] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.123474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.123499] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.123512] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.123788] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2277 [D 20:42:12.123808] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:12.123824] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 15/70. [D 20:42:12.123900] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2277 [D 20:42:12.123940] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 16/70. [D 20:42:12.141094] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2277 [D 20:42:12.141164] element 0: offset: 0x2aaaab604850, size: 24 [D 20:42:12.141184] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 17/70. [D 20:42:12.141698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.141719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.141733] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.147182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.147203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.147216] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.147416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2280 [D 20:42:12.147434] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.147450] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 18/70. [D 20:42:12.147612] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2280 [D 20:42:12.147638] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 19/70. [D 20:42:12.166311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.166382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.166397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.166550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2282 [D 20:42:12.166566] element 0: offset: 0x2aaaab60f9d0, size: 24 [D 20:42:12.166585] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 20/70. [D 20:42:12.166676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2280 [D 20:42:12.166692] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.166707] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 21/70. [D 20:42:12.166764] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2282 [D 20:42:12.166790] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 22/70. [D 20:42:12.166832] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.166846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.166859] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.179311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.179339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.179352] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.179445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2286 [D 20:42:12.179462] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.179479] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 23/70. [D 20:42:12.179630] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2286 [D 20:42:12.179672] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 24/70. [D 20:42:12.183294] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2282 [D 20:42:12.183319] element 0: offset: 0x2aaaab60f9d0, size: 24 [D 20:42:12.183346] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 25/70. [D 20:42:12.186742] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.186763] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.186785] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.196600] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2286 [D 20:42:12.196622] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.196640] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 26/70. [D 20:42:12.199468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.199489] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.199504] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.203442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.203505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.203519] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.203648] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2288 [D 20:42:12.203665] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.203685] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 27/70. [D 20:42:12.203884] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2288 [D 20:42:12.204235] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 28/70. [D 20:42:12.222730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.222800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.222815] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.223141] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2292 [D 20:42:12.223159] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:12.223178] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 29/70. [D 20:42:12.223254] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2288 [D 20:42:12.223269] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.223290] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 30/70. [D 20:42:12.223345] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2292 [D 20:42:12.223373] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 31/70. [D 20:42:12.223425] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.223440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.223452] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.240669] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.240688] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.240701] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.240770] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2294 [D 20:42:12.240785] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.240803] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 32/70. [D 20:42:12.240909] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2294 [D 20:42:12.240966] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 33/70. [D 20:42:12.245273] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2292 [D 20:42:12.245330] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:12.245351] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 34/70. [D 20:42:12.245513] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.245533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.245546] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.256069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2294 [D 20:42:12.256138] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.256159] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 35/70. [D 20:42:12.256287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.256305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.256318] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.695381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.695401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.695420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.695709] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2297 [D 20:42:12.695729] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.695744] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 36/70. [D 20:42:12.698941] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2297 [D 20:42:12.698963] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 37/70. [D 20:42:12.715860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2297 [D 20:42:12.715922] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.715943] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 38/70. [D 20:42:12.716049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.716067] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.716080] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.722150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.722168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.722181] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.725551] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2300 [D 20:42:12.725569] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.725585] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 39/70. [D 20:42:12.725928] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2300 [D 20:42:12.725956] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 40/70. [D 20:42:12.744227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2300 [D 20:42:12.744292] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.744314] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 41/70. [D 20:42:12.744599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.744620] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.744634] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:12.750958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.750979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.750992] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:12.753490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.753561] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.753575] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.756743] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2303 [D 20:42:12.756764] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.756780] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 42/70. [D 20:42:12.756799] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2307 [D 20:42:12.756813] element 0: offset: 0x2aaaab60f490, size: 24 [D 20:42:12.756827] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 43/70. [D 20:42:12.758863] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2303 [D 20:42:12.758893] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 44/70. [D 20:42:12.758935] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2307 [D 20:42:12.758955] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 45/70. [D 20:42:12.783393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.783418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.783432] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:12.792305] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2303 [D 20:42:12.792358] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.792378] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 46/70. [D 20:42:12.792413] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2309 [D 20:42:12.792427] element 0: offset: 0x2aaaab60f950, size: 24 [D 20:42:12.792442] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 47/70. [D 20:42:12.792467] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2307 [D 20:42:12.792480] element 0: offset: 0x2aaaab60f490, size: 24 [D 20:42:12.792496] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 48/70. [D 20:42:12.792541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.792556] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.792570] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:12.792628] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2309 [D 20:42:12.792662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.792671] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 49/70. [D 20:42:12.792676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.792994] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.805491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:12.805512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.805525] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:12.810220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2312 [D 20:42:12.810277] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.810298] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 50/70. [D 20:42:12.810538] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2312 [D 20:42:12.810566] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 51/70. [D 20:42:12.811517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2309 [D 20:42:12.811536] element 0: offset: 0x2aaaab60f950, size: 24 [D 20:42:12.811554] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 52/70. [D 20:42:12.811693] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.811712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.811726] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:12.829253] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2312 [D 20:42:12.829273] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:12.829287] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 53/70. [D 20:42:12.831473] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:12.831544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:12.831560] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.388710] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.388783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.388799] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.388943] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2316 [D 20:42:13.388967] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:13.388984] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 54/70. [D 20:42:13.389314] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2316 [D 20:42:13.389337] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 55/70. [D 20:42:13.403242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.403264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.403277] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:13.407985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2318 [D 20:42:13.408018] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.408037] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 56/70. [D 20:42:13.413309] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2316 [D 20:42:13.413336] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:13.413359] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 57/70. [D 20:42:13.413412] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2318 [D 20:42:13.413442] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 58/70. [D 20:42:13.415499] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.415551] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.415565] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:13.432353] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2318 [D 20:42:13.432427] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.432448] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 59/70. [D 20:42:13.434556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.434577] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.434591] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.437816] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.437837] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.437850] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.437973] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2321 [D 20:42:13.437989] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.438005] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 60/70. [D 20:42:13.438156] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2321 [D 20:42:13.438182] openib_post_sr: 10.1.4.240:43806 bh 10 len 48 wr 0/70. [D 20:42:13.456023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2321 [D 20:42:13.456092] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.456113] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 1/70. [D 20:42:13.456489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.456510] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.456524] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.464363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.464384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.464397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.464518] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2324 [D 20:42:13.464534] element 0: offset: 0x2aaaab6194e0, size: 24 [D 20:42:13.464551] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 2/70. [D 20:42:13.464741] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2324 [D 20:42:13.464770] openib_post_sr: 10.1.4.240:43806 bh 13 len 48 wr 3/70. [D 20:42:13.482501] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2324 [D 20:42:13.482570] element 0: offset: 0x2aaaab6194e0, size: 24 [D 20:42:13.482591] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 4/70. [D 20:42:13.482967] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.482988] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.483001] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.490868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.490888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.490901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.491022] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2327 [D 20:42:13.491037] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:13.491053] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 5/70. [D 20:42:13.491126] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2327 [D 20:42:13.491168] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 6/70. [D 20:42:13.508116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2327 [D 20:42:13.508186] element 0: offset: 0x2aaaab603dd0, size: 24 [D 20:42:13.508206] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 7/70. [D 20:42:13.511264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.511291] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.511307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.554102] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.554124] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.554142] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.554458] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2330 [D 20:42:13.554481] element 0: offset: 0x2aaaab6113f0, size: 24 [D 20:42:13.554501] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 8/70. [D 20:42:13.555557] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2330 [D 20:42:13.555592] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 9/70. [D 20:42:13.573711] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2330 [D 20:42:13.573775] element 0: offset: 0x2aaaab6113f0, size: 24 [D 20:42:13.573796] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 10/70. [D 20:42:13.574097] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.574118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.574131] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.579751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.579772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.579785] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.579904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2333 [D 20:42:13.579920] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.579935] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 11/70. [D 20:42:13.580009] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2333 [D 20:42:13.580050] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 12/70. [D 20:42:13.597967] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2333 [D 20:42:13.598036] element 0: offset: 0x2aaaab611500, size: 24 [D 20:42:13.598057] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 13/70. [D 20:42:13.598132] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.598147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.598160] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.606555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.606575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.606589] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.606708] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2336 [D 20:42:13.606724] element 0: offset: 0x2aaaab000a10, size: 24 [D 20:42:13.606739] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 14/70. [D 20:42:13.606814] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2336 [D 20:42:13.606850] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 15/70. [D 20:42:13.622741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2336 [D 20:42:13.622812] element 0: offset: 0x2aaaab000a10, size: 24 [D 20:42:13.622833] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 16/70. [D 20:42:13.623204] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.623225] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.623239] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.631780] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.631801] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.631814] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.631934] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2339 [D 20:42:13.631950] element 0: offset: 0x2aaaab014f20, size: 24 [D 20:42:13.631966] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 17/70. [D 20:42:13.632038] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2339 [D 20:42:13.632077] openib_post_sr: 10.1.4.240:43806 bh 8 len 48 wr 18/70. [D 20:42:13.648969] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2339 [D 20:42:13.649040] element 0: offset: 0x2aaaab014f20, size: 24 [D 20:42:13.649061] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 19/70. [D 20:42:13.652217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.652242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.652260] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.673791] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.673820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.673838] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.674011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2342 [D 20:42:13.674031] element 0: offset: 0x2aaaab014ed0, size: 24 [D 20:42:13.674048] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 20/70. [D 20:42:13.675454] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2342 [D 20:42:13.675479] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 21/70. [D 20:42:13.678980] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2342 [D 20:42:13.679001] element 0: offset: 0x2aaaab014ed0, size: 24 [D 20:42:13.679021] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 22/70. [D 20:42:13.679086] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.679102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.679123] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.679526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.679546] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.679561] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.679680] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2344 [D 20:42:13.679697] element 0: offset: 0x2aaaab002040, size: 24 [D 20:42:13.682168] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 23/70. [D 20:42:13.684394] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 1306880, tag: 2344 [D 20:42:13.684461] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 24/70. [D 20:42:13.684520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 149. [D 20:42:13.684562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ff44b0 rkey 4a40044 nic_wr_credit 150. [D 20:42:13.684578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40144b0 rkey 4a40044 nic_wr_credit 151. [D 20:42:13.684592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40344b0 rkey 4a40044 nic_wr_credit 152. [D 20:42:13.684608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40544b0 rkey 4a40044 nic_wr_credit 153. [D 20:42:13.684623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40744b0 rkey 4a40044 nic_wr_credit 154. [D 20:42:13.684637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40944b0 rkey 4a40044 nic_wr_credit 155. [D 20:42:13.684653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40b44b0 rkey 4a40044 nic_wr_credit 156. [D 20:42:13.684687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40d44b0 rkey 4a40044 nic_wr_credit 157. [D 20:42:13.684701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40f44b0 rkey 4a40044 nic_wr_credit 158. [D 20:42:13.684716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41144b0 rkey 4a40044 nic_wr_credit 159. [D 20:42:13.684735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41344b0 rkey 4a40044 nic_wr_credit 160. [D 20:42:13.684750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41544b0 rkey 4a40044 nic_wr_credit 161. [D 20:42:13.684765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41744b0 rkey 4a40044 nic_wr_credit 162. [D 20:42:13.684784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41944b0 rkey 4a40044 nic_wr_credit 163. [D 20:42:13.684801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41b44b0 rkey 4a40044 nic_wr_credit 164. [D 20:42:13.684816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41d44b0 rkey 4a40044 nic_wr_credit 165. [D 20:42:13.684838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41f44b0 rkey 4a40044 nic_wr_credit 166. [D 20:42:13.684868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42144b0 rkey 4a40044 nic_wr_credit 167. [D 20:42:13.684884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42344b0 rkey 4a40044 nic_wr_credit 168. [D 20:42:13.684906] openib_post_sr_rdmaw: ibv_post_send wr_id 656b00 to 10.1.4.240:43806 remote addr f42544b0 rkey 4a40044 nic_wr_credit 169. [D 20:42:13.693574] openib_check_cq: completed rdma wr_id 656b00, nic_wr_credit 169. [D 20:42:13.693596] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 25/70. [D 20:42:13.693693] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.693717] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.693731] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.867998] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.868019] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.868032] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.868155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2348 [D 20:42:13.868172] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:13.868407] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 26/70. [D 20:42:13.868454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.868469] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.868481] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:13.868529] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2348 [D 20:42:13.868554] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 27/70. [D 20:42:13.869092] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2352 [D 20:42:13.869111] element 0: offset: 0x2aaaab0187c0, size: 24 [D 20:42:13.869128] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 28/70. [D 20:42:13.869271] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2352 [D 20:42:13.869459] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 29/70. [D 20:42:13.870424] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2348 [D 20:42:13.870447] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:13.870466] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 30/70. [D 20:42:13.870624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.870642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.870654] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:13.873998] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2352 [D 20:42:13.874042] element 0: offset: 0x2aaaab0187c0, size: 24 [D 20:42:13.874064] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 31/70. [D 20:42:13.874148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.874164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.874177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:13.875945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.875966] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.875979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:13.876099] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2354 [D 20:42:13.876115] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:13.876130] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 32/70. [D 20:42:13.876307] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2354 [D 20:42:13.876337] openib_post_sr: 10.1.4.240:43806 bh 3 len 48 wr 33/70. [D 20:42:13.887771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.887791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.887805] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:13.891690] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.891718] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.891733] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:13.892583] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2360 [D 20:42:13.893786] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:13.893818] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 34/70. [D 20:42:13.893849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2363 [D 20:42:13.893867] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:13.893886] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 35/70. [D 20:42:13.899926] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2354 [D 20:42:13.899979] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:13.900000] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 36/70. [D 20:42:13.907001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.907072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.907086] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:13.907204] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2360 [D 20:42:13.907234] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 37/70. [D 20:42:13.907314] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2363 [D 20:42:13.907332] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 38/70. [D 20:42:13.907369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 169. [D 20:42:13.907441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 170. [D 20:42:13.907459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 171. [D 20:42:13.907482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 172. [D 20:42:13.907501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 173. [D 20:42:13.907520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 174. [D 20:42:13.907549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 175. [D 20:42:13.907567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 176. [D 20:42:13.907586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 177. [D 20:42:13.907604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 178. [D 20:42:13.907623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 179. [D 20:42:13.907642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 180. [D 20:42:13.907661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 181. [D 20:42:13.907682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 182. [D 20:42:13.907701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 183. [D 20:42:13.907719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 184. [D 20:42:13.907738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 185. [D 20:42:13.907754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 186. [D 20:42:13.907770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 187. [D 20:42:13.907788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 188. [D 20:42:13.907807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 189. [D 20:42:13.907826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 190. [D 20:42:13.907844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 191. [D 20:42:13.907863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 192. [D 20:42:13.907882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 193. [D 20:42:13.907900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 194. [D 20:42:13.907919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 195. [D 20:42:13.907938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 196. [D 20:42:13.907957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 197. [D 20:42:13.907972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 198. [D 20:42:13.907987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 199. [D 20:42:13.908001] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 200. [D 20:42:13.908020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 201. [D 20:42:13.908035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 202. [D 20:42:13.908050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 203. [D 20:42:13.908064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 204. [D 20:42:13.908079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 205. [D 20:42:13.908094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 206. [D 20:42:13.908109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 207. [D 20:42:13.908123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 208. [D 20:42:13.908138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 209. [D 20:42:13.908152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 210. [D 20:42:13.908168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 211. [D 20:42:13.908182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 212. [D 20:42:13.908197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 213. [D 20:42:13.908211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 214. [D 20:42:13.908226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 215. [D 20:42:13.908241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 216. [D 20:42:13.908256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 217. [D 20:42:13.908270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 218. [D 20:42:13.908285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 219. [D 20:42:13.908299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 220. [D 20:42:13.908314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 221. [D 20:42:13.908329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 222. [D 20:42:13.908354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 223. [D 20:42:13.908369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 224. [D 20:42:13.908384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 225. [D 20:42:13.908398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 226. [D 20:42:13.908414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 227. [D 20:42:13.908429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 228. [D 20:42:13.908443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 229. [D 20:42:13.908458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 230. [D 20:42:13.908473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 231. [D 20:42:13.908489] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 232. [D 20:42:13.909412] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.909435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.909448] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:13.909719] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:13.909736] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.909749] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:13.919057] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 232. [D 20:42:13.919086] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 39/70. [D 20:42:13.925783] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 231. [D 20:42:13.925803] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 40/70. [D 20:42:13.925884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.925906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.925920] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:13.925942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:13.925956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:13.925968] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:14.122945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.122965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.122978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:14.123007] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2375 [D 20:42:14.123022] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:14.123040] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 41/70. [D 20:42:14.127166] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2375 [D 20:42:14.127239] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 42/70. [D 20:42:14.127304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 231. [D 20:42:14.127345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 232. [D 20:42:14.127361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 233. [D 20:42:14.127376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 234. [D 20:42:14.127391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 235. [D 20:42:14.127406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 236. [D 20:42:14.127422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 237. [D 20:42:14.127463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 238. [D 20:42:14.127478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 239. [D 20:42:14.127493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 240. [D 20:42:14.127507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 241. [D 20:42:14.127527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 242. [D 20:42:14.127543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 243. [D 20:42:14.127557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 244. [D 20:42:14.127583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 245. [D 20:42:14.127599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 246. [D 20:42:14.127623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 247. [D 20:42:14.127638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 248. [D 20:42:14.127653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 249. [D 20:42:14.127668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 250. [D 20:42:14.127686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 251. [D 20:42:14.127701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 252. [D 20:42:14.127716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 253. [D 20:42:14.127731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 254. [D 20:42:14.127745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 255. [D 20:42:14.127760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 256. [D 20:42:14.127787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 257. [D 20:42:14.127833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 258. [D 20:42:14.127855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 259. [D 20:42:14.127870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 260. [D 20:42:14.127885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 261. [D 20:42:14.127899] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 262. [D 20:42:14.133273] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 262. [D 20:42:14.133294] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 43/70. [D 20:42:14.133388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.133413] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.133427] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:14.159592] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.159612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.159625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:14.159663] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2379 [D 20:42:14.159678] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:14.159695] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 44/70. [D 20:42:14.163496] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2379 [D 20:42:14.163561] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 45/70. [D 20:42:14.163617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 262. [D 20:42:14.163642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 263. [D 20:42:14.163658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 264. [D 20:42:14.163672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 265. [D 20:42:14.163690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 266. [D 20:42:14.163708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 267. [D 20:42:14.163723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 268. [D 20:42:14.163738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 269. [D 20:42:14.163752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 270. [D 20:42:14.163770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 271. [D 20:42:14.163787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 272. [D 20:42:14.163820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 273. [D 20:42:14.163869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 274. [D 20:42:14.163887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 275. [D 20:42:14.163902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 276. [D 20:42:14.163917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 277. [D 20:42:14.163946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 278. [D 20:42:14.163962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 279. [D 20:42:14.163976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 280. [D 20:42:14.163991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 281. [D 20:42:14.164006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 282. [D 20:42:14.164024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 283. [D 20:42:14.164041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 284. [D 20:42:14.164055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 285. [D 20:42:14.164133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 286. [D 20:42:14.164156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 287. [D 20:42:14.164171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 288. [D 20:42:14.164186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 289. [D 20:42:14.164204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 290. [D 20:42:14.164220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 291. [D 20:42:14.164235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 292. [D 20:42:14.164250] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 293. [D 20:42:14.169586] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 293. [D 20:42:14.169607] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 46/70. [D 20:42:14.169701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.169725] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.169739] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:14.201866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.201887] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.201900] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:14.201936] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2381 [D 20:42:14.201951] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:14.201968] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 47/70. [D 20:42:14.205857] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2381 [D 20:42:14.205934] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 48/70. [D 20:42:14.205996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 293. [D 20:42:14.206021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 294. [D 20:42:14.206036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 295. [D 20:42:14.206051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 296. [D 20:42:14.206068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 297. [D 20:42:14.206082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 298. [D 20:42:14.206097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 299. [D 20:42:14.206112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 300. [D 20:42:14.206126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 301. [D 20:42:14.206141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 302. [D 20:42:14.206156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 303. [D 20:42:14.206171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 304. [D 20:42:14.206185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 305. [D 20:42:14.206201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 306. [D 20:42:14.206235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 307. [D 20:42:14.206253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 308. [D 20:42:14.206268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 309. [D 20:42:14.206283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 310. [D 20:42:14.206298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 311. [D 20:42:14.206313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 312. [D 20:42:14.206327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 313. [D 20:42:14.206342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 314. [D 20:42:14.206357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 315. [D 20:42:14.206371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 316. [D 20:42:14.206387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 317. [D 20:42:14.206403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 318. [D 20:42:14.206418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 319. [D 20:42:14.206433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 320. [D 20:42:14.206448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 321. [D 20:42:14.206497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 322. [D 20:42:14.206518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 323. [D 20:42:14.206533] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 324. [D 20:42:14.211944] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 324. [D 20:42:14.211965] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 49/70. [D 20:42:14.212064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.212089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.212102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:14.295713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.295733] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.295747] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:14.295786] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2385 [D 20:42:14.295801] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:14.295819] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 50/70. [D 20:42:14.299670] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2385 [D 20:42:14.299751] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 51/70. [D 20:42:14.299863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 324. [D 20:42:14.299942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 325. [D 20:42:14.299961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 326. [D 20:42:14.299980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 327. [D 20:42:14.299998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 328. [D 20:42:14.300017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 329. [D 20:42:14.300035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 330. [D 20:42:14.300054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 331. [D 20:42:14.300073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 332. [D 20:42:14.300103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 333. [D 20:42:14.300121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 334. [D 20:42:14.300140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 335. [D 20:42:14.300158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 336. [D 20:42:14.300177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 337. [D 20:42:14.300195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 338. [D 20:42:14.300223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 339. [D 20:42:14.300241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 340. [D 20:42:14.300259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 341. [D 20:42:14.300278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 342. [D 20:42:14.300307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 343. [D 20:42:14.300326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 344. [D 20:42:14.300344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 345. [D 20:42:14.300363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 346. [D 20:42:14.300382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 347. [D 20:42:14.300400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 348. [D 20:42:14.300419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 349. [D 20:42:14.300437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 350. [D 20:42:14.300456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 351. [D 20:42:14.300474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 352. [D 20:42:14.300493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 353. [D 20:42:14.300508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 354. [D 20:42:14.300523] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 355. [D 20:42:14.311026] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 355. [D 20:42:14.311054] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 52/70. [D 20:42:14.311148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.311173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.311187] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:14.320615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2371 [D 20:42:14.320636] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:14.320653] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 53/70. [D 20:42:14.320722] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.320737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.320750] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:14.320820] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2372 [D 20:42:14.320835] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:14.320851] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 54/70. [D 20:42:14.320923] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2372 [D 20:42:14.320962] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 55/70. [D 20:42:14.335138] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2372 [D 20:42:14.335206] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:14.335227] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 56/70. [D 20:42:14.335455] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.335474] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.335488] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.345519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.345540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.345553] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.345588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2388 [D 20:42:14.345602] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:14.345618] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 57/70. [D 20:42:14.349483] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2388 [D 20:42:14.349558] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 58/70. [D 20:42:14.349618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 355. [D 20:42:14.349645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 356. [D 20:42:14.349661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 357. [D 20:42:14.349676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 358. [D 20:42:14.349710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 359. [D 20:42:14.349732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 360. [D 20:42:14.349751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 361. [D 20:42:14.349766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 362. [D 20:42:14.349780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 363. [D 20:42:14.349799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 364. [D 20:42:14.349818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 365. [D 20:42:14.349835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 366. [D 20:42:14.349849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 367. [D 20:42:14.349864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 368. [D 20:42:14.349881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 369. [D 20:42:14.349895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 370. [D 20:42:14.349910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 371. [D 20:42:14.349925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 372. [D 20:42:14.349940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 373. [D 20:42:14.349954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 374. [D 20:42:14.349969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 375. [D 20:42:14.349984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 376. [D 20:42:14.350026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 377. [D 20:42:14.350048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 378. [D 20:42:14.350063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 379. [D 20:42:14.350077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 380. [D 20:42:14.350092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 381. [D 20:42:14.350118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 382. [D 20:42:14.350134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 383. [D 20:42:14.350149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 384. [D 20:42:14.350163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 385. [D 20:42:14.350177] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 386. [D 20:42:14.358123] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 386. [D 20:42:14.358144] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 59/70. [D 20:42:14.358275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.358299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.358313] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.440585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.440605] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.440618] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.440657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2391 [D 20:42:14.440672] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:14.440689] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 60/70. [D 20:42:14.444600] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2391 [D 20:42:14.444663] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 0/70. [D 20:42:14.444733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 386. [D 20:42:14.444819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 387. [D 20:42:14.444838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 388. [D 20:42:14.444857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 389. [D 20:42:14.444887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 390. [D 20:42:14.444905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 391. [D 20:42:14.444924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 392. [D 20:42:14.444943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 393. [D 20:42:14.444962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 394. [D 20:42:14.444980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 395. [D 20:42:14.445014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 396. [D 20:42:14.445032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 397. [D 20:42:14.445051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 398. [D 20:42:14.445070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 399. [D 20:42:14.445088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 400. [D 20:42:14.445107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 401. [D 20:42:14.445125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 402. [D 20:42:14.445144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 403. [D 20:42:14.445163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 404. [D 20:42:14.445182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 405. [D 20:42:14.445200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 406. [D 20:42:14.445219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 407. [D 20:42:14.445238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 408. [D 20:42:14.445257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 409. [D 20:42:14.445276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 410. [D 20:42:14.445295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 411. [D 20:42:14.445313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 412. [D 20:42:14.445331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 413. [D 20:42:14.445350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 414. [D 20:42:14.445369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 415. [D 20:42:14.445384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 416. [D 20:42:14.445399] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 417. [D 20:42:14.455178] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 417. [D 20:42:14.455206] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 1/70. [D 20:42:14.455354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.455379] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.455392] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.463658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.463678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.463690] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.463728] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2393 [D 20:42:14.463743] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:14.463761] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 2/70. [D 20:42:14.467446] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2393 [D 20:42:14.467518] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 3/70. [D 20:42:14.467601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 417. [D 20:42:14.467645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 418. [D 20:42:14.467681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 419. [D 20:42:14.467703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 420. [D 20:42:14.467721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 421. [D 20:42:14.467740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 422. [D 20:42:14.467759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 423. [D 20:42:14.467778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 424. [D 20:42:14.467796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 425. [D 20:42:14.467815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 426. [D 20:42:14.467834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 427. [D 20:42:14.467863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 428. [D 20:42:14.467881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 429. [D 20:42:14.467899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 430. [D 20:42:14.467918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 431. [D 20:42:14.467937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 432. [D 20:42:14.467955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 433. [D 20:42:14.467974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 434. [D 20:42:14.468005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 435. [D 20:42:14.468023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 436. [D 20:42:14.468042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 437. [D 20:42:14.468058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 438. [D 20:42:14.468073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 439. [D 20:42:14.468091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 440. [D 20:42:14.468118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 441. [D 20:42:14.468137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 442. [D 20:42:14.468156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 443. [D 20:42:14.468174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 444. [D 20:42:14.468193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 445. [D 20:42:14.468212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 446. [D 20:42:14.468227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 447. [D 20:42:14.468242] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 448. [D 20:42:14.475157] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 448. [D 20:42:14.475181] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 4/70. [D 20:42:14.475359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.475387] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.475400] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.488374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.488394] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.488407] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.488445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2397 [D 20:42:14.488460] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:14.488479] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 5/70. [D 20:42:14.491875] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2397 [D 20:42:14.491941] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 6/70. [D 20:42:14.492085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 448. [D 20:42:14.492113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 449. [D 20:42:14.492132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 450. [D 20:42:14.492154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 451. [D 20:42:14.492172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 452. [D 20:42:14.492191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 453. [D 20:42:14.492210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 454. [D 20:42:14.492229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 455. [D 20:42:14.492247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 456. [D 20:42:14.492266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 457. [D 20:42:14.492284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 458. [D 20:42:14.492303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 459. [D 20:42:14.492319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 460. [D 20:42:14.492347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 461. [D 20:42:14.492366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 462. [D 20:42:14.492385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 463. [D 20:42:14.492403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 464. [D 20:42:14.492422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 465. [D 20:42:14.492441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 466. [D 20:42:14.492459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 467. [D 20:42:14.492477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 468. [D 20:42:14.492496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 469. [D 20:42:14.492514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 470. [D 20:42:14.492533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 471. [D 20:42:14.492551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 472. [D 20:42:14.492570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 473. [D 20:42:14.492588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 474. [D 20:42:14.492607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 475. [D 20:42:14.492626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 476. [D 20:42:14.492645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 477. [D 20:42:14.492659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 478. [D 20:42:14.492674] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 479. [D 20:42:14.498054] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 479. [D 20:42:14.498080] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 7/70. [D 20:42:14.498163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.498185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.498199] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.564594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.564615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.564628] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.564664] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2399 [D 20:42:14.564679] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:14.564695] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 8/70. [D 20:42:14.568379] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2399 [D 20:42:14.568443] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 9/70. [D 20:42:14.568501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 479. [D 20:42:14.568526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 480. [D 20:42:14.568545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 481. [D 20:42:14.568560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 482. [D 20:42:14.568575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 483. [D 20:42:14.568590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 484. [D 20:42:14.568605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 485. [D 20:42:14.568620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 486. [D 20:42:14.568636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 487. [D 20:42:14.568655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 488. [D 20:42:14.568675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 489. [D 20:42:14.568697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 490. [D 20:42:14.568715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 491. [D 20:42:14.568733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 492. [D 20:42:14.568750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 493. [D 20:42:14.568768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 494. [D 20:42:14.568785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 495. [D 20:42:14.568803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 496. [D 20:42:14.568820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 497. [D 20:42:14.568838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 498. [D 20:42:14.568855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 499. [D 20:42:14.568873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 500. [D 20:42:14.568902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 501. [D 20:42:14.568920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 502. [D 20:42:14.568938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 503. [D 20:42:14.568955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 504. [D 20:42:14.568972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 505. [D 20:42:14.568990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 506. [D 20:42:14.569007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 507. [D 20:42:14.569025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 508. [D 20:42:14.569040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 509. [D 20:42:14.569055] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 510. [D 20:42:14.574456] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 510. [D 20:42:14.574480] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 10/70. [D 20:42:14.574572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.574596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.574609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.593473] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.593494] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.593506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.593544] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2403 [D 20:42:14.593559] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:14.593575] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 11/70. [D 20:42:14.597540] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2403 [D 20:42:14.597614] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 12/70. [D 20:42:14.597674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 510. [D 20:42:14.597717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 511. [D 20:42:14.597732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 512. [D 20:42:14.597747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 513. [D 20:42:14.597762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 514. [D 20:42:14.597776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 515. [D 20:42:14.597791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 516. [D 20:42:14.597808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 517. [D 20:42:14.597823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 518. [D 20:42:14.597837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 519. [D 20:42:14.597852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 520. [D 20:42:14.597867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 521. [D 20:42:14.597881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 522. [D 20:42:14.597908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 523. [D 20:42:14.597923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 524. [D 20:42:14.597938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 525. [D 20:42:14.597952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 526. [D 20:42:14.597968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 527. [D 20:42:14.598016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 528. [D 20:42:14.598036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 529. [D 20:42:14.598051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 530. [D 20:42:14.598065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 531. [D 20:42:14.598080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 532. [D 20:42:14.598094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 533. [D 20:42:14.598120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 534. [D 20:42:14.598135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 535. [D 20:42:14.598149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 536. [D 20:42:14.598164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 537. [D 20:42:14.598178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 538. [D 20:42:14.598193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 539. [D 20:42:14.598209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 540. [D 20:42:14.598223] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 541. [D 20:42:14.603663] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 541. [D 20:42:14.603684] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 13/70. [D 20:42:14.603779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.603804] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.603818] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.666836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.666857] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.666869] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.666907] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2406 [D 20:42:14.666921] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:14.666938] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 14/70. [D 20:42:14.670958] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2406 [D 20:42:14.671037] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 15/70. [D 20:42:14.671100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 541. [D 20:42:14.671126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 542. [D 20:42:14.671141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 543. [D 20:42:14.671155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 544. [D 20:42:14.671171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 545. [D 20:42:14.671185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 546. [D 20:42:14.671200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 547. [D 20:42:14.671215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 548. [D 20:42:14.671230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 549. [D 20:42:14.671244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 550. [D 20:42:14.671259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 551. [D 20:42:14.671275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 552. [D 20:42:14.671289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 553. [D 20:42:14.671304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 554. [D 20:42:14.671344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 555. [D 20:42:14.671363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 556. [D 20:42:14.671378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 557. [D 20:42:14.671392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 558. [D 20:42:14.671407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 559. [D 20:42:14.671421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 560. [D 20:42:14.671439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 561. [D 20:42:14.671454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 562. [D 20:42:14.671469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 563. [D 20:42:14.671483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 564. [D 20:42:14.671498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 565. [D 20:42:14.671513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 566. [D 20:42:14.671528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 567. [D 20:42:14.671542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 568. [D 20:42:14.671570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 569. [D 20:42:14.671585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 570. [D 20:42:14.671600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 571. [D 20:42:14.671614] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 572. [D 20:42:14.677068] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 572. [D 20:42:14.677088] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 16/70. [D 20:42:14.677187] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.677212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.677225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:14.733343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:14.733365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.733378] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:14.733417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2408 [D 20:42:14.733432] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:14.733449] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 17/70. [D 20:42:14.737110] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2408 [D 20:42:14.737179] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 18/70. [D 20:42:14.737289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 572. [D 20:42:14.737335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 573. [D 20:42:14.737350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 574. [D 20:42:14.737364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 575. [D 20:42:14.737380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 576. [D 20:42:14.737395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 577. [D 20:42:14.737409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 578. [D 20:42:14.737424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 579. [D 20:42:14.737439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 580. [D 20:42:14.737454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 581. [D 20:42:14.737470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 582. [D 20:42:14.737518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 583. [D 20:42:14.737540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 584. [D 20:42:14.737559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 585. [D 20:42:14.737578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 586. [D 20:42:14.737613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 587. [D 20:42:14.737631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 588. [D 20:42:14.737649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 589. [D 20:42:14.737668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 590. [D 20:42:14.737687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 591. [D 20:42:14.737706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 592. [D 20:42:14.737724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 593. [D 20:42:14.737742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 594. [D 20:42:14.737761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 595. [D 20:42:14.737780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 596. [D 20:42:14.737808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 597. [D 20:42:14.737827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 598. [D 20:42:14.737846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 599. [D 20:42:14.737865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 600. [D 20:42:14.737883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 601. [D 20:42:14.737898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 602. [D 20:42:14.737913] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 603. [D 20:42:14.749099] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 603. [D 20:42:14.749127] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 19/70. [D 20:42:14.749302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:14.749326] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:14.749340] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.055188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.055262] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.055277] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.055347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 2411 [D 20:42:15.055362] element 0: offset: 0x2aaaab019a90, size: 104 [D 20:42:15.055380] openib_post_sr: 10.1.4.240:43806 bh 11 len 120 wr 20/70. [D 20:42:15.055778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.055797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.055810] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.180301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.180329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.180343] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.180376] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2414 [D 20:42:15.180390] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:15.180407] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 21/70. [D 20:42:15.184413] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2414 [D 20:42:15.184487] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 22/70. [D 20:42:15.184559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 603. [D 20:42:15.184634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 604. [D 20:42:15.184674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 605. [D 20:42:15.184690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 606. [D 20:42:15.184705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 607. [D 20:42:15.184719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 608. [D 20:42:15.184734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 609. [D 20:42:15.184754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 610. [D 20:42:15.184769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 611. [D 20:42:15.184784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 612. [D 20:42:15.184803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 613. [D 20:42:15.184817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 614. [D 20:42:15.184834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 615. [D 20:42:15.184851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 616. [D 20:42:15.184866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 617. [D 20:42:15.184881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 618. [D 20:42:15.184915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 619. [D 20:42:15.184933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 620. [D 20:42:15.184949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 621. [D 20:42:15.184964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 622. [D 20:42:15.184979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 623. [D 20:42:15.184993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 624. [D 20:42:15.185017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 625. [D 20:42:15.185032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 626. [D 20:42:15.185047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 627. [D 20:42:15.185061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 628. [D 20:42:15.185076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 629. [D 20:42:15.185093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 630. [D 20:42:15.185108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 631. [D 20:42:15.185123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 632. [D 20:42:15.185163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 633. [D 20:42:15.185178] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 634. [D 20:42:15.190498] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 634. [D 20:42:15.190520] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 23/70. [D 20:42:15.190650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.190673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.190687] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.195067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.195088] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.195101] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.195139] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2418 [D 20:42:15.195154] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:15.195172] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 24/70. [D 20:42:15.199120] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2418 [D 20:42:15.199182] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 25/70. [D 20:42:15.199240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 634. [D 20:42:15.199267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 635. [D 20:42:15.199282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 636. [D 20:42:15.199297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 637. [D 20:42:15.199311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 638. [D 20:42:15.199328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 639. [D 20:42:15.199343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 640. [D 20:42:15.199358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 641. [D 20:42:15.199392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 642. [D 20:42:15.199407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 643. [D 20:42:15.199422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 644. [D 20:42:15.199444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 645. [D 20:42:15.199459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 646. [D 20:42:15.199473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 647. [D 20:42:15.199488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 648. [D 20:42:15.199503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 649. [D 20:42:15.199518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 650. [D 20:42:15.199532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 651. [D 20:42:15.199548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 652. [D 20:42:15.199562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 653. [D 20:42:15.199577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 654. [D 20:42:15.199591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 655. [D 20:42:15.199606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 656. [D 20:42:15.199621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 657. [D 20:42:15.199636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 658. [D 20:42:15.199650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 659. [D 20:42:15.199665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 660. [D 20:42:15.199684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 661. [D 20:42:15.199700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 662. [D 20:42:15.199714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 663. [D 20:42:15.199730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 664. [D 20:42:15.199791] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 665. [D 20:42:15.205133] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 665. [D 20:42:15.205154] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 26/70. [D 20:42:15.205247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.205271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.205285] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.250183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.250204] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.250217] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.250254] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2420 [D 20:42:15.250269] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:15.250286] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 27/70. [D 20:42:15.254056] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2420 [D 20:42:15.254120] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 28/70. [D 20:42:15.254181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 665. [D 20:42:15.254209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 666. [D 20:42:15.254224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 667. [D 20:42:15.254238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 668. [D 20:42:15.254253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 669. [D 20:42:15.254268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 670. [D 20:42:15.254283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 671. [D 20:42:15.254299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 672. [D 20:42:15.254314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 673. [D 20:42:15.254343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 674. [D 20:42:15.254358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 675. [D 20:42:15.254373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 676. [D 20:42:15.254388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 677. [D 20:42:15.254403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 678. [D 20:42:15.254447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 679. [D 20:42:15.254466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 680. [D 20:42:15.254486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 681. [D 20:42:15.254501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 682. [D 20:42:15.254516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 683. [D 20:42:15.254530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 684. [D 20:42:15.254545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 685. [D 20:42:15.254559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 686. [D 20:42:15.254574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 687. [D 20:42:15.254599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 688. [D 20:42:15.254614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 689. [D 20:42:15.254628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 690. [D 20:42:15.254651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 691. [D 20:42:15.254666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 692. [D 20:42:15.254680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 693. [D 20:42:15.254703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 694. [D 20:42:15.254718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 695. [D 20:42:15.254732] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 696. [D 20:42:15.265895] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 696. [D 20:42:15.265922] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 29/70. [D 20:42:15.266056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.266080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.266093] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.327426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.327452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.327465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.327502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2424 [D 20:42:15.327517] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:15.327534] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 30/70. [D 20:42:15.331271] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2424 [D 20:42:15.331336] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 31/70. [D 20:42:15.331399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 696. [D 20:42:15.331442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 697. [D 20:42:15.331460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 698. [D 20:42:15.331474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 699. [D 20:42:15.331489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 700. [D 20:42:15.331504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 701. [D 20:42:15.331519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 702. [D 20:42:15.331549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 703. [D 20:42:15.331564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 704. [D 20:42:15.331579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 705. [D 20:42:15.331594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 706. [D 20:42:15.331639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 707. [D 20:42:15.331654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 708. [D 20:42:15.331674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 709. [D 20:42:15.331688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 710. [D 20:42:15.331703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 711. [D 20:42:15.331717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 712. [D 20:42:15.331732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 713. [D 20:42:15.331761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 714. [D 20:42:15.331776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 715. [D 20:42:15.331802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 716. [D 20:42:15.331817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 717. [D 20:42:15.331832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 718. [D 20:42:15.331847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 719. [D 20:42:15.331884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 720. [D 20:42:15.331899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 721. [D 20:42:15.331935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 722. [D 20:42:15.331950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 723. [D 20:42:15.331964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 724. [D 20:42:15.331979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 725. [D 20:42:15.331994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 726. [D 20:42:15.332009] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 727. [D 20:42:15.337361] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 727. [D 20:42:15.337382] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 32/70. [D 20:42:15.337465] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.337488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.337501] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.473280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.473303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.473316] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.473556] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2428 [D 20:42:15.473575] element 0: offset: 0x2aaaab01e290, size: 24 [D 20:42:15.473591] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 33/70. [D 20:42:15.473720] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2428 [D 20:42:15.473746] openib_post_sr: 10.1.4.240:43806 bh 5 len 48 wr 34/70. [D 20:42:15.475645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2428 [D 20:42:15.475667] element 0: offset: 0x2aaaab01e290, size: 24 [D 20:42:15.475683] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 35/70. [D 20:42:15.475909] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.475931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.475944] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.496075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.496097] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.496110] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.496190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2431 [D 20:42:15.496206] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:15.496223] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 36/70. [D 20:42:15.499474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.499540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.499554] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:15.500132] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2434 [D 20:42:15.500152] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:15.500172] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 37/70. [D 20:42:15.500433] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2434 [D 20:42:15.500463] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 38/70. [D 20:42:15.500641] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2431 [D 20:42:15.500669] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 39/70. [D 20:42:15.512584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 727. [D 20:42:15.512654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 728. [D 20:42:15.512670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 729. [D 20:42:15.512684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 730. [D 20:42:15.512699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 731. [D 20:42:15.512714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 732. [D 20:42:15.512729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 733. [D 20:42:15.512743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 734. [D 20:42:15.512758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 735. [D 20:42:15.512773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 736. [D 20:42:15.512787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 737. [D 20:42:15.512802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 738. [D 20:42:15.512816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 739. [D 20:42:15.512831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 740. [D 20:42:15.512846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 741. [D 20:42:15.512860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 742. [D 20:42:15.512875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 743. [D 20:42:15.512889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 744. [D 20:42:15.512904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 745. [D 20:42:15.512919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 746. [D 20:42:15.512933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 747. [D 20:42:15.512948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 748. [D 20:42:15.512963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 749. [D 20:42:15.512977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 750. [D 20:42:15.512991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 751. [D 20:42:15.513006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 752. [D 20:42:15.513021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 753. [D 20:42:15.513035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 754. [D 20:42:15.513050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 755. [D 20:42:15.513065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 756. [D 20:42:15.513081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 757. [D 20:42:15.513095] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 758. [D 20:42:15.517841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.517915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.517930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:15.517974] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2437 [D 20:42:15.517989] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:15.518008] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 40/70. [D 20:42:15.518668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2434 [D 20:42:15.518690] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:15.518710] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 41/70. [D 20:42:15.519154] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 758. [D 20:42:15.519182] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 42/70. [D 20:42:15.519329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.519350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.519363] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:15.519387] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.519400] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.519413] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:15.523172] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2437 [D 20:42:15.523243] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 43/70. [D 20:42:15.523308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 758. [D 20:42:15.523349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 759. [D 20:42:15.523365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 760. [D 20:42:15.523380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 761. [D 20:42:15.523396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 762. [D 20:42:15.523411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 763. [D 20:42:15.523426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 764. [D 20:42:15.523444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 765. [D 20:42:15.523462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 766. [D 20:42:15.523477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 767. [D 20:42:15.523492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 768. [D 20:42:15.523507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 769. [D 20:42:15.523522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 770. [D 20:42:15.523537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 771. [D 20:42:15.523551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 772. [D 20:42:15.523570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 773. [D 20:42:15.523586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 774. [D 20:42:15.523600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 775. [D 20:42:15.523615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 776. [D 20:42:15.523630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 777. [D 20:42:15.523644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 778. [D 20:42:15.523659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 779. [D 20:42:15.523678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 780. [D 20:42:15.523693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 781. [D 20:42:15.523708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 782. [D 20:42:15.523723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 783. [D 20:42:15.523748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 784. [D 20:42:15.523766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 785. [D 20:42:15.523781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 786. [D 20:42:15.523796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 787. [D 20:42:15.523812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 788. [D 20:42:15.523826] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 789. [D 20:42:15.524783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.524807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.524821] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:15.524951] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2440 [D 20:42:15.524967] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:15.524983] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 44/70. [D 20:42:15.529940] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 789. [D 20:42:15.529965] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 45/70. [D 20:42:15.530034] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2440 [D 20:42:15.530067] openib_post_sr: 10.1.4.240:43806 bh 17 len 48 wr 46/70. [D 20:42:15.530122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.530137] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.530149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:15.547639] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2440 [D 20:42:15.547705] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:15.547727] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 47/70. [D 20:42:15.547836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.547855] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.547869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.553143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.553162] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.553175] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.553295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2443 [D 20:42:15.553311] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:15.553326] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 48/70. [D 20:42:15.553540] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2443 [D 20:42:15.553567] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 49/70. [D 20:42:15.571539] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2443 [D 20:42:15.571608] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:15.571629] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 50/70. [D 20:42:15.571842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.571862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.571876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.578004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.578025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.578037] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.578072] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2447 [D 20:42:15.578086] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:15.578102] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 51/70. [D 20:42:15.582167] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2447 [D 20:42:15.582241] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 52/70. [D 20:42:15.582308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 789. [D 20:42:15.582335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 790. [D 20:42:15.582351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 791. [D 20:42:15.582365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 792. [D 20:42:15.582384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 793. [D 20:42:15.582400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 794. [D 20:42:15.582415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 795. [D 20:42:15.582429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 796. [D 20:42:15.582445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 797. [D 20:42:15.582472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 798. [D 20:42:15.582500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 799. [D 20:42:15.582515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 800. [D 20:42:15.582530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 801. [D 20:42:15.582545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 802. [D 20:42:15.582560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 803. [D 20:42:15.582574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 804. [D 20:42:15.582589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 805. [D 20:42:15.582603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 806. [D 20:42:15.582619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 807. [D 20:42:15.582651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 808. [D 20:42:15.582667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 809. [D 20:42:15.582682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 810. [D 20:42:15.582717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 811. [D 20:42:15.582731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 812. [D 20:42:15.582746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 813. [D 20:42:15.582761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 814. [D 20:42:15.582776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 815. [D 20:42:15.582790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 816. [D 20:42:15.582805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 817. [D 20:42:15.582820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 818. [D 20:42:15.582839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 819. [D 20:42:15.582853] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 820. [D 20:42:15.582998] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.583022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.583035] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:15.583165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2449 [D 20:42:15.583182] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:15.583198] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 53/70. [D 20:42:15.589074] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 820. [D 20:42:15.589102] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 54/70. [D 20:42:15.589195] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2449 [D 20:42:15.589228] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 55/70. [D 20:42:15.589275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.589290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.589302] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:15.606181] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2449 [D 20:42:15.606248] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:15.606269] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 56/70. [D 20:42:15.606345] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.606361] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.606374] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.611690] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.611711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.611724] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.611843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2452 [D 20:42:15.611859] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:15.611874] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 57/70. [D 20:42:15.611963] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2452 [D 20:42:15.611988] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 58/70. [D 20:42:15.629567] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2452 [D 20:42:15.629637] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:15.629658] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 59/70. [D 20:42:15.630034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.630055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.630068] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.633944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.633965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.633978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.634097] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2455 [D 20:42:15.634113] element 0: offset: 0x2aaaab019af0, size: 24 [D 20:42:15.634130] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 60/70. [D 20:42:15.634198] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2455 [D 20:42:15.634222] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 0/70. [D 20:42:15.640507] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2455 [D 20:42:15.640559] element 0: offset: 0x2aaaab019af0, size: 24 [D 20:42:15.640579] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 1/70. [D 20:42:15.640859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.640879] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.640892] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.642736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.642757] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.642770] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.642886] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2458 [D 20:42:15.642902] element 0: offset: 0x2aaaab01e290, size: 24 [D 20:42:15.642917] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 2/70. [D 20:42:15.647030] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2458 [D 20:42:15.647101] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 3/70. [D 20:42:15.647244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 820. [D 20:42:15.647269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 821. [D 20:42:15.647285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 822. [D 20:42:15.647299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 823. [D 20:42:15.647315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 824. [D 20:42:15.647330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 825. [D 20:42:15.647345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 826. [D 20:42:15.647360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 827. [D 20:42:15.647374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 828. [D 20:42:15.647396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 829. [D 20:42:15.647431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 830. [D 20:42:15.647473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 831. [D 20:42:15.647489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 832. [D 20:42:15.647504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 833. [D 20:42:15.647518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 834. [D 20:42:15.647542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 835. [D 20:42:15.647561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 836. [D 20:42:15.647578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 837. [D 20:42:15.647593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 838. [D 20:42:15.647608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 839. [D 20:42:15.647622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 840. [D 20:42:15.647637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 841. [D 20:42:15.647651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 842. [D 20:42:15.647666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 843. [D 20:42:15.647681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 844. [D 20:42:15.647707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 845. [D 20:42:15.647722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 846. [D 20:42:15.647737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 847. [D 20:42:15.647756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 848. [D 20:42:15.647774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 849. [D 20:42:15.647789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 850. [D 20:42:15.647813] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 851. [D 20:42:15.658305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.658330] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.658343] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:15.658385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2462 [D 20:42:15.658400] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:15.658417] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 4/70. [D 20:42:15.660268] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 851. [D 20:42:15.660297] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 5/70. [D 20:42:15.660479] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.660501] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.660514] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:15.664400] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2462 [D 20:42:15.664470] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 6/70. [D 20:42:15.664527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 851. [D 20:42:15.664551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 852. [D 20:42:15.664566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 853. [D 20:42:15.664580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 854. [D 20:42:15.664595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 855. [D 20:42:15.664610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 856. [D 20:42:15.664625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 857. [D 20:42:15.664639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 858. [D 20:42:15.664654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 859. [D 20:42:15.664668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 860. [D 20:42:15.664708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 861. [D 20:42:15.664723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 862. [D 20:42:15.664742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 863. [D 20:42:15.664756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 864. [D 20:42:15.664771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 865. [D 20:42:15.664785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 866. [D 20:42:15.664800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 867. [D 20:42:15.664815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 868. [D 20:42:15.664831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 869. [D 20:42:15.664847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 870. [D 20:42:15.664862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 871. [D 20:42:15.664877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 872. [D 20:42:15.664892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 873. [D 20:42:15.664931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 874. [D 20:42:15.664953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 875. [D 20:42:15.664968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 876. [D 20:42:15.664983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 877. [D 20:42:15.664998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 878. [D 20:42:15.665012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 879. [D 20:42:15.665046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 880. [D 20:42:15.665061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 881. [D 20:42:15.665077] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 882. [D 20:42:15.670472] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 882. [D 20:42:15.670492] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 7/70. [D 20:42:15.670577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.670600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.670614] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.750100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.750121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.750134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.750172] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2464 [D 20:42:15.750187] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:15.750204] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 8/70. [D 20:42:15.753884] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2464 [D 20:42:15.753949] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 9/70. [D 20:42:15.754011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 882. [D 20:42:15.754051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 883. [D 20:42:15.754066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 884. [D 20:42:15.754081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 885. [D 20:42:15.754096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 886. [D 20:42:15.754111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 887. [D 20:42:15.754126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 888. [D 20:42:15.754140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 889. [D 20:42:15.754155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 890. [D 20:42:15.754173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 891. [D 20:42:15.754187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 892. [D 20:42:15.754202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 893. [D 20:42:15.754217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 894. [D 20:42:15.754232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 895. [D 20:42:15.754275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 896. [D 20:42:15.754292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 897. [D 20:42:15.754307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 898. [D 20:42:15.754322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 899. [D 20:42:15.754337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 900. [D 20:42:15.754351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 901. [D 20:42:15.754366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 902. [D 20:42:15.754381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 903. [D 20:42:15.754396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 904. [D 20:42:15.754410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 905. [D 20:42:15.754425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 906. [D 20:42:15.754439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 907. [D 20:42:15.754454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 908. [D 20:42:15.754486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 909. [D 20:42:15.754501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 910. [D 20:42:15.754516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 911. [D 20:42:15.754532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 912. [D 20:42:15.754547] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 913. [D 20:42:15.759980] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 913. [D 20:42:15.760001] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 10/70. [D 20:42:15.760095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.760120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.760133] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.816941] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.816961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.816974] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.817011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2468 [D 20:42:15.817026] element 0: offset: 0x2aaaab0160f0, size: 24 [D 20:42:15.817044] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 11/70. [D 20:42:15.820985] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2468 [D 20:42:15.821049] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 12/70. [D 20:42:15.821110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 913. [D 20:42:15.821133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 914. [D 20:42:15.821149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 915. [D 20:42:15.821164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 916. [D 20:42:15.821178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 917. [D 20:42:15.821194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 918. [D 20:42:15.821209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 919. [D 20:42:15.821224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 920. [D 20:42:15.821239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 921. [D 20:42:15.821254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 922. [D 20:42:15.821278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 923. [D 20:42:15.821293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 924. [D 20:42:15.821307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 925. [D 20:42:15.821326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 926. [D 20:42:15.821340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 927. [D 20:42:15.821355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 928. [D 20:42:15.821370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 929. [D 20:42:15.821400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 930. [D 20:42:15.821415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 931. [D 20:42:15.821429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 932. [D 20:42:15.821473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 933. [D 20:42:15.821488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 934. [D 20:42:15.821510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 935. [D 20:42:15.821525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 936. [D 20:42:15.821539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 937. [D 20:42:15.821554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 938. [D 20:42:15.821569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 939. [D 20:42:15.821584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 940. [D 20:42:15.821598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 941. [D 20:42:15.821627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 942. [D 20:42:15.821643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 943. [D 20:42:15.821658] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 944. [D 20:42:15.827056] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 944. [D 20:42:15.827076] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 13/70. [D 20:42:15.827170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.827194] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.827208] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:15.898958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:15.898978] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.898991] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:15.899027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2471 [D 20:42:15.899042] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:15.899059] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 14/70. [D 20:42:15.902966] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2471 [D 20:42:15.903034] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 15/70. [D 20:42:15.903099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 944. [D 20:42:15.903162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 945. [D 20:42:15.903178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 946. [D 20:42:15.903193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 947. [D 20:42:15.903208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 948. [D 20:42:15.903223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 949. [D 20:42:15.903239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 950. [D 20:42:15.903254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 951. [D 20:42:15.903269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 952. [D 20:42:15.903284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 953. [D 20:42:15.903318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 954. [D 20:42:15.903333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 955. [D 20:42:15.903355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 956. [D 20:42:15.903370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 957. [D 20:42:15.903385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 958. [D 20:42:15.903400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 959. [D 20:42:15.903432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 960. [D 20:42:15.903457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 961. [D 20:42:15.903472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 962. [D 20:42:15.903487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 963. [D 20:42:15.903503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 964. [D 20:42:15.903518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 965. [D 20:42:15.903532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 966. [D 20:42:15.903547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 967. [D 20:42:15.903562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 968. [D 20:42:15.903576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 969. [D 20:42:15.903591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 970. [D 20:42:15.903652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 971. [D 20:42:15.903668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 972. [D 20:42:15.903683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 973. [D 20:42:15.903697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 974. [D 20:42:15.903716] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 975. [D 20:42:15.914800] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 975. [D 20:42:15.914830] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 16/70. [D 20:42:15.914961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:15.914984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:15.914997] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.057476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.057497] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.057510] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.057547] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2474 [D 20:42:16.057562] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:16.057578] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 17/70. [D 20:42:16.061337] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2474 [D 20:42:16.061403] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 18/70. [D 20:42:16.061481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 975. [D 20:42:16.061545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 976. [D 20:42:16.061562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 977. [D 20:42:16.061577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 978. [D 20:42:16.061592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 979. [D 20:42:16.061607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 980. [D 20:42:16.061622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 981. [D 20:42:16.061637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 982. [D 20:42:16.061653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 983. [D 20:42:16.061699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 984. [D 20:42:16.061714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 985. [D 20:42:16.061729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 986. [D 20:42:16.061743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 987. [D 20:42:16.061758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 988. [D 20:42:16.061772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 989. [D 20:42:16.061787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 990. [D 20:42:16.061802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 991. [D 20:42:16.061817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 992. [D 20:42:16.061843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 993. [D 20:42:16.061858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 994. [D 20:42:16.061893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 995. [D 20:42:16.061912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 996. [D 20:42:16.061931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 997. [D 20:42:16.061947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 998. [D 20:42:16.061962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 999. [D 20:42:16.061976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 1000. [D 20:42:16.061991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 1001. [D 20:42:16.062007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 1002. [D 20:42:16.062022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 1003. [D 20:42:16.062039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 1004. [D 20:42:16.062054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1005. [D 20:42:16.062069] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1006. [D 20:42:16.067496] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1006. [D 20:42:16.067520] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 19/70. [D 20:42:16.067613] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.067638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.067652] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.154268] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.154288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.154301] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.154338] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2476 [D 20:42:16.154353] element 0: offset: 0x2aaaab019af0, size: 24 [D 20:42:16.154370] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 20/70. [D 20:42:16.158063] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2476 [D 20:42:16.158128] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 21/70. [D 20:42:16.158191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1006. [D 20:42:16.158218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1007. [D 20:42:16.158233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1008. [D 20:42:16.158248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1009. [D 20:42:16.158263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1010. [D 20:42:16.158278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1011. [D 20:42:16.158292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1012. [D 20:42:16.158307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1013. [D 20:42:16.158322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1014. [D 20:42:16.158337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1015. [D 20:42:16.158354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1016. [D 20:42:16.158369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1017. [D 20:42:16.158383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1018. [D 20:42:16.158398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1019. [D 20:42:16.158413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1020. [D 20:42:16.158457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1021. [D 20:42:16.158474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1022. [D 20:42:16.158511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1023. [D 20:42:16.158526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1024. [D 20:42:16.158541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1025. [D 20:42:16.158556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1026. [D 20:42:16.158571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1027. [D 20:42:16.158585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1028. [D 20:42:16.158600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1029. [D 20:42:16.158615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1030. [D 20:42:16.158630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1031. [D 20:42:16.158645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1032. [D 20:42:16.158659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1033. [D 20:42:16.158674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1034. [D 20:42:16.158689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1035. [D 20:42:16.158706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1036. [D 20:42:16.158722] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1037. [D 20:42:16.169078] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1037. [D 20:42:16.169104] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 22/70. [D 20:42:16.169235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.169259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.169273] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.181012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.181033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.181046] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.181084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2479 [D 20:42:16.181099] element 0: offset: 0x2aaaab028380, size: 24 [D 20:42:16.181116] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 23/70. [D 20:42:16.185237] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2479 [D 20:42:16.185310] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 24/70. [D 20:42:16.186437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1037. [D 20:42:16.186471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1038. [D 20:42:16.186487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1039. [D 20:42:16.186503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1040. [D 20:42:16.186517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1041. [D 20:42:16.186532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1042. [D 20:42:16.186547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1043. [D 20:42:16.186561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1044. [D 20:42:16.186576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1045. [D 20:42:16.186599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1046. [D 20:42:16.186613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1047. [D 20:42:16.186628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1048. [D 20:42:16.186646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1049. [D 20:42:16.186661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1050. [D 20:42:16.186675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1051. [D 20:42:16.186690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1052. [D 20:42:16.186705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1053. [D 20:42:16.186720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1054. [D 20:42:16.186734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1055. [D 20:42:16.186749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1056. [D 20:42:16.186787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1057. [D 20:42:16.186805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1058. [D 20:42:16.186820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1059. [D 20:42:16.186835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1060. [D 20:42:16.186849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1061. [D 20:42:16.186864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1062. [D 20:42:16.186878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1063. [D 20:42:16.186893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1064. [D 20:42:16.186908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1065. [D 20:42:16.186923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1066. [D 20:42:16.186942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1067. [D 20:42:16.186956] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1068. [D 20:42:16.187108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.187132] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.187146] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:16.187188] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2483 [D 20:42:16.187203] element 0: offset: 0x2aaaab0282a0, size: 24 [D 20:42:16.187221] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 25/70. [D 20:42:16.192344] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1068. [D 20:42:16.192373] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 26/70. [D 20:42:16.192555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.192577] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.192590] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:16.195825] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2483 [D 20:42:16.195901] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 27/70. [D 20:42:16.195975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1068. [D 20:42:16.196001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 1069. [D 20:42:16.196016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 1070. [D 20:42:16.196042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 1071. [D 20:42:16.196058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 1072. [D 20:42:16.196072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 1073. [D 20:42:16.196087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1074. [D 20:42:16.196101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1075. [D 20:42:16.196116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1076. [D 20:42:16.196130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 1077. [D 20:42:16.196145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 1078. [D 20:42:16.196159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 1079. [D 20:42:16.196174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 1080. [D 20:42:16.196188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 1081. [D 20:42:16.196203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1082. [D 20:42:16.196217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1083. [D 20:42:16.196232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1084. [D 20:42:16.196246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 1085. [D 20:42:16.196261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 1086. [D 20:42:16.196275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 1087. [D 20:42:16.196290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 1088. [D 20:42:16.196305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 1089. [D 20:42:16.196319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1090. [D 20:42:16.196334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1091. [D 20:42:16.196348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1092. [D 20:42:16.196363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 1093. [D 20:42:16.196377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 1094. [D 20:42:16.196391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 1095. [D 20:42:16.196406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 1096. [D 20:42:16.196420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 1097. [D 20:42:16.196436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1098. [D 20:42:16.196451] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1099. [D 20:42:16.201946] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1099. [D 20:42:16.201969] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 28/70. [D 20:42:16.202046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.202067] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.202080] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.271221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.271242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.271254] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.271293] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2485 [D 20:42:16.271307] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:16.271324] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 29/70. [D 20:42:16.274929] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2485 [D 20:42:16.274993] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 30/70. [D 20:42:16.275053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1099. [D 20:42:16.275079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1100. [D 20:42:16.275094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1101. [D 20:42:16.275109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1102. [D 20:42:16.275124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1103. [D 20:42:16.275138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1104. [D 20:42:16.275153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1105. [D 20:42:16.275168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1106. [D 20:42:16.275182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1107. [D 20:42:16.275197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1108. [D 20:42:16.275211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1109. [D 20:42:16.275226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1110. [D 20:42:16.275240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1111. [D 20:42:16.275255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1112. [D 20:42:16.275271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1113. [D 20:42:16.275320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1114. [D 20:42:16.275336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1115. [D 20:42:16.275357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1116. [D 20:42:16.275373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1117. [D 20:42:16.275388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1118. [D 20:42:16.275402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1119. [D 20:42:16.275417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1120. [D 20:42:16.275432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1121. [D 20:42:16.275451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1122. [D 20:42:16.275466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1123. [D 20:42:16.275480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1124. [D 20:42:16.275506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1125. [D 20:42:16.275521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1126. [D 20:42:16.275535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1127. [D 20:42:16.275550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1128. [D 20:42:16.275568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1129. [D 20:42:16.275583] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1130. [D 20:42:16.280982] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1130. [D 20:42:16.281003] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 31/70. [D 20:42:16.281096] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.281120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.281134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.407168] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.407188] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.407201] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.407237] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2488 [D 20:42:16.407252] element 0: offset: 0x2aaaab01e290, size: 24 [D 20:42:16.407269] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 32/70. [D 20:42:16.410789] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2488 [D 20:42:16.410862] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 33/70. [D 20:42:16.410921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1130. [D 20:42:16.410941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1131. [D 20:42:16.410956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1132. [D 20:42:16.410971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1133. [D 20:42:16.410985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1134. [D 20:42:16.411000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1135. [D 20:42:16.411015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1136. [D 20:42:16.411029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1137. [D 20:42:16.411044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1138. [D 20:42:16.411059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1139. [D 20:42:16.411073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1140. [D 20:42:16.411088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1141. [D 20:42:16.411102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1142. [D 20:42:16.411117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1143. [D 20:42:16.411131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1144. [D 20:42:16.411146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1145. [D 20:42:16.411168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1146. [D 20:42:16.411183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1147. [D 20:42:16.411197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1148. [D 20:42:16.411212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1149. [D 20:42:16.411226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1150. [D 20:42:16.411241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1151. [D 20:42:16.411255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1152. [D 20:42:16.411270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1153. [D 20:42:16.411284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1154. [D 20:42:16.411299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1155. [D 20:42:16.411313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1156. [D 20:42:16.411327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1157. [D 20:42:16.411342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1158. [D 20:42:16.411362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1159. [D 20:42:16.411376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1160. [D 20:42:16.411391] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1161. [D 20:42:16.416857] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1161. [D 20:42:16.416878] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 34/70. [D 20:42:16.416969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.417030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.417044] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.450211] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.450234] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.450247] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.450286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2491 [D 20:42:16.450301] element 0: offset: 0x2aaaab026890, size: 24 [D 20:42:16.450321] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 35/70. [D 20:42:16.454279] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2491 [D 20:42:16.454304] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 36/70. [D 20:42:16.454367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1161. [D 20:42:16.454386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1162. [D 20:42:16.454401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1163. [D 20:42:16.454416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1164. [D 20:42:16.454431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1165. [D 20:42:16.454446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1166. [D 20:42:16.454460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1167. [D 20:42:16.454474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1168. [D 20:42:16.454489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1169. [D 20:42:16.454503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1170. [D 20:42:16.454518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1171. [D 20:42:16.454536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1172. [D 20:42:16.454551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1173. [D 20:42:16.454566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1174. [D 20:42:16.454580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1175. [D 20:42:16.454595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1176. [D 20:42:16.454610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1177. [D 20:42:16.454624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1178. [D 20:42:16.454639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1179. [D 20:42:16.454654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1180. [D 20:42:16.454669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1181. [D 20:42:16.454683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1182. [D 20:42:16.454698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1183. [D 20:42:16.454713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1184. [D 20:42:16.454728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1185. [D 20:42:16.454742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1186. [D 20:42:16.454757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1187. [D 20:42:16.454771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1188. [D 20:42:16.454798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1189. [D 20:42:16.454814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1190. [D 20:42:16.454829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1191. [D 20:42:16.454844] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1192. [D 20:42:16.460255] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1192. [D 20:42:16.460275] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 37/70. [D 20:42:16.460360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.460420] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.460433] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.467801] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.467825] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.467838] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.467877] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2495 [D 20:42:16.467892] element 0: offset: 0x2aaaab019d00, size: 24 [D 20:42:16.467911] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 38/70. [D 20:42:16.471800] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2495 [D 20:42:16.471829] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 39/70. [D 20:42:16.471892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1192. [D 20:42:16.471912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1193. [D 20:42:16.471927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1194. [D 20:42:16.471942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1195. [D 20:42:16.471956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1196. [D 20:42:16.471971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1197. [D 20:42:16.471985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1198. [D 20:42:16.472000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1199. [D 20:42:16.472014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1200. [D 20:42:16.472028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1201. [D 20:42:16.472043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1202. [D 20:42:16.472061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1203. [D 20:42:16.472076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1204. [D 20:42:16.472091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1205. [D 20:42:16.472105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1206. [D 20:42:16.472119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1207. [D 20:42:16.472134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1208. [D 20:42:16.472148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1209. [D 20:42:16.472162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1210. [D 20:42:16.472177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1211. [D 20:42:16.472191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1212. [D 20:42:16.472205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1213. [D 20:42:16.472220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1214. [D 20:42:16.472234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1215. [D 20:42:16.472248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1216. [D 20:42:16.472263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1217. [D 20:42:16.472277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1218. [D 20:42:16.472291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1219. [D 20:42:16.472306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1220. [D 20:42:16.472320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1221. [D 20:42:16.472336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1222. [D 20:42:16.472350] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1223. [D 20:42:16.481425] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1223. [D 20:42:16.481447] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 40/70. [D 20:42:16.481585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.481642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.481656] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.490456] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.490477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.490490] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.490529] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2497 [D 20:42:16.490544] element 0: offset: 0x2aaaab02cc00, size: 24 [D 20:42:16.490564] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 41/70. [D 20:42:16.494254] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2497 [D 20:42:16.494283] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 42/70. [D 20:42:16.494417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1223. [D 20:42:16.494442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1224. [D 20:42:16.494463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1225. [D 20:42:16.494482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1226. [D 20:42:16.494501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1227. [D 20:42:16.494524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1228. [D 20:42:16.494540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1229. [D 20:42:16.494556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1230. [D 20:42:16.494574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1231. [D 20:42:16.494593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1232. [D 20:42:16.494611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1233. [D 20:42:16.494630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1234. [D 20:42:16.494663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1235. [D 20:42:16.494681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1236. [D 20:42:16.494700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1237. [D 20:42:16.494718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1238. [D 20:42:16.494737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1239. [D 20:42:16.494755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1240. [D 20:42:16.494774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1241. [D 20:42:16.494792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1242. [D 20:42:16.494811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1243. [D 20:42:16.494829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1244. [D 20:42:16.494848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1245. [D 20:42:16.494866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1246. [D 20:42:16.494885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1247. [D 20:42:16.494903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1248. [D 20:42:16.494922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1249. [D 20:42:16.494941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1250. [D 20:42:16.494960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1251. [D 20:42:16.494979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1252. [D 20:42:16.494997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1253. [D 20:42:16.495013] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1254. [D 20:42:16.500344] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1254. [D 20:42:16.500368] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 43/70. [D 20:42:16.500460] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.500513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.500527] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:16.521483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:16.521503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.521516] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:16.521554] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2500 [D 20:42:16.521569] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:16.521588] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 44/70. [D 20:42:16.527333] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2500 [D 20:42:16.527394] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 45/70. [D 20:42:16.527466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1254. [D 20:42:16.527486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1255. [D 20:42:16.527502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1256. [D 20:42:16.527522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1257. [D 20:42:16.527537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1258. [D 20:42:16.527552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1259. [D 20:42:16.527566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1260. [D 20:42:16.527586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1261. [D 20:42:16.527624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1262. [D 20:42:16.527641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1263. [D 20:42:16.527659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1264. [D 20:42:16.527677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1265. [D 20:42:16.527705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1266. [D 20:42:16.527723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1267. [D 20:42:16.527740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1268. [D 20:42:16.527758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1269. [D 20:42:16.527776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1270. [D 20:42:16.527794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1271. [D 20:42:16.527812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1272. [D 20:42:16.527833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1273. [D 20:42:16.527851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1274. [D 20:42:16.527869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1275. [D 20:42:16.527887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1276. [D 20:42:16.527905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1277. [D 20:42:16.527923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1278. [D 20:42:16.527941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1279. [D 20:42:16.527956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1280. [D 20:42:16.527971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1281. [D 20:42:16.527989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1282. [D 20:42:16.528006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1283. [D 20:42:16.528021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1284. [D 20:42:16.528036] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1285. [D 20:42:16.538975] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1285. [D 20:42:16.539000] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 46/70. [D 20:42:16.539099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:16.539153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:16.539167] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.183442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.183466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.183480] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.183517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2503 [D 20:42:17.183532] element 0: offset: 0x2aaaab026630, size: 24 [D 20:42:17.183551] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 47/70. [D 20:42:17.187123] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2503 [D 20:42:17.187234] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 48/70. [D 20:42:17.187361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1285. [D 20:42:17.187386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1286. [D 20:42:17.187408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1287. [D 20:42:17.187427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1288. [D 20:42:17.187445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1289. [D 20:42:17.187496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1290. [D 20:42:17.187514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1291. [D 20:42:17.187533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1292. [D 20:42:17.187551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1293. [D 20:42:17.187569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1294. [D 20:42:17.187587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1295. [D 20:42:17.187616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1296. [D 20:42:17.187635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1297. [D 20:42:17.187653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1298. [D 20:42:17.187672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1299. [D 20:42:17.187690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1300. [D 20:42:17.187706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1301. [D 20:42:17.187721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1302. [D 20:42:17.187739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1303. [D 20:42:17.187758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1304. [D 20:42:17.187777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1305. [D 20:42:17.187794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1306. [D 20:42:17.187813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1307. [D 20:42:17.187831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1308. [D 20:42:17.187849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1309. [D 20:42:17.187871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1310. [D 20:42:17.187890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1311. [D 20:42:17.187908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1312. [D 20:42:17.187927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1313. [D 20:42:17.187945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1314. [D 20:42:17.187964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1315. [D 20:42:17.187979] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1316. [D 20:42:17.193295] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1316. [D 20:42:17.193320] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 49/70. [D 20:42:17.193417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.193475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.193489] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.265244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.265264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.265277] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.265316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2506 [D 20:42:17.265331] element 0: offset: 0x2aaaab020520, size: 24 [D 20:42:17.265350] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 50/70. [D 20:42:17.268855] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2506 [D 20:42:17.268885] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 51/70. [D 20:42:17.268953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1316. [D 20:42:17.268976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1317. [D 20:42:17.268991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1318. [D 20:42:17.269006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1319. [D 20:42:17.269021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1320. [D 20:42:17.269036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1321. [D 20:42:17.269050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1322. [D 20:42:17.269265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1323. [D 20:42:17.269286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1324. [D 20:42:17.269301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1325. [D 20:42:17.269316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1326. [D 20:42:17.269347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1327. [D 20:42:17.269365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1328. [D 20:42:17.269384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1329. [D 20:42:17.269408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1330. [D 20:42:17.269438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1331. [D 20:42:17.269456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1332. [D 20:42:17.269474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1333. [D 20:42:17.269493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1334. [D 20:42:17.269511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1335. [D 20:42:17.269546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1336. [D 20:42:17.269564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1337. [D 20:42:17.269582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1338. [D 20:42:17.269600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1339. [D 20:42:17.269619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1340. [D 20:42:17.269647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1341. [D 20:42:17.269674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1342. [D 20:42:17.269693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1343. [D 20:42:17.269711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1344. [D 20:42:17.269729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1345. [D 20:42:17.269747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1346. [D 20:42:17.269766] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1347. [D 20:42:17.275630] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1347. [D 20:42:17.275653] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 52/70. [D 20:42:17.275750] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.275803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.275817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.586893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.586914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.586927] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.586965] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2509 [D 20:42:17.586980] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:17.586999] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 53/70. [D 20:42:17.590567] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2509 [D 20:42:17.590651] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 54/70. [D 20:42:17.590736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1347. [D 20:42:17.590762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1348. [D 20:42:17.590780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1349. [D 20:42:17.590795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1350. [D 20:42:17.590810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1351. [D 20:42:17.590825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1352. [D 20:42:17.590875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1353. [D 20:42:17.590893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1354. [D 20:42:17.590912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1355. [D 20:42:17.590930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1356. [D 20:42:17.590949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1357. [D 20:42:17.590967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1358. [D 20:42:17.590985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1359. [D 20:42:17.591004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1360. [D 20:42:17.591022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1361. [D 20:42:17.591041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1362. [D 20:42:17.591068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1363. [D 20:42:17.591087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1364. [D 20:42:17.591105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1365. [D 20:42:17.591124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1366. [D 20:42:17.591142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1367. [D 20:42:17.591161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1368. [D 20:42:17.591197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1369. [D 20:42:17.591215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1370. [D 20:42:17.591234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1371. [D 20:42:17.591252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1372. [D 20:42:17.591268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1373. [D 20:42:17.591284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1374. [D 20:42:17.591301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1375. [D 20:42:17.591320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1376. [D 20:42:17.591336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1377. [D 20:42:17.591351] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1378. [D 20:42:17.596705] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1378. [D 20:42:17.596730] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 55/70. [D 20:42:17.596826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.596878] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.596892] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.677509] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.677528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.677541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.677578] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2512 [D 20:42:17.677593] element 0: offset: 0x2aaaab019af0, size: 24 [D 20:42:17.677612] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 56/70. [D 20:42:17.681090] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2512 [D 20:42:17.681119] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 57/70. [D 20:42:17.681186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1378. [D 20:42:17.681206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1379. [D 20:42:17.681221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1380. [D 20:42:17.681236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1381. [D 20:42:17.681250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1382. [D 20:42:17.681265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1383. [D 20:42:17.681280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1384. [D 20:42:17.681487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1385. [D 20:42:17.681524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1386. [D 20:42:17.681539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1387. [D 20:42:17.681554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1388. [D 20:42:17.681568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1389. [D 20:42:17.681583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1390. [D 20:42:17.681597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1391. [D 20:42:17.681612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1392. [D 20:42:17.681631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1393. [D 20:42:17.681645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1394. [D 20:42:17.681660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1395. [D 20:42:17.681675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1396. [D 20:42:17.681689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1397. [D 20:42:17.681704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1398. [D 20:42:17.681718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1399. [D 20:42:17.681733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1400. [D 20:42:17.681763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1401. [D 20:42:17.681778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1402. [D 20:42:17.681793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1403. [D 20:42:17.681808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1404. [D 20:42:17.681822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1405. [D 20:42:17.681836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1406. [D 20:42:17.681851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1407. [D 20:42:17.681875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1408. [D 20:42:17.681890] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1409. [D 20:42:17.687140] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1409. [D 20:42:17.687162] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 58/70. [D 20:42:17.687263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.687315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.687329] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.715701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.715722] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.715735] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.715774] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2515 [D 20:42:17.715788] element 0: offset: 0x2aaaab020060, size: 24 [D 20:42:17.715808] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 59/70. [D 20:42:17.719389] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2515 [D 20:42:17.719415] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 60/70. [D 20:42:17.719467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1409. [D 20:42:17.719484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1410. [D 20:42:17.719501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1411. [D 20:42:17.719516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1412. [D 20:42:17.719531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1413. [D 20:42:17.719545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1414. [D 20:42:17.719560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1415. [D 20:42:17.719575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1416. [D 20:42:17.719590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1417. [D 20:42:17.719605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1418. [D 20:42:17.719619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1419. [D 20:42:17.719636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1420. [D 20:42:17.719650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1421. [D 20:42:17.719665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1422. [D 20:42:17.719680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1423. [D 20:42:17.719694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1424. [D 20:42:17.719726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1425. [D 20:42:17.719741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1426. [D 20:42:17.719757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1427. [D 20:42:17.719772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1428. [D 20:42:17.719786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1429. [D 20:42:17.719802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1430. [D 20:42:17.719857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1431. [D 20:42:17.719872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1432. [D 20:42:17.719891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1433. [D 20:42:17.719918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1434. [D 20:42:17.719933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1435. [D 20:42:17.719948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1436. [D 20:42:17.719962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1437. [D 20:42:17.719977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1438. [D 20:42:17.719991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1439. [D 20:42:17.720006] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1440. [D 20:42:17.725411] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1440. [D 20:42:17.725435] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 0/70. [D 20:42:17.725535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.725587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.725601] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.850817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.850840] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.850853] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.850890] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2518 [D 20:42:17.850905] element 0: offset: 0x2aaaab028380, size: 24 [D 20:42:17.850924] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 1/70. [D 20:42:17.854633] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2518 [D 20:42:17.854707] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 2/70. [D 20:42:17.854876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1440. [D 20:42:17.854902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1441. [D 20:42:17.854924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1442. [D 20:42:17.854943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1443. [D 20:42:17.854961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1444. [D 20:42:17.854980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1445. [D 20:42:17.854998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1446. [D 20:42:17.855017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1447. [D 20:42:17.855035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1448. [D 20:42:17.855054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1449. [D 20:42:17.855072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1450. [D 20:42:17.855091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1451. [D 20:42:17.855110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1452. [D 20:42:17.855128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1453. [D 20:42:17.855147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1454. [D 20:42:17.855166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1455. [D 20:42:17.855184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1456. [D 20:42:17.855203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1457. [D 20:42:17.855222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1458. [D 20:42:17.855240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1459. [D 20:42:17.855259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1460. [D 20:42:17.855278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1461. [D 20:42:17.855296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1462. [D 20:42:17.855315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1463. [D 20:42:17.855334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1464. [D 20:42:17.855352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1465. [D 20:42:17.855369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1466. [D 20:42:17.855390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1467. [D 20:42:17.855408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1468. [D 20:42:17.855427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1469. [D 20:42:17.855445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1470. [D 20:42:17.855461] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1471. [D 20:42:17.860768] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1471. [D 20:42:17.860792] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 3/70. [D 20:42:17.860886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.860938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.860953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.880386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.880407] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.880420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.880457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2521 [D 20:42:17.880472] element 0: offset: 0x2aaaab0282a0, size: 24 [D 20:42:17.880492] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 4/70. [D 20:42:17.884424] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2521 [D 20:42:17.884460] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 5/70. [D 20:42:17.884512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1471. [D 20:42:17.884529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1472. [D 20:42:17.884544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1473. [D 20:42:17.884559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1474. [D 20:42:17.884573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1475. [D 20:42:17.884606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1476. [D 20:42:17.884620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1477. [D 20:42:17.884635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1478. [D 20:42:17.884649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1479. [D 20:42:17.884664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1480. [D 20:42:17.884679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1481. [D 20:42:17.884693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1482. [D 20:42:17.884708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1483. [D 20:42:17.884723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1484. [D 20:42:17.884738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1485. [D 20:42:17.884770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1486. [D 20:42:17.884784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1487. [D 20:42:17.884805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1488. [D 20:42:17.884819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1489. [D 20:42:17.884834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1490. [D 20:42:17.884849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1491. [D 20:42:17.884864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1492. [D 20:42:17.884879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1493. [D 20:42:17.884894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1494. [D 20:42:17.884911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1495. [D 20:42:17.884928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1496. [D 20:42:17.884942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1497. [D 20:42:17.884963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1498. [D 20:42:17.885005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1499. [D 20:42:17.885038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1500. [D 20:42:17.885053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1501. [D 20:42:17.885068] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1502. [D 20:42:17.891760] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 1502. [D 20:42:17.891780] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 6/70. [D 20:42:17.891882] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.891935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.891949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.905584] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.905606] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.905619] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.905657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2525 [D 20:42:17.905672] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:17.907782] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 7/70. [D 20:42:17.907834] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.907850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.907863] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:17.907887] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2528 [D 20:42:17.907902] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:17.907920] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 8/70. [D 20:42:17.915066] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2525 [D 20:42:17.915140] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 9/70. [D 20:42:17.915164] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2528 [D 20:42:17.915183] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 10/70. [D 20:42:17.915337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1502. [D 20:42:17.915374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1503. [D 20:42:17.915392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1504. [D 20:42:17.915408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1505. [D 20:42:17.915429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1506. [D 20:42:17.915448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1507. [D 20:42:17.915469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1508. [D 20:42:17.915485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1509. [D 20:42:17.915500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1510. [D 20:42:17.915515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1511. [D 20:42:17.915535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1512. [D 20:42:17.915554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1513. [D 20:42:17.915573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1514. [D 20:42:17.915591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1515. [D 20:42:17.915610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1516. [D 20:42:17.915629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1517. [D 20:42:17.915647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1518. [D 20:42:17.915666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1519. [D 20:42:17.915684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1520. [D 20:42:17.915703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1521. [D 20:42:17.915722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1522. [D 20:42:17.915740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1523. [D 20:42:17.915759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1524. [D 20:42:17.915777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1525. [D 20:42:17.915796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1526. [D 20:42:17.915815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1527. [D 20:42:17.915834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1528. [D 20:42:17.915853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1529. [D 20:42:17.915872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1530. [D 20:42:17.915891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1531. [D 20:42:17.915914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1532. [D 20:42:17.915929] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1533. [D 20:42:17.915947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1534. [D 20:42:17.915962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1535. [D 20:42:17.915976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1536. [D 20:42:17.915991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1537. [D 20:42:17.916005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1538. [D 20:42:17.916020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1539. [D 20:42:17.916035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1540. [D 20:42:17.916049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1541. [D 20:42:17.916064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1542. [D 20:42:17.916078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1543. [D 20:42:17.916093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1544. [D 20:42:17.916107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1545. [D 20:42:17.916122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1546. [D 20:42:17.916136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1547. [D 20:42:17.916151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1548. [D 20:42:17.916165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1549. [D 20:42:17.916179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1550. [D 20:42:17.916194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1551. [D 20:42:17.916209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1552. [D 20:42:17.916223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1553. [D 20:42:17.916238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1554. [D 20:42:17.916252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1555. [D 20:42:17.916267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1556. [D 20:42:17.916281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1557. [D 20:42:17.916296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1558. [D 20:42:17.916320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1559. [D 20:42:17.916336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1560. [D 20:42:17.916350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1561. [D 20:42:17.916366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1562. [D 20:42:17.916381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1563. [D 20:42:17.916395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1564. [D 20:42:17.916410] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1565. [D 20:42:17.927262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.927308] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1565. [D 20:42:17.927332] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.927347] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 11/70. [D 20:42:17.927351] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:17.927431] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2530 [D 20:42:17.927447] element 0: offset: 0x2aaaab0379a0, size: 24 [D 20:42:17.927473] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 12/70. [D 20:42:17.936497] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 1564. [D 20:42:17.936528] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 13/70. [D 20:42:17.936622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.936645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.936658] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:17.936744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.936759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.936772] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:17.940489] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2530 [D 20:42:17.940515] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 14/70. [D 20:42:17.940576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 1564. [D 20:42:17.940594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 1565. [D 20:42:17.940609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1566. [D 20:42:17.940624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1567. [D 20:42:17.940639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1568. [D 20:42:17.940654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1569. [D 20:42:17.940695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1570. [D 20:42:17.940710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1571. [D 20:42:17.940725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1572. [D 20:42:17.940740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1573. [D 20:42:17.940755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1574. [D 20:42:17.940770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1575. [D 20:42:17.940785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1576. [D 20:42:17.940800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1577. [D 20:42:17.940833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1578. [D 20:42:17.940848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1579. [D 20:42:17.940868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1580. [D 20:42:17.940883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1581. [D 20:42:17.940897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1582. [D 20:42:17.940912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1583. [D 20:42:17.940927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1584. [D 20:42:17.940941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1585. [D 20:42:17.940956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1586. [D 20:42:17.940971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1587. [D 20:42:17.940985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1588. [D 20:42:17.941000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1589. [D 20:42:17.941015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1590. [D 20:42:17.941054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1591. [D 20:42:17.941070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1592. [D 20:42:17.941094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1593. [D 20:42:17.941109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1594. [D 20:42:17.941124] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1595. [D 20:42:17.948395] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1595. [D 20:42:17.948461] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 15/70. [D 20:42:17.948559] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.948614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.948628] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:17.980281] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:17.980302] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.980315] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:17.980357] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2533 [D 20:42:17.980372] element 0: offset: 0x2aaaab026890, size: 24 [D 20:42:17.980392] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 16/70. [D 20:42:17.984148] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2533 [D 20:42:17.984204] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 17/70. [D 20:42:17.984289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1595. [D 20:42:17.984317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1596. [D 20:42:17.984333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1597. [D 20:42:17.984351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1598. [D 20:42:17.984365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1599. [D 20:42:17.984380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1600. [D 20:42:17.984419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1601. [D 20:42:17.984435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1602. [D 20:42:17.984451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1603. [D 20:42:17.984466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1604. [D 20:42:17.984487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1605. [D 20:42:17.984505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1606. [D 20:42:17.984545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1607. [D 20:42:17.984563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1608. [D 20:42:17.984581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1609. [D 20:42:17.984599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1610. [D 20:42:17.984618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1611. [D 20:42:17.984636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1612. [D 20:42:17.984655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1613. [D 20:42:17.984688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1614. [D 20:42:17.984706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1615. [D 20:42:17.984724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1616. [D 20:42:17.984743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1617. [D 20:42:17.984761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1618. [D 20:42:17.984780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1619. [D 20:42:17.984808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1620. [D 20:42:17.984826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1621. [D 20:42:17.984844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1622. [D 20:42:17.984863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1623. [D 20:42:17.984882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1624. [D 20:42:17.984908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1625. [D 20:42:17.984922] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1626. [D 20:42:17.991023] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1626. [D 20:42:17.991048] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 18/70. [D 20:42:17.991144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:17.991197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:17.991211] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.070322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.070343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.070356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.070394] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2537 [D 20:42:18.070409] element 0: offset: 0x2aaaab02cc00, size: 24 [D 20:42:18.070429] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 19/70. [D 20:42:18.074003] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2537 [D 20:42:18.074030] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 20/70. [D 20:42:18.074083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1626. [D 20:42:18.074105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1627. [D 20:42:18.074120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1628. [D 20:42:18.074134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1629. [D 20:42:18.074149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1630. [D 20:42:18.074163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1631. [D 20:42:18.074181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1632. [D 20:42:18.074195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1633. [D 20:42:18.074210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1634. [D 20:42:18.074225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1635. [D 20:42:18.074240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1636. [D 20:42:18.074275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1637. [D 20:42:18.074294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1638. [D 20:42:18.074315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1639. [D 20:42:18.074330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1640. [D 20:42:18.074345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1641. [D 20:42:18.074372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1642. [D 20:42:18.074387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1643. [D 20:42:18.074401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1644. [D 20:42:18.074416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1645. [D 20:42:18.074431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1646. [D 20:42:18.074450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1647. [D 20:42:18.074464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1648. [D 20:42:18.074479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1649. [D 20:42:18.074493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1650. [D 20:42:18.074508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1651. [D 20:42:18.074523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1652. [D 20:42:18.074537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1653. [D 20:42:18.074595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1654. [D 20:42:18.074619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1655. [D 20:42:18.074634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1656. [D 20:42:18.074649] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1657. [D 20:42:18.080053] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1657. [D 20:42:18.080073] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 21/70. [D 20:42:18.080175] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.080227] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.080242] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.130993] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.131014] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.131027] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.131066] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2539 [D 20:42:18.131081] element 0: offset: 0x2aaaab026630, size: 24 [D 20:42:18.131100] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 22/70. [D 20:42:18.135012] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2539 [D 20:42:18.135057] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 23/70. [D 20:42:18.135109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1657. [D 20:42:18.135126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1658. [D 20:42:18.135147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1659. [D 20:42:18.135162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1660. [D 20:42:18.135177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1661. [D 20:42:18.135192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1662. [D 20:42:18.135226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1663. [D 20:42:18.135241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1664. [D 20:42:18.135256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1665. [D 20:42:18.135280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1666. [D 20:42:18.135295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1667. [D 20:42:18.135309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1668. [D 20:42:18.135328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1669. [D 20:42:18.135343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1670. [D 20:42:18.135357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1671. [D 20:42:18.135372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1672. [D 20:42:18.135387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1673. [D 20:42:18.135401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1674. [D 20:42:18.135416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1675. [D 20:42:18.135451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1676. [D 20:42:18.135510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1677. [D 20:42:18.135529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1678. [D 20:42:18.135544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1679. [D 20:42:18.135559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1680. [D 20:42:18.135574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1681. [D 20:42:18.135589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1682. [D 20:42:18.135606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1683. [D 20:42:18.135621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1684. [D 20:42:18.135636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1685. [D 20:42:18.135651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1686. [D 20:42:18.135684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1687. [D 20:42:18.135698] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1688. [D 20:42:18.141024] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1688. [D 20:42:18.141044] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 24/70. [D 20:42:18.141145] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.141196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.141210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.177331] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.177352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.177366] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.177404] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2542 [D 20:42:18.177419] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:18.177438] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 25/70. [D 20:42:18.181032] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2542 [D 20:42:18.181059] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 26/70. [D 20:42:18.181112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1688. [D 20:42:18.181129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1689. [D 20:42:18.181144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1690. [D 20:42:18.181159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1691. [D 20:42:18.181174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1692. [D 20:42:18.181189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1693. [D 20:42:18.181205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1694. [D 20:42:18.181220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1695. [D 20:42:18.181235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1696. [D 20:42:18.181249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1697. [D 20:42:18.181265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1698. [D 20:42:18.181297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1699. [D 20:42:18.181312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1700. [D 20:42:18.181332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1701. [D 20:42:18.181347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1702. [D 20:42:18.181362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1703. [D 20:42:18.181376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1704. [D 20:42:18.181391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1705. [D 20:42:18.181405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1706. [D 20:42:18.181433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1707. [D 20:42:18.181448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1708. [D 20:42:18.181463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1709. [D 20:42:18.181477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1710. [D 20:42:18.181492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1711. [D 20:42:18.181511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1712. [D 20:42:18.181537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1713. [D 20:42:18.181552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1714. [D 20:42:18.181566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1715. [D 20:42:18.181581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1716. [D 20:42:18.181595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1717. [D 20:42:18.181610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1718. [D 20:42:18.181660] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1719. [D 20:42:18.191338] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1719. [D 20:42:18.191360] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 27/70. [D 20:42:18.191466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.191517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.191531] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.240163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.240184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.240197] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.240235] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2545 [D 20:42:18.240250] element 0: offset: 0x2aaaab000ca0, size: 24 [D 20:42:18.240269] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 28/70. [D 20:42:18.244685] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2545 [D 20:42:18.244727] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 29/70. [D 20:42:18.244784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1719. [D 20:42:18.244802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1720. [D 20:42:18.244817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1721. [D 20:42:18.244832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1722. [D 20:42:18.244847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1723. [D 20:42:18.244865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1724. [D 20:42:18.244882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1725. [D 20:42:18.244897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1726. [D 20:42:18.244912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1727. [D 20:42:18.244945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1728. [D 20:42:18.244960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1729. [D 20:42:18.244974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1730. [D 20:42:18.244996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1731. [D 20:42:18.245011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1732. [D 20:42:18.245025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1733. [D 20:42:18.245040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1734. [D 20:42:18.245054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1735. [D 20:42:18.245069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1736. [D 20:42:18.245084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1737. [D 20:42:18.245098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1738. [D 20:42:18.245121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1739. [D 20:42:18.245161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1740. [D 20:42:18.245179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1741. [D 20:42:18.245198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1742. [D 20:42:18.245213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1743. [D 20:42:18.245228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1744. [D 20:42:18.245263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1745. [D 20:42:18.245279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1746. [D 20:42:18.245294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1747. [D 20:42:18.245308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1748. [D 20:42:18.245323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1749. [D 20:42:18.245337] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1750. [D 20:42:18.250704] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1750. [D 20:42:18.250726] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 30/70. [D 20:42:18.250826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.250876] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.250890] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.325430] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.325452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.325465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.325502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2549 [D 20:42:18.325517] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:18.325536] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 31/70. [D 20:42:18.329429] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2549 [D 20:42:18.329476] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 32/70. [D 20:42:18.329529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1750. [D 20:42:18.329548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1751. [D 20:42:18.329563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1752. [D 20:42:18.329577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1753. [D 20:42:18.329602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1754. [D 20:42:18.329617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1755. [D 20:42:18.329631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1756. [D 20:42:18.329650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1757. [D 20:42:18.329667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1758. [D 20:42:18.329684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1759. [D 20:42:18.329698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1760. [D 20:42:18.329713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1761. [D 20:42:18.329728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1762. [D 20:42:18.329743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1763. [D 20:42:18.329757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1764. [D 20:42:18.329776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1765. [D 20:42:18.329824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1766. [D 20:42:18.329840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1767. [D 20:42:18.329854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1768. [D 20:42:18.329869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1769. [D 20:42:18.329884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1770. [D 20:42:18.329899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1771. [D 20:42:18.329914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1772. [D 20:42:18.329928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1773. [D 20:42:18.329943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1774. [D 20:42:18.329958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1775. [D 20:42:18.329975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1776. [D 20:42:18.329992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1777. [D 20:42:18.330007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1778. [D 20:42:18.330028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1779. [D 20:42:18.330075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1780. [D 20:42:18.330095] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1781. [D 20:42:18.335473] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1781. [D 20:42:18.335493] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 33/70. [D 20:42:18.335594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.335645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.335659] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.483884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.483906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.483919] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.483958] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2551 [D 20:42:18.483974] element 0: offset: 0x2aaaab038e20, size: 24 [D 20:42:18.483994] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 34/70. [D 20:42:18.487519] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2551 [D 20:42:18.487547] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 35/70. [D 20:42:18.487601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 1781. [D 20:42:18.487622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 1782. [D 20:42:18.487637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 1783. [D 20:42:18.487651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 1784. [D 20:42:18.487666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 1785. [D 20:42:18.487681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 1786. [D 20:42:18.487698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 1787. [D 20:42:18.487712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 1788. [D 20:42:18.487727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 1789. [D 20:42:18.487741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 1790. [D 20:42:18.487756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 1791. [D 20:42:18.487788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 1792. [D 20:42:18.487803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 1793. [D 20:42:18.487828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 1794. [D 20:42:18.487843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 1795. [D 20:42:18.487858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 1796. [D 20:42:18.487872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 1797. [D 20:42:18.487887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 1798. [D 20:42:18.487901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 1799. [D 20:42:18.487916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 1800. [D 20:42:18.487930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 1801. [D 20:42:18.487949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 1802. [D 20:42:18.487977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 1803. [D 20:42:18.487992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 1804. [D 20:42:18.488008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 1805. [D 20:42:18.488023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 1806. [D 20:42:18.488038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 1807. [D 20:42:18.488052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 1808. [D 20:42:18.488067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 1809. [D 20:42:18.488140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 1810. [D 20:42:18.488160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 1811. [D 20:42:18.488175] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 1812. [D 20:42:18.493492] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1812. [D 20:42:18.493514] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 36/70. [D 20:42:18.493618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.493670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.493684] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.519482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.519504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.519517] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.519554] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2554 [D 20:42:18.519570] element 0: offset: 0x2aaaab028380, size: 24 [D 20:42:18.519588] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 37/70. [D 20:42:18.523462] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2554 [D 20:42:18.523493] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 38/70. [D 20:42:18.523637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1812. [D 20:42:18.523659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1813. [D 20:42:18.523676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1814. [D 20:42:18.523690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1815. [D 20:42:18.523705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1816. [D 20:42:18.523724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1817. [D 20:42:18.523739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1818. [D 20:42:18.523753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1819. [D 20:42:18.523769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1820. [D 20:42:18.523788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1821. [D 20:42:18.523802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1822. [D 20:42:18.523817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1823. [D 20:42:18.523835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1824. [D 20:42:18.523850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1825. [D 20:42:18.523865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1826. [D 20:42:18.523879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1827. [D 20:42:18.523894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1828. [D 20:42:18.523909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1829. [D 20:42:18.523940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1830. [D 20:42:18.523959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1831. [D 20:42:18.523978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1832. [D 20:42:18.523993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1833. [D 20:42:18.524008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1834. [D 20:42:18.524023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1835. [D 20:42:18.524037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1836. [D 20:42:18.524052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1837. [D 20:42:18.524066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1838. [D 20:42:18.524081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1839. [D 20:42:18.524096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1840. [D 20:42:18.524114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1841. [D 20:42:18.524128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1842. [D 20:42:18.524143] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1843. [D 20:42:18.529907] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1843. [D 20:42:18.529932] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 39/70. [D 20:42:18.530036] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.530095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.530109] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.530397] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.530418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.530431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.530471] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2557 [D 20:42:18.530486] element 0: offset: 0x2aaaab0282a0, size: 24 [D 20:42:18.530507] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 40/70. [D 20:42:18.534091] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2557 [D 20:42:18.534117] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 41/70. [D 20:42:18.534167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1843. [D 20:42:18.534187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1844. [D 20:42:18.534202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1845. [D 20:42:18.534217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1846. [D 20:42:18.534231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1847. [D 20:42:18.534246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1848. [D 20:42:18.534263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1849. [D 20:42:18.534278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1850. [D 20:42:18.534292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1851. [D 20:42:18.534307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1852. [D 20:42:18.534322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1853. [D 20:42:18.534357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1854. [D 20:42:18.534376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1855. [D 20:42:18.534397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1856. [D 20:42:18.534412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1857. [D 20:42:18.534426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1858. [D 20:42:18.534453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1859. [D 20:42:18.534468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1860. [D 20:42:18.534483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1861. [D 20:42:18.534497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1862. [D 20:42:18.534512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1863. [D 20:42:18.534531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1864. [D 20:42:18.534546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1865. [D 20:42:18.534560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1866. [D 20:42:18.534575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1867. [D 20:42:18.534590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1868. [D 20:42:18.534617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1869. [D 20:42:18.534633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1870. [D 20:42:18.534675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1871. [D 20:42:18.534690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1872. [D 20:42:18.534712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1873. [D 20:42:18.534727] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1874. [D 20:42:18.540094] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1874. [D 20:42:18.540114] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 42/70. [D 20:42:18.540220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.540273] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.540287] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.606496] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.606518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.606531] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.606570] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2561 [D 20:42:18.606585] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:18.606604] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 43/70. [D 20:42:18.610175] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2561 [D 20:42:18.610203] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 44/70. [D 20:42:18.610253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1874. [D 20:42:18.610270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1875. [D 20:42:18.610285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1876. [D 20:42:18.610300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1877. [D 20:42:18.610314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1878. [D 20:42:18.610329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1879. [D 20:42:18.610346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1880. [D 20:42:18.610360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1881. [D 20:42:18.610376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1882. [D 20:42:18.610390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1883. [D 20:42:18.610405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1884. [D 20:42:18.610438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1885. [D 20:42:18.610454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1886. [D 20:42:18.610479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1887. [D 20:42:18.610494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1888. [D 20:42:18.610521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1889. [D 20:42:18.610535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1890. [D 20:42:18.610550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1891. [D 20:42:18.610565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1892. [D 20:42:18.610579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1893. [D 20:42:18.610605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1894. [D 20:42:18.610619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1895. [D 20:42:18.610639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1896. [D 20:42:18.610653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1897. [D 20:42:18.610668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1898. [D 20:42:18.610683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1899. [D 20:42:18.610698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1900. [D 20:42:18.610713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1901. [D 20:42:18.610728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1902. [D 20:42:18.610787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1903. [D 20:42:18.610812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1904. [D 20:42:18.610827] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1905. [D 20:42:18.616212] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1905. [D 20:42:18.616232] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 45/70. [D 20:42:18.616336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.616388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.616401] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.676407] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.676428] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.676442] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.676480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2563 [D 20:42:18.676495] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:18.676514] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 46/70. [D 20:42:18.680175] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2563 [D 20:42:18.680207] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 47/70. [D 20:42:18.680342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 1905. [D 20:42:18.680366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 1906. [D 20:42:18.680381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 1907. [D 20:42:18.680400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 1908. [D 20:42:18.680415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 1909. [D 20:42:18.680431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 1910. [D 20:42:18.680445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 1911. [D 20:42:18.680460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 1912. [D 20:42:18.680474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 1913. [D 20:42:18.680493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 1914. [D 20:42:18.680508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 1915. [D 20:42:18.680522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 1916. [D 20:42:18.680537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 1917. [D 20:42:18.680551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 1918. [D 20:42:18.680566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 1919. [D 20:42:18.680580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 1920. [D 20:42:18.680595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 1921. [D 20:42:18.680638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 1922. [D 20:42:18.680653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 1923. [D 20:42:18.680668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 1924. [D 20:42:18.680682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 1925. [D 20:42:18.680697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 1926. [D 20:42:18.680711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 1927. [D 20:42:18.680726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 1928. [D 20:42:18.680740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 1929. [D 20:42:18.680754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 1930. [D 20:42:18.680768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 1931. [D 20:42:18.680788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 1932. [D 20:42:18.680804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 1933. [D 20:42:18.680819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 1934. [D 20:42:18.680840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 1935. [D 20:42:18.680884] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 1936. [D 20:42:18.686280] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1936. [D 20:42:18.686301] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 48/70. [D 20:42:18.686401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.686453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.686467] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.788432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.788454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.788467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.788504] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2567 [D 20:42:18.788519] element 0: offset: 0x2aaaab0379a0, size: 24 [D 20:42:18.788538] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 49/70. [D 20:42:18.792101] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2567 [D 20:42:18.792133] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 50/70. [D 20:42:18.792184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1936. [D 20:42:18.792207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1937. [D 20:42:18.792222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 1938. [D 20:42:18.792237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 1939. [D 20:42:18.792253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 1940. [D 20:42:18.792272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 1941. [D 20:42:18.792287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1942. [D 20:42:18.792317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1943. [D 20:42:18.792332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1944. [D 20:42:18.792347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 1945. [D 20:42:18.792362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 1946. [D 20:42:18.792376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 1947. [D 20:42:18.792390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 1948. [D 20:42:18.792405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 1949. [D 20:42:18.792420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1950. [D 20:42:18.792435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1951. [D 20:42:18.792449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1952. [D 20:42:18.792464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1953. [D 20:42:18.792499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1954. [D 20:42:18.792514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1955. [D 20:42:18.792538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1956. [D 20:42:18.792553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1957. [D 20:42:18.792568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1958. [D 20:42:18.792582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1959. [D 20:42:18.792597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1960. [D 20:42:18.792612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1961. [D 20:42:18.792626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1962. [D 20:42:18.792641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1963. [D 20:42:18.792670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1964. [D 20:42:18.792684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1965. [D 20:42:18.792698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1966. [D 20:42:18.792713] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1967. [D 20:42:18.798156] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1967. [D 20:42:18.798177] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 51/70. [D 20:42:18.798278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.798329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.798343] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.825212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.825234] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.825247] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.825284] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2569 [D 20:42:18.825299] element 0: offset: 0x2aaaab026890, size: 24 [D 20:42:18.825318] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 52/70. [D 20:42:18.828948] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2569 [D 20:42:18.828985] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 53/70. [D 20:42:18.829047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1967. [D 20:42:18.829065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1968. [D 20:42:18.829086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 1969. [D 20:42:18.829101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 1970. [D 20:42:18.829115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 1971. [D 20:42:18.829130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 1972. [D 20:42:18.829149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 1973. [D 20:42:18.829164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1974. [D 20:42:18.829179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1975. [D 20:42:18.829194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1976. [D 20:42:18.829221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 1977. [D 20:42:18.829236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 1978. [D 20:42:18.829250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 1979. [D 20:42:18.829268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 1980. [D 20:42:18.829283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 1981. [D 20:42:18.829298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1982. [D 20:42:18.829312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1983. [D 20:42:18.829327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1984. [D 20:42:18.829342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 1985. [D 20:42:18.829356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 1986. [D 20:42:18.829371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 1987. [D 20:42:18.829425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 1988. [D 20:42:18.829441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 1989. [D 20:42:18.829456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1990. [D 20:42:18.829470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1991. [D 20:42:18.829485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1992. [D 20:42:18.829500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 1993. [D 20:42:18.829515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 1994. [D 20:42:18.829529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 1995. [D 20:42:18.829544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 1996. [D 20:42:18.829562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 1997. [D 20:42:18.829577] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1998. [D 20:42:18.834973] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 1998. [D 20:42:18.834993] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 54/70. [D 20:42:18.835094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.835147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.835161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.881360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.881382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.881395] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.881432] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2573 [D 20:42:18.881448] element 0: offset: 0x2aaaab02cc00, size: 24 [D 20:42:18.881467] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 55/70. [D 20:42:18.885186] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2573 [D 20:42:18.885218] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 56/70. [D 20:42:18.885271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1998. [D 20:42:18.885290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 1999. [D 20:42:18.885304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 2000. [D 20:42:18.885319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 2001. [D 20:42:18.885359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 2002. [D 20:42:18.885375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 2003. [D 20:42:18.885389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2004. [D 20:42:18.885408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2005. [D 20:42:18.885424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2006. [D 20:42:18.885439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 2007. [D 20:42:18.885453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 2008. [D 20:42:18.885469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 2009. [D 20:42:18.885484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 2010. [D 20:42:18.885499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 2011. [D 20:42:18.885520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2012. [D 20:42:18.885554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2013. [D 20:42:18.885569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2014. [D 20:42:18.885589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2015. [D 20:42:18.885603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2016. [D 20:42:18.885618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2017. [D 20:42:18.885632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2018. [D 20:42:18.885647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2019. [D 20:42:18.885661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2020. [D 20:42:18.885675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2021. [D 20:42:18.885690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2022. [D 20:42:18.885705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2023. [D 20:42:18.885719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2024. [D 20:42:18.885735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2025. [D 20:42:18.885773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2026. [D 20:42:18.885787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2027. [D 20:42:18.885809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2028. [D 20:42:18.885836] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2029. [D 20:42:18.891238] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2029. [D 20:42:18.891259] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 57/70. [D 20:42:18.891360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.891412] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.891426] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:18.917414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:18.917435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.917449] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:18.917487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2575 [D 20:42:18.917502] element 0: offset: 0x2aaaab026630, size: 24 [D 20:42:18.917521] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 58/70. [D 20:42:18.921181] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2575 [D 20:42:18.921215] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 59/70. [D 20:42:18.921266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2029. [D 20:42:18.921283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2030. [D 20:42:18.921298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2031. [D 20:42:18.921318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2032. [D 20:42:18.921334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2033. [D 20:42:18.921364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2034. [D 20:42:18.921379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2035. [D 20:42:18.921393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2036. [D 20:42:18.921408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2037. [D 20:42:18.921423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2038. [D 20:42:18.921438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2039. [D 20:42:18.921453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2040. [D 20:42:18.921467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2041. [D 20:42:18.921482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2042. [D 20:42:18.921497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2043. [D 20:42:18.921531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2044. [D 20:42:18.921546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2045. [D 20:42:18.921565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2046. [D 20:42:18.921580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2047. [D 20:42:18.921595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2048. [D 20:42:18.921609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2049. [D 20:42:18.921624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2050. [D 20:42:18.921639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2051. [D 20:42:18.921653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2052. [D 20:42:18.921672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2053. [D 20:42:18.921689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2054. [D 20:42:18.921704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2055. [D 20:42:18.921719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2056. [D 20:42:18.921768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2057. [D 20:42:18.921787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2058. [D 20:42:18.921807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2059. [D 20:42:18.921823] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2060. [D 20:42:18.927203] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2060. [D 20:42:18.927222] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 60/70. [D 20:42:18.927324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:18.927376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:18.927390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.037099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.037121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.037135] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.037174] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2579 [D 20:42:19.037189] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:19.037209] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 0/70. [D 20:42:19.040819] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2579 [D 20:42:19.040854] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 1/70. [D 20:42:19.040906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2060. [D 20:42:19.040922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2061. [D 20:42:19.040937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2062. [D 20:42:19.040952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2063. [D 20:42:19.040967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2064. [D 20:42:19.040982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2065. [D 20:42:19.040997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2066. [D 20:42:19.041027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2067. [D 20:42:19.041042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2068. [D 20:42:19.041057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2069. [D 20:42:19.041072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2070. [D 20:42:19.041087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2071. [D 20:42:19.041101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2072. [D 20:42:19.041116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2073. [D 20:42:19.041131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2074. [D 20:42:19.041165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2075. [D 20:42:19.041179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2076. [D 20:42:19.041199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2077. [D 20:42:19.041214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2078. [D 20:42:19.041229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2079. [D 20:42:19.041243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2080. [D 20:42:19.041258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2081. [D 20:42:19.041273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2082. [D 20:42:19.041287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2083. [D 20:42:19.041306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2084. [D 20:42:19.041323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2085. [D 20:42:19.041337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2086. [D 20:42:19.041352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2087. [D 20:42:19.041367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2088. [D 20:42:19.041412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2089. [D 20:42:19.041445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2090. [D 20:42:19.041461] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2091. [D 20:42:19.046785] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2091. [D 20:42:19.046806] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 2/70. [D 20:42:19.046910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.046962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.046975] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.107010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.107032] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.107045] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.107083] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2581 [D 20:42:19.107098] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:19.107117] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 3/70. [D 20:42:19.110776] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2581 [D 20:42:19.110808] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 4/70. [D 20:42:19.110864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2091. [D 20:42:19.110881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2092. [D 20:42:19.110895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2093. [D 20:42:19.110911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2094. [D 20:42:19.110927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2095. [D 20:42:19.110942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2096. [D 20:42:19.110956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2097. [D 20:42:19.110971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2098. [D 20:42:19.111002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2099. [D 20:42:19.111016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2100. [D 20:42:19.111031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2101. [D 20:42:19.111046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2102. [D 20:42:19.111061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2103. [D 20:42:19.111075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2104. [D 20:42:19.111090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2105. [D 20:42:19.111124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2106. [D 20:42:19.111139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2107. [D 20:42:19.111159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2108. [D 20:42:19.111173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2109. [D 20:42:19.111188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2110. [D 20:42:19.111202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2111. [D 20:42:19.111217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2112. [D 20:42:19.111231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2113. [D 20:42:19.111246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2114. [D 20:42:19.111264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2115. [D 20:42:19.111281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2116. [D 20:42:19.111296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2117. [D 20:42:19.111311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2118. [D 20:42:19.111354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2119. [D 20:42:19.111370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2120. [D 20:42:19.111391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2121. [D 20:42:19.111406] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2122. [D 20:42:19.114551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.114573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.114590] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:19.114633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2584 [D 20:42:19.114649] element 0: offset: 0x2aaaab038e20, size: 24 [D 20:42:19.114665] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 5/70. [D 20:42:19.116754] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2122. [D 20:42:19.116777] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 6/70. [D 20:42:19.119821] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.119841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.119855] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:19.123143] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2584 [D 20:42:19.123163] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 7/70. [D 20:42:19.123223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2122. [D 20:42:19.123241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2123. [D 20:42:19.123256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2124. [D 20:42:19.123271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2125. [D 20:42:19.123295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2126. [D 20:42:19.123309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2127. [D 20:42:19.123338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2128. [D 20:42:19.123353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2129. [D 20:42:19.123367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2130. [D 20:42:19.123383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2131. [D 20:42:19.123398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2132. [D 20:42:19.123413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2133. [D 20:42:19.123441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2134. [D 20:42:19.123460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2135. [D 20:42:19.123479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2136. [D 20:42:19.123498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2137. [D 20:42:19.123513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2138. [D 20:42:19.123527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2139. [D 20:42:19.123542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2140. [D 20:42:19.123557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2141. [D 20:42:19.123571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2142. [D 20:42:19.123586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2143. [D 20:42:19.123603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2144. [D 20:42:19.123618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2145. [D 20:42:19.123645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2146. [D 20:42:19.123659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2147. [D 20:42:19.123674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2148. [D 20:42:19.123689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2149. [D 20:42:19.123703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2150. [D 20:42:19.123718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2151. [D 20:42:19.123732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2152. [D 20:42:19.123747] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2153. [D 20:42:19.129168] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2153. [D 20:42:19.129190] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 8/70. [D 20:42:19.131489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.131508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.131523] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.180529] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.180550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.180567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.180590] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2587 [D 20:42:19.180605] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:19.180620] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 9/70. [D 20:42:19.184141] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2587 [D 20:42:19.184170] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 10/70. [D 20:42:19.184224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2153. [D 20:42:19.184240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2154. [D 20:42:19.184255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2155. [D 20:42:19.184270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2156. [D 20:42:19.184285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2157. [D 20:42:19.184301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2158. [D 20:42:19.184316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2159. [D 20:42:19.184330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2160. [D 20:42:19.184345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2161. [D 20:42:19.184384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2162. [D 20:42:19.184398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2163. [D 20:42:19.184417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2164. [D 20:42:19.184432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2165. [D 20:42:19.184446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2166. [D 20:42:19.184461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2167. [D 20:42:19.184476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2168. [D 20:42:19.184490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2169. [D 20:42:19.184505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2170. [D 20:42:19.184520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2171. [D 20:42:19.184534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2172. [D 20:42:19.184561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2173. [D 20:42:19.184576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2174. [D 20:42:19.184626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2175. [D 20:42:19.184646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2176. [D 20:42:19.184660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2177. [D 20:42:19.184675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2178. [D 20:42:19.184690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2179. [D 20:42:19.184704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2180. [D 20:42:19.184719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2181. [D 20:42:19.184733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2182. [D 20:42:19.184751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2183. [D 20:42:19.184766] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2184. [D 20:42:19.190144] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2184. [D 20:42:19.190163] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 11/70. [D 20:42:19.193207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.193226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.193242] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.259492] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.259513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.259530] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.259553] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2590 [D 20:42:19.259568] element 0: offset: 0x2aaaab028380, size: 24 [D 20:42:19.259583] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 12/70. [D 20:42:19.265801] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2590 [D 20:42:19.265825] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 13/70. [D 20:42:19.265880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2184. [D 20:42:19.265901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2185. [D 20:42:19.265916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2186. [D 20:42:19.265930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2187. [D 20:42:19.265945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2188. [D 20:42:19.265960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2189. [D 20:42:19.265979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2190. [D 20:42:19.265994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2191. [D 20:42:19.266010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2192. [D 20:42:19.266025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2193. [D 20:42:19.266040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2194. [D 20:42:19.266054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2195. [D 20:42:19.266070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2196. [D 20:42:19.266084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2197. [D 20:42:19.266099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2198. [D 20:42:19.266114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2199. [D 20:42:19.266156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2200. [D 20:42:19.266175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2201. [D 20:42:19.266189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2202. [D 20:42:19.266204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2203. [D 20:42:19.266219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2204. [D 20:42:19.266234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2205. [D 20:42:19.266248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2206. [D 20:42:19.266263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2207. [D 20:42:19.266289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2208. [D 20:42:19.266304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2209. [D 20:42:19.266318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2210. [D 20:42:19.266337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2211. [D 20:42:19.266353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2212. [D 20:42:19.266368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2213. [D 20:42:19.266383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2214. [D 20:42:19.266439] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2215. [D 20:42:19.271810] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2215. [D 20:42:19.271829] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 14/70. [D 20:42:19.274872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.274891] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.274907] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.460561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.460583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.460600] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.460622] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2594 [D 20:42:19.460638] element 0: offset: 0x2aaaab0282a0, size: 24 [D 20:42:19.460653] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 15/70. [D 20:42:19.464156] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2594 [D 20:42:19.464179] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 16/70. [D 20:42:19.464232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 2215. [D 20:42:19.464249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2216. [D 20:42:19.464264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2217. [D 20:42:19.464278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2218. [D 20:42:19.464294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2219. [D 20:42:19.464308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2220. [D 20:42:19.464323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2221. [D 20:42:19.464343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2222. [D 20:42:19.464362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2223. [D 20:42:19.464377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2224. [D 20:42:19.464406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2225. [D 20:42:19.464420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2226. [D 20:42:19.464435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2227. [D 20:42:19.464449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2228. [D 20:42:19.464465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2229. [D 20:42:19.464483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2230. [D 20:42:19.464501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2231. [D 20:42:19.464515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2232. [D 20:42:19.464531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2233. [D 20:42:19.464565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2234. [D 20:42:19.464581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2235. [D 20:42:19.464600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2236. [D 20:42:19.464619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2237. [D 20:42:19.464634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2238. [D 20:42:19.464649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2239. [D 20:42:19.464663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2240. [D 20:42:19.464678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2241. [D 20:42:19.464693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2242. [D 20:42:19.464708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2243. [D 20:42:19.464726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2244. [D 20:42:19.464741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2245. [D 20:42:19.464770] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2246. [D 20:42:19.470109] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2246. [D 20:42:19.470129] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 17/70. [D 20:42:19.473188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.473207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.473222] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.643679] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.643700] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.643717] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.643739] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2597 [D 20:42:19.643754] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:19.643769] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 18/70. [D 20:42:19.647205] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2597 [D 20:42:19.647283] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 19/70. [D 20:42:19.647346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 2246. [D 20:42:19.647371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2247. [D 20:42:19.647386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2248. [D 20:42:19.647401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2249. [D 20:42:19.647415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2250. [D 20:42:19.647430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2251. [D 20:42:19.647445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2252. [D 20:42:19.647460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2253. [D 20:42:19.647475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2254. [D 20:42:19.647493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2255. [D 20:42:19.647508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2256. [D 20:42:19.647562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2257. [D 20:42:19.647577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2258. [D 20:42:19.647591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2259. [D 20:42:19.647606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2260. [D 20:42:19.647621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2261. [D 20:42:19.647635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2262. [D 20:42:19.647650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2263. [D 20:42:19.647665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2264. [D 20:42:19.647680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2265. [D 20:42:19.647696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2266. [D 20:42:19.647711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2267. [D 20:42:19.647725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2268. [D 20:42:19.647740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2269. [D 20:42:19.647790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2270. [D 20:42:19.647809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2271. [D 20:42:19.647835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2272. [D 20:42:19.647850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2273. [D 20:42:19.647864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2274. [D 20:42:19.647879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2275. [D 20:42:19.647894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2276. [D 20:42:19.647909] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2277. [D 20:42:19.653315] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2277. [D 20:42:19.653335] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 20/70. [D 20:42:19.655493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.655512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.655528] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.703223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.703244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.703261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.703283] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2599 [D 20:42:19.703298] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:19.703313] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 21/70. [D 20:42:19.709553] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2599 [D 20:42:19.709581] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 22/70. [D 20:42:19.709652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2277. [D 20:42:19.709726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2278. [D 20:42:19.709743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2279. [D 20:42:19.709758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2280. [D 20:42:19.709776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2281. [D 20:42:19.709799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2282. [D 20:42:19.709813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2283. [D 20:42:19.709828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2284. [D 20:42:19.709846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2285. [D 20:42:19.709861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2286. [D 20:42:19.709875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2287. [D 20:42:19.709894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2288. [D 20:42:19.709909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2289. [D 20:42:19.709926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2290. [D 20:42:19.709962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2291. [D 20:42:19.709978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2292. [D 20:42:19.710006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2293. [D 20:42:19.710024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2294. [D 20:42:19.710039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2295. [D 20:42:19.710058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2296. [D 20:42:19.710073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2297. [D 20:42:19.710087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2298. [D 20:42:19.710101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2299. [D 20:42:19.710116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2300. [D 20:42:19.710131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2301. [D 20:42:19.710145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2302. [D 20:42:19.710159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2303. [D 20:42:19.710174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2304. [D 20:42:19.710189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2305. [D 20:42:19.710204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2306. [D 20:42:19.710258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2307. [D 20:42:19.710273] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2308. [D 20:42:19.715670] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2308. [D 20:42:19.715692] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 23/70. [D 20:42:19.718725] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.718746] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.718761] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.755389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.755411] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.755427] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.755468] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2602 [D 20:42:19.755487] element 0: offset: 0x2aaaab0379a0, size: 24 [D 20:42:19.755503] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 24/70. [D 20:42:19.759509] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2602 [D 20:42:19.759535] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 25/70. [D 20:42:19.759601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2308. [D 20:42:19.759681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2309. [D 20:42:19.759697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2310. [D 20:42:19.759712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2311. [D 20:42:19.759727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2312. [D 20:42:19.759745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2313. [D 20:42:19.759768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2314. [D 20:42:19.759782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2315. [D 20:42:19.759797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2316. [D 20:42:19.759816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2317. [D 20:42:19.759831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2318. [D 20:42:19.759845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2319. [D 20:42:19.759864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2320. [D 20:42:19.759879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2321. [D 20:42:19.759912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2322. [D 20:42:19.759926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2323. [D 20:42:19.759941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2324. [D 20:42:19.759956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2325. [D 20:42:19.759986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2326. [D 20:42:19.760005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2327. [D 20:42:19.760031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2328. [D 20:42:19.760046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2329. [D 20:42:19.760060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2330. [D 20:42:19.760078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2331. [D 20:42:19.760093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2332. [D 20:42:19.760108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2333. [D 20:42:19.760136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2334. [D 20:42:19.760152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2335. [D 20:42:19.760166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2336. [D 20:42:19.760181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2337. [D 20:42:19.760195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2338. [D 20:42:19.760209] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2339. [D 20:42:19.765603] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2339. [D 20:42:19.765626] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 26/70. [D 20:42:19.767516] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.767536] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.767552] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.856392] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.856414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.856431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.856472] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2605 [D 20:42:19.856488] element 0: offset: 0x2aaaab026630, size: 24 [D 20:42:19.856504] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 27/70. [D 20:42:19.859852] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2605 [D 20:42:19.859881] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 28/70. [D 20:42:19.859932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2339. [D 20:42:19.859950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2340. [D 20:42:19.859964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2341. [D 20:42:19.859979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2342. [D 20:42:19.859993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2343. [D 20:42:19.860007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2344. [D 20:42:19.860022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2345. [D 20:42:19.860037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2346. [D 20:42:19.860051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2347. [D 20:42:19.860065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2348. [D 20:42:19.860079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2349. [D 20:42:19.860093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2350. [D 20:42:19.860107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2351. [D 20:42:19.860121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2352. [D 20:42:19.860135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2353. [D 20:42:19.860149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2354. [D 20:42:19.860163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2355. [D 20:42:19.860178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2356. [D 20:42:19.860192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2357. [D 20:42:19.860206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2358. [D 20:42:19.860220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2359. [D 20:42:19.860234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2360. [D 20:42:19.860248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2361. [D 20:42:19.860262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2362. [D 20:42:19.860276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2363. [D 20:42:19.860290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2364. [D 20:42:19.860304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2365. [D 20:42:19.860318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2366. [D 20:42:19.860332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2367. [D 20:42:19.860348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2368. [D 20:42:19.860362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2369. [D 20:42:19.860377] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2370. [D 20:42:19.865899] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2370. [D 20:42:19.865924] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 29/70. [D 20:42:19.866018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.866087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.866102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.917299] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.917324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.917338] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.917378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2609 [D 20:42:19.917393] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:19.917409] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 30/70. [D 20:42:19.920886] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2609 [D 20:42:19.920968] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 31/70. [D 20:42:19.921031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 2370. [D 20:42:19.921061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2371. [D 20:42:19.921077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2372. [D 20:42:19.921092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2373. [D 20:42:19.921106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2374. [D 20:42:19.921121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2375. [D 20:42:19.921136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2376. [D 20:42:19.921151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2377. [D 20:42:19.921165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2378. [D 20:42:19.921180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2379. [D 20:42:19.921195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2380. [D 20:42:19.921210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2381. [D 20:42:19.921225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2382. [D 20:42:19.921240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2383. [D 20:42:19.921254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2384. [D 20:42:19.921269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2385. [D 20:42:19.921284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2386. [D 20:42:19.921298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2387. [D 20:42:19.921318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2388. [D 20:42:19.921333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2389. [D 20:42:19.921348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2390. [D 20:42:19.921362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2391. [D 20:42:19.921377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2392. [D 20:42:19.921391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2393. [D 20:42:19.921406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2394. [D 20:42:19.921432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2395. [D 20:42:19.921447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2396. [D 20:42:19.921462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2397. [D 20:42:19.921476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2398. [D 20:42:19.921491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2399. [D 20:42:19.921507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2400. [D 20:42:19.921522] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2401. [D 20:42:19.926981] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2401. [D 20:42:19.927005] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 32/70. [D 20:42:19.927102] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.927126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.927140] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:19.977152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:19.977173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.977186] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:19.977223] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2612 [D 20:42:19.977238] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:19.977256] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 33/70. [D 20:42:19.981049] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2612 [D 20:42:19.981127] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 34/70. [D 20:42:19.981200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2401. [D 20:42:19.981226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2402. [D 20:42:19.981241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2403. [D 20:42:19.981255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2404. [D 20:42:19.981270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2405. [D 20:42:19.981285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2406. [D 20:42:19.981300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2407. [D 20:42:19.981315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2408. [D 20:42:19.981349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2409. [D 20:42:19.981364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2410. [D 20:42:19.981382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2411. [D 20:42:19.981397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2412. [D 20:42:19.981412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2413. [D 20:42:19.981426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2414. [D 20:42:19.981441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2415. [D 20:42:19.981456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2416. [D 20:42:19.981471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2417. [D 20:42:19.981485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2418. [D 20:42:19.981501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2419. [D 20:42:19.981534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2420. [D 20:42:19.981549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2421. [D 20:42:19.981573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2422. [D 20:42:19.981589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2423. [D 20:42:19.981604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2424. [D 20:42:19.981618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2425. [D 20:42:19.981633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2426. [D 20:42:19.981650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2427. [D 20:42:19.981665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2428. [D 20:42:19.981679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2429. [D 20:42:19.981694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2430. [D 20:42:19.981713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2431. [D 20:42:19.981728] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2432. [D 20:42:19.987147] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2432. [D 20:42:19.987169] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 35/70. [D 20:42:19.987269] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:19.987293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:19.987307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.035843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.035864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.035877] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.035916] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2614 [D 20:42:20.035931] element 0: offset: 0x2aaaab000ca0, size: 24 [D 20:42:20.035948] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 36/70. [D 20:42:20.039694] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2614 [D 20:42:20.039772] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 37/70. [D 20:42:20.039833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2432. [D 20:42:20.039860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2433. [D 20:42:20.039875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2434. [D 20:42:20.039890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2435. [D 20:42:20.039905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2436. [D 20:42:20.039919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2437. [D 20:42:20.039934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2438. [D 20:42:20.039949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2439. [D 20:42:20.039964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2440. [D 20:42:20.039978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2441. [D 20:42:20.039993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2442. [D 20:42:20.040008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2443. [D 20:42:20.040027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2444. [D 20:42:20.040043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2445. [D 20:42:20.040079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2446. [D 20:42:20.040098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2447. [D 20:42:20.040112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2448. [D 20:42:20.040127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2449. [D 20:42:20.040142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2450. [D 20:42:20.040156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2451. [D 20:42:20.040171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2452. [D 20:42:20.040185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2453. [D 20:42:20.040200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2454. [D 20:42:20.040214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2455. [D 20:42:20.040232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2456. [D 20:42:20.040262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2457. [D 20:42:20.040277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2458. [D 20:42:20.040292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2459. [D 20:42:20.040347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2460. [D 20:42:20.040366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2461. [D 20:42:20.040381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2462. [D 20:42:20.040395] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2463. [D 20:42:20.047237] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2463. [D 20:42:20.047262] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 38/70. [D 20:42:20.047408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.047431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.047445] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.057292] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.057312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.057326] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.057364] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2617 [D 20:42:20.057379] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:20.057396] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 39/70. [D 20:42:20.061048] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2617 [D 20:42:20.061125] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 40/70. [D 20:42:20.061184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2463. [D 20:42:20.061210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2464. [D 20:42:20.061225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2465. [D 20:42:20.061240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2466. [D 20:42:20.061255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2467. [D 20:42:20.061270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2468. [D 20:42:20.061300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2469. [D 20:42:20.061315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2470. [D 20:42:20.061329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2471. [D 20:42:20.061344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2472. [D 20:42:20.061359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2473. [D 20:42:20.061377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2474. [D 20:42:20.061409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2475. [D 20:42:20.061509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2476. [D 20:42:20.061527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2477. [D 20:42:20.061542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2478. [D 20:42:20.061653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2479. [D 20:42:20.061862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2480. [D 20:42:20.061880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2481. [D 20:42:20.061895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2482. [D 20:42:20.061965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2483. [D 20:42:20.061982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2484. [D 20:42:20.062048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2485. [D 20:42:20.062157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2486. [D 20:42:20.062175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2487. [D 20:42:20.062190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2488. [D 20:42:20.062259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2489. [D 20:42:20.062275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2490. [D 20:42:20.062343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2491. [D 20:42:20.062469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2492. [D 20:42:20.062488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2493. [D 20:42:20.062503] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2494. [D 20:42:20.067133] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2494. [D 20:42:20.067156] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 41/70. [D 20:42:20.067255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.067280] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.067293] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.113022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.113042] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.113055] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.113094] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2620 [D 20:42:20.113109] element 0: offset: 0x2aaaab038e20, size: 24 [D 20:42:20.113126] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 42/70. [D 20:42:20.116822] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2620 [D 20:42:20.116900] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 43/70. [D 20:42:20.116957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2494. [D 20:42:20.116984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2495. [D 20:42:20.116999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2496. [D 20:42:20.117014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2497. [D 20:42:20.117029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2498. [D 20:42:20.117047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2499. [D 20:42:20.117062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2500. [D 20:42:20.117077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2501. [D 20:42:20.117092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2502. [D 20:42:20.117106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2503. [D 20:42:20.117121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2504. [D 20:42:20.117136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2505. [D 20:42:20.117151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2506. [D 20:42:20.117170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2507. [D 20:42:20.117185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2508. [D 20:42:20.117227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2509. [D 20:42:20.117242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2510. [D 20:42:20.117257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2511. [D 20:42:20.117272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2512. [D 20:42:20.117286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2513. [D 20:42:20.117301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2514. [D 20:42:20.117315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2515. [D 20:42:20.117330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2516. [D 20:42:20.117344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2517. [D 20:42:20.117359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2518. [D 20:42:20.117373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2519. [D 20:42:20.117388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2520. [D 20:42:20.117403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2521. [D 20:42:20.117417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2522. [D 20:42:20.117484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2523. [D 20:42:20.117499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2524. [D 20:42:20.117515] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2525. [D 20:42:20.122920] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2525. [D 20:42:20.122941] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 44/70. [D 20:42:20.123042] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.123066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.123080] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.169107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.169127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.169140] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.169178] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2623 [D 20:42:20.169193] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:20.169210] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 45/70. [D 20:42:20.172910] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2623 [D 20:42:20.172991] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 46/70. [D 20:42:20.173055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2525. [D 20:42:20.173080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2526. [D 20:42:20.173095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2527. [D 20:42:20.173111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2528. [D 20:42:20.173126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2529. [D 20:42:20.173140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2530. [D 20:42:20.173159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2531. [D 20:42:20.173174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2532. [D 20:42:20.173190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2533. [D 20:42:20.173205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2534. [D 20:42:20.173220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2535. [D 20:42:20.173235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2536. [D 20:42:20.173250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2537. [D 20:42:20.173264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2538. [D 20:42:20.173279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2539. [D 20:42:20.173295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2540. [D 20:42:20.173335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2541. [D 20:42:20.173354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2542. [D 20:42:20.173369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2543. [D 20:42:20.173384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2544. [D 20:42:20.173398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2545. [D 20:42:20.173413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2546. [D 20:42:20.173428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2547. [D 20:42:20.173442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2548. [D 20:42:20.173457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2549. [D 20:42:20.173471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2550. [D 20:42:20.173498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2551. [D 20:42:20.173513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2552. [D 20:42:20.173528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2553. [D 20:42:20.173542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2554. [D 20:42:20.173557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2555. [D 20:42:20.173572] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2556. [D 20:42:20.179017] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2556. [D 20:42:20.179037] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 47/70. [D 20:42:20.179139] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.179162] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.179176] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.229330] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.229350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.229363] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.229401] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2627 [D 20:42:20.229416] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:20.229432] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 48/70. [D 20:42:20.233179] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2627 [D 20:42:20.233257] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 49/70. [D 20:42:20.233314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2556. [D 20:42:20.233341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2557. [D 20:42:20.233357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2558. [D 20:42:20.233372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2559. [D 20:42:20.233387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2560. [D 20:42:20.233406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2561. [D 20:42:20.233421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2562. [D 20:42:20.233436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2563. [D 20:42:20.233451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2564. [D 20:42:20.233465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2565. [D 20:42:20.233480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2566. [D 20:42:20.233495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2567. [D 20:42:20.233510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2568. [D 20:42:20.233529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2569. [D 20:42:20.233580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2570. [D 20:42:20.233599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2571. [D 20:42:20.233614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2572. [D 20:42:20.233629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2573. [D 20:42:20.233643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2574. [D 20:42:20.233658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2575. [D 20:42:20.233673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2576. [D 20:42:20.233687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2577. [D 20:42:20.233702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2578. [D 20:42:20.233717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2579. [D 20:42:20.233731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2580. [D 20:42:20.233757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2581. [D 20:42:20.233773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2582. [D 20:42:20.233787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2583. [D 20:42:20.233841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2584. [D 20:42:20.233860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2585. [D 20:42:20.233879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2586. [D 20:42:20.233894] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2587. [D 20:42:20.239267] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2587. [D 20:42:20.239287] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 50/70. [D 20:42:20.239387] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.239411] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.239425] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.334215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.334236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.334249] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.334287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2629 [D 20:42:20.334302] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:20.334319] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 51/70. [D 20:42:20.337795] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2629 [D 20:42:20.337861] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 52/70. [D 20:42:20.337920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2587. [D 20:42:20.337948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2588. [D 20:42:20.337963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2589. [D 20:42:20.337978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2590. [D 20:42:20.337993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2591. [D 20:42:20.338008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2592. [D 20:42:20.338048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2593. [D 20:42:20.338063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2594. [D 20:42:20.338079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2595. [D 20:42:20.338105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2596. [D 20:42:20.338124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2597. [D 20:42:20.338143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2598. [D 20:42:20.338162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2599. [D 20:42:20.338180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2600. [D 20:42:20.338199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2601. [D 20:42:20.338217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2602. [D 20:42:20.338236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2603. [D 20:42:20.338254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2604. [D 20:42:20.338284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2605. [D 20:42:20.338300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2606. [D 20:42:20.338322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2607. [D 20:42:20.338340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2608. [D 20:42:20.338359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2609. [D 20:42:20.338378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2610. [D 20:42:20.338396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2611. [D 20:42:20.338415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2612. [D 20:42:20.338434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2613. [D 20:42:20.338453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2614. [D 20:42:20.338472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2615. [D 20:42:20.338491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2616. [D 20:42:20.338506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2617. [D 20:42:20.338521] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2618. [D 20:42:20.343891] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2618. [D 20:42:20.343915] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 53/70. [D 20:42:20.344004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.344027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.344044] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.414083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.414102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.414115] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.414151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2632 [D 20:42:20.414166] element 0: offset: 0x2aaaab0379a0, size: 24 [D 20:42:20.414183] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 54/70. [D 20:42:20.417592] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2632 [D 20:42:20.417670] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 55/70. [D 20:42:20.417737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2618. [D 20:42:20.417766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2619. [D 20:42:20.417781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2620. [D 20:42:20.417804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2621. [D 20:42:20.418007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2622. [D 20:42:20.418025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2623. [D 20:42:20.418175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2624. [D 20:42:20.418289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2625. [D 20:42:20.418323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2626. [D 20:42:20.418427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2627. [D 20:42:20.418543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2628. [D 20:42:20.418653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2629. [D 20:42:20.418754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2630. [D 20:42:20.418861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2631. [D 20:42:20.418962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2632. [D 20:42:20.419066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2633. [D 20:42:20.419170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2634. [D 20:42:20.419274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2635. [D 20:42:20.419378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2636. [D 20:42:20.419481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2637. [D 20:42:20.419501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2638. [D 20:42:20.419516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2639. [D 20:42:20.419531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2640. [D 20:42:20.419546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2641. [D 20:42:20.419565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2642. [D 20:42:20.419747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2643. [D 20:42:20.419765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2644. [D 20:42:20.419789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2645. [D 20:42:20.419807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2646. [D 20:42:20.419826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2647. [D 20:42:20.419849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2648. [D 20:42:20.419867] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2649. [D 20:42:20.423704] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2649. [D 20:42:20.423727] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 56/70. [D 20:42:20.423818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.423842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.423856] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.509205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.509224] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.509237] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.509275] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2636 [D 20:42:20.509290] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:20.509307] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 57/70. [D 20:42:20.512809] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2636 [D 20:42:20.512881] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 58/70. [D 20:42:20.512939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2649. [D 20:42:20.512967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2650. [D 20:42:20.512983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2651. [D 20:42:20.513006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2652. [D 20:42:20.513038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2653. [D 20:42:20.513056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2654. [D 20:42:20.513075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2655. [D 20:42:20.513094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2656. [D 20:42:20.513113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2657. [D 20:42:20.513132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2658. [D 20:42:20.513151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2659. [D 20:42:20.513170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2660. [D 20:42:20.513189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2661. [D 20:42:20.513208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2662. [D 20:42:20.513227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2663. [D 20:42:20.513246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2664. [D 20:42:20.513265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2665. [D 20:42:20.513284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2666. [D 20:42:20.513303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2667. [D 20:42:20.513321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2668. [D 20:42:20.513340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2669. [D 20:42:20.513359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2670. [D 20:42:20.513378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2671. [D 20:42:20.513397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2672. [D 20:42:20.513416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2673. [D 20:42:20.513435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2674. [D 20:42:20.513454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2675. [D 20:42:20.513474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2676. [D 20:42:20.513492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2677. [D 20:42:20.513509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2678. [D 20:42:20.513525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2679. [D 20:42:20.513540] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2680. [D 20:42:20.518906] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2680. [D 20:42:20.518926] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 59/70. [D 20:42:20.519023] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.519047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.519060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.664740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.664760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.664773] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.664810] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2638 [D 20:42:20.664825] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:20.664842] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 60/70. [D 20:42:20.668445] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2638 [D 20:42:20.668508] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 0/70. [D 20:42:20.668567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2680. [D 20:42:20.668595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2681. [D 20:42:20.668609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 2682. [D 20:42:20.668624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 2683. [D 20:42:20.668647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 2684. [D 20:42:20.668687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 2685. [D 20:42:20.668702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 2686. [D 20:42:20.668717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2687. [D 20:42:20.668732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2688. [D 20:42:20.668746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2689. [D 20:42:20.668761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 2690. [D 20:42:20.668776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 2691. [D 20:42:20.668790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 2692. [D 20:42:20.668805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 2693. [D 20:42:20.668820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 2694. [D 20:42:20.668848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2695. [D 20:42:20.668867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2696. [D 20:42:20.668886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2697. [D 20:42:20.668901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 2698. [D 20:42:20.668915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 2699. [D 20:42:20.668940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 2700. [D 20:42:20.668955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 2701. [D 20:42:20.668969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 2702. [D 20:42:20.668984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2703. [D 20:42:20.668998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2704. [D 20:42:20.669013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2705. [D 20:42:20.669027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 2706. [D 20:42:20.669042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 2707. [D 20:42:20.669057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 2708. [D 20:42:20.669093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 2709. [D 20:42:20.669109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 2710. [D 20:42:20.669133] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2711. [D 20:42:20.674454] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2711. [D 20:42:20.674474] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 1/70. [D 20:42:20.674570] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.674594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.674607] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.709363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.709382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.709395] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.709431] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2641 [D 20:42:20.709446] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:20.709463] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 2/70. [D 20:42:20.713151] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2641 [D 20:42:20.713216] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 3/70. [D 20:42:20.713275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2711. [D 20:42:20.713303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2712. [D 20:42:20.713318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2713. [D 20:42:20.713332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2714. [D 20:42:20.713349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2715. [D 20:42:20.713378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2716. [D 20:42:20.713394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2717. [D 20:42:20.713426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2718. [D 20:42:20.713441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2719. [D 20:42:20.713455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2720. [D 20:42:20.713474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2721. [D 20:42:20.713489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2722. [D 20:42:20.713503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2723. [D 20:42:20.713518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2724. [D 20:42:20.713534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2725. [D 20:42:20.713549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2726. [D 20:42:20.713564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2727. [D 20:42:20.713595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2728. [D 20:42:20.713610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2729. [D 20:42:20.713630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2730. [D 20:42:20.713649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2731. [D 20:42:20.713663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2732. [D 20:42:20.713678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2733. [D 20:42:20.713692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2734. [D 20:42:20.713710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2735. [D 20:42:20.713725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2736. [D 20:42:20.713739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2737. [D 20:42:20.713754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2738. [D 20:42:20.713773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2739. [D 20:42:20.713787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2740. [D 20:42:20.713802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2741. [D 20:42:20.713828] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2742. [D 20:42:20.719162] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2742. [D 20:42:20.719182] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 4/70. [D 20:42:20.719279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.719304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.719317] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.752347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.752367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.752380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.752416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2644 [D 20:42:20.752432] element 0: offset: 0x2aaaab000ca0, size: 24 [D 20:42:20.752449] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 5/70. [D 20:42:20.756205] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2644 [D 20:42:20.756268] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 6/70. [D 20:42:20.756322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2742. [D 20:42:20.756350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2743. [D 20:42:20.756366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2744. [D 20:42:20.756380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2745. [D 20:42:20.756396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2746. [D 20:42:20.756412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2747. [D 20:42:20.756427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2748. [D 20:42:20.756442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2749. [D 20:42:20.756457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2750. [D 20:42:20.756478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2751. [D 20:42:20.756493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2752. [D 20:42:20.756507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2753. [D 20:42:20.756526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2754. [D 20:42:20.756540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2755. [D 20:42:20.756556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2756. [D 20:42:20.756581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2757. [D 20:42:20.756596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2758. [D 20:42:20.756611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2759. [D 20:42:20.756626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2760. [D 20:42:20.756661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2761. [D 20:42:20.756679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2762. [D 20:42:20.756699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2763. [D 20:42:20.756713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2764. [D 20:42:20.756728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2765. [D 20:42:20.756743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2766. [D 20:42:20.756760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2767. [D 20:42:20.756775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2768. [D 20:42:20.756790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2769. [D 20:42:20.756804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2770. [D 20:42:20.756831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2771. [D 20:42:20.756846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2772. [D 20:42:20.756860] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2773. [D 20:42:20.762296] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2773. [D 20:42:20.762317] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 7/70. [D 20:42:20.762413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.762438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.762451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.827991] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.828012] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.828025] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.828060] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2648 [D 20:42:20.828075] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:20.828092] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 8/70. [D 20:42:20.831543] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2648 [D 20:42:20.831570] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 9/70. [D 20:42:20.831660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2773. [D 20:42:20.831681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2774. [D 20:42:20.831696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2775. [D 20:42:20.831711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2776. [D 20:42:20.831726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2777. [D 20:42:20.831741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2778. [D 20:42:20.831755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2779. [D 20:42:20.831770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2780. [D 20:42:20.831785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2781. [D 20:42:20.831814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2782. [D 20:42:20.831828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2783. [D 20:42:20.831849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2784. [D 20:42:20.831864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2785. [D 20:42:20.831878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2786. [D 20:42:20.831893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2787. [D 20:42:20.831919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2788. [D 20:42:20.831934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2789. [D 20:42:20.831948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2790. [D 20:42:20.831963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2791. [D 20:42:20.831977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2792. [D 20:42:20.831992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2793. [D 20:42:20.832007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2794. [D 20:42:20.832021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2795. [D 20:42:20.832048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2796. [D 20:42:20.832087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2797. [D 20:42:20.832103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2798. [D 20:42:20.832123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2799. [D 20:42:20.832139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2800. [D 20:42:20.832155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2801. [D 20:42:20.832169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2802. [D 20:42:20.832183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2803. [D 20:42:20.832198] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2804. [D 20:42:20.837623] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2804. [D 20:42:20.837647] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 10/70. [D 20:42:20.837760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.837811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.837825] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.907669] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.907689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.907702] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.907739] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2650 [D 20:42:20.907753] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:20.907774] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 11/70. [D 20:42:20.911371] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2650 [D 20:42:20.911399] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 12/70. [D 20:42:20.911451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2804. [D 20:42:20.911645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2805. [D 20:42:20.911665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2806. [D 20:42:20.911680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2807. [D 20:42:20.911695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2808. [D 20:42:20.911994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2809. [D 20:42:20.912015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2810. [D 20:42:20.912029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2811. [D 20:42:20.912044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2812. [D 20:42:20.912333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2813. [D 20:42:20.912352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2814. [D 20:42:20.912366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2815. [D 20:42:20.912481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2816. [D 20:42:20.912502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2817. [D 20:42:20.912803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2818. [D 20:42:20.912821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2819. [D 20:42:20.912836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2820. [D 20:42:20.912850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2821. [D 20:42:20.912964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2822. [D 20:42:20.913224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2823. [D 20:42:20.913240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2824. [D 20:42:20.913255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2825. [D 20:42:20.913270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2826. [D 20:42:20.913380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2827. [D 20:42:20.913638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2828. [D 20:42:20.913656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2829. [D 20:42:20.913670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2830. [D 20:42:20.913685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2831. [D 20:42:20.913971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2832. [D 20:42:20.913990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2833. [D 20:42:20.914005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2834. [D 20:42:20.914019] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2835. [D 20:42:20.917580] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2835. [D 20:42:20.917603] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 13/70. [D 20:42:20.917723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.917774] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.917787] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:20.965650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:20.965670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.965683] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:20.965719] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2654 [D 20:42:20.965734] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:20.965752] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 14/70. [D 20:42:20.969343] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2654 [D 20:42:20.969371] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 15/70. [D 20:42:20.969491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2835. [D 20:42:20.969515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 2836. [D 20:42:20.969531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 2837. [D 20:42:20.969548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 2838. [D 20:42:20.969564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 2839. [D 20:42:20.969578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 2840. [D 20:42:20.969604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2841. [D 20:42:20.969618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2842. [D 20:42:20.969633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2843. [D 20:42:20.969647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 2844. [D 20:42:20.969662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 2845. [D 20:42:20.969676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 2846. [D 20:42:20.969691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 2847. [D 20:42:20.969736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 2848. [D 20:42:20.969752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2849. [D 20:42:20.969778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2850. [D 20:42:20.969796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2851. [D 20:42:20.969813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 2852. [D 20:42:20.969840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 2853. [D 20:42:20.969859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 2854. [D 20:42:20.969876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 2855. [D 20:42:20.969894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 2856. [D 20:42:20.969912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2857. [D 20:42:20.969930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2858. [D 20:42:20.969948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2859. [D 20:42:20.969966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 2860. [D 20:42:20.969984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 2861. [D 20:42:20.970002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 2862. [D 20:42:20.970020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 2863. [D 20:42:20.970037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 2864. [D 20:42:20.970056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2865. [D 20:42:20.970073] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2866. [D 20:42:20.975458] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2866. [D 20:42:20.975481] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 16/70. [D 20:42:20.975612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:20.975665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:20.975679] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.023159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.023181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.023194] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.023231] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2656 [D 20:42:21.023246] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:21.023266] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 17/70. [D 20:42:21.026944] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2656 [D 20:42:21.026975] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 18/70. [D 20:42:21.027023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2866. [D 20:42:21.027041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2867. [D 20:42:21.027055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2868. [D 20:42:21.027070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2869. [D 20:42:21.027089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2870. [D 20:42:21.027104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2871. [D 20:42:21.027118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2872. [D 20:42:21.027133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2873. [D 20:42:21.027148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2874. [D 20:42:21.027163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2875. [D 20:42:21.027177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 2876. [D 20:42:21.027193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 2877. [D 20:42:21.027231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 2878. [D 20:42:21.027250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 2879. [D 20:42:21.027265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 2880. [D 20:42:21.027280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 2881. [D 20:42:21.027294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 2882. [D 20:42:21.027309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 2883. [D 20:42:21.027324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 2884. [D 20:42:21.027338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 2885. [D 20:42:21.027353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 2886. [D 20:42:21.027368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 2887. [D 20:42:21.027382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 2888. [D 20:42:21.027397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 2889. [D 20:42:21.027412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 2890. [D 20:42:21.027437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 2891. [D 20:42:21.027452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 2892. [D 20:42:21.027467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 2893. [D 20:42:21.027482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 2894. [D 20:42:21.027500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 2895. [D 20:42:21.027515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 2896. [D 20:42:21.027540] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 2897. [D 20:42:21.032990] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2897. [D 20:42:21.033014] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 19/70. [D 20:42:21.035523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.035544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.035559] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.213573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.213595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.213611] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.213652] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2659 [D 20:42:21.213670] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:21.213685] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 20/70. [D 20:42:21.218726] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2659 [D 20:42:21.218752] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 21/70. [D 20:42:21.218808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2897. [D 20:42:21.218825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2898. [D 20:42:21.218840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 2899. [D 20:42:21.218855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 2900. [D 20:42:21.218870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 2901. [D 20:42:21.218884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 2902. [D 20:42:21.218903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 2903. [D 20:42:21.218917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2904. [D 20:42:21.218932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2905. [D 20:42:21.218947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2906. [D 20:42:21.218962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 2907. [D 20:42:21.218976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 2908. [D 20:42:21.218991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 2909. [D 20:42:21.219006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 2910. [D 20:42:21.219109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 2911. [D 20:42:21.219128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2912. [D 20:42:21.219143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2913. [D 20:42:21.219157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2914. [D 20:42:21.219172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 2915. [D 20:42:21.219200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 2916. [D 20:42:21.219214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 2917. [D 20:42:21.219229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 2918. [D 20:42:21.219243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 2919. [D 20:42:21.219258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2920. [D 20:42:21.219272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2921. [D 20:42:21.219287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2922. [D 20:42:21.219301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 2923. [D 20:42:21.219316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 2924. [D 20:42:21.219389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 2925. [D 20:42:21.219414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 2926. [D 20:42:21.219467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 2927. [D 20:42:21.219484] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2928. [D 20:42:21.224704] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2928. [D 20:42:21.224728] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 22/70. [D 20:42:21.224820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.224880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.224895] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.231356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.231378] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.231391] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.231431] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2663 [D 20:42:21.231446] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:21.231466] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 23/70. [D 20:42:21.235106] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2663 [D 20:42:21.235138] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 24/70. [D 20:42:21.235193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2928. [D 20:42:21.235215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 2929. [D 20:42:21.235230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 2930. [D 20:42:21.235245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 2931. [D 20:42:21.235259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 2932. [D 20:42:21.235292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 2933. [D 20:42:21.235307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2934. [D 20:42:21.235321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2935. [D 20:42:21.235337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2936. [D 20:42:21.235359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 2937. [D 20:42:21.235373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 2938. [D 20:42:21.235388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 2939. [D 20:42:21.235415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 2940. [D 20:42:21.235430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 2941. [D 20:42:21.235444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2942. [D 20:42:21.235459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2943. [D 20:42:21.235473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2944. [D 20:42:21.235488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 2945. [D 20:42:21.235507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 2946. [D 20:42:21.235523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 2947. [D 20:42:21.235538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 2948. [D 20:42:21.235552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 2949. [D 20:42:21.235567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2950. [D 20:42:21.235594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2951. [D 20:42:21.235609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2952. [D 20:42:21.235626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 2953. [D 20:42:21.235640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 2954. [D 20:42:21.235655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 2955. [D 20:42:21.235673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 2956. [D 20:42:21.235687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 2957. [D 20:42:21.235702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2958. [D 20:42:21.235717] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2959. [D 20:42:21.241092] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2959. [D 20:42:21.241115] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 25/70. [D 20:42:21.243518] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.243538] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.243552] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.259695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.259749] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.259764] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.259806] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2665 [D 20:42:21.259821] element 0: offset: 0x2aaaab038ee0, size: 24 [D 20:42:21.259841] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 26/70. [D 20:42:21.263539] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2665 [D 20:42:21.263565] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 27/70. [D 20:42:21.263619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 2959. [D 20:42:21.263637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 2960. [D 20:42:21.263651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 2961. [D 20:42:21.263666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 2962. [D 20:42:21.263680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 2963. [D 20:42:21.263695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 2964. [D 20:42:21.263710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 2965. [D 20:42:21.263728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 2966. [D 20:42:21.263743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 2967. [D 20:42:21.263758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 2968. [D 20:42:21.263773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 2969. [D 20:42:21.263787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 2970. [D 20:42:21.263802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 2971. [D 20:42:21.263817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 2972. [D 20:42:21.263832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 2973. [D 20:42:21.263848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 2974. [D 20:42:21.263863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 2975. [D 20:42:21.263877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 2976. [D 20:42:21.263892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 2977. [D 20:42:21.263913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 2978. [D 20:42:21.263961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 2979. [D 20:42:21.263982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 2980. [D 20:42:21.263997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 2981. [D 20:42:21.264011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 2982. [D 20:42:21.264026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 2983. [D 20:42:21.264041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 2984. [D 20:42:21.264055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 2985. [D 20:42:21.264070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 2986. [D 20:42:21.264084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 2987. [D 20:42:21.264102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 2988. [D 20:42:21.264129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 2989. [D 20:42:21.264143] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 2990. [D 20:42:21.267407] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.267473] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.267494] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:21.267540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2668 [D 20:42:21.267555] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:21.267576] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 28/70. [D 20:42:21.269497] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 2990. [D 20:42:21.269521] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 29/70. [D 20:42:21.269751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.269778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.269799] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:21.272924] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2668 [D 20:42:21.272948] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 30/70. [D 20:42:21.273005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 2990. [D 20:42:21.273022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 2991. [D 20:42:21.273036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 2992. [D 20:42:21.273051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 2993. [D 20:42:21.273071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 2994. [D 20:42:21.273086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 2995. [D 20:42:21.273101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 2996. [D 20:42:21.273116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 2997. [D 20:42:21.273130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 2998. [D 20:42:21.273145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 2999. [D 20:42:21.273160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3000. [D 20:42:21.273175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3001. [D 20:42:21.273189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3002. [D 20:42:21.273205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3003. [D 20:42:21.273219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3004. [D 20:42:21.273234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3005. [D 20:42:21.273248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3006. [D 20:42:21.273263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3007. [D 20:42:21.273278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3008. [D 20:42:21.273292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3009. [D 20:42:21.273307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3010. [D 20:42:21.273322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3011. [D 20:42:21.273337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3012. [D 20:42:21.273351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3013. [D 20:42:21.273425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3014. [D 20:42:21.273439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3015. [D 20:42:21.273454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3016. [D 20:42:21.273469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3017. [D 20:42:21.273483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3018. [D 20:42:21.273498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3019. [D 20:42:21.273513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3020. [D 20:42:21.273527] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3021. [D 20:42:21.278880] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3021. [D 20:42:21.278900] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 31/70. [D 20:42:21.281883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.281902] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.281919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.339831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.339894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.339908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.339954] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2672 [D 20:42:21.339969] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:21.339988] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 32/70. [D 20:42:21.343673] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2672 [D 20:42:21.343706] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 33/70. [D 20:42:21.343899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3021. [D 20:42:21.343924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 3022. [D 20:42:21.343958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 3023. [D 20:42:21.343977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 3024. [D 20:42:21.343995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 3025. [D 20:42:21.344014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 3026. [D 20:42:21.344033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3027. [D 20:42:21.344051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3028. [D 20:42:21.344070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3029. [D 20:42:21.344088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 3030. [D 20:42:21.344110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 3031. [D 20:42:21.344138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 3032. [D 20:42:21.344156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 3033. [D 20:42:21.344175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 3034. [D 20:42:21.344193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3035. [D 20:42:21.344211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3036. [D 20:42:21.344230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3037. [D 20:42:21.344248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 3038. [D 20:42:21.344267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 3039. [D 20:42:21.344285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 3040. [D 20:42:21.344303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 3041. [D 20:42:21.344330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 3042. [D 20:42:21.344349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3043. [D 20:42:21.344368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3044. [D 20:42:21.344386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3045. [D 20:42:21.344404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 3046. [D 20:42:21.344423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 3047. [D 20:42:21.344440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 3048. [D 20:42:21.344458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 3049. [D 20:42:21.344477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 3050. [D 20:42:21.344493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3051. [D 20:42:21.344510] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3052. [D 20:42:21.349867] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3052. [D 20:42:21.349891] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 34/70. [D 20:42:21.349988] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.350049] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.350063] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.415942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.415963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.415976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.416015] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2675 [D 20:42:21.416030] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:21.416051] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 35/70. [D 20:42:21.419531] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2675 [D 20:42:21.419556] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 36/70. [D 20:42:21.419609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3052. [D 20:42:21.419626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 3053. [D 20:42:21.419643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 3054. [D 20:42:21.419658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 3055. [D 20:42:21.419673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 3056. [D 20:42:21.419687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 3057. [D 20:42:21.419702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3058. [D 20:42:21.419717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3059. [D 20:42:21.419732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3060. [D 20:42:21.419747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 3061. [D 20:42:21.419762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 3062. [D 20:42:21.419776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 3063. [D 20:42:21.419791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 3064. [D 20:42:21.419809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 3065. [D 20:42:21.419824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3066. [D 20:42:21.419839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3067. [D 20:42:21.419854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3068. [D 20:42:21.419869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 3069. [D 20:42:21.419915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 3070. [D 20:42:21.419936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 3071. [D 20:42:21.419950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 3072. [D 20:42:21.419965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 3073. [D 20:42:21.419980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3074. [D 20:42:21.419994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3075. [D 20:42:21.420009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3076. [D 20:42:21.420024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 3077. [D 20:42:21.420038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 3078. [D 20:42:21.420053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 3079. [D 20:42:21.420067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 3080. [D 20:42:21.420095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 3081. [D 20:42:21.420112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3082. [D 20:42:21.420127] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3083. [D 20:42:21.425566] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3083. [D 20:42:21.425590] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 37/70. [D 20:42:21.425706] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.425759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.425773] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.540077] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.540099] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.540114] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.540151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2678 [D 20:42:21.540166] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:21.540185] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 38/70. [D 20:42:21.543541] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2678 [D 20:42:21.543572] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 39/70. [D 20:42:21.543627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3083. [D 20:42:21.543650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 3084. [D 20:42:21.543665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 3085. [D 20:42:21.543679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 3086. [D 20:42:21.543694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 3087. [D 20:42:21.543709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 3088. [D 20:42:21.543723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3089. [D 20:42:21.543738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3090. [D 20:42:21.543752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3091. [D 20:42:21.543767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 3092. [D 20:42:21.543782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 3093. [D 20:42:21.543796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 3094. [D 20:42:21.543874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 3095. [D 20:42:21.543892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 3096. [D 20:42:21.543907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3097. [D 20:42:21.543921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3098. [D 20:42:21.543936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3099. [D 20:42:21.543959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 3100. [D 20:42:21.544015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 3101. [D 20:42:21.544030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 3102. [D 20:42:21.544050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 3103. [D 20:42:21.544128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 3104. [D 20:42:21.544146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3105. [D 20:42:21.544160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3106. [D 20:42:21.544175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3107. [D 20:42:21.544189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 3108. [D 20:42:21.544207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 3109. [D 20:42:21.544221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 3110. [D 20:42:21.544236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 3111. [D 20:42:21.544262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 3112. [D 20:42:21.544276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3113. [D 20:42:21.544290] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3114. [D 20:42:21.549518] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3114. [D 20:42:21.549541] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 40/70. [D 20:42:21.549657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.549710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.549724] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.602332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.602353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.602366] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.602403] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2680 [D 20:42:21.602418] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:21.602437] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 41/70. [D 20:42:21.603541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.603595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.603608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:21.603646] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2683 [D 20:42:21.603660] element 0: offset: 0x2aaaab038ee0, size: 24 [D 20:42:21.603679] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 42/70. [D 20:42:21.607061] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 2680 [D 20:42:21.607092] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 43/70. [D 20:42:21.607163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3114. [D 20:42:21.607181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3115. [D 20:42:21.607196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3116. [D 20:42:21.607210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3117. [D 20:42:21.607225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3118. [D 20:42:21.607240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3119. [D 20:42:21.607256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3120. [D 20:42:21.607276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3121. [D 20:42:21.607291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3122. [D 20:42:21.607306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3123. [D 20:42:21.607326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3124. [D 20:42:21.607340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3125. [D 20:42:21.607355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3126. [D 20:42:21.607370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3127. [D 20:42:21.607385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3128. [D 20:42:21.607405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3129. [D 20:42:21.607422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3130. [D 20:42:21.607436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3131. [D 20:42:21.607451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3132. [D 20:42:21.607466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3133. [D 20:42:21.607480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3134. [D 20:42:21.607495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3135. [D 20:42:21.607515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3136. [D 20:42:21.607587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3137. [D 20:42:21.607602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3138. [D 20:42:21.607618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3139. [D 20:42:21.607633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3140. [D 20:42:21.607648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3141. [D 20:42:21.607677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3142. [D 20:42:21.607691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3143. [D 20:42:21.607706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3144. [D 20:42:21.607724] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3145. [D 20:42:21.613081] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3145. [D 20:42:21.613151] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 44/70. [D 20:42:21.615561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.615616] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.615630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:21.616842] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2683 [D 20:42:21.616870] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 45/70. [D 20:42:21.616929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3145. [D 20:42:21.616947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3146. [D 20:42:21.616961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3147. [D 20:42:21.616976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3148. [D 20:42:21.616991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3149. [D 20:42:21.617013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3150. [D 20:42:21.617028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3151. [D 20:42:21.617043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3152. [D 20:42:21.617057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3153. [D 20:42:21.617072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3154. [D 20:42:21.617087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3155. [D 20:42:21.617102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3156. [D 20:42:21.617116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3157. [D 20:42:21.617131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3158. [D 20:42:21.617146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3159. [D 20:42:21.617160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3160. [D 20:42:21.617215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3161. [D 20:42:21.617236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3162. [D 20:42:21.617251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3163. [D 20:42:21.617265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3164. [D 20:42:21.617280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3165. [D 20:42:21.617294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3166. [D 20:42:21.617309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3167. [D 20:42:21.617336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3168. [D 20:42:21.617351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3169. [D 20:42:21.617365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3170. [D 20:42:21.617380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3171. [D 20:42:21.617394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3172. [D 20:42:21.617409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3173. [D 20:42:21.617423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3174. [D 20:42:21.617438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3175. [D 20:42:21.617452] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3176. [D 20:42:21.622844] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3176. [D 20:42:21.622867] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 46/70. [D 20:42:21.623555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.623612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.623626] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.654702] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.654723] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.654736] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.654776] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2686 [D 20:42:21.654791] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:21.654811] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 47/70. [D 20:42:21.658704] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2686 [D 20:42:21.658733] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 48/70. [D 20:42:21.658794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3176. [D 20:42:21.658810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3177. [D 20:42:21.658825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3178. [D 20:42:21.658841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3179. [D 20:42:21.658871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3180. [D 20:42:21.658886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3181. [D 20:42:21.658901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3182. [D 20:42:21.658916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3183. [D 20:42:21.658930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3184. [D 20:42:21.658971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3185. [D 20:42:21.658986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3186. [D 20:42:21.659007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3187. [D 20:42:21.659021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3188. [D 20:42:21.659036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3189. [D 20:42:21.659050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3190. [D 20:42:21.659065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3191. [D 20:42:21.659080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3192. [D 20:42:21.659094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3193. [D 20:42:21.659109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3194. [D 20:42:21.659140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3195. [D 20:42:21.659155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3196. [D 20:42:21.659172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3197. [D 20:42:21.659186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3198. [D 20:42:21.659201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3199. [D 20:42:21.659216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3200. [D 20:42:21.659231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3201. [D 20:42:21.659245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3202. [D 20:42:21.659261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3203. [D 20:42:21.659311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3204. [D 20:42:21.659334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3205. [D 20:42:21.659353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3206. [D 20:42:21.659368] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3207. [D 20:42:21.664736] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3207. [D 20:42:21.664757] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 49/70. [D 20:42:21.664874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.664934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.664948] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.788246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.788267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.788280] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.788320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2690 [D 20:42:21.788335] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:21.788354] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 50/70. [D 20:42:21.792325] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2690 [D 20:42:21.792352] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 51/70. [D 20:42:21.792406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3207. [D 20:42:21.792423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 3208. [D 20:42:21.792438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 3209. [D 20:42:21.792453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 3210. [D 20:42:21.792470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 3211. [D 20:42:21.792484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 3212. [D 20:42:21.792499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3213. [D 20:42:21.792514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3214. [D 20:42:21.792529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3215. [D 20:42:21.792556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 3216. [D 20:42:21.792571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 3217. [D 20:42:21.792601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 3218. [D 20:42:21.792616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 3219. [D 20:42:21.792631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 3220. [D 20:42:21.792645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3221. [D 20:42:21.792660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3222. [D 20:42:21.792675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3223. [D 20:42:21.792689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 3224. [D 20:42:21.792704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 3225. [D 20:42:21.792719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 3226. [D 20:42:21.792735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 3227. [D 20:42:21.792750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 3228. [D 20:42:21.792765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3229. [D 20:42:21.792800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3230. [D 20:42:21.792816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3231. [D 20:42:21.792877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 3232. [D 20:42:21.792908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 3233. [D 20:42:21.792923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 3234. [D 20:42:21.792938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 3235. [D 20:42:21.792953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 3236. [D 20:42:21.792967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3237. [D 20:42:21.792982] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3238. [D 20:42:21.798340] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3238. [D 20:42:21.798361] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 52/70. [D 20:42:21.798471] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.798523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.798536] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:21.855254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:21.855275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.855288] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:21.855324] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2692 [D 20:42:21.855339] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:21.855359] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 53/70. [D 20:42:21.858856] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2692 [D 20:42:21.858886] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 54/70. [D 20:42:21.858949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3238. [D 20:42:21.858968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3239. [D 20:42:21.858983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3240. [D 20:42:21.858997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3241. [D 20:42:21.859012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3242. [D 20:42:21.859027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3243. [D 20:42:21.859290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3244. [D 20:42:21.859370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3245. [D 20:42:21.859386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3246. [D 20:42:21.859517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3247. [D 20:42:21.859534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3248. [D 20:42:21.859548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3249. [D 20:42:21.859563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3250. [D 20:42:21.859577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3251. [D 20:42:21.859592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3252. [D 20:42:21.859623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3253. [D 20:42:21.859638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3254. [D 20:42:21.859652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3255. [D 20:42:21.859667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3256. [D 20:42:21.859681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3257. [D 20:42:21.859696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3258. [D 20:42:21.859710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3259. [D 20:42:21.859737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3260. [D 20:42:21.859751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3261. [D 20:42:21.859766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3262. [D 20:42:21.859780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3263. [D 20:42:21.859795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3264. [D 20:42:21.859809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3265. [D 20:42:21.859824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3266. [D 20:42:21.859838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3267. [D 20:42:21.859853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3268. [D 20:42:21.859867] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3269. [D 20:42:21.864908] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3269. [D 20:42:21.864930] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 55/70. [D 20:42:21.865034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:21.865086] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:21.865100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.146503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.146525] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.146538] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.146575] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2695 [D 20:42:22.146590] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:22.146610] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 56/70. [D 20:42:22.150162] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2695 [D 20:42:22.150239] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 57/70. [D 20:42:22.150432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3269. [D 20:42:22.150460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3270. [D 20:42:22.150476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3271. [D 20:42:22.150490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3272. [D 20:42:22.150505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3273. [D 20:42:22.150520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3274. [D 20:42:22.150535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3275. [D 20:42:22.150549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3276. [D 20:42:22.150564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3277. [D 20:42:22.150578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3278. [D 20:42:22.150608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3279. [D 20:42:22.150622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3280. [D 20:42:22.150636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3281. [D 20:42:22.150651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3282. [D 20:42:22.150665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3283. [D 20:42:22.150679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3284. [D 20:42:22.150694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3285. [D 20:42:22.150708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3286. [D 20:42:22.150723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3287. [D 20:42:22.150737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3288. [D 20:42:22.150752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3289. [D 20:42:22.150766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3290. [D 20:42:22.150781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3291. [D 20:42:22.150807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3292. [D 20:42:22.150821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3293. [D 20:42:22.150836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3294. [D 20:42:22.150850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3295. [D 20:42:22.150864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3296. [D 20:42:22.150879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3297. [D 20:42:22.150893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3298. [D 20:42:22.150909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3299. [D 20:42:22.150924] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3300. [D 20:42:22.156392] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3300. [D 20:42:22.156426] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 58/70. [D 20:42:22.156512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.156535] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.156548] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.169819] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.169842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.169855] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.169893] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2698 [D 20:42:22.169908] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:22.169926] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 59/70. [D 20:42:22.173745] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2698 [D 20:42:22.173820] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 60/70. [D 20:42:22.173881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3300. [D 20:42:22.173916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3301. [D 20:42:22.173932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3302. [D 20:42:22.173947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3303. [D 20:42:22.173961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3304. [D 20:42:22.173979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3305. [D 20:42:22.173995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3306. [D 20:42:22.174009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3307. [D 20:42:22.174035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3308. [D 20:42:22.174050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3309. [D 20:42:22.174065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3310. [D 20:42:22.174079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3311. [D 20:42:22.174094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3312. [D 20:42:22.174108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3313. [D 20:42:22.174123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3314. [D 20:42:22.174137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3315. [D 20:42:22.174156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3316. [D 20:42:22.174170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3317. [D 20:42:22.174184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3318. [D 20:42:22.174199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3319. [D 20:42:22.174213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3320. [D 20:42:22.174239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3321. [D 20:42:22.174254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3322. [D 20:42:22.174268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3323. [D 20:42:22.174282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3324. [D 20:42:22.174297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3325. [D 20:42:22.174311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3326. [D 20:42:22.174326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3327. [D 20:42:22.174340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3328. [D 20:42:22.174355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3329. [D 20:42:22.174370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3330. [D 20:42:22.174384] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3331. [D 20:42:22.179833] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3331. [D 20:42:22.179854] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 0/70. [D 20:42:22.179961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.179985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.179999] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.249184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.249204] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.249217] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.249255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2702 [D 20:42:22.249269] element 0: offset: 0x2aaaab005610, size: 24 [D 20:42:22.249286] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 1/70. [D 20:42:22.253164] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2702 [D 20:42:22.253229] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 2/70. [D 20:42:22.253293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3331. [D 20:42:22.253317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 3332. [D 20:42:22.253332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 3333. [D 20:42:22.253346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 3334. [D 20:42:22.253361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 3335. [D 20:42:22.253376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 3336. [D 20:42:22.253391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3337. [D 20:42:22.253405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3338. [D 20:42:22.253420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3339. [D 20:42:22.253435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 3340. [D 20:42:22.253449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 3341. [D 20:42:22.253464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 3342. [D 20:42:22.253513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 3343. [D 20:42:22.253528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 3344. [D 20:42:22.253542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3345. [D 20:42:22.253557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3346. [D 20:42:22.253571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3347. [D 20:42:22.253586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 3348. [D 20:42:22.253610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 3349. [D 20:42:22.253625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 3350. [D 20:42:22.253640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 3351. [D 20:42:22.253664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 3352. [D 20:42:22.253678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3353. [D 20:42:22.253693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3354. [D 20:42:22.253708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3355. [D 20:42:22.253728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 3356. [D 20:42:22.253745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 3357. [D 20:42:22.253759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 3358. [D 20:42:22.253774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 3359. [D 20:42:22.253790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 3360. [D 20:42:22.253805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3361. [D 20:42:22.253820] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3362. [D 20:42:22.259257] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3362. [D 20:42:22.259277] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 3/70. [D 20:42:22.262305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.262325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.262341] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.343735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.343760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.343773] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.343813] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2704 [D 20:42:22.343828] element 0: offset: 0x2aaaab010130, size: 24 [D 20:42:22.343846] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 4/70. [D 20:42:22.347590] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2704 [D 20:42:22.347670] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 5/70. [D 20:42:22.352750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3362. [D 20:42:22.352776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3363. [D 20:42:22.352791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3364. [D 20:42:22.352806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3365. [D 20:42:22.352820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3366. [D 20:42:22.352835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3367. [D 20:42:22.352850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3368. [D 20:42:22.352865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3369. [D 20:42:22.352879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3370. [D 20:42:22.352894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3371. [D 20:42:22.352908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3372. [D 20:42:22.352923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3373. [D 20:42:22.352938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3374. [D 20:42:22.352952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3375. [D 20:42:22.352967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3376. [D 20:42:22.352981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3377. [D 20:42:22.352996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3378. [D 20:42:22.353010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3379. [D 20:42:22.353025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3380. [D 20:42:22.353040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3381. [D 20:42:22.353054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3382. [D 20:42:22.353069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3383. [D 20:42:22.353083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3384. [D 20:42:22.353098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3385. [D 20:42:22.353112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3386. [D 20:42:22.353127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3387. [D 20:42:22.353142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3388. [D 20:42:22.353157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3389. [D 20:42:22.353171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3390. [D 20:42:22.353186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3391. [D 20:42:22.353202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3392. [D 20:42:22.353216] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3393. [D 20:42:22.353279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.353304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.353317] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:22.353358] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2707 [D 20:42:22.353373] element 0: offset: 0x2aaaab014910, size: 24 [D 20:42:22.353390] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 6/70. [D 20:42:22.358731] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3393. [D 20:42:22.358759] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 7/70. [D 20:42:22.358912] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.358935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.358948] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:22.362737] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2707 [D 20:42:22.362806] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 8/70. [D 20:42:22.362865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3393. [D 20:42:22.362893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3394. [D 20:42:22.362908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3395. [D 20:42:22.362923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3396. [D 20:42:22.362937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3397. [D 20:42:22.362959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3398. [D 20:42:22.362976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3399. [D 20:42:22.362990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3400. [D 20:42:22.363005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3401. [D 20:42:22.363020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3402. [D 20:42:22.363035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3403. [D 20:42:22.363050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3404. [D 20:42:22.363065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3405. [D 20:42:22.363080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3406. [D 20:42:22.363118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3407. [D 20:42:22.363139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3408. [D 20:42:22.363154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3409. [D 20:42:22.363168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3410. [D 20:42:22.363183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3411. [D 20:42:22.363198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3412. [D 20:42:22.363213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3413. [D 20:42:22.363228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3414. [D 20:42:22.363242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3415. [D 20:42:22.363257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3416. [D 20:42:22.363272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3417. [D 20:42:22.363286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3418. [D 20:42:22.363301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3419. [D 20:42:22.363316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3420. [D 20:42:22.363330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3421. [D 20:42:22.363350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3422. [D 20:42:22.363367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3423. [D 20:42:22.363382] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3424. [D 20:42:22.368804] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3424. [D 20:42:22.368825] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 9/70. [D 20:42:22.368933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.368957] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.368971] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.417639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.417660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.417673] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.417711] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2710 [D 20:42:22.417726] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:22.417743] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 10/70. [D 20:42:22.421800] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2710 [D 20:42:22.421864] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 11/70. [D 20:42:22.421920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3424. [D 20:42:22.421949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3425. [D 20:42:22.421965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3426. [D 20:42:22.421979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3427. [D 20:42:22.421994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3428. [D 20:42:22.422009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3429. [D 20:42:22.422026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3430. [D 20:42:22.422041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3431. [D 20:42:22.422056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3432. [D 20:42:22.422071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3433. [D 20:42:22.422086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3434. [D 20:42:22.422100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3435. [D 20:42:22.422115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3436. [D 20:42:22.422163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3437. [D 20:42:22.422178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3438. [D 20:42:22.422193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3439. [D 20:42:22.422208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3440. [D 20:42:22.422222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3441. [D 20:42:22.422237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3442. [D 20:42:22.422252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3443. [D 20:42:22.422267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3444. [D 20:42:22.422281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3445. [D 20:42:22.422296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3446. [D 20:42:22.422311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3447. [D 20:42:22.422325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3448. [D 20:42:22.422340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3449. [D 20:42:22.422358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3450. [D 20:42:22.422382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3451. [D 20:42:22.422398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3452. [D 20:42:22.422412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3453. [D 20:42:22.422427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3454. [D 20:42:22.422442] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3455. [D 20:42:22.427861] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3455. [D 20:42:22.427881] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 12/70. [D 20:42:22.427987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.428011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.428025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.502765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.502785] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.502798] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.502835] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2713 [D 20:42:22.502850] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:22.502867] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 13/70. [D 20:42:22.506681] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2713 [D 20:42:22.506743] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 14/70. [D 20:42:22.506803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3455. [D 20:42:22.506832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3456. [D 20:42:22.506847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3457. [D 20:42:22.506862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3458. [D 20:42:22.506877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3459. [D 20:42:22.506913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3460. [D 20:42:22.506928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3461. [D 20:42:22.506943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3462. [D 20:42:22.506957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3463. [D 20:42:22.506972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3464. [D 20:42:22.506987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3465. [D 20:42:22.507001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3466. [D 20:42:22.507016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3467. [D 20:42:22.507031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3468. [D 20:42:22.507045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3469. [D 20:42:22.507060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3470. [D 20:42:22.507075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3471. [D 20:42:22.507220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3472. [D 20:42:22.507239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3473. [D 20:42:22.507254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3474. [D 20:42:22.507269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3475. [D 20:42:22.507284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3476. [D 20:42:22.507302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3477. [D 20:42:22.507317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3478. [D 20:42:22.507332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3479. [D 20:42:22.507346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3480. [D 20:42:22.507361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3481. [D 20:42:22.507386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3482. [D 20:42:22.507460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3483. [D 20:42:22.507491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3484. [D 20:42:22.507512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3485. [D 20:42:22.507533] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3486. [D 20:42:22.512768] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3486. [D 20:42:22.512792] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 15/70. [D 20:42:22.512894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.512919] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.512932] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.586429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.586449] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.586462] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.586499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2716 [D 20:42:22.586514] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:22.586531] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 16/70. [D 20:42:22.590409] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2716 [D 20:42:22.590471] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 17/70. [D 20:42:22.590534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3486. [D 20:42:22.590564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3487. [D 20:42:22.590579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3488. [D 20:42:22.590594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3489. [D 20:42:22.590684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3490. [D 20:42:22.590704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3491. [D 20:42:22.590719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3492. [D 20:42:22.590733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3493. [D 20:42:22.590807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3494. [D 20:42:22.590879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3495. [D 20:42:22.590959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3496. [D 20:42:22.590977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3497. [D 20:42:22.591013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3498. [D 20:42:22.591028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3499. [D 20:42:22.591048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3500. [D 20:42:22.591062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3501. [D 20:42:22.591077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3502. [D 20:42:22.591091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3503. [D 20:42:22.591106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3504. [D 20:42:22.591121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3505. [D 20:42:22.591135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3506. [D 20:42:22.591150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3507. [D 20:42:22.591164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3508. [D 20:42:22.591244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3509. [D 20:42:22.591270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3510. [D 20:42:22.591288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3511. [D 20:42:22.591366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3512. [D 20:42:22.591430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3513. [D 20:42:22.591501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3514. [D 20:42:22.591522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3515. [D 20:42:22.591537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3516. [D 20:42:22.591552] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3517. [D 20:42:22.596486] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3517. [D 20:42:22.596511] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 18/70. [D 20:42:22.596598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.596622] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.596636] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.676564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.676583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.676596] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.676633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2719 [D 20:42:22.676648] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:22.676665] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 19/70. [D 20:42:22.680088] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2719 [D 20:42:22.680161] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 20/70. [D 20:42:22.680228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3517. [D 20:42:22.680255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3518. [D 20:42:22.680274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3519. [D 20:42:22.680289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3520. [D 20:42:22.680304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3521. [D 20:42:22.680319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3522. [D 20:42:22.680334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3523. [D 20:42:22.680350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3524. [D 20:42:22.680384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3525. [D 20:42:22.680402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3526. [D 20:42:22.680421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3527. [D 20:42:22.680440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3528. [D 20:42:22.680458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3529. [D 20:42:22.680477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3530. [D 20:42:22.680495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3531. [D 20:42:22.680513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3532. [D 20:42:22.680532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3533. [D 20:42:22.680550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3534. [D 20:42:22.680580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3535. [D 20:42:22.680599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3536. [D 20:42:22.680616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3537. [D 20:42:22.680632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3538. [D 20:42:22.680647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3539. [D 20:42:22.680668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3540. [D 20:42:22.680687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3541. [D 20:42:22.680714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3542. [D 20:42:22.680732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3543. [D 20:42:22.680750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3544. [D 20:42:22.680768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3545. [D 20:42:22.680787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3546. [D 20:42:22.680802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3547. [D 20:42:22.680817] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3548. [D 20:42:22.686166] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3548. [D 20:42:22.686190] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 21/70. [D 20:42:22.686295] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.686319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.686332] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.717254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.717275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.717288] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.717325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2722 [D 20:42:22.717340] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:22.717357] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 22/70. [D 20:42:22.721294] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2722 [D 20:42:22.721358] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 23/70. [D 20:42:22.721419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3548. [D 20:42:22.721442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3549. [D 20:42:22.721458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3550. [D 20:42:22.721473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3551. [D 20:42:22.721488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3552. [D 20:42:22.721504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3553. [D 20:42:22.721520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3554. [D 20:42:22.721535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3555. [D 20:42:22.721550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3556. [D 20:42:22.721564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3557. [D 20:42:22.721579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3558. [D 20:42:22.721594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3559. [D 20:42:22.721609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3560. [D 20:42:22.721650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3561. [D 20:42:22.721665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3562. [D 20:42:22.721680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3563. [D 20:42:22.721695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3564. [D 20:42:22.721709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3565. [D 20:42:22.721724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3566. [D 20:42:22.721739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3567. [D 20:42:22.721753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3568. [D 20:42:22.721768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3569. [D 20:42:22.721782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3570. [D 20:42:22.721797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3571. [D 20:42:22.721811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3572. [D 20:42:22.721826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3573. [D 20:42:22.721840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3574. [D 20:42:22.721859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3575. [D 20:42:22.721874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3576. [D 20:42:22.721899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3577. [D 20:42:22.721914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3578. [D 20:42:22.721929] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3579. [D 20:42:22.727362] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3579. [D 20:42:22.727383] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 24/70. [D 20:42:22.727534] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.727552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.727568] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.747692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.747717] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.747731] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.747771] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2726 [D 20:42:22.747786] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:22.747804] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 25/70. [D 20:42:22.751500] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2726 [D 20:42:22.751580] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 26/70. [D 20:42:22.751637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 3579. [D 20:42:22.751661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 3580. [D 20:42:22.751676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 3581. [D 20:42:22.751691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 3582. [D 20:42:22.751706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 3583. [D 20:42:22.751720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 3584. [D 20:42:22.751735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3585. [D 20:42:22.751750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3586. [D 20:42:22.751765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3587. [D 20:42:22.751805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 3588. [D 20:42:22.751820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 3589. [D 20:42:22.751835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 3590. [D 20:42:22.751856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 3591. [D 20:42:22.751870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 3592. [D 20:42:22.751885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3593. [D 20:42:22.751911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3594. [D 20:42:22.751942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3595. [D 20:42:22.751957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 3596. [D 20:42:22.751973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 3597. [D 20:42:22.751988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 3598. [D 20:42:22.752003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 3599. [D 20:42:22.752018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 3600. [D 20:42:22.752033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3601. [D 20:42:22.752048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3602. [D 20:42:22.752064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3603. [D 20:42:22.752078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 3604. [D 20:42:22.752094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 3605. [D 20:42:22.752109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 3606. [D 20:42:22.752163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 3607. [D 20:42:22.752190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 3608. [D 20:42:22.752209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3609. [D 20:42:22.752225] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3610. [D 20:42:22.757602] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3610. [D 20:42:22.757622] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 27/70. [D 20:42:22.757728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.757753] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.757767] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.772759] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.772779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.772793] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.772829] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2728 [D 20:42:22.772844] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:22.772861] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 28/70. [D 20:42:22.776709] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2728 [D 20:42:22.776773] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 29/70. [D 20:42:22.776833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3610. [D 20:42:22.776857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3611. [D 20:42:22.776872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3612. [D 20:42:22.776890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3613. [D 20:42:22.776907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3614. [D 20:42:22.776922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3615. [D 20:42:22.776936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3616. [D 20:42:22.776951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3617. [D 20:42:22.776966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3618. [D 20:42:22.776981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3619. [D 20:42:22.776996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3620. [D 20:42:22.777031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3621. [D 20:42:22.777046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3622. [D 20:42:22.777060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3623. [D 20:42:22.777075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3624. [D 20:42:22.777089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3625. [D 20:42:22.777104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3626. [D 20:42:22.777119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3627. [D 20:42:22.777133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3628. [D 20:42:22.777148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3629. [D 20:42:22.777163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3630. [D 20:42:22.777177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3631. [D 20:42:22.777192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3632. [D 20:42:22.777208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3633. [D 20:42:22.777226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3634. [D 20:42:22.777240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3635. [D 20:42:22.777255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3636. [D 20:42:22.777270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3637. [D 20:42:22.777284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3638. [D 20:42:22.777299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3639. [D 20:42:22.777314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3640. [D 20:42:22.777372] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3641. [D 20:42:22.782784] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3641. [D 20:42:22.782805] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 30/70. [D 20:42:22.785808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.785829] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.785846] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.835676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.835701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.835715] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.835755] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2731 [D 20:42:22.835770] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:22.835788] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 31/70. [D 20:42:22.839501] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2731 [D 20:42:22.839593] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 32/70. [D 20:42:22.839651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3641. [D 20:42:22.839675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3642. [D 20:42:22.839690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3643. [D 20:42:22.839705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3644. [D 20:42:22.839720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3645. [D 20:42:22.839742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3646. [D 20:42:22.839758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3647. [D 20:42:22.839773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3648. [D 20:42:22.839788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3649. [D 20:42:22.839803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3650. [D 20:42:22.839817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3651. [D 20:42:22.839832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3652. [D 20:42:22.839847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3653. [D 20:42:22.839881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3654. [D 20:42:22.839896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3655. [D 20:42:22.839922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3656. [D 20:42:22.839937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3657. [D 20:42:22.839952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3658. [D 20:42:22.839967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3659. [D 20:42:22.839981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3660. [D 20:42:22.839996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3661. [D 20:42:22.840010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3662. [D 20:42:22.840025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3663. [D 20:42:22.840040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3664. [D 20:42:22.840054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3665. [D 20:42:22.840069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3666. [D 20:42:22.840084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3667. [D 20:42:22.840098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3668. [D 20:42:22.840113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3669. [D 20:42:22.840127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3670. [D 20:42:22.840142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3671. [D 20:42:22.840157] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3672. [D 20:42:22.845603] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3672. [D 20:42:22.845623] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 33/70. [D 20:42:22.845710] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.845734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.845747] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.908487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.908509] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.908522] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.908561] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2734 [D 20:42:22.908576] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:22.908593] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 34/70. [D 20:42:22.912388] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2734 [D 20:42:22.912465] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 35/70. [D 20:42:22.912525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3672. [D 20:42:22.912550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3673. [D 20:42:22.912565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 3674. [D 20:42:22.912580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 3675. [D 20:42:22.912601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 3676. [D 20:42:22.912616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 3677. [D 20:42:22.912631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 3678. [D 20:42:22.912645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3679. [D 20:42:22.912660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3680. [D 20:42:22.912675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3681. [D 20:42:22.912690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 3682. [D 20:42:22.912704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 3683. [D 20:42:22.912719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 3684. [D 20:42:22.912733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 3685. [D 20:42:22.912748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 3686. [D 20:42:22.912763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3687. [D 20:42:22.912777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3688. [D 20:42:22.912792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3689. [D 20:42:22.912812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 3690. [D 20:42:22.912827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 3691. [D 20:42:22.912842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 3692. [D 20:42:22.912857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 3693. [D 20:42:22.912871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 3694. [D 20:42:22.912886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3695. [D 20:42:22.912900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3696. [D 20:42:22.912915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3697. [D 20:42:22.912940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 3698. [D 20:42:22.912955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 3699. [D 20:42:22.912969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 3700. [D 20:42:22.912984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 3701. [D 20:42:22.913000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 3702. [D 20:42:22.913015] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3703. [D 20:42:22.918458] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3703. [D 20:42:22.918478] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 36/70. [D 20:42:22.918585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.918610] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.918624] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:22.983433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:22.983453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.983466] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:22.983505] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2737 [D 20:42:22.983525] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:22.983542] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 37/70. [D 20:42:22.987305] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2737 [D 20:42:22.987380] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 38/70. [D 20:42:22.987437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3703. [D 20:42:22.987460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3704. [D 20:42:22.987488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3705. [D 20:42:22.987503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3706. [D 20:42:22.987522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3707. [D 20:42:22.987537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3708. [D 20:42:22.987553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3709. [D 20:42:22.987567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3710. [D 20:42:22.987582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3711. [D 20:42:22.987597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3712. [D 20:42:22.987612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3713. [D 20:42:22.987637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3714. [D 20:42:22.987653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3715. [D 20:42:22.987668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3716. [D 20:42:22.987684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3717. [D 20:42:22.987699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3718. [D 20:42:22.987713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3719. [D 20:42:22.987768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3720. [D 20:42:22.987789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3721. [D 20:42:22.987804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3722. [D 20:42:22.987819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3723. [D 20:42:22.987834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3724. [D 20:42:22.987848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3725. [D 20:42:22.987863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3726. [D 20:42:22.987877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3727. [D 20:42:22.987892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3728. [D 20:42:22.987907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3729. [D 20:42:22.987921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3730. [D 20:42:22.987936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3731. [D 20:42:22.987951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3732. [D 20:42:22.987975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3733. [D 20:42:22.987990] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3734. [D 20:42:22.993378] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3734. [D 20:42:22.993398] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 39/70. [D 20:42:22.993508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:22.993532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:22.993546] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.078573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.078594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.078607] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.078645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2741 [D 20:42:23.078660] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:23.078677] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 40/70. [D 20:42:23.082407] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2741 [D 20:42:23.082487] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 41/70. [D 20:42:23.082546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 3734. [D 20:42:23.082572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 3735. [D 20:42:23.082587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 3736. [D 20:42:23.082603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 3737. [D 20:42:23.082618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 3738. [D 20:42:23.082632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 3739. [D 20:42:23.082652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3740. [D 20:42:23.082667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3741. [D 20:42:23.082682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3742. [D 20:42:23.082697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 3743. [D 20:42:23.082711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 3744. [D 20:42:23.082726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 3745. [D 20:42:23.082741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 3746. [D 20:42:23.082756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 3747. [D 20:42:23.082771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3748. [D 20:42:23.082785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3749. [D 20:42:23.082801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3750. [D 20:42:23.082815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 3751. [D 20:42:23.082836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 3752. [D 20:42:23.082883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 3753. [D 20:42:23.082904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 3754. [D 20:42:23.082919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 3755. [D 20:42:23.082934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3756. [D 20:42:23.082949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3757. [D 20:42:23.082964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3758. [D 20:42:23.082979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 3759. [D 20:42:23.082994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 3760. [D 20:42:23.083020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 3761. [D 20:42:23.083034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 3762. [D 20:42:23.083049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 3763. [D 20:42:23.083064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3764. [D 20:42:23.083078] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3765. [D 20:42:23.088492] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3765. [D 20:42:23.088515] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 42/70. [D 20:42:23.088626] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.088650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.088664] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.217107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.217128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.217140] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.217179] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2743 [D 20:42:23.217194] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:23.217211] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 43/70. [D 20:42:23.221006] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2743 [D 20:42:23.221069] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 44/70. [D 20:42:23.221126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3765. [D 20:42:23.221154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3766. [D 20:42:23.221169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 3767. [D 20:42:23.221184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 3768. [D 20:42:23.221199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 3769. [D 20:42:23.221216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 3770. [D 20:42:23.221232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 3771. [D 20:42:23.221247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3772. [D 20:42:23.221261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3773. [D 20:42:23.221277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3774. [D 20:42:23.221302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 3775. [D 20:42:23.221317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 3776. [D 20:42:23.221331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 3777. [D 20:42:23.221350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 3778. [D 20:42:23.221365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 3779. [D 20:42:23.221379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3780. [D 20:42:23.221394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3781. [D 20:42:23.221409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3782. [D 20:42:23.221423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 3783. [D 20:42:23.221438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 3784. [D 20:42:23.221453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 3785. [D 20:42:23.221469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 3786. [D 20:42:23.221486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 3787. [D 20:42:23.221500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3788. [D 20:42:23.221515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3789. [D 20:42:23.221530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3790. [D 20:42:23.221581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 3791. [D 20:42:23.221602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 3792. [D 20:42:23.221617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 3793. [D 20:42:23.221632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 3794. [D 20:42:23.221646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 3795. [D 20:42:23.221661] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3796. [D 20:42:23.227025] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3796. [D 20:42:23.227048] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 45/70. [D 20:42:23.227153] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.227177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.227191] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.281821] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.281841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.281854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.281890] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2747 [D 20:42:23.281905] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:23.281922] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 46/70. [D 20:42:23.285776] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2747 [D 20:42:23.285839] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 47/70. [D 20:42:23.285896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3796. [D 20:42:23.285922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 3797. [D 20:42:23.285937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 3798. [D 20:42:23.285952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 3799. [D 20:42:23.285967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 3800. [D 20:42:23.285982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 3801. [D 20:42:23.285998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3802. [D 20:42:23.286013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3803. [D 20:42:23.286028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3804. [D 20:42:23.286043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 3805. [D 20:42:23.286058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 3806. [D 20:42:23.286072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 3807. [D 20:42:23.286088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 3808. [D 20:42:23.286124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 3809. [D 20:42:23.286139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3810. [D 20:42:23.286154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3811. [D 20:42:23.286180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3812. [D 20:42:23.286195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 3813. [D 20:42:23.286210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 3814. [D 20:42:23.286225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 3815. [D 20:42:23.286239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 3816. [D 20:42:23.286254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 3817. [D 20:42:23.286269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3818. [D 20:42:23.286283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3819. [D 20:42:23.286298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3820. [D 20:42:23.286312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 3821. [D 20:42:23.286331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 3822. [D 20:42:23.286346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 3823. [D 20:42:23.286371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 3824. [D 20:42:23.286386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 3825. [D 20:42:23.286401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3826. [D 20:42:23.286416] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3827. [D 20:42:23.291780] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3827. [D 20:42:23.291801] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 48/70. [D 20:42:23.291907] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.291932] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.291946] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.336033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.336053] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.336067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.336103] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2749 [D 20:42:23.336118] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:23.336135] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 49/70. [D 20:42:23.339558] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2749 [D 20:42:23.339584] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 50/70. [D 20:42:23.339642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 3827. [D 20:42:23.339659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 3828. [D 20:42:23.339675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 3829. [D 20:42:23.339690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 3830. [D 20:42:23.339704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 3831. [D 20:42:23.339720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 3832. [D 20:42:23.339735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 3833. [D 20:42:23.339750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 3834. [D 20:42:23.339765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 3835. [D 20:42:23.339780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 3836. [D 20:42:23.339795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 3837. [D 20:42:23.339811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 3838. [D 20:42:23.339825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 3839. [D 20:42:23.339842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 3840. [D 20:42:23.339857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 3841. [D 20:42:23.339872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 3842. [D 20:42:23.339887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 3843. [D 20:42:23.339902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 3844. [D 20:42:23.339917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 3845. [D 20:42:23.339932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 3846. [D 20:42:23.339946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 3847. [D 20:42:23.339961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 3848. [D 20:42:23.339982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 3849. [D 20:42:23.339997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 3850. [D 20:42:23.340012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 3851. [D 20:42:23.340036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 3852. [D 20:42:23.340097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 3853. [D 20:42:23.340112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 3854. [D 20:42:23.340127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 3855. [D 20:42:23.340141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 3856. [D 20:42:23.340156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 3857. [D 20:42:23.340171] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 3858. [D 20:42:23.345527] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3858. [D 20:42:23.345547] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 51/70. [D 20:42:23.345659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.345711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.345724] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.395219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.395240] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.395253] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.395290] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2752 [D 20:42:23.395305] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:23.395324] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 52/70. [D 20:42:23.399359] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2752 [D 20:42:23.399388] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 53/70. [D 20:42:23.399528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 3858. [D 20:42:23.399546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 3859. [D 20:42:23.399562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 3860. [D 20:42:23.399576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 3861. [D 20:42:23.399591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 3862. [D 20:42:23.399606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 3863. [D 20:42:23.399621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 3864. [D 20:42:23.399657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 3865. [D 20:42:23.399671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 3866. [D 20:42:23.399686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 3867. [D 20:42:23.399701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 3868. [D 20:42:23.399715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 3869. [D 20:42:23.399740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 3870. [D 20:42:23.399755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 3871. [D 20:42:23.399770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 3872. [D 20:42:23.399784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 3873. [D 20:42:23.399803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 3874. [D 20:42:23.399821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 3875. [D 20:42:23.399835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 3876. [D 20:42:23.399850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 3877. [D 20:42:23.399865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 3878. [D 20:42:23.399879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 3879. [D 20:42:23.399894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 3880. [D 20:42:23.399909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 3881. [D 20:42:23.399924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 3882. [D 20:42:23.399998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 3883. [D 20:42:23.400021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 3884. [D 20:42:23.400038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 3885. [D 20:42:23.400052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 3886. [D 20:42:23.400067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 3887. [D 20:42:23.400093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 3888. [D 20:42:23.400108] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 3889. [D 20:42:23.410452] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3889. [D 20:42:23.410477] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 54/70. [D 20:42:23.410584] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.410636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.410650] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.415294] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.415315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.415328] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.415364] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2756 [D 20:42:23.415380] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:23.415399] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 55/70. [D 20:42:23.419127] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2756 [D 20:42:23.419158] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 56/70. [D 20:42:23.419210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3889. [D 20:42:23.419227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 3890. [D 20:42:23.419242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 3891. [D 20:42:23.419257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 3892. [D 20:42:23.419275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 3893. [D 20:42:23.419290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 3894. [D 20:42:23.419305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3895. [D 20:42:23.419320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3896. [D 20:42:23.419334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3897. [D 20:42:23.419349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 3898. [D 20:42:23.419364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 3899. [D 20:42:23.419378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 3900. [D 20:42:23.419393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 3901. [D 20:42:23.419408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 3902. [D 20:42:23.419422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3903. [D 20:42:23.419437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3904. [D 20:42:23.419452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3905. [D 20:42:23.419496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 3906. [D 20:42:23.419520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 3907. [D 20:42:23.419535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 3908. [D 20:42:23.419561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 3909. [D 20:42:23.419576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 3910. [D 20:42:23.419591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3911. [D 20:42:23.419605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3912. [D 20:42:23.419620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3913. [D 20:42:23.419635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 3914. [D 20:42:23.419649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 3915. [D 20:42:23.419664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 3916. [D 20:42:23.419678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 3917. [D 20:42:23.419693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 3918. [D 20:42:23.419707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3919. [D 20:42:23.419722] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3920. [D 20:42:23.425152] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3920. [D 20:42:23.425172] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 57/70. [D 20:42:23.425285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.425347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.425361] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.442577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.442598] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.442611] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.442650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2758 [D 20:42:23.442665] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:23.442685] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 58/70. [D 20:42:23.446439] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2758 [D 20:42:23.446469] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 59/70. [D 20:42:23.446519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3920. [D 20:42:23.446535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3921. [D 20:42:23.446551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 3922. [D 20:42:23.446565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 3923. [D 20:42:23.446587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 3924. [D 20:42:23.446601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 3925. [D 20:42:23.446616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 3926. [D 20:42:23.446631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3927. [D 20:42:23.446646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3928. [D 20:42:23.446661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3929. [D 20:42:23.446676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 3930. [D 20:42:23.446691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 3931. [D 20:42:23.446706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 3932. [D 20:42:23.446721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 3933. [D 20:42:23.446736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 3934. [D 20:42:23.446757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3935. [D 20:42:23.446810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3936. [D 20:42:23.446825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3937. [D 20:42:23.446840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 3938. [D 20:42:23.446854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 3939. [D 20:42:23.446869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 3940. [D 20:42:23.446884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 3941. [D 20:42:23.446898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 3942. [D 20:42:23.446924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3943. [D 20:42:23.446939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3944. [D 20:42:23.446955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3945. [D 20:42:23.446969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 3946. [D 20:42:23.446984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 3947. [D 20:42:23.446999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 3948. [D 20:42:23.447014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 3949. [D 20:42:23.447029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 3950. [D 20:42:23.447044] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3951. [D 20:42:23.452435] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3951. [D 20:42:23.452455] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 60/70. [D 20:42:23.452570] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.452630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.452644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.516312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.516332] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.516346] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.516385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2761 [D 20:42:23.516401] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:23.516420] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 0/70. [D 20:42:23.520190] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2761 [D 20:42:23.520229] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 1/70. [D 20:42:23.520282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3951. [D 20:42:23.520299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3952. [D 20:42:23.520317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 3953. [D 20:42:23.520332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 3954. [D 20:42:23.520346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 3955. [D 20:42:23.520375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 3956. [D 20:42:23.520390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 3957. [D 20:42:23.520405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3958. [D 20:42:23.520421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3959. [D 20:42:23.520448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3960. [D 20:42:23.520464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 3961. [D 20:42:23.520480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 3962. [D 20:42:23.520502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 3963. [D 20:42:23.520517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 3964. [D 20:42:23.520532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 3965. [D 20:42:23.520546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3966. [D 20:42:23.520561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3967. [D 20:42:23.520575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3968. [D 20:42:23.520590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 3969. [D 20:42:23.520604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 3970. [D 20:42:23.520619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 3971. [D 20:42:23.520644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 3972. [D 20:42:23.520659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 3973. [D 20:42:23.520673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3974. [D 20:42:23.520689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3975. [D 20:42:23.520703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3976. [D 20:42:23.520727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 3977. [D 20:42:23.520744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 3978. [D 20:42:23.520759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 3979. [D 20:42:23.520774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 3980. [D 20:42:23.520791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 3981. [D 20:42:23.520805] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3982. [D 20:42:23.526195] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 3982. [D 20:42:23.526214] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 2/70. [D 20:42:23.526329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.526388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.526402] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.570037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.570058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.570071] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.570111] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2765 [D 20:42:23.570126] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:23.570147] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 3/70. [D 20:42:23.573937] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2765 [D 20:42:23.573967] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 4/70. [D 20:42:23.574030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3982. [D 20:42:23.574048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 3983. [D 20:42:23.574062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 3984. [D 20:42:23.574077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 3985. [D 20:42:23.574092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 3986. [D 20:42:23.574107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 3987. [D 20:42:23.574121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3988. [D 20:42:23.574136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3989. [D 20:42:23.574151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3990. [D 20:42:23.574172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 3991. [D 20:42:23.574204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 3992. [D 20:42:23.574222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 3993. [D 20:42:23.574243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 3994. [D 20:42:23.574258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 3995. [D 20:42:23.574273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3996. [D 20:42:23.574287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3997. [D 20:42:23.574302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3998. [D 20:42:23.574316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 3999. [D 20:42:23.574331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 4000. [D 20:42:23.574345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 4001. [D 20:42:23.574371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 4002. [D 20:42:23.574386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 4003. [D 20:42:23.574401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4004. [D 20:42:23.574416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4005. [D 20:42:23.574435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4006. [D 20:42:23.574452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 4007. [D 20:42:23.574467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 4008. [D 20:42:23.574482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 4009. [D 20:42:23.574497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 4010. [D 20:42:23.574512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 4011. [D 20:42:23.574527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4012. [D 20:42:23.574543] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4013. [D 20:42:23.579971] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4013. [D 20:42:23.579994] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 5/70. [D 20:42:23.580111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.580170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.580184] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.732744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.732765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.732778] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.732818] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2768 [D 20:42:23.732833] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:23.732853] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 6/70. [D 20:42:23.736578] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2768 [D 20:42:23.736606] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 7/70. [D 20:42:23.736697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 4013. [D 20:42:23.736718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 4014. [D 20:42:23.736732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 4015. [D 20:42:23.736756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 4016. [D 20:42:23.736786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 4017. [D 20:42:23.736801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 4018. [D 20:42:23.736830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4019. [D 20:42:23.736845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4020. [D 20:42:23.736859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4021. [D 20:42:23.736884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 4022. [D 20:42:23.736900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 4023. [D 20:42:23.736914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 4024. [D 20:42:23.736929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 4025. [D 20:42:23.736946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 4026. [D 20:42:23.736963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4027. [D 20:42:23.736977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4028. [D 20:42:23.737115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4029. [D 20:42:23.737135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 4030. [D 20:42:23.737150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 4031. [D 20:42:23.737164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 4032. [D 20:42:23.737179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 4033. [D 20:42:23.737197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 4034. [D 20:42:23.737211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4035. [D 20:42:23.737226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4036. [D 20:42:23.737240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4037. [D 20:42:23.737255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 4038. [D 20:42:23.737324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 4039. [D 20:42:23.737359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 4040. [D 20:42:23.737376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 4041. [D 20:42:23.737460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 4042. [D 20:42:23.737590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4043. [D 20:42:23.737655] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4044. [D 20:42:23.742587] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4044. [D 20:42:23.742611] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 8/70. [D 20:42:23.742723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.742775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.742789] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.761109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.761130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.761143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.761180] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2770 [D 20:42:23.761195] element 0: offset: 0x2aaaab031060, size: 24 [D 20:42:23.761215] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 9/70. [D 20:42:23.764882] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2770 [D 20:42:23.764912] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 10/70. [D 20:42:23.768523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4044. [D 20:42:23.768544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4045. [D 20:42:23.768564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4046. [D 20:42:23.768579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4047. [D 20:42:23.768594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4048. [D 20:42:23.768611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4049. [D 20:42:23.768628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4050. [D 20:42:23.768643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4051. [D 20:42:23.768658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4052. [D 20:42:23.768673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4053. [D 20:42:23.768687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4054. [D 20:42:23.768702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4055. [D 20:42:23.768717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4056. [D 20:42:23.768733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4057. [D 20:42:23.768767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4058. [D 20:42:23.768787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4059. [D 20:42:23.768802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4060. [D 20:42:23.768816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4061. [D 20:42:23.768831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4062. [D 20:42:23.768846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4063. [D 20:42:23.768860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4064. [D 20:42:23.768875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4065. [D 20:42:23.768889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4066. [D 20:42:23.768904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4067. [D 20:42:23.768928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4068. [D 20:42:23.768944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4069. [D 20:42:23.768958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4070. [D 20:42:23.768978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4071. [D 20:42:23.768993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4072. [D 20:42:23.769008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4073. [D 20:42:23.769023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4074. [D 20:42:23.769038] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4075. [D 20:42:23.769115] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.769177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.769191] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:23.769234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2773 [D 20:42:23.769250] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:23.769270] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 11/70. [D 20:42:23.774414] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4075. [D 20:42:23.774441] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 12/70. [D 20:42:23.774588] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.774611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.774624] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:23.778437] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2773 [D 20:42:23.778461] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 13/70. [D 20:42:23.778518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4075. [D 20:42:23.778534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4076. [D 20:42:23.778549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4077. [D 20:42:23.778564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4078. [D 20:42:23.778578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4079. [D 20:42:23.778593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4080. [D 20:42:23.778608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4081. [D 20:42:23.778622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4082. [D 20:42:23.778657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4083. [D 20:42:23.778686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4084. [D 20:42:23.778702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4085. [D 20:42:23.778716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4086. [D 20:42:23.778743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4087. [D 20:42:23.778758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4088. [D 20:42:23.778773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4089. [D 20:42:23.778788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4090. [D 20:42:23.778803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4091. [D 20:42:23.778820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4092. [D 20:42:23.778837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4093. [D 20:42:23.778852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4094. [D 20:42:23.778877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4095. [D 20:42:23.778893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4096. [D 20:42:23.778907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4097. [D 20:42:23.778923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4098. [D 20:42:23.778970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4099. [D 20:42:23.778986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4100. [D 20:42:23.779009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4101. [D 20:42:23.779027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4102. [D 20:42:23.779044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4103. [D 20:42:23.779058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4104. [D 20:42:23.779074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4105. [D 20:42:23.779088] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4106. [D 20:42:23.784394] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4106. [D 20:42:23.784413] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 14/70. [D 20:42:23.784527] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.784584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.784598] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.825878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.825899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.825912] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.825952] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2776 [D 20:42:23.825968] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:23.825987] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 15/70. [D 20:42:23.830201] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2776 [D 20:42:23.830230] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 16/70. [D 20:42:23.830367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4106. [D 20:42:23.830388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4107. [D 20:42:23.830407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4108. [D 20:42:23.830421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4109. [D 20:42:23.830436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4110. [D 20:42:23.830457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4111. [D 20:42:23.830472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4112. [D 20:42:23.830486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4113. [D 20:42:23.830501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4114. [D 20:42:23.830516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4115. [D 20:42:23.830531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4116. [D 20:42:23.830545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4117. [D 20:42:23.830560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4118. [D 20:42:23.830575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4119. [D 20:42:23.830609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4120. [D 20:42:23.830624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4121. [D 20:42:23.830644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4122. [D 20:42:23.830658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4123. [D 20:42:23.830684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4124. [D 20:42:23.830699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4125. [D 20:42:23.830714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4126. [D 20:42:23.830729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4127. [D 20:42:23.830743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4128. [D 20:42:23.830758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4129. [D 20:42:23.830772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4130. [D 20:42:23.830787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4131. [D 20:42:23.830802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4132. [D 20:42:23.830833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4133. [D 20:42:23.830849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4134. [D 20:42:23.830864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4135. [D 20:42:23.830879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4136. [D 20:42:23.830894] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4137. [D 20:42:23.841353] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4137. [D 20:42:23.841378] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 17/70. [D 20:42:23.841488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.841540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.841554] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:23.846552] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:23.846573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.846587] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:23.846624] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2780 [D 20:42:23.846639] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:23.846661] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 18/70. [D 20:42:23.850355] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2780 [D 20:42:23.850393] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 19/70. [D 20:42:23.850445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 4137. [D 20:42:23.850462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 4138. [D 20:42:23.850477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 4139. [D 20:42:23.850491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 4140. [D 20:42:23.850517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 4141. [D 20:42:23.850532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 4142. [D 20:42:23.850547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4143. [D 20:42:23.850561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4144. [D 20:42:23.850580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4145. [D 20:42:23.850595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 4146. [D 20:42:23.850614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 4147. [D 20:42:23.850631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 4148. [D 20:42:23.850645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 4149. [D 20:42:23.850660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 4150. [D 20:42:23.850753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4151. [D 20:42:23.850772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4152. [D 20:42:23.850787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4153. [D 20:42:23.850801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 4154. [D 20:42:23.850816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 4155. [D 20:42:23.850834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 4156. [D 20:42:23.850849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 4157. [D 20:42:23.850863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 4158. [D 20:42:23.850878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4159. [D 20:42:23.850893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4160. [D 20:42:23.850969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4161. [D 20:42:23.851003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 4162. [D 20:42:23.851022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 4163. [D 20:42:23.851098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 4164. [D 20:42:23.851260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 4165. [D 20:42:23.851332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 4166. [D 20:42:23.851347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4167. [D 20:42:23.851362] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4168. [D 20:42:23.856381] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4168. [D 20:42:23.856405] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 20/70. [D 20:42:23.856500] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:23.856552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:23.856566] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.145034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.145054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.145067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.145105] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2783 [D 20:42:24.145120] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:24.145139] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 21/70. [D 20:42:24.148492] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2783 [D 20:42:24.148556] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 22/70. [D 20:42:24.148643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 4168. [D 20:42:24.148670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 4169. [D 20:42:24.148685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 4170. [D 20:42:24.148700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 4171. [D 20:42:24.148719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 4172. [D 20:42:24.148734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 4173. [D 20:42:24.148749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4174. [D 20:42:24.148795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4175. [D 20:42:24.148814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4176. [D 20:42:24.148833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 4177. [D 20:42:24.148852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 4178. [D 20:42:24.148881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 4179. [D 20:42:24.148899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 4180. [D 20:42:24.148918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 4181. [D 20:42:24.148936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4182. [D 20:42:24.148954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4183. [D 20:42:24.148973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4184. [D 20:42:24.149002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 4185. [D 20:42:24.149020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 4186. [D 20:42:24.149038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 4187. [D 20:42:24.149057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 4188. [D 20:42:24.149075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 4189. [D 20:42:24.149091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4190. [D 20:42:24.149106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4191. [D 20:42:24.149127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4192. [D 20:42:24.149146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 4193. [D 20:42:24.149164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 4194. [D 20:42:24.149183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 4195. [D 20:42:24.149202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 4196. [D 20:42:24.149220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 4197. [D 20:42:24.149236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4198. [D 20:42:24.149251] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4199. [D 20:42:24.154619] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4199. [D 20:42:24.154643] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 23/70. [D 20:42:24.154731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.154755] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.154768] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.208708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.208729] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.208741] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.208778] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2785 [D 20:42:24.208793] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:42:24.208809] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 24/70. [D 20:42:24.212677] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2785 [D 20:42:24.212741] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 25/70. [D 20:42:24.212796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4199. [D 20:42:24.212824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4200. [D 20:42:24.212839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4201. [D 20:42:24.212854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4202. [D 20:42:24.212868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4203. [D 20:42:24.212884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4204. [D 20:42:24.212909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4205. [D 20:42:24.212925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4206. [D 20:42:24.212941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4207. [D 20:42:24.212956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4208. [D 20:42:24.212970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4209. [D 20:42:24.212992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4210. [D 20:42:24.213026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4211. [D 20:42:24.213041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4212. [D 20:42:24.213062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4213. [D 20:42:24.213077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4214. [D 20:42:24.213092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4215. [D 20:42:24.213106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4216. [D 20:42:24.213131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4217. [D 20:42:24.213146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4218. [D 20:42:24.213161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4219. [D 20:42:24.213175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4220. [D 20:42:24.213190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4221. [D 20:42:24.213205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4222. [D 20:42:24.213225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4223. [D 20:42:24.213242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4224. [D 20:42:24.213256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4225. [D 20:42:24.213271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4226. [D 20:42:24.213287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4227. [D 20:42:24.213302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4228. [D 20:42:24.213317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4229. [D 20:42:24.213332] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4230. [D 20:42:24.218729] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4230. [D 20:42:24.218749] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 26/70. [D 20:42:24.219553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.219574] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.219592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.263700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.263725] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.263739] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.263779] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2788 [D 20:42:24.263794] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:24.263812] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 27/70. [D 20:42:24.267609] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2788 [D 20:42:24.267686] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 28/70. [D 20:42:24.267744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4230. [D 20:42:24.267769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4231. [D 20:42:24.267784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4232. [D 20:42:24.267800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4233. [D 20:42:24.267815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4234. [D 20:42:24.267829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4235. [D 20:42:24.267844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4236. [D 20:42:24.267866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4237. [D 20:42:24.267883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4238. [D 20:42:24.267910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4239. [D 20:42:24.267927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4240. [D 20:42:24.267943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4241. [D 20:42:24.267957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4242. [D 20:42:24.267973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4243. [D 20:42:24.268012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4244. [D 20:42:24.268027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4245. [D 20:42:24.268051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4246. [D 20:42:24.268066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4247. [D 20:42:24.268081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4248. [D 20:42:24.268096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4249. [D 20:42:24.268111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4250. [D 20:42:24.268126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4251. [D 20:42:24.268140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4252. [D 20:42:24.268155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4253. [D 20:42:24.268169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4254. [D 20:42:24.268184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4255. [D 20:42:24.268199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4256. [D 20:42:24.268224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4257. [D 20:42:24.268238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4258. [D 20:42:24.268253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4259. [D 20:42:24.268268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4260. [D 20:42:24.268286] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4261. [D 20:42:24.273682] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4261. [D 20:42:24.273703] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 29/70. [D 20:42:24.273808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.273833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.273847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.347761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.347782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.347794] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.347832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2791 [D 20:42:24.347848] element 0: offset: 0x2aaaab028250, size: 24 [D 20:42:24.347864] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 30/70. [D 20:42:24.351565] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2791 [D 20:42:24.351598] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 31/70. [D 20:42:24.351652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4261. [D 20:42:24.351670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4262. [D 20:42:24.351684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4263. [D 20:42:24.351711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4264. [D 20:42:24.351726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4265. [D 20:42:24.351741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4266. [D 20:42:24.351773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4267. [D 20:42:24.351788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4268. [D 20:42:24.351806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4269. [D 20:42:24.351823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4270. [D 20:42:24.351838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4271. [D 20:42:24.351853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4272. [D 20:42:24.351868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4273. [D 20:42:24.351883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4274. [D 20:42:24.351898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4275. [D 20:42:24.351913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4276. [D 20:42:24.351948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4277. [D 20:42:24.351981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4278. [D 20:42:24.351997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4279. [D 20:42:24.352022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4280. [D 20:42:24.352037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4281. [D 20:42:24.352052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4282. [D 20:42:24.352067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4283. [D 20:42:24.352082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4284. [D 20:42:24.352097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4285. [D 20:42:24.352121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4286. [D 20:42:24.352136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4287. [D 20:42:24.352150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4288. [D 20:42:24.352165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4289. [D 20:42:24.352179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4290. [D 20:42:24.352194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4291. [D 20:42:24.352208] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4292. [D 20:42:24.357576] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4292. [D 20:42:24.357596] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 32/70. [D 20:42:24.357712] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.357764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.357777] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.432388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.432410] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.432423] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.432460] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2795 [D 20:42:24.432475] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:24.432494] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 33/70. [D 20:42:24.436328] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2795 [D 20:42:24.436361] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 34/70. [D 20:42:24.436415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 4292. [D 20:42:24.436432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 4293. [D 20:42:24.436449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 4294. [D 20:42:24.436466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 4295. [D 20:42:24.436481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 4296. [D 20:42:24.436495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 4297. [D 20:42:24.436510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4298. [D 20:42:24.436525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4299. [D 20:42:24.436540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4300. [D 20:42:24.436579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 4301. [D 20:42:24.436594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 4302. [D 20:42:24.436623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 4303. [D 20:42:24.436639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 4304. [D 20:42:24.436654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 4305. [D 20:42:24.436669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4306. [D 20:42:24.436684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4307. [D 20:42:24.436699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4308. [D 20:42:24.436714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 4309. [D 20:42:24.436729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 4310. [D 20:42:24.436744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 4311. [D 20:42:24.436762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 4312. [D 20:42:24.436778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 4313. [D 20:42:24.436794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4314. [D 20:42:24.436808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4315. [D 20:42:24.436823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4316. [D 20:42:24.436838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 4317. [D 20:42:24.436853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 4318. [D 20:42:24.436869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 4319. [D 20:42:24.436918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 4320. [D 20:42:24.436939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 4321. [D 20:42:24.436956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4322. [D 20:42:24.436975] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4323. [D 20:42:24.442348] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4323. [D 20:42:24.442368] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 35/70. [D 20:42:24.442481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.442537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.442551] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.480793] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.480814] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.480827] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.480866] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2797 [D 20:42:24.480881] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:24.480903] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 36/70. [D 20:42:24.484685] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2797 [D 20:42:24.484718] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 37/70. [D 20:42:24.484769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4323. [D 20:42:24.484786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4324. [D 20:42:24.484801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4325. [D 20:42:24.484821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4326. [D 20:42:24.484838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4327. [D 20:42:24.484852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4328. [D 20:42:24.484867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4329. [D 20:42:24.484882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4330. [D 20:42:24.484896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4331. [D 20:42:24.484911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4332. [D 20:42:24.484952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4333. [D 20:42:24.484968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4334. [D 20:42:24.484991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4335. [D 20:42:24.485006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4336. [D 20:42:24.485021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4337. [D 20:42:24.485036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4338. [D 20:42:24.485050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4339. [D 20:42:24.485065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4340. [D 20:42:24.485080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4341. [D 20:42:24.485096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4342. [D 20:42:24.485110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4343. [D 20:42:24.485125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4344. [D 20:42:24.485152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4345. [D 20:42:24.485167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4346. [D 20:42:24.485181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4347. [D 20:42:24.485196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4348. [D 20:42:24.485214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4349. [D 20:42:24.485231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4350. [D 20:42:24.485246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4351. [D 20:42:24.485260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4352. [D 20:42:24.485277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4353. [D 20:42:24.485291] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4354. [D 20:42:24.490717] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4354. [D 20:42:24.490737] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 38/70. [D 20:42:24.490852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.490911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.490925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.544929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.544950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.544963] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.545004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2800 [D 20:42:24.545019] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:24.545039] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 39/70. [D 20:42:24.548806] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2800 [D 20:42:24.548838] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 40/70. [D 20:42:24.548897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4354. [D 20:42:24.548914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4355. [D 20:42:24.548929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4356. [D 20:42:24.548958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4357. [D 20:42:24.548974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4358. [D 20:42:24.548989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4359. [D 20:42:24.549004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4360. [D 20:42:24.549019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4361. [D 20:42:24.549034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4362. [D 20:42:24.549074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4363. [D 20:42:24.549090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4364. [D 20:42:24.549111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4365. [D 20:42:24.549126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4366. [D 20:42:24.549140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4367. [D 20:42:24.549155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4368. [D 20:42:24.549170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4369. [D 20:42:24.549185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4370. [D 20:42:24.549221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4371. [D 20:42:24.549236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4372. [D 20:42:24.549255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4373. [D 20:42:24.549273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4374. [D 20:42:24.549288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4375. [D 20:42:24.549303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4376. [D 20:42:24.549319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4377. [D 20:42:24.549334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4378. [D 20:42:24.549349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4379. [D 20:42:24.549403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4380. [D 20:42:24.549418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4381. [D 20:42:24.549445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4382. [D 20:42:24.549463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4383. [D 20:42:24.549479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4384. [D 20:42:24.549494] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4385. [D 20:42:24.554848] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4385. [D 20:42:24.554868] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 41/70. [D 20:42:24.557928] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.557948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.557966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.607577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.607599] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.607616] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.607657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2803 [D 20:42:24.607676] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:24.607692] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 42/70. [D 20:42:24.611259] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2803 [D 20:42:24.611284] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 43/70. [D 20:42:24.611334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4385. [D 20:42:24.611353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4386. [D 20:42:24.611368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4387. [D 20:42:24.611382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4388. [D 20:42:24.611397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4389. [D 20:42:24.611412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4390. [D 20:42:24.611427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4391. [D 20:42:24.611442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4392. [D 20:42:24.611457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4393. [D 20:42:24.611472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4394. [D 20:42:24.611487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4395. [D 20:42:24.611501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4396. [D 20:42:24.611517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4397. [D 20:42:24.611535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4398. [D 20:42:24.611550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4399. [D 20:42:24.611565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4400. [D 20:42:24.611580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4401. [D 20:42:24.611600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4402. [D 20:42:24.611615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4403. [D 20:42:24.611631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4404. [D 20:42:24.611674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4405. [D 20:42:24.611693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4406. [D 20:42:24.611708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4407. [D 20:42:24.611722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4408. [D 20:42:24.611737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4409. [D 20:42:24.611752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4410. [D 20:42:24.611766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4411. [D 20:42:24.611791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4412. [D 20:42:24.611807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4413. [D 20:42:24.611821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4414. [D 20:42:24.611836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4415. [D 20:42:24.611850] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4416. [D 20:42:24.617268] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4416. [D 20:42:24.617288] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 44/70. [D 20:42:24.620326] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.620345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.620363] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.666807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.666828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.666846] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.666869] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2806 [D 20:42:24.666886] element 0: offset: 0x2aaaab005860, size: 24 [D 20:42:24.666904] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 45/70. [D 20:42:24.670531] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2806 [D 20:42:24.670556] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 46/70. [D 20:42:24.670609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4416. [D 20:42:24.670626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4417. [D 20:42:24.670641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4418. [D 20:42:24.670655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4419. [D 20:42:24.670670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4420. [D 20:42:24.670685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4421. [D 20:42:24.670700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4422. [D 20:42:24.670715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4423. [D 20:42:24.670729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4424. [D 20:42:24.670744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4425. [D 20:42:24.670759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4426. [D 20:42:24.670774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4427. [D 20:42:24.670788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4428. [D 20:42:24.670803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4429. [D 20:42:24.670818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4430. [D 20:42:24.670832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4431. [D 20:42:24.670847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4432. [D 20:42:24.670862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4433. [D 20:42:24.670877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4434. [D 20:42:24.670924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4435. [D 20:42:24.670945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4436. [D 20:42:24.670960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4437. [D 20:42:24.670974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4438. [D 20:42:24.670989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4439. [D 20:42:24.671014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4440. [D 20:42:24.671029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4441. [D 20:42:24.671043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4442. [D 20:42:24.671058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4443. [D 20:42:24.671073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4444. [D 20:42:24.671087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4445. [D 20:42:24.671102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4446. [D 20:42:24.671116] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4447. [D 20:42:24.676560] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4447. [D 20:42:24.676580] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 47/70. [D 20:42:24.679545] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.679564] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.679578] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.746796] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.746818] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.746835] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.746859] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2810 [D 20:42:24.746877] element 0: offset: 0x2aaaab028250, size: 24 [D 20:42:24.746895] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 48/70. [D 20:42:24.750660] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2810 [D 20:42:24.750684] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 49/70. [D 20:42:24.750743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 4447. [D 20:42:24.750760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 4448. [D 20:42:24.750775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 4449. [D 20:42:24.750789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 4450. [D 20:42:24.750805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 4451. [D 20:42:24.750833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 4452. [D 20:42:24.750848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4453. [D 20:42:24.750864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4454. [D 20:42:24.750879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4455. [D 20:42:24.750894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 4456. [D 20:42:24.750936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 4457. [D 20:42:24.750965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 4458. [D 20:42:24.750981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 4459. [D 20:42:24.750996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 4460. [D 20:42:24.751010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4461. [D 20:42:24.751025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4462. [D 20:42:24.751039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4463. [D 20:42:24.751054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 4464. [D 20:42:24.751069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 4465. [D 20:42:24.751083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 4466. [D 20:42:24.751108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 4467. [D 20:42:24.751123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 4468. [D 20:42:24.751138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4469. [D 20:42:24.751154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4470. [D 20:42:24.751169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4471. [D 20:42:24.751184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 4472. [D 20:42:24.751199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 4473. [D 20:42:24.751214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 4474. [D 20:42:24.751229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 4475. [D 20:42:24.751283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 4476. [D 20:42:24.751298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4477. [D 20:42:24.751321] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4478. [D 20:42:24.756678] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4478. [D 20:42:24.756698] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 50/70. [D 20:42:24.759774] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.759793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.759811] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.823557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.823580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.823594] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.823618] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2812 [D 20:42:24.823633] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:24.823649] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 51/70. [D 20:42:24.829976] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2812 [D 20:42:24.829999] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 52/70. [D 20:42:24.830051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4478. [D 20:42:24.830068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4479. [D 20:42:24.830083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4480. [D 20:42:24.830098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4481. [D 20:42:24.830113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4482. [D 20:42:24.830128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4483. [D 20:42:24.830143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4484. [D 20:42:24.830162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4485. [D 20:42:24.830177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4486. [D 20:42:24.830194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4487. [D 20:42:24.830209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4488. [D 20:42:24.830223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4489. [D 20:42:24.830238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4490. [D 20:42:24.830253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4491. [D 20:42:24.830268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4492. [D 20:42:24.830282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4493. [D 20:42:24.830297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4494. [D 20:42:24.830312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4495. [D 20:42:24.830327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4496. [D 20:42:24.830342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4497. [D 20:42:24.830357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4498. [D 20:42:24.830402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4499. [D 20:42:24.830423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4500. [D 20:42:24.830438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4501. [D 20:42:24.830453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4502. [D 20:42:24.830467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4503. [D 20:42:24.830482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4504. [D 20:42:24.830497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4505. [D 20:42:24.830511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4506. [D 20:42:24.830526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4507. [D 20:42:24.830541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4508. [D 20:42:24.830555] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4509. [D 20:42:24.835999] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4509. [D 20:42:24.836018] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 53/70. [D 20:42:24.839058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.839078] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.839093] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.895704] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.895766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.895781] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.895825] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2815 [D 20:42:24.895840] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:24.895861] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 54/70. [D 20:42:24.899556] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2815 [D 20:42:24.899588] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 55/70. [D 20:42:24.899638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4509. [D 20:42:24.899666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4510. [D 20:42:24.899681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4511. [D 20:42:24.899701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4512. [D 20:42:24.899718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4513. [D 20:42:24.899732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4514. [D 20:42:24.899747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4515. [D 20:42:24.899762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4516. [D 20:42:24.899777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4517. [D 20:42:24.899792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4518. [D 20:42:24.899832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4519. [D 20:42:24.899847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4520. [D 20:42:24.899882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4521. [D 20:42:24.899897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4522. [D 20:42:24.899912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4523. [D 20:42:24.899927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4524. [D 20:42:24.899942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4525. [D 20:42:24.899956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4526. [D 20:42:24.899971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4527. [D 20:42:24.899986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4528. [D 20:42:24.900000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4529. [D 20:42:24.900015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4530. [D 20:42:24.900030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4531. [D 20:42:24.900044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4532. [D 20:42:24.900059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4533. [D 20:42:24.900074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4534. [D 20:42:24.900096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4535. [D 20:42:24.900111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4536. [D 20:42:24.900126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4537. [D 20:42:24.900141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4538. [D 20:42:24.900156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4539. [D 20:42:24.900171] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4540. [D 20:42:24.905592] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4540. [D 20:42:24.905611] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 56/70. [D 20:42:24.905728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.905787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.905801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:24.980111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:24.980131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.980145] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:24.980185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2818 [D 20:42:24.980200] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:24.980221] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 57/70. [D 20:42:24.984070] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2818 [D 20:42:24.984098] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 58/70. [D 20:42:24.984256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4540. [D 20:42:24.984280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4541. [D 20:42:24.984296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4542. [D 20:42:24.984311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4543. [D 20:42:24.984331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4544. [D 20:42:24.984347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4545. [D 20:42:24.984367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4546. [D 20:42:24.984386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4547. [D 20:42:24.984410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4548. [D 20:42:24.984429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4549. [D 20:42:24.984447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4550. [D 20:42:24.984465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4551. [D 20:42:24.984483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4552. [D 20:42:24.984502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4553. [D 20:42:24.984520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4554. [D 20:42:24.984539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4555. [D 20:42:24.984557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4556. [D 20:42:24.984575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4557. [D 20:42:24.984594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4558. [D 20:42:24.984612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4559. [D 20:42:24.984641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4560. [D 20:42:24.984660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4561. [D 20:42:24.984688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4562. [D 20:42:24.984704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4563. [D 20:42:24.984725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4564. [D 20:42:24.984744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4565. [D 20:42:24.984763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4566. [D 20:42:24.984781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4567. [D 20:42:24.984799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4568. [D 20:42:24.984818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4569. [D 20:42:24.984837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4570. [D 20:42:24.984852] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4571. [D 20:42:24.990191] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4571. [D 20:42:24.990215] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 59/70. [D 20:42:24.990316] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:24.990377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:24.990391] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.029889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.029910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.029923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.029964] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2821 [D 20:42:25.029979] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:25.029999] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 60/70. [D 20:42:25.033861] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2821 [D 20:42:25.033893] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 0/70. [D 20:42:25.033948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4571. [D 20:42:25.033979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4572. [D 20:42:25.033997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4573. [D 20:42:25.034012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4574. [D 20:42:25.034027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4575. [D 20:42:25.034042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4576. [D 20:42:25.034058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4577. [D 20:42:25.034073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4578. [D 20:42:25.034088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4579. [D 20:42:25.034104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4580. [D 20:42:25.034133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4581. [D 20:42:25.034167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4582. [D 20:42:25.034182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4583. [D 20:42:25.034197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4584. [D 20:42:25.034211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4585. [D 20:42:25.034226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4586. [D 20:42:25.034240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4587. [D 20:42:25.034255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4588. [D 20:42:25.034269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4589. [D 20:42:25.034284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4590. [D 20:42:25.034299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4591. [D 20:42:25.034313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4592. [D 20:42:25.034328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4593. [D 20:42:25.034342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4594. [D 20:42:25.034366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4595. [D 20:42:25.034383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4596. [D 20:42:25.034397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4597. [D 20:42:25.034412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4598. [D 20:42:25.034428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4599. [D 20:42:25.034442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4600. [D 20:42:25.034457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4601. [D 20:42:25.034472] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4602. [D 20:42:25.039886] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4602. [D 20:42:25.039906] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 1/70. [D 20:42:25.040021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.040081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.040095] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.104360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.104381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.104394] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.104434] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2824 [D 20:42:25.104449] element 0: offset: 0x2aaaab019bb0, size: 24 [D 20:42:25.104469] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 2/70. [D 20:42:25.108222] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2824 [D 20:42:25.108252] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 3/70. [D 20:42:25.108312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4602. [D 20:42:25.108333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4603. [D 20:42:25.108352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4604. [D 20:42:25.108379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4605. [D 20:42:25.108395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4606. [D 20:42:25.108409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4607. [D 20:42:25.108424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4608. [D 20:42:25.108439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4609. [D 20:42:25.108454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4610. [D 20:42:25.108499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4611. [D 20:42:25.108519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4612. [D 20:42:25.108534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4613. [D 20:42:25.108549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4614. [D 20:42:25.108564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4615. [D 20:42:25.108579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4616. [D 20:42:25.108594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4617. [D 20:42:25.108609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4618. [D 20:42:25.108624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4619. [D 20:42:25.108649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4620. [D 20:42:25.108664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4621. [D 20:42:25.108678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4622. [D 20:42:25.108693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4623. [D 20:42:25.108715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4624. [D 20:42:25.108730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4625. [D 20:42:25.108745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4626. [D 20:42:25.108759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4627. [D 20:42:25.108774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4628. [D 20:42:25.108789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4629. [D 20:42:25.108804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4630. [D 20:42:25.108819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4631. [D 20:42:25.108876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4632. [D 20:42:25.108902] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4633. [D 20:42:25.114244] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4633. [D 20:42:25.114264] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 4/70. [D 20:42:25.114381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.114439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.114453] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.223141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.223162] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.223175] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.223215] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2827 [D 20:42:25.223230] element 0: offset: 0x2aaaab005860, size: 24 [D 20:42:25.223250] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 5/70. [D 20:42:25.227046] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2827 [D 20:42:25.227076] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 6/70. [D 20:42:25.227139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 4633. [D 20:42:25.227156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 4634. [D 20:42:25.227171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 4635. [D 20:42:25.227200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 4636. [D 20:42:25.227216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 4637. [D 20:42:25.227231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 4638. [D 20:42:25.227246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 4639. [D 20:42:25.227261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4640. [D 20:42:25.227276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4641. [D 20:42:25.227317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4642. [D 20:42:25.227332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 4643. [D 20:42:25.227352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 4644. [D 20:42:25.227367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 4645. [D 20:42:25.227381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 4646. [D 20:42:25.227407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 4647. [D 20:42:25.227422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4648. [D 20:42:25.227436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4649. [D 20:42:25.227451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4650. [D 20:42:25.227476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 4651. [D 20:42:25.227498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 4652. [D 20:42:25.227513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 4653. [D 20:42:25.227528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 4654. [D 20:42:25.227545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 4655. [D 20:42:25.227560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4656. [D 20:42:25.227575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4657. [D 20:42:25.227590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4658. [D 20:42:25.227605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 4659. [D 20:42:25.227619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 4660. [D 20:42:25.227634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 4661. [D 20:42:25.227649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 4662. [D 20:42:25.227664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 4663. [D 20:42:25.227728] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4664. [D 20:42:25.233025] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4664. [D 20:42:25.233044] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 7/70. [D 20:42:25.233156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.233216] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.233229] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.281676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.281697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.281710] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.281749] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2831 [D 20:42:25.281765] element 0: offset: 0x2aaaab028250, size: 24 [D 20:42:25.281784] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 8/70. [D 20:42:25.285523] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2831 [D 20:42:25.285557] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 9/70. [D 20:42:25.287617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4664. [D 20:42:25.287640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4665. [D 20:42:25.287663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4666. [D 20:42:25.287682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4667. [D 20:42:25.287701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4668. [D 20:42:25.287719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4669. [D 20:42:25.287738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4670. [D 20:42:25.287756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4671. [D 20:42:25.287775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4672. [D 20:42:25.287793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4673. [D 20:42:25.287812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4674. [D 20:42:25.287831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4675. [D 20:42:25.287849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4676. [D 20:42:25.287868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4677. [D 20:42:25.287884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4678. [D 20:42:25.287899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4679. [D 20:42:25.287918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4680. [D 20:42:25.287936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4681. [D 20:42:25.287955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4682. [D 20:42:25.287973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4683. [D 20:42:25.287991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4684. [D 20:42:25.288010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4685. [D 20:42:25.288028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4686. [D 20:42:25.288047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4687. [D 20:42:25.288065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4688. [D 20:42:25.288084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4689. [D 20:42:25.288103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4690. [D 20:42:25.288122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4691. [D 20:42:25.288140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4692. [D 20:42:25.288158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4693. [D 20:42:25.288177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4694. [D 20:42:25.288193] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4695. [D 20:42:25.288263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.288327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.288342] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:25.288387] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2833 [D 20:42:25.288403] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:25.288432] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:42:25.293508] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4695. [D 20:42:25.293535] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 11/70. [D 20:42:25.293684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.293706] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.293719] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:25.297812] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2833 [D 20:42:25.297842] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 12/70. [D 20:42:25.297898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4695. [D 20:42:25.297915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4696. [D 20:42:25.297930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4697. [D 20:42:25.297944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4698. [D 20:42:25.297959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4699. [D 20:42:25.297976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4700. [D 20:42:25.297991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4701. [D 20:42:25.298006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4702. [D 20:42:25.298020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4703. [D 20:42:25.298035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4704. [D 20:42:25.298053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4705. [D 20:42:25.298069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4706. [D 20:42:25.298117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4707. [D 20:42:25.298132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4708. [D 20:42:25.298147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4709. [D 20:42:25.298162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4710. [D 20:42:25.298177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4711. [D 20:42:25.298192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4712. [D 20:42:25.298207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4713. [D 20:42:25.298222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4714. [D 20:42:25.298237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4715. [D 20:42:25.298252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4716. [D 20:42:25.298267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4717. [D 20:42:25.298282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4718. [D 20:42:25.298297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4719. [D 20:42:25.298316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4720. [D 20:42:25.298333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4721. [D 20:42:25.298348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4722. [D 20:42:25.298363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4723. [D 20:42:25.298377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4724. [D 20:42:25.298393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4725. [D 20:42:25.298408] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4726. [D 20:42:25.303821] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4726. [D 20:42:25.303841] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 13/70. [D 20:42:25.303955] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.304013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.304027] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.354743] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.354764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.354778] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.354818] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2836 [D 20:42:25.354833] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:25.354853] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 14/70. [D 20:42:25.358635] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2836 [D 20:42:25.358666] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 15/70. [D 20:42:25.358727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4726. [D 20:42:25.358755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4727. [D 20:42:25.358771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 4728. [D 20:42:25.358787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 4729. [D 20:42:25.358802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 4730. [D 20:42:25.358817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 4731. [D 20:42:25.358833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 4732. [D 20:42:25.358847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4733. [D 20:42:25.358870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4734. [D 20:42:25.358899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4735. [D 20:42:25.358917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 4736. [D 20:42:25.358947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 4737. [D 20:42:25.358962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 4738. [D 20:42:25.358977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 4739. [D 20:42:25.358991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 4740. [D 20:42:25.359006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4741. [D 20:42:25.359021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4742. [D 20:42:25.359035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4743. [D 20:42:25.359050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4744. [D 20:42:25.359064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4745. [D 20:42:25.359079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4746. [D 20:42:25.359094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4747. [D 20:42:25.359122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4748. [D 20:42:25.359137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4749. [D 20:42:25.359152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4750. [D 20:42:25.359167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4751. [D 20:42:25.359182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4752. [D 20:42:25.359197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4753. [D 20:42:25.359219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4754. [D 20:42:25.359276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4755. [D 20:42:25.359297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4756. [D 20:42:25.359315] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4757. [D 20:42:25.364657] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4757. [D 20:42:25.364681] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 16/70. [D 20:42:25.364798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.364858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.364872] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.485717] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.485738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.485752] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.485792] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2839 [D 20:42:25.485807] element 0: offset: 0x2aaaab005860, size: 24 [D 20:42:25.485827] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 17/70. [D 20:42:25.489524] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2839 [D 20:42:25.489557] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 18/70. [D 20:42:25.489642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4757. [D 20:42:25.489663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4758. [D 20:42:25.489678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4759. [D 20:42:25.489702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4760. [D 20:42:25.489733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4761. [D 20:42:25.489749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4762. [D 20:42:25.489777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4763. [D 20:42:25.489792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4764. [D 20:42:25.489806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4765. [D 20:42:25.489825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4766. [D 20:42:25.489839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4767. [D 20:42:25.489854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4768. [D 20:42:25.489868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4769. [D 20:42:25.489887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4770. [D 20:42:25.489902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4771. [D 20:42:25.489917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4772. [D 20:42:25.489932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4773. [D 20:42:25.489947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4774. [D 20:42:25.489978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4775. [D 20:42:25.489994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4776. [D 20:42:25.490018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4777. [D 20:42:25.490033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4778. [D 20:42:25.490060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4779. [D 20:42:25.490075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4780. [D 20:42:25.490090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4781. [D 20:42:25.490105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4782. [D 20:42:25.490120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4783. [D 20:42:25.490153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4784. [D 20:42:25.490171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4785. [D 20:42:25.490189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4786. [D 20:42:25.490212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4787. [D 20:42:25.490230] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4788. [D 20:42:25.495535] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4788. [D 20:42:25.495559] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 19/70. [D 20:42:25.495670] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.495722] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.495736] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.532015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.532036] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.532049] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.532088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2842 [D 20:42:25.532103] element 0: offset: 0x2aaaab014a80, size: 24 [D 20:42:25.532122] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 20/70. [D 20:42:25.535580] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2842 [D 20:42:25.535604] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 21/70. [D 20:42:25.535661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 4788. [D 20:42:25.535678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 4789. [D 20:42:25.535693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 4790. [D 20:42:25.535708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 4791. [D 20:42:25.535723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 4792. [D 20:42:25.535737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 4793. [D 20:42:25.535752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 4794. [D 20:42:25.535767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4795. [D 20:42:25.535782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4796. [D 20:42:25.535797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4797. [D 20:42:25.535811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 4798. [D 20:42:25.535826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 4799. [D 20:42:25.535841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 4800. [D 20:42:25.535855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 4801. [D 20:42:25.535873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 4802. [D 20:42:25.535890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4803. [D 20:42:25.535905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4804. [D 20:42:25.535919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4805. [D 20:42:25.535940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 4806. [D 20:42:25.535955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 4807. [D 20:42:25.535970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 4808. [D 20:42:25.535986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 4809. [D 20:42:25.536001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 4810. [D 20:42:25.536047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4811. [D 20:42:25.536062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4812. [D 20:42:25.536077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4813. [D 20:42:25.536091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 4814. [D 20:42:25.536106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 4815. [D 20:42:25.536121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 4816. [D 20:42:25.536135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 4817. [D 20:42:25.536150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 4818. [D 20:42:25.536164] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4819. [D 20:42:25.541595] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4819. [D 20:42:25.541615] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 22/70. [D 20:42:25.541730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.541783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.541797] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.574156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.574177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.574190] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.574227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2846 [D 20:42:25.574242] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:25.574261] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 23/70. [D 20:42:25.578118] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2846 [D 20:42:25.578166] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 24/70. [D 20:42:25.578221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4819. [D 20:42:25.578237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 4820. [D 20:42:25.578252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 4821. [D 20:42:25.578269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 4822. [D 20:42:25.578293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 4823. [D 20:42:25.578309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 4824. [D 20:42:25.578328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4825. [D 20:42:25.578362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4826. [D 20:42:25.578381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4827. [D 20:42:25.578396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 4828. [D 20:42:25.578423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 4829. [D 20:42:25.578438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 4830. [D 20:42:25.578463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 4831. [D 20:42:25.578478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 4832. [D 20:42:25.578493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4833. [D 20:42:25.578508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4834. [D 20:42:25.578525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4835. [D 20:42:25.578540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4836. [D 20:42:25.578555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4837. [D 20:42:25.578570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4838. [D 20:42:25.578585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4839. [D 20:42:25.578600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4840. [D 20:42:25.578616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4841. [D 20:42:25.578659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4842. [D 20:42:25.578692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4843. [D 20:42:25.578716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4844. [D 20:42:25.578733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4845. [D 20:42:25.578748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4846. [D 20:42:25.578763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4847. [D 20:42:25.578780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4848. [D 20:42:25.578795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4849. [D 20:42:25.578810] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4850. [D 20:42:25.583417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.583439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.583457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:25.583487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2848 [D 20:42:25.583504] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:25.583520] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 25/70. [D 20:42:25.584115] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4850. [D 20:42:25.584137] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 26/70. [D 20:42:25.587192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.587212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.587226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:25.590643] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2848 [D 20:42:25.590666] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 27/70. [D 20:42:25.590727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4850. [D 20:42:25.590743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4851. [D 20:42:25.590758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4852. [D 20:42:25.590783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4853. [D 20:42:25.590798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4854. [D 20:42:25.590813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4855. [D 20:42:25.590827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4856. [D 20:42:25.590843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4857. [D 20:42:25.590877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4858. [D 20:42:25.590892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4859. [D 20:42:25.590923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4860. [D 20:42:25.590938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4861. [D 20:42:25.590952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4862. [D 20:42:25.590967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4863. [D 20:42:25.590982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4864. [D 20:42:25.590996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4865. [D 20:42:25.591011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4866. [D 20:42:25.591026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4867. [D 20:42:25.591040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4868. [D 20:42:25.591057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4869. [D 20:42:25.591072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4870. [D 20:42:25.591087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4871. [D 20:42:25.591102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4872. [D 20:42:25.591129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4873. [D 20:42:25.591145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4874. [D 20:42:25.591194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4875. [D 20:42:25.591214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4876. [D 20:42:25.591231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4877. [D 20:42:25.591250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4878. [D 20:42:25.591267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4879. [D 20:42:25.591292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4880. [D 20:42:25.591307] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4881. [D 20:42:25.596661] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4881. [D 20:42:25.596684] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 28/70. [D 20:42:25.599687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.599707] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.599723] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.747556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.747579] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.747596] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.747620] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2851 [D 20:42:25.747637] element 0: offset: 0x2aaaab01c540, size: 24 [D 20:42:25.747653] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 29/70. [D 20:42:25.753971] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2851 [D 20:42:25.753995] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 30/70. [D 20:42:25.754049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 4881. [D 20:42:25.754066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 4882. [D 20:42:25.754081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 4883. [D 20:42:25.754096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 4884. [D 20:42:25.754111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 4885. [D 20:42:25.754126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 4886. [D 20:42:25.754140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 4887. [D 20:42:25.754155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 4888. [D 20:42:25.754170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 4889. [D 20:42:25.754184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 4890. [D 20:42:25.754200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 4891. [D 20:42:25.754214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 4892. [D 20:42:25.754229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 4893. [D 20:42:25.754244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 4894. [D 20:42:25.754258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 4895. [D 20:42:25.754273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 4896. [D 20:42:25.754289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 4897. [D 20:42:25.754335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 4898. [D 20:42:25.754356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 4899. [D 20:42:25.754371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 4900. [D 20:42:25.754386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 4901. [D 20:42:25.754401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 4902. [D 20:42:25.754416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 4903. [D 20:42:25.754431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 4904. [D 20:42:25.754446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 4905. [D 20:42:25.754460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 4906. [D 20:42:25.754487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 4907. [D 20:42:25.754502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 4908. [D 20:42:25.754516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 4909. [D 20:42:25.754531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 4910. [D 20:42:25.754545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 4911. [D 20:42:25.754560] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 4912. [D 20:42:25.759928] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4912. [D 20:42:25.759948] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 31/70. [D 20:42:25.763014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.763033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.763048] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.834042] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.834063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.834080] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.834103] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2855 [D 20:42:25.834121] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:25.834137] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 32/70. [D 20:42:25.838017] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2855 [D 20:42:25.838053] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 33/70. [D 20:42:25.838122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4912. [D 20:42:25.838146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 4913. [D 20:42:25.838163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 4914. [D 20:42:25.838178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 4915. [D 20:42:25.838192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 4916. [D 20:42:25.838207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 4917. [D 20:42:25.838222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4918. [D 20:42:25.838257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4919. [D 20:42:25.838279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4920. [D 20:42:25.838294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 4921. [D 20:42:25.838309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 4922. [D 20:42:25.838324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 4923. [D 20:42:25.838339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 4924. [D 20:42:25.838354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 4925. [D 20:42:25.838369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4926. [D 20:42:25.838384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4927. [D 20:42:25.838399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4928. [D 20:42:25.838414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4929. [D 20:42:25.838429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4930. [D 20:42:25.838446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4931. [D 20:42:25.838463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4932. [D 20:42:25.838478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4933. [D 20:42:25.838493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4934. [D 20:42:25.838508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4935. [D 20:42:25.838522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4936. [D 20:42:25.838538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4937. [D 20:42:25.838603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4938. [D 20:42:25.838618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4939. [D 20:42:25.838635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4940. [D 20:42:25.838656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4941. [D 20:42:25.838673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4942. [D 20:42:25.838688] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4943. [D 20:42:25.844105] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4943. [D 20:42:25.844125] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 34/70. [D 20:42:25.847183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.847203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.847218] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.850774] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.850794] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.850811] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.850833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2857 [D 20:42:25.850853] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:25.850869] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 35/70. [D 20:42:25.854588] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2857 [D 20:42:25.854612] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 36/70. [D 20:42:25.854670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4943. [D 20:42:25.854687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4944. [D 20:42:25.854705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4945. [D 20:42:25.854730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4946. [D 20:42:25.854746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4947. [D 20:42:25.854761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4948. [D 20:42:25.854776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4949. [D 20:42:25.854791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4950. [D 20:42:25.854807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4951. [D 20:42:25.854854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4952. [D 20:42:25.854878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4953. [D 20:42:25.854893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4954. [D 20:42:25.854921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4955. [D 20:42:25.854936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4956. [D 20:42:25.854960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4957. [D 20:42:25.854975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4958. [D 20:42:25.855003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4959. [D 20:42:25.855034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4960. [D 20:42:25.855049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4961. [D 20:42:25.855079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4962. [D 20:42:25.855110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4963. [D 20:42:25.855169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4964. [D 20:42:25.855185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4965. [D 20:42:25.855227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4966. [D 20:42:25.855243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4967. [D 20:42:25.855265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4968. [D 20:42:25.855280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4969. [D 20:42:25.855295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4970. [D 20:42:25.855310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4971. [D 20:42:25.855324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4972. [D 20:42:25.855339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4973. [D 20:42:25.855354] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4974. [D 20:42:25.866266] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 4974. [D 20:42:25.866288] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 37/70. [D 20:42:25.869270] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.869287] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.869301] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.875401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.875421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.875435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.875457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2860 [D 20:42:25.875472] element 0: offset: 0x2aaaab014a80, size: 24 [D 20:42:25.875487] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 38/70. [D 20:42:25.879226] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2860 [D 20:42:25.879248] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 39/70. [D 20:42:25.879304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 4974. [D 20:42:25.879321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 4975. [D 20:42:25.879336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 4976. [D 20:42:25.879356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 4977. [D 20:42:25.879373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 4978. [D 20:42:25.879387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 4979. [D 20:42:25.879402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 4980. [D 20:42:25.879416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4981. [D 20:42:25.879431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4982. [D 20:42:25.879446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4983. [D 20:42:25.879475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 4984. [D 20:42:25.879492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 4985. [D 20:42:25.879516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 4986. [D 20:42:25.879532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 4987. [D 20:42:25.879551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 4988. [D 20:42:25.879567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4989. [D 20:42:25.879582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4990. [D 20:42:25.879597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4991. [D 20:42:25.879611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 4992. [D 20:42:25.879627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 4993. [D 20:42:25.879642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 4994. [D 20:42:25.879656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 4995. [D 20:42:25.879671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 4996. [D 20:42:25.879686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4997. [D 20:42:25.879701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4998. [D 20:42:25.879725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4999. [D 20:42:25.879740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5000. [D 20:42:25.879763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5001. [D 20:42:25.879778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5002. [D 20:42:25.879792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5003. [D 20:42:25.879807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5004. [D 20:42:25.879822] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5005. [D 20:42:25.887035] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5005. [D 20:42:25.887060] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 40/70. [D 20:42:25.887560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.887579] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.887593] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.899454] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.899475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.899492] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.899515] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2863 [D 20:42:25.899532] element 0: offset: 0x2aaaab028250, size: 24 [D 20:42:25.899551] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 41/70. [D 20:42:25.903252] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2863 [D 20:42:25.903290] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 42/70. [D 20:42:25.903348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5005. [D 20:42:25.903365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5006. [D 20:42:25.903384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5007. [D 20:42:25.903401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5008. [D 20:42:25.903416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5009. [D 20:42:25.903431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5010. [D 20:42:25.903446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5011. [D 20:42:25.903460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5012. [D 20:42:25.903475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5013. [D 20:42:25.903514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5014. [D 20:42:25.903546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5015. [D 20:42:25.903561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5016. [D 20:42:25.903576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5017. [D 20:42:25.903591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5018. [D 20:42:25.903605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5019. [D 20:42:25.903620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5020. [D 20:42:25.903635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5021. [D 20:42:25.903649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5022. [D 20:42:25.903665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5023. [D 20:42:25.903679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5024. [D 20:42:25.903694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5025. [D 20:42:25.903713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5026. [D 20:42:25.903728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5027. [D 20:42:25.903743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5028. [D 20:42:25.903757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5029. [D 20:42:25.903781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5030. [D 20:42:25.903796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5031. [D 20:42:25.903811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5032. [D 20:42:25.903826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5033. [D 20:42:25.903841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5034. [D 20:42:25.903856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5035. [D 20:42:25.903871] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5036. [D 20:42:25.909270] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5036. [D 20:42:25.909290] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 43/70. [D 20:42:25.912332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.912351] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.912371] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:25.970656] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:25.970677] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.970694] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:25.970716] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2866 [D 20:42:25.970734] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:25.970751] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 44/70. [D 20:42:25.974321] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2866 [D 20:42:25.974345] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 45/70. [D 20:42:25.974400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5036. [D 20:42:25.974425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5037. [D 20:42:25.974440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5038. [D 20:42:25.974455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5039. [D 20:42:25.974470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5040. [D 20:42:25.974485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5041. [D 20:42:25.974553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5042. [D 20:42:25.974570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5043. [D 20:42:25.974585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5044. [D 20:42:25.974600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5045. [D 20:42:25.974614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5046. [D 20:42:25.974634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5047. [D 20:42:25.974661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5048. [D 20:42:25.974676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5049. [D 20:42:25.974690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5050. [D 20:42:25.974705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5051. [D 20:42:25.974719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5052. [D 20:42:25.974734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5053. [D 20:42:25.974749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5054. [D 20:42:25.974763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5055. [D 20:42:25.974778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5056. [D 20:42:25.974792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5057. [D 20:42:25.974807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5058. [D 20:42:25.974821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5059. [D 20:42:25.974836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5060. [D 20:42:25.974850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5061. [D 20:42:25.974865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5062. [D 20:42:25.974879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5063. [D 20:42:25.974894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5064. [D 20:42:25.974908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5065. [D 20:42:25.974925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5066. [D 20:42:25.974940] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5067. [D 20:42:25.980360] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5067. [D 20:42:25.980384] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 46/70. [D 20:42:25.983436] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:25.983452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:25.983465] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.039525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.039597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.039617] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.039643] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2869 [D 20:42:26.039659] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:26.039674] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 47/70. [D 20:42:26.043084] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2869 [D 20:42:26.043107] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 48/70. [D 20:42:26.043165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5067. [D 20:42:26.043185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5068. [D 20:42:26.043200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5069. [D 20:42:26.043215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5070. [D 20:42:26.043230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5071. [D 20:42:26.043245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5072. [D 20:42:26.043260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5073. [D 20:42:26.043274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5074. [D 20:42:26.043294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5075. [D 20:42:26.043309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5076. [D 20:42:26.043325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5077. [D 20:42:26.043340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5078. [D 20:42:26.043355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5079. [D 20:42:26.043369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5080. [D 20:42:26.043384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5081. [D 20:42:26.043399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5082. [D 20:42:26.043414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5083. [D 20:42:26.043429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5084. [D 20:42:26.043444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5085. [D 20:42:26.043459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5086. [D 20:42:26.043474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5087. [D 20:42:26.043488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5088. [D 20:42:26.043503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5089. [D 20:42:26.043518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5090. [D 20:42:26.043538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5091. [D 20:42:26.043557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5092. [D 20:42:26.043572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5093. [D 20:42:26.043586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5094. [D 20:42:26.043601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5095. [D 20:42:26.043615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5096. [D 20:42:26.043643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5097. [D 20:42:26.043658] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5098. [D 20:42:26.049116] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5098. [D 20:42:26.049137] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 49/70. [D 20:42:26.052212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.052229] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.052243] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.114807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.114827] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.114841] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.114863] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2872 [D 20:42:26.114878] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:26.114893] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 50/70. [D 20:42:26.118488] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2872 [D 20:42:26.118511] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 51/70. [D 20:42:26.118564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5098. [D 20:42:26.118583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5099. [D 20:42:26.118598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5100. [D 20:42:26.118613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5101. [D 20:42:26.118628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5102. [D 20:42:26.118642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5103. [D 20:42:26.118657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5104. [D 20:42:26.118671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5105. [D 20:42:26.118692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5106. [D 20:42:26.118706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5107. [D 20:42:26.118721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5108. [D 20:42:26.118736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5109. [D 20:42:26.118751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5110. [D 20:42:26.118766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5111. [D 20:42:26.118780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5112. [D 20:42:26.118795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5113. [D 20:42:26.118809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5114. [D 20:42:26.118824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5115. [D 20:42:26.118839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5116. [D 20:42:26.118853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5117. [D 20:42:26.118868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5118. [D 20:42:26.118882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5119. [D 20:42:26.118897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5120. [D 20:42:26.118911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5121. [D 20:42:26.118932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5122. [D 20:42:26.118947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5123. [D 20:42:26.118961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5124. [D 20:42:26.118976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5125. [D 20:42:26.118990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5126. [D 20:42:26.119016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5127. [D 20:42:26.119032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5128. [D 20:42:26.119046] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5129. [D 20:42:26.124512] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5129. [D 20:42:26.124532] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 52/70. [D 20:42:26.127616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.127633] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.127647] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.191754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.191822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.191837] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.191883] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2875 [D 20:42:26.191898] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:26.191918] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 53/70. [D 20:42:26.195774] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2875 [D 20:42:26.195798] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 54/70. [D 20:42:26.195859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5129. [D 20:42:26.195877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5130. [D 20:42:26.195892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5131. [D 20:42:26.195907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5132. [D 20:42:26.195922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5133. [D 20:42:26.195950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5134. [D 20:42:26.195966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5135. [D 20:42:26.195981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5136. [D 20:42:26.195995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5137. [D 20:42:26.196010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5138. [D 20:42:26.196024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5139. [D 20:42:26.196039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5140. [D 20:42:26.196054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5141. [D 20:42:26.196068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5142. [D 20:42:26.196083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5143. [D 20:42:26.196097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5144. [D 20:42:26.196117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5145. [D 20:42:26.196132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5146. [D 20:42:26.196147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5147. [D 20:42:26.196162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5148. [D 20:42:26.196176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5149. [D 20:42:26.196191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5150. [D 20:42:26.196205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5151. [D 20:42:26.196219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5152. [D 20:42:26.196234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5153. [D 20:42:26.196248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5154. [D 20:42:26.196263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5155. [D 20:42:26.196278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5156. [D 20:42:26.196302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5157. [D 20:42:26.196317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5158. [D 20:42:26.196333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5159. [D 20:42:26.196348] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5160. [D 20:42:26.201789] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5160. [D 20:42:26.201810] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 55/70. [D 20:42:26.201924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.201987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.202001] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.253962] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.253985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.253999] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.254039] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2878 [D 20:42:26.254053] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:26.254073] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 56/70. [D 20:42:26.257990] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2878 [D 20:42:26.258016] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 57/70. [D 20:42:26.258071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5160. [D 20:42:26.258089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5161. [D 20:42:26.258104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5162. [D 20:42:26.258120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5163. [D 20:42:26.258135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5164. [D 20:42:26.258149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5165. [D 20:42:26.258175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5166. [D 20:42:26.258190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5167. [D 20:42:26.258205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5168. [D 20:42:26.258220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5169. [D 20:42:26.258235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5170. [D 20:42:26.258250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5171. [D 20:42:26.258265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5172. [D 20:42:26.258280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5173. [D 20:42:26.258294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5174. [D 20:42:26.258309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5175. [D 20:42:26.258324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5176. [D 20:42:26.258339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5177. [D 20:42:26.258353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5178. [D 20:42:26.258368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5179. [D 20:42:26.258382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5180. [D 20:42:26.258397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5181. [D 20:42:26.258418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5182. [D 20:42:26.258433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5183. [D 20:42:26.258447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5184. [D 20:42:26.258472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5185. [D 20:42:26.258488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5186. [D 20:42:26.258503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5187. [D 20:42:26.258517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5188. [D 20:42:26.258532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5189. [D 20:42:26.258547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5190. [D 20:42:26.258561] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5191. [D 20:42:26.263997] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5191. [D 20:42:26.264017] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 58/70. [D 20:42:26.264134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.264195] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.264208] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.285424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.285445] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.285458] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.285498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2881 [D 20:42:26.285514] element 0: offset: 0x2aaaab014a80, size: 24 [D 20:42:26.285533] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 59/70. [D 20:42:26.289430] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2881 [D 20:42:26.289463] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 60/70. [D 20:42:26.289525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5191. [D 20:42:26.289542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5192. [D 20:42:26.289569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5193. [D 20:42:26.289584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5194. [D 20:42:26.289598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5195. [D 20:42:26.289613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5196. [D 20:42:26.289628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5197. [D 20:42:26.289643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5198. [D 20:42:26.289657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5199. [D 20:42:26.289699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5200. [D 20:42:26.289715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5201. [D 20:42:26.289736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5202. [D 20:42:26.289751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5203. [D 20:42:26.289766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5204. [D 20:42:26.289781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5205. [D 20:42:26.289796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5206. [D 20:42:26.289810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5207. [D 20:42:26.289826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5208. [D 20:42:26.289840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5209. [D 20:42:26.289866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5210. [D 20:42:26.289884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5211. [D 20:42:26.289901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5212. [D 20:42:26.289916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5213. [D 20:42:26.289931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5214. [D 20:42:26.289947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5215. [D 20:42:26.289961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5216. [D 20:42:26.289977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5217. [D 20:42:26.290038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5218. [D 20:42:26.290061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5219. [D 20:42:26.290080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5220. [D 20:42:26.290095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5221. [D 20:42:26.290111] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5222. [D 20:42:26.295456] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5222. [D 20:42:26.295477] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 0/70. [D 20:42:26.295566] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.295584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.295599] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.349680] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.349702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.349720] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.349744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2885 [D 20:42:26.349763] element 0: offset: 0x2aaaab020500, size: 24 [D 20:42:26.349779] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 1/70. [D 20:42:26.353676] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2885 [D 20:42:26.353701] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 2/70. [D 20:42:26.353756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5222. [D 20:42:26.353773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 5223. [D 20:42:26.353789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 5224. [D 20:42:26.353803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 5225. [D 20:42:26.353821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 5226. [D 20:42:26.353836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 5227. [D 20:42:26.353851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5228. [D 20:42:26.353865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5229. [D 20:42:26.353881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5230. [D 20:42:26.353896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 5231. [D 20:42:26.353911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 5232. [D 20:42:26.353926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 5233. [D 20:42:26.353963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 5234. [D 20:42:26.353983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 5235. [D 20:42:26.354004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5236. [D 20:42:26.354019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5237. [D 20:42:26.354045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5238. [D 20:42:26.354060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5239. [D 20:42:26.354075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5240. [D 20:42:26.354089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5241. [D 20:42:26.354104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5242. [D 20:42:26.354119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5243. [D 20:42:26.354133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5244. [D 20:42:26.354148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5245. [D 20:42:26.354162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5246. [D 20:42:26.354177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5247. [D 20:42:26.354192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5248. [D 20:42:26.354206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5249. [D 20:42:26.354225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5250. [D 20:42:26.354240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5251. [D 20:42:26.354255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5252. [D 20:42:26.354269] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5253. [D 20:42:26.359718] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5253. [D 20:42:26.359738] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 3/70. [D 20:42:26.362787] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.362807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.362822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.551877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.551939] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.551954] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.552000] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2887 [D 20:42:26.552016] element 0: offset: 0x2aaaab01c570, size: 24 [D 20:42:26.552038] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 4/70. [D 20:42:26.555676] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2887 [D 20:42:26.555703] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 5/70. [D 20:42:26.555759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5253. [D 20:42:26.555776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5254. [D 20:42:26.555792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5255. [D 20:42:26.555806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5256. [D 20:42:26.555832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5257. [D 20:42:26.555847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5258. [D 20:42:26.555861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5259. [D 20:42:26.555880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5260. [D 20:42:26.555895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5261. [D 20:42:26.555910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5262. [D 20:42:26.555941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5263. [D 20:42:26.555957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5264. [D 20:42:26.556082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5265. [D 20:42:26.556101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5266. [D 20:42:26.556116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5267. [D 20:42:26.556134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5268. [D 20:42:26.556149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5269. [D 20:42:26.556163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5270. [D 20:42:26.556245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5271. [D 20:42:26.556269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5272. [D 20:42:26.556287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5273. [D 20:42:26.556420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5274. [D 20:42:26.556497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5275. [D 20:42:26.556568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5276. [D 20:42:26.556586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5277. [D 20:42:26.556600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5278. [D 20:42:26.556615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5279. [D 20:42:26.556630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5280. [D 20:42:26.556654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5281. [D 20:42:26.556669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5282. [D 20:42:26.556740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5283. [D 20:42:26.556768] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5284. [D 20:42:26.561640] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5284. [D 20:42:26.561663] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 6/70. [D 20:42:26.561778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.561830] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.561844] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.573642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.573663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.573676] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.573713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2890 [D 20:42:26.573728] element 0: offset: 0x2aaaab028250, size: 24 [D 20:42:26.573748] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 7/70. [D 20:42:26.577706] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2890 [D 20:42:26.577734] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 8/70. [D 20:42:26.577793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5284. [D 20:42:26.577810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5285. [D 20:42:26.577825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5286. [D 20:42:26.577840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5287. [D 20:42:26.577875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5288. [D 20:42:26.577891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5289. [D 20:42:26.577906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5290. [D 20:42:26.577920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5291. [D 20:42:26.577935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5292. [D 20:42:26.577950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5293. [D 20:42:26.577965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5294. [D 20:42:26.577980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5295. [D 20:42:26.577994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5296. [D 20:42:26.578010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5297. [D 20:42:26.578042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5298. [D 20:42:26.578061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5299. [D 20:42:26.578080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5300. [D 20:42:26.578095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5301. [D 20:42:26.578109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5302. [D 20:42:26.578124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5303. [D 20:42:26.578139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5304. [D 20:42:26.578154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5305. [D 20:42:26.578168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5306. [D 20:42:26.578195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5307. [D 20:42:26.578210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5308. [D 20:42:26.578225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5309. [D 20:42:26.578240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5310. [D 20:42:26.578254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5311. [D 20:42:26.578269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5312. [D 20:42:26.578284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5313. [D 20:42:26.578299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5314. [D 20:42:26.578314] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5315. [D 20:42:26.583745] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5315. [D 20:42:26.583765] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 9/70. [D 20:42:26.583875] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.583927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.583940] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.652118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.652139] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.652152] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.652190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2893 [D 20:42:26.652205] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:26.652225] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 10/70. [D 20:42:26.656053] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2893 [D 20:42:26.656087] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 11/70. [D 20:42:26.656142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5315. [D 20:42:26.656159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5316. [D 20:42:26.656174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5317. [D 20:42:26.656195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5318. [D 20:42:26.656212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5319. [D 20:42:26.656227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5320. [D 20:42:26.656242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5321. [D 20:42:26.656276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5322. [D 20:42:26.656291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5323. [D 20:42:26.656306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5324. [D 20:42:26.656335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5325. [D 20:42:26.656350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5326. [D 20:42:26.656365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5327. [D 20:42:26.656380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5328. [D 20:42:26.656394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5329. [D 20:42:26.656413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5330. [D 20:42:26.656429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5331. [D 20:42:26.656447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5332. [D 20:42:26.656464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5333. [D 20:42:26.656478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5334. [D 20:42:26.656494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5335. [D 20:42:26.656535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5336. [D 20:42:26.656551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5337. [D 20:42:26.656575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5338. [D 20:42:26.656590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5339. [D 20:42:26.656605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5340. [D 20:42:26.656620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5341. [D 20:42:26.656635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5342. [D 20:42:26.656649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5343. [D 20:42:26.656664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5344. [D 20:42:26.656679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5345. [D 20:42:26.656696] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5346. [D 20:42:26.662110] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5346. [D 20:42:26.662133] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 12/70. [D 20:42:26.662247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.662306] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.662320] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.718117] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.718138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.718151] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.718191] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2897 [D 20:42:26.718207] element 0: offset: 0x2aaaab0266f0, size: 24 [D 20:42:26.718227] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 13/70. [D 20:42:26.722185] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2897 [D 20:42:26.722216] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 14/70. [D 20:42:26.722277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5346. [D 20:42:26.722294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 5347. [D 20:42:26.722309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 5348. [D 20:42:26.722325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 5349. [D 20:42:26.722341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 5350. [D 20:42:26.722369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 5351. [D 20:42:26.722384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5352. [D 20:42:26.722398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5353. [D 20:42:26.722413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5354. [D 20:42:26.722428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 5355. [D 20:42:26.722455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 5356. [D 20:42:26.722470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 5357. [D 20:42:26.722497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 5358. [D 20:42:26.722512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 5359. [D 20:42:26.722527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5360. [D 20:42:26.722541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5361. [D 20:42:26.722556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5362. [D 20:42:26.722570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5363. [D 20:42:26.722585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5364. [D 20:42:26.722600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5365. [D 20:42:26.722615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5366. [D 20:42:26.722629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5367. [D 20:42:26.722655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5368. [D 20:42:26.722669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5369. [D 20:42:26.722684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5370. [D 20:42:26.722699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5371. [D 20:42:26.722720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5372. [D 20:42:26.722737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5373. [D 20:42:26.722752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5374. [D 20:42:26.722767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5375. [D 20:42:26.722783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5376. [D 20:42:26.722797] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5377. [D 20:42:26.728209] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5377. [D 20:42:26.728229] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 15/70. [D 20:42:26.728346] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.728405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.728420] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.788426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.788447] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.788460] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.788500] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2900 [D 20:42:26.788515] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:26.788535] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 16/70. [D 20:42:26.792412] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2900 [D 20:42:26.792443] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 17/70. [D 20:42:26.792505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5377. [D 20:42:26.792522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 5378. [D 20:42:26.792537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 5379. [D 20:42:26.792552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 5380. [D 20:42:26.792580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 5381. [D 20:42:26.792595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 5382. [D 20:42:26.792610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5383. [D 20:42:26.792624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5384. [D 20:42:26.792639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5385. [D 20:42:26.792680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 5386. [D 20:42:26.792697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 5387. [D 20:42:26.792717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 5388. [D 20:42:26.792732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 5389. [D 20:42:26.792759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 5390. [D 20:42:26.792774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5391. [D 20:42:26.792788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5392. [D 20:42:26.792803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5393. [D 20:42:26.792818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5394. [D 20:42:26.792843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5395. [D 20:42:26.792863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5396. [D 20:42:26.792881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5397. [D 20:42:26.792895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5398. [D 20:42:26.792910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5399. [D 20:42:26.792926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5400. [D 20:42:26.792941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5401. [D 20:42:26.792956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5402. [D 20:42:26.792971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5403. [D 20:42:26.793020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5404. [D 20:42:26.793035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5405. [D 20:42:26.793059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5406. [D 20:42:26.793078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5407. [D 20:42:26.793097] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5408. [D 20:42:26.798440] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5408. [D 20:42:26.798460] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 18/70. [D 20:42:26.798574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.798634] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.798648] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.855659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.855681] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.855693] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.855734] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2902 [D 20:42:26.855749] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:26.855768] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 19/70. [D 20:42:26.859732] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2902 [D 20:42:26.859762] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 20/70. [D 20:42:26.859812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5408. [D 20:42:26.859830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5409. [D 20:42:26.859845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5410. [D 20:42:26.859860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5411. [D 20:42:26.859875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5412. [D 20:42:26.859890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5413. [D 20:42:26.859905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5414. [D 20:42:26.859920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5415. [D 20:42:26.859934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5416. [D 20:42:26.859949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5417. [D 20:42:26.859964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5418. [D 20:42:26.859979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5419. [D 20:42:26.859994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5420. [D 20:42:26.860009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5421. [D 20:42:26.860024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5422. [D 20:42:26.860038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5423. [D 20:42:26.860053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5424. [D 20:42:26.860108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5425. [D 20:42:26.860129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5426. [D 20:42:26.860144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5427. [D 20:42:26.860159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5428. [D 20:42:26.860173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5429. [D 20:42:26.860188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5430. [D 20:42:26.860203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5431. [D 20:42:26.860217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5432. [D 20:42:26.860232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5433. [D 20:42:26.860247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5434. [D 20:42:26.860261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5435. [D 20:42:26.860276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5436. [D 20:42:26.860290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5437. [D 20:42:26.860305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5438. [D 20:42:26.860320] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5439. [D 20:42:26.865765] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5439. [D 20:42:26.865784] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 21/70. [D 20:42:26.865899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.865959] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.865974] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:26.924354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:26.924375] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.924388] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:26.924429] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2905 [D 20:42:26.924445] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:26.924465] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 22/70. [D 20:42:26.928423] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2905 [D 20:42:26.928461] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 23/70. [D 20:42:26.928518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5439. [D 20:42:26.928535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5440. [D 20:42:26.928563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5441. [D 20:42:26.928580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5442. [D 20:42:26.928595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5443. [D 20:42:26.928610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5444. [D 20:42:26.928625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5445. [D 20:42:26.928639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5446. [D 20:42:26.928654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5447. [D 20:42:26.928692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5448. [D 20:42:26.928707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5449. [D 20:42:26.928731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5450. [D 20:42:26.928747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5451. [D 20:42:26.928762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5452. [D 20:42:26.928776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5453. [D 20:42:26.928803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5454. [D 20:42:26.928828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5455. [D 20:42:26.928843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5456. [D 20:42:26.928858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5457. [D 20:42:26.928872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5458. [D 20:42:26.928887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5459. [D 20:42:26.928902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5460. [D 20:42:26.928917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5461. [D 20:42:26.928939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5462. [D 20:42:26.928956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5463. [D 20:42:26.928971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5464. [D 20:42:26.928986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5465. [D 20:42:26.929002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5466. [D 20:42:26.929017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5467. [D 20:42:26.929031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5468. [D 20:42:26.929047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5469. [D 20:42:26.929100] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5470. [D 20:42:26.934437] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5470. [D 20:42:26.934456] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 24/70. [D 20:42:26.934571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:26.934630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:26.934644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.044955] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.044977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.044990] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.045030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2908 [D 20:42:27.045045] element 0: offset: 0x2aaaab039150, size: 24 [D 20:42:27.045065] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 25/70. [D 20:42:27.048946] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2908 [D 20:42:27.048976] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 26/70. [D 20:42:27.049042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5470. [D 20:42:27.049060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5471. [D 20:42:27.049081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5472. [D 20:42:27.049097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5473. [D 20:42:27.049112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5474. [D 20:42:27.049126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5475. [D 20:42:27.049141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5476. [D 20:42:27.049156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5477. [D 20:42:27.049171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5478. [D 20:42:27.049186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5479. [D 20:42:27.049213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5480. [D 20:42:27.049231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5481. [D 20:42:27.049252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5482. [D 20:42:27.049267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5483. [D 20:42:27.049282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5484. [D 20:42:27.049297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5485. [D 20:42:27.049311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5486. [D 20:42:27.049337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5487. [D 20:42:27.049353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5488. [D 20:42:27.049367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5489. [D 20:42:27.049382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5490. [D 20:42:27.049397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5491. [D 20:42:27.049411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5492. [D 20:42:27.049426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5493. [D 20:42:27.049444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5494. [D 20:42:27.049461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5495. [D 20:42:27.049476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5496. [D 20:42:27.049490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5497. [D 20:42:27.049507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5498. [D 20:42:27.049522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5499. [D 20:42:27.049536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5500. [D 20:42:27.049552] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5501. [D 20:42:27.054979] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5501. [D 20:42:27.054999] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 27/70. [D 20:42:27.055109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.055169] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.055183] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.169351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.169373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.169386] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.169425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2912 [D 20:42:27.169440] element 0: offset: 0x2aaaab020500, size: 24 [D 20:42:27.169460] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 28/70. [D 20:42:27.173532] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2912 [D 20:42:27.173561] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 29/70. [D 20:42:27.173616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5501. [D 20:42:27.173633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 5502. [D 20:42:27.173648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 5503. [D 20:42:27.173662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 5504. [D 20:42:27.173678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 5505. [D 20:42:27.173693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 5506. [D 20:42:27.173708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5507. [D 20:42:27.173723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5508. [D 20:42:27.173748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5509. [D 20:42:27.173779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 5510. [D 20:42:27.173794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 5511. [D 20:42:27.173809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 5512. [D 20:42:27.173823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 5513. [D 20:42:27.173838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 5514. [D 20:42:27.173853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5515. [D 20:42:27.173868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5516. [D 20:42:27.173886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5517. [D 20:42:27.173901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 5518. [D 20:42:27.173916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 5519. [D 20:42:27.173931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 5520. [D 20:42:27.173946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 5521. [D 20:42:27.173961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 5522. [D 20:42:27.173975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5523. [D 20:42:27.173998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5524. [D 20:42:27.174048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5525. [D 20:42:27.174064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 5526. [D 20:42:27.174084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 5527. [D 20:42:27.174104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 5528. [D 20:42:27.174121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 5529. [D 20:42:27.174136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 5530. [D 20:42:27.174150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5531. [D 20:42:27.174165] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5532. [D 20:42:27.179497] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5532. [D 20:42:27.179517] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 30/70. [D 20:42:27.182519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.182540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.182556] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.231042] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.231064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.231081] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.231109] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2914 [D 20:42:27.231125] element 0: offset: 0x2aaaab01c570, size: 24 [D 20:42:27.231141] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:42:27.234856] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2914 [D 20:42:27.234881] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 32/70. [D 20:42:27.234949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5532. [D 20:42:27.234965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5533. [D 20:42:27.234980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 5534. [D 20:42:27.234995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 5535. [D 20:42:27.235010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 5536. [D 20:42:27.235025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 5537. [D 20:42:27.235041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 5538. [D 20:42:27.235055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5539. [D 20:42:27.235097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5540. [D 20:42:27.235114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5541. [D 20:42:27.235134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 5542. [D 20:42:27.235149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 5543. [D 20:42:27.235175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 5544. [D 20:42:27.235190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 5545. [D 20:42:27.235205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 5546. [D 20:42:27.235220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5547. [D 20:42:27.235235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5548. [D 20:42:27.235249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5549. [D 20:42:27.235264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5550. [D 20:42:27.235279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5551. [D 20:42:27.235294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5552. [D 20:42:27.235308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5553. [D 20:42:27.235331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5554. [D 20:42:27.235348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5555. [D 20:42:27.235372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5556. [D 20:42:27.235387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5557. [D 20:42:27.235402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5558. [D 20:42:27.235417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5559. [D 20:42:27.235440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5560. [D 20:42:27.235496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5561. [D 20:42:27.235521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5562. [D 20:42:27.235538] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5563. [D 20:42:27.240906] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5563. [D 20:42:27.240926] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 33/70. [D 20:42:27.243996] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.244015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.244032] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.244183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.244201] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.244215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.244250] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2917 [D 20:42:27.244266] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:27.244281] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 34/70. [D 20:42:27.247819] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2917 [D 20:42:27.247846] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 35/70. [D 20:42:27.248052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5563. [D 20:42:27.248091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5564. [D 20:42:27.248113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5565. [D 20:42:27.248131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5566. [D 20:42:27.248150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5567. [D 20:42:27.248180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5568. [D 20:42:27.248198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5569. [D 20:42:27.248216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5570. [D 20:42:27.248235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5571. [D 20:42:27.248253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5572. [D 20:42:27.248271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5573. [D 20:42:27.248290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5574. [D 20:42:27.248308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5575. [D 20:42:27.248326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5576. [D 20:42:27.248345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5577. [D 20:42:27.248363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5578. [D 20:42:27.248382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5579. [D 20:42:27.248409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5580. [D 20:42:27.248427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5581. [D 20:42:27.248449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5582. [D 20:42:27.248468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5583. [D 20:42:27.248485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5584. [D 20:42:27.248504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5585. [D 20:42:27.248522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5586. [D 20:42:27.248541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5587. [D 20:42:27.248556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5588. [D 20:42:27.248571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5589. [D 20:42:27.248590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5590. [D 20:42:27.248608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5591. [D 20:42:27.248627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5592. [D 20:42:27.248646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5593. [D 20:42:27.248661] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5594. [D 20:42:27.257782] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5594. [D 20:42:27.257807] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 36/70. [D 20:42:27.260783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.260805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.260820] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.267573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.267595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.267612] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.267636] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2920 [D 20:42:27.267656] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:27.268946] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 37/70. [D 20:42:27.272235] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2920 [D 20:42:27.272259] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 38/70. [D 20:42:27.272321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5594. [D 20:42:27.272338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5595. [D 20:42:27.272353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5596. [D 20:42:27.272368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5597. [D 20:42:27.272383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5598. [D 20:42:27.272405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5599. [D 20:42:27.272420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5600. [D 20:42:27.272434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5601. [D 20:42:27.272453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5602. [D 20:42:27.272468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5603. [D 20:42:27.272483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5604. [D 20:42:27.272498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5605. [D 20:42:27.272513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5606. [D 20:42:27.272528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5607. [D 20:42:27.272543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5608. [D 20:42:27.272558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5609. [D 20:42:27.272573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5610. [D 20:42:27.272618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5611. [D 20:42:27.272639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5612. [D 20:42:27.272654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5613. [D 20:42:27.272669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5614. [D 20:42:27.272684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5615. [D 20:42:27.272698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5616. [D 20:42:27.272713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5617. [D 20:42:27.272728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5618. [D 20:42:27.272742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5619. [D 20:42:27.272757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5620. [D 20:42:27.272772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5621. [D 20:42:27.272786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5622. [D 20:42:27.272801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5623. [D 20:42:27.272816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5624. [D 20:42:27.272831] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5625. [D 20:42:27.278261] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5625. [D 20:42:27.278280] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 39/70. [D 20:42:27.279700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.279762] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.279776] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.314409] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.314429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.314443] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.314484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2924 [D 20:42:27.314499] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:27.314519] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 40/70. [D 20:42:27.318380] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2924 [D 20:42:27.318412] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 41/70. [D 20:42:27.318464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5625. [D 20:42:27.318481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 5626. [D 20:42:27.318496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 5627. [D 20:42:27.318511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 5628. [D 20:42:27.318526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 5629. [D 20:42:27.318541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 5630. [D 20:42:27.318558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5631. [D 20:42:27.318573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5632. [D 20:42:27.318588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5633. [D 20:42:27.318603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 5634. [D 20:42:27.318618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 5635. [D 20:42:27.318632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 5636. [D 20:42:27.318647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 5637. [D 20:42:27.318662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 5638. [D 20:42:27.318677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5639. [D 20:42:27.318692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5640. [D 20:42:27.318707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5641. [D 20:42:27.318721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 5642. [D 20:42:27.318736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 5643. [D 20:42:27.318751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 5644. [D 20:42:27.318795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 5645. [D 20:42:27.318815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 5646. [D 20:42:27.318830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5647. [D 20:42:27.318845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5648. [D 20:42:27.318871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5649. [D 20:42:27.318886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 5650. [D 20:42:27.318901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 5651. [D 20:42:27.318915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 5652. [D 20:42:27.318930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 5653. [D 20:42:27.318945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 5654. [D 20:42:27.318959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5655. [D 20:42:27.318974] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5656. [D 20:42:27.324420] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5656. [D 20:42:27.324440] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 42/70. [D 20:42:27.324558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.324618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.324632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.413433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.413455] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.413468] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.413508] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2926 [D 20:42:27.413523] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:27.413544] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 43/70. [D 20:42:27.417450] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2926 [D 20:42:27.417481] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 44/70. [D 20:42:27.417547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 5656. [D 20:42:27.417564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 5657. [D 20:42:27.417579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5658. [D 20:42:27.417593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5659. [D 20:42:27.417608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5660. [D 20:42:27.417623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5661. [D 20:42:27.417651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5662. [D 20:42:27.417666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5663. [D 20:42:27.417684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5664. [D 20:42:27.417700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5665. [D 20:42:27.417727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5666. [D 20:42:27.417742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5667. [D 20:42:27.417762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5668. [D 20:42:27.417777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5669. [D 20:42:27.417792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5670. [D 20:42:27.417806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5671. [D 20:42:27.417821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5672. [D 20:42:27.417835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5673. [D 20:42:27.417850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5674. [D 20:42:27.417864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5675. [D 20:42:27.417879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5676. [D 20:42:27.417898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5677. [D 20:42:27.417913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5678. [D 20:42:27.417937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5679. [D 20:42:27.417953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5680. [D 20:42:27.417968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5681. [D 20:42:27.417983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5682. [D 20:42:27.417997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5683. [D 20:42:27.418013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5684. [D 20:42:27.418068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5685. [D 20:42:27.418096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5686. [D 20:42:27.418118] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5687. [D 20:42:27.423433] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5687. [D 20:42:27.423452] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 45/70. [D 20:42:27.423571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.423632] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.423646] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.470512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.470533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.470547] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.470586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2929 [D 20:42:27.470601] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:27.470621] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 46/70. [D 20:42:27.474484] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2929 [D 20:42:27.474516] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 47/70. [D 20:42:27.474569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5687. [D 20:42:27.474586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5688. [D 20:42:27.474601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5689. [D 20:42:27.474616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5690. [D 20:42:27.474631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5691. [D 20:42:27.474647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5692. [D 20:42:27.474674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5693. [D 20:42:27.474709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5694. [D 20:42:27.474724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5695. [D 20:42:27.474739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5696. [D 20:42:27.474758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5697. [D 20:42:27.474773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5698. [D 20:42:27.474788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5699. [D 20:42:27.474803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5700. [D 20:42:27.474817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5701. [D 20:42:27.474832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5702. [D 20:42:27.474852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5703. [D 20:42:27.474867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5704. [D 20:42:27.474882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5705. [D 20:42:27.474896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5706. [D 20:42:27.474947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5707. [D 20:42:27.474963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5708. [D 20:42:27.474981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5709. [D 20:42:27.474997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5710. [D 20:42:27.475012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5711. [D 20:42:27.475027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5712. [D 20:42:27.475042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5713. [D 20:42:27.475056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5714. [D 20:42:27.475072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5715. [D 20:42:27.475086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5716. [D 20:42:27.475101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5717. [D 20:42:27.475116] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5718. [D 20:42:27.480452] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5718. [D 20:42:27.480479] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 48/70. [D 20:42:27.480595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.480656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.480669] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.495105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.495125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.495138] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.495177] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2933 [D 20:42:27.495193] element 0: offset: 0x2aaaab0267b0, size: 24 [D 20:42:27.495212] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 49/70. [D 20:42:27.498974] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2933 [D 20:42:27.499004] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 50/70. [D 20:42:27.499068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5718. [D 20:42:27.499086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 5719. [D 20:42:27.499101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 5720. [D 20:42:27.499116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 5721. [D 20:42:27.499132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 5722. [D 20:42:27.499159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 5723. [D 20:42:27.499191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5724. [D 20:42:27.499206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5725. [D 20:42:27.499225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5726. [D 20:42:27.499244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 5727. [D 20:42:27.499259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 5728. [D 20:42:27.499274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 5729. [D 20:42:27.499288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 5730. [D 20:42:27.499303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 5731. [D 20:42:27.499318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5732. [D 20:42:27.499332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5733. [D 20:42:27.499347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5734. [D 20:42:27.499362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5735. [D 20:42:27.499376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5736. [D 20:42:27.499391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5737. [D 20:42:27.499416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5738. [D 20:42:27.499431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5739. [D 20:42:27.499446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5740. [D 20:42:27.499461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5741. [D 20:42:27.499509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5742. [D 20:42:27.499532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5743. [D 20:42:27.499548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5744. [D 20:42:27.499618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5745. [D 20:42:27.499637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5746. [D 20:42:27.499652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5747. [D 20:42:27.499667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5748. [D 20:42:27.499681] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5749. [D 20:42:27.505008] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5749. [D 20:42:27.505032] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 51/70. [D 20:42:27.505146] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.505206] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.505220] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.528692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.528713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.528726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.528766] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2935 [D 20:42:27.528781] element 0: offset: 0x2aaaab039150, size: 24 [D 20:42:27.528800] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 52/70. [D 20:42:27.532581] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2935 [D 20:42:27.532612] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 53/70. [D 20:42:27.532660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 5749. [D 20:42:27.532677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 5750. [D 20:42:27.532692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5751. [D 20:42:27.532706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5752. [D 20:42:27.532729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5753. [D 20:42:27.532743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5754. [D 20:42:27.532759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5755. [D 20:42:27.532774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5756. [D 20:42:27.532789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5757. [D 20:42:27.532804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5758. [D 20:42:27.532819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5759. [D 20:42:27.532833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5760. [D 20:42:27.532849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5761. [D 20:42:27.532897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5762. [D 20:42:27.532916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5763. [D 20:42:27.532930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5764. [D 20:42:27.532945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5765. [D 20:42:27.532959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5766. [D 20:42:27.532974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5767. [D 20:42:27.532989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5768. [D 20:42:27.533003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5769. [D 20:42:27.533018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5770. [D 20:42:27.533033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5771. [D 20:42:27.533047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5772. [D 20:42:27.533062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5773. [D 20:42:27.533076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5774. [D 20:42:27.533091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5775. [D 20:42:27.533117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5776. [D 20:42:27.533140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5777. [D 20:42:27.533157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5778. [D 20:42:27.533172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5779. [D 20:42:27.533186] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5780. [D 20:42:27.538610] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5780. [D 20:42:27.538630] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 54/70. [D 20:42:27.538744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.538803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.538817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.563095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.563116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.563129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.563169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2938 [D 20:42:27.563184] element 0: offset: 0x2aaaab020500, size: 24 [D 20:42:27.563203] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 55/70. [D 20:42:27.567013] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2938 [D 20:42:27.567043] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 56/70. [D 20:42:27.567094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5780. [D 20:42:27.567111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5781. [D 20:42:27.567127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5782. [D 20:42:27.567141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5783. [D 20:42:27.567156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5784. [D 20:42:27.567171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5785. [D 20:42:27.567186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5786. [D 20:42:27.567201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5787. [D 20:42:27.567216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5788. [D 20:42:27.567230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5789. [D 20:42:27.567245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5790. [D 20:42:27.567260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5791. [D 20:42:27.567274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5792. [D 20:42:27.567289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5793. [D 20:42:27.567304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5794. [D 20:42:27.567319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5795. [D 20:42:27.567333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5796. [D 20:42:27.567348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5797. [D 20:42:27.567398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5798. [D 20:42:27.567419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5799. [D 20:42:27.567434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5800. [D 20:42:27.567448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5801. [D 20:42:27.567463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5802. [D 20:42:27.567478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5803. [D 20:42:27.567492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5804. [D 20:42:27.567507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5805. [D 20:42:27.567521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5806. [D 20:42:27.567536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5807. [D 20:42:27.567550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5808. [D 20:42:27.567568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5809. [D 20:42:27.567583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5810. [D 20:42:27.567597] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5811. [D 20:42:27.573040] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5811. [D 20:42:27.573060] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 57/70. [D 20:42:27.573174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.573234] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.573248] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.612946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.612967] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.612980] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.613020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2941 [D 20:42:27.613035] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:27.613054] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 58/70. [D 20:42:27.617030] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2941 [D 20:42:27.617064] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 59/70. [D 20:42:27.617118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5811. [D 20:42:27.617146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5812. [D 20:42:27.617162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5813. [D 20:42:27.617177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5814. [D 20:42:27.617192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5815. [D 20:42:27.617207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5816. [D 20:42:27.617221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5817. [D 20:42:27.617236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5818. [D 20:42:27.617251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5819. [D 20:42:27.617266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5820. [D 20:42:27.617306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5821. [D 20:42:27.617321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5822. [D 20:42:27.617344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5823. [D 20:42:27.617359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5824. [D 20:42:27.617374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5825. [D 20:42:27.617388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5826. [D 20:42:27.617403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5827. [D 20:42:27.617418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5828. [D 20:42:27.617433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5829. [D 20:42:27.617447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5830. [D 20:42:27.617462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5831. [D 20:42:27.617476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5832. [D 20:42:27.617501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5833. [D 20:42:27.617516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5834. [D 20:42:27.617531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5835. [D 20:42:27.617545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5836. [D 20:42:27.617569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5837. [D 20:42:27.617586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5838. [D 20:42:27.617601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5839. [D 20:42:27.617616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5840. [D 20:42:27.617632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5841. [D 20:42:27.617647] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5842. [D 20:42:27.623051] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5842. [D 20:42:27.623071] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 60/70. [D 20:42:27.626129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.626150] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.626167] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:27.674482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:27.674504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.674520] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:27.674548] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2944 [D 20:42:27.674564] element 0: offset: 0x2aaaab01c570, size: 24 [D 20:42:27.674579] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 0/70. [D 20:42:27.678246] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2944 [D 20:42:27.678271] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 1/70. [D 20:42:27.678326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5842. [D 20:42:27.678354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5843. [D 20:42:27.678370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5844. [D 20:42:27.678388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5845. [D 20:42:27.678405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5846. [D 20:42:27.678420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5847. [D 20:42:27.678435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5848. [D 20:42:27.678450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5849. [D 20:42:27.678464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5850. [D 20:42:27.678479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5851. [D 20:42:27.678522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5852. [D 20:42:27.678539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5853. [D 20:42:27.678560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5854. [D 20:42:27.678574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5855. [D 20:42:27.678589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5856. [D 20:42:27.678604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5857. [D 20:42:27.678618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5858. [D 20:42:27.678633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5859. [D 20:42:27.678648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5860. [D 20:42:27.678662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5861. [D 20:42:27.678677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5862. [D 20:42:27.678692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5863. [D 20:42:27.678706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5864. [D 20:42:27.678724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5865. [D 20:42:27.678740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5866. [D 20:42:27.678755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5867. [D 20:42:27.678770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5868. [D 20:42:27.678785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5869. [D 20:42:27.678813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5870. [D 20:42:27.678828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5871. [D 20:42:27.678881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5872. [D 20:42:27.678900] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5873. [D 20:42:27.684260] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5873. [D 20:42:27.684280] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 2/70. [D 20:42:27.687321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:27.687340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:27.687355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.003360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.003383] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.003400] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.003423] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2947 [D 20:42:28.003442] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:28.003459] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 3/70. [D 20:42:28.006902] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2947 [D 20:42:28.006926] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 4/70. [D 20:42:28.006981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 5873. [D 20:42:28.006998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 5874. [D 20:42:28.007013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5875. [D 20:42:28.007027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 5876. [D 20:42:28.007042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 5877. [D 20:42:28.007057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 5878. [D 20:42:28.007124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 5879. [D 20:42:28.007142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 5880. [D 20:42:28.007157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 5881. [D 20:42:28.007173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 5882. [D 20:42:28.007200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 5883. [D 20:42:28.007219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 5884. [D 20:42:28.007234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 5885. [D 20:42:28.007249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 5886. [D 20:42:28.007264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 5887. [D 20:42:28.007278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 5888. [D 20:42:28.007293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 5889. [D 20:42:28.007307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 5890. [D 20:42:28.007322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 5891. [D 20:42:28.007336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 5892. [D 20:42:28.007351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 5893. [D 20:42:28.007378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 5894. [D 20:42:28.007393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 5895. [D 20:42:28.007407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 5896. [D 20:42:28.007422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 5897. [D 20:42:28.007446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 5898. [D 20:42:28.007461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 5899. [D 20:42:28.007544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 5900. [D 20:42:28.007622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 5901. [D 20:42:28.007638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 5902. [D 20:42:28.007662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 5903. [D 20:42:28.007821] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 5904. [D 20:42:28.012911] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5904. [D 20:42:28.012935] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 5/70. [D 20:42:28.015759] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.015820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.015834] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.101220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.101241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.101254] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.101295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2950 [D 20:42:28.101311] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:28.101330] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 6/70. [D 20:42:28.105303] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2950 [D 20:42:28.105340] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 7/70. [D 20:42:28.105406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5904. [D 20:42:28.105423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5905. [D 20:42:28.105438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 5906. [D 20:42:28.105453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 5907. [D 20:42:28.105468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 5908. [D 20:42:28.105482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 5909. [D 20:42:28.105498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 5910. [D 20:42:28.105518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5911. [D 20:42:28.105533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5912. [D 20:42:28.105548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5913. [D 20:42:28.105569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 5914. [D 20:42:28.105583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 5915. [D 20:42:28.105599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 5916. [D 20:42:28.105613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 5917. [D 20:42:28.105648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 5918. [D 20:42:28.105666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5919. [D 20:42:28.105680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5920. [D 20:42:28.105695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5921. [D 20:42:28.105710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 5922. [D 20:42:28.105725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 5923. [D 20:42:28.105740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 5924. [D 20:42:28.105770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 5925. [D 20:42:28.105812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 5926. [D 20:42:28.105832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5927. [D 20:42:28.105852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5928. [D 20:42:28.105869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5929. [D 20:42:28.105883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 5930. [D 20:42:28.105898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 5931. [D 20:42:28.105913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 5932. [D 20:42:28.105941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 5933. [D 20:42:28.105956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 5934. [D 20:42:28.105975] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5935. [D 20:42:28.111356] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5935. [D 20:42:28.111376] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 8/70. [D 20:42:28.114440] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.114460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.114476] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.185671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.185693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.185710] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.185734] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2953 [D 20:42:28.185752] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:28.185768] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 9/70. [D 20:42:28.189463] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2953 [D 20:42:28.189494] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 10/70. [D 20:42:28.189545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5935. [D 20:42:28.189562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5936. [D 20:42:28.189576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5937. [D 20:42:28.189591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5938. [D 20:42:28.189619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5939. [D 20:42:28.189634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5940. [D 20:42:28.189648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5941. [D 20:42:28.189665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5942. [D 20:42:28.189679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5943. [D 20:42:28.189694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5944. [D 20:42:28.189710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5945. [D 20:42:28.189742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5946. [D 20:42:28.189760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5947. [D 20:42:28.189781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5948. [D 20:42:28.189796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5949. [D 20:42:28.189810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5950. [D 20:42:28.189836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5951. [D 20:42:28.189851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5952. [D 20:42:28.189866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5953. [D 20:42:28.189880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5954. [D 20:42:28.189895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5955. [D 20:42:28.189920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5956. [D 20:42:28.189935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5957. [D 20:42:28.189950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5958. [D 20:42:28.189965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5959. [D 20:42:28.189984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5960. [D 20:42:28.189999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5961. [D 20:42:28.190014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5962. [D 20:42:28.190028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5963. [D 20:42:28.190043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5964. [D 20:42:28.190058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5965. [D 20:42:28.190073] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5966. [D 20:42:28.195506] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5966. [D 20:42:28.195526] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 11/70. [D 20:42:28.198604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.198623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.198640] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.255715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.255737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.255754] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.255777] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2956 [D 20:42:28.255795] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:28.255812] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 12/70. [D 20:42:28.259481] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2956 [D 20:42:28.259505] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 13/70. [D 20:42:28.259561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 5966. [D 20:42:28.259581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 5967. [D 20:42:28.259608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 5968. [D 20:42:28.259623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 5969. [D 20:42:28.259640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 5970. [D 20:42:28.259655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 5971. [D 20:42:28.259670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 5972. [D 20:42:28.259685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 5973. [D 20:42:28.259700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 5974. [D 20:42:28.259715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 5975. [D 20:42:28.259730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 5976. [D 20:42:28.259745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 5977. [D 20:42:28.259760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 5978. [D 20:42:28.259785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 5979. [D 20:42:28.259800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 5980. [D 20:42:28.259815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 5981. [D 20:42:28.259830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 5982. [D 20:42:28.259845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 5983. [D 20:42:28.259861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 5984. [D 20:42:28.259908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 5985. [D 20:42:28.259928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 5986. [D 20:42:28.259943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 5987. [D 20:42:28.259958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 5988. [D 20:42:28.259973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 5989. [D 20:42:28.259987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 5990. [D 20:42:28.260002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 5991. [D 20:42:28.260017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 5992. [D 20:42:28.260031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 5993. [D 20:42:28.260046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 5994. [D 20:42:28.260061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 5995. [D 20:42:28.260086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 5996. [D 20:42:28.260101] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 5997. [D 20:42:28.265529] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 5997. [D 20:42:28.265550] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 14/70. [D 20:42:28.267625] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.267686] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.267700] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.331820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.331841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.331854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.331895] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2959 [D 20:42:28.331910] element 0: offset: 0x2aaaab0267b0, size: 24 [D 20:42:28.331929] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 15/70. [D 20:42:28.335614] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2959 [D 20:42:28.335642] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 16/70. [D 20:42:28.335695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 5997. [D 20:42:28.335714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 5998. [D 20:42:28.335729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 5999. [D 20:42:28.335743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 6000. [D 20:42:28.335759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 6001. [D 20:42:28.335773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 6002. [D 20:42:28.335788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 6003. [D 20:42:28.335803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6004. [D 20:42:28.335818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6005. [D 20:42:28.335833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6006. [D 20:42:28.335847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 6007. [D 20:42:28.335862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 6008. [D 20:42:28.335882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 6009. [D 20:42:28.335897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 6010. [D 20:42:28.335912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 6011. [D 20:42:28.335938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6012. [D 20:42:28.335954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6013. [D 20:42:28.335968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6014. [D 20:42:28.335983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 6015. [D 20:42:28.335998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 6016. [D 20:42:28.336013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 6017. [D 20:42:28.336027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 6018. [D 20:42:28.336042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 6019. [D 20:42:28.336056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6020. [D 20:42:28.336071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6021. [D 20:42:28.336086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6022. [D 20:42:28.336101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 6023. [D 20:42:28.336115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 6024. [D 20:42:28.336130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 6025. [D 20:42:28.336144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 6026. [D 20:42:28.336163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 6027. [D 20:42:28.336178] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6028. [D 20:42:28.341626] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6028. [D 20:42:28.341646] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 17/70. [D 20:42:28.341902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.341965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.341979] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.401841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.401864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.401877] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.401917] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2963 [D 20:42:28.401932] element 0: offset: 0x2aaaab020500, size: 24 [D 20:42:28.401951] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 18/70. [D 20:42:28.405880] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2963 [D 20:42:28.405905] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 19/70. [D 20:42:28.405959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6028. [D 20:42:28.405978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 6029. [D 20:42:28.405993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 6030. [D 20:42:28.406007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 6031. [D 20:42:28.406022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 6032. [D 20:42:28.406037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 6033. [D 20:42:28.406057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6034. [D 20:42:28.406072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6035. [D 20:42:28.406086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6036. [D 20:42:28.406101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 6037. [D 20:42:28.406116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 6038. [D 20:42:28.406131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 6039. [D 20:42:28.406146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 6040. [D 20:42:28.406161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 6041. [D 20:42:28.406176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6042. [D 20:42:28.406191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6043. [D 20:42:28.406206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6044. [D 20:42:28.406220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6045. [D 20:42:28.406235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6046. [D 20:42:28.406249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6047. [D 20:42:28.406264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6048. [D 20:42:28.406285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6049. [D 20:42:28.406299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6050. [D 20:42:28.406314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6051. [D 20:42:28.406329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6052. [D 20:42:28.406343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6053. [D 20:42:28.406358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6054. [D 20:42:28.406372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6055. [D 20:42:28.406387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6056. [D 20:42:28.406401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6057. [D 20:42:28.406417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6058. [D 20:42:28.406432] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6059. [D 20:42:28.411894] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6059. [D 20:42:28.411914] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 20/70. [D 20:42:28.412032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.412092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.412106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.534541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.534562] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.534575] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.534615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2965 [D 20:42:28.534630] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:28.534649] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 21/70. [D 20:42:28.538427] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2965 [D 20:42:28.538463] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 22/70. [D 20:42:28.538620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6059. [D 20:42:28.538644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6060. [D 20:42:28.538684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6061. [D 20:42:28.538703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6062. [D 20:42:28.538721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6063. [D 20:42:28.538739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6064. [D 20:42:28.538758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6065. [D 20:42:28.538776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6066. [D 20:42:28.538795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6067. [D 20:42:28.538813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6068. [D 20:42:28.538831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6069. [D 20:42:28.538860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6070. [D 20:42:28.538878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6071. [D 20:42:28.538897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6072. [D 20:42:28.538915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6073. [D 20:42:28.538933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6074. [D 20:42:28.538952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6075. [D 20:42:28.538968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6076. [D 20:42:28.538989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6077. [D 20:42:28.539007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6078. [D 20:42:28.539025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6079. [D 20:42:28.539043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6080. [D 20:42:28.539071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6081. [D 20:42:28.539089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6082. [D 20:42:28.539108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6083. [D 20:42:28.539126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6084. [D 20:42:28.539144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6085. [D 20:42:28.539162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6086. [D 20:42:28.539180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6087. [D 20:42:28.539199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6088. [D 20:42:28.539217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6089. [D 20:42:28.539233] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6090. [D 20:42:28.544506] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6090. [D 20:42:28.544529] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 23/70. [D 20:42:28.544640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.544693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.544707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.602785] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.602805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.602818] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.602856] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2968 [D 20:42:28.602871] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:28.602890] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 24/70. [D 20:42:28.606749] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2968 [D 20:42:28.606784] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 25/70. [D 20:42:28.606834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6090. [D 20:42:28.606851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6091. [D 20:42:28.606866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6092. [D 20:42:28.606881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6093. [D 20:42:28.606896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6094. [D 20:42:28.606911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6095. [D 20:42:28.606926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6096. [D 20:42:28.606941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6097. [D 20:42:28.606965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6098. [D 20:42:28.606980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6099. [D 20:42:28.606995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6100. [D 20:42:28.607015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 6101. [D 20:42:28.607029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 6102. [D 20:42:28.607044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 6103. [D 20:42:28.607075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 6104. [D 20:42:28.607090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 6105. [D 20:42:28.607117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 6106. [D 20:42:28.607131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 6107. [D 20:42:28.607146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 6108. [D 20:42:28.607161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 6109. [D 20:42:28.607176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 6110. [D 20:42:28.607191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 6111. [D 20:42:28.607205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 6112. [D 20:42:28.607220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 6113. [D 20:42:28.607288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 6114. [D 20:42:28.607304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 6115. [D 20:42:28.607331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 6116. [D 20:42:28.607346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 6117. [D 20:42:28.607360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 6118. [D 20:42:28.607375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 6119. [D 20:42:28.607390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 6120. [D 20:42:28.607404] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 6121. [D 20:42:28.612715] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6121. [D 20:42:28.612734] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 26/70. [D 20:42:28.612847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.612900] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.612913] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.632157] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.632177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.632190] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.632228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2972 [D 20:42:28.632243] element 0: offset: 0x2aaaab005960, size: 24 [D 20:42:28.632262] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 27/70. [D 20:42:28.635602] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2972 [D 20:42:28.635626] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 28/70. [D 20:42:28.635675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6121. [D 20:42:28.635693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 6122. [D 20:42:28.635707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 6123. [D 20:42:28.635728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 6124. [D 20:42:28.635743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 6125. [D 20:42:28.635760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 6126. [D 20:42:28.635775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6127. [D 20:42:28.635790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6128. [D 20:42:28.635804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6129. [D 20:42:28.635819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 6130. [D 20:42:28.635834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 6131. [D 20:42:28.635849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 6132. [D 20:42:28.635864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 6133. [D 20:42:28.635879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 6134. [D 20:42:28.635893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6135. [D 20:42:28.635908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6136. [D 20:42:28.635923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6137. [D 20:42:28.635943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6138. [D 20:42:28.635960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6139. [D 20:42:28.635974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6140. [D 20:42:28.635989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6141. [D 20:42:28.636010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6142. [D 20:42:28.636024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6143. [D 20:42:28.636040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6144. [D 20:42:28.636054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6145. [D 20:42:28.636069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6146. [D 20:42:28.636084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6147. [D 20:42:28.636128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6148. [D 20:42:28.636143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6149. [D 20:42:28.636157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6150. [D 20:42:28.636171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6151. [D 20:42:28.636186] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6152. [D 20:42:28.643552] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6152. [D 20:42:28.643580] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 29/70. [D 20:42:28.643755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.643808] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.643822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.653676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.653697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.653710] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.653746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2974 [D 20:42:28.653761] element 0: offset: 0x2aaaab019c70, size: 24 [D 20:42:28.653780] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 30/70. [D 20:42:28.657621] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2974 [D 20:42:28.657657] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 31/70. [D 20:42:28.657712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 6152. [D 20:42:28.657730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 6153. [D 20:42:28.657745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 6154. [D 20:42:28.657760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 6155. [D 20:42:28.657775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 6156. [D 20:42:28.657790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 6157. [D 20:42:28.657805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 6158. [D 20:42:28.657839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6159. [D 20:42:28.657854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6160. [D 20:42:28.657868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6161. [D 20:42:28.657890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 6162. [D 20:42:28.657904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 6163. [D 20:42:28.657919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 6164. [D 20:42:28.657934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 6165. [D 20:42:28.657949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 6166. [D 20:42:28.657964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6167. [D 20:42:28.657986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6168. [D 20:42:28.658003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6169. [D 20:42:28.658018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 6170. [D 20:42:28.658032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 6171. [D 20:42:28.658047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 6172. [D 20:42:28.658062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 6173. [D 20:42:28.658077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 6174. [D 20:42:28.658092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6175. [D 20:42:28.658164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6176. [D 20:42:28.658184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6177. [D 20:42:28.658201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 6178. [D 20:42:28.658216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 6179. [D 20:42:28.658230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 6180. [D 20:42:28.658245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 6181. [D 20:42:28.658260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 6182. [D 20:42:28.658293] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6183. [D 20:42:28.663636] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6183. [D 20:42:28.663656] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 32/70. [D 20:42:28.663767] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.663819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.663833] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.695919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.695941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.695954] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.695991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2978 [D 20:42:28.696006] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:28.696025] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 33/70. [D 20:42:28.699708] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2978 [D 20:42:28.699741] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 34/70. [D 20:42:28.699893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6183. [D 20:42:28.699917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 6184. [D 20:42:28.699940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 6185. [D 20:42:28.699959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 6186. [D 20:42:28.699982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 6187. [D 20:42:28.700000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 6188. [D 20:42:28.700018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6189. [D 20:42:28.700034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6190. [D 20:42:28.700049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6191. [D 20:42:28.700067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 6192. [D 20:42:28.700086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 6193. [D 20:42:28.700104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 6194. [D 20:42:28.700122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 6195. [D 20:42:28.700141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 6196. [D 20:42:28.700159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6197. [D 20:42:28.700177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6198. [D 20:42:28.700196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6199. [D 20:42:28.700214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6200. [D 20:42:28.700232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6201. [D 20:42:28.700251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6202. [D 20:42:28.700269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6203. [D 20:42:28.700287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6204. [D 20:42:28.700306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6205. [D 20:42:28.700324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6206. [D 20:42:28.700342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6207. [D 20:42:28.700361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6208. [D 20:42:28.700379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6209. [D 20:42:28.700397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6210. [D 20:42:28.700415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6211. [D 20:42:28.700434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6212. [D 20:42:28.700453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6213. [D 20:42:28.700468] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6214. [D 20:42:28.705840] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6214. [D 20:42:28.705865] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 35/70. [D 20:42:28.705975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.706037] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.706052] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.745178] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.745198] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.745211] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.745250] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2980 [D 20:42:28.745265] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:28.745285] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 36/70. [D 20:42:28.749038] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2980 [D 20:42:28.749070] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 37/70. [D 20:42:28.749121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6214. [D 20:42:28.749138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6215. [D 20:42:28.749154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6216. [D 20:42:28.749168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6217. [D 20:42:28.749186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6218. [D 20:42:28.749200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6219. [D 20:42:28.749215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6220. [D 20:42:28.749230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6221. [D 20:42:28.749245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6222. [D 20:42:28.749260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6223. [D 20:42:28.749275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6224. [D 20:42:28.749320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6225. [D 20:42:28.749335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6226. [D 20:42:28.749354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6227. [D 20:42:28.749369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6228. [D 20:42:28.749383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6229. [D 20:42:28.749398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6230. [D 20:42:28.749413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6231. [D 20:42:28.749427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6232. [D 20:42:28.749442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6233. [D 20:42:28.749457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6234. [D 20:42:28.749472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6235. [D 20:42:28.749486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6236. [D 20:42:28.749501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6237. [D 20:42:28.749516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6238. [D 20:42:28.749530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6239. [D 20:42:28.749545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6240. [D 20:42:28.749564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6241. [D 20:42:28.749579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6242. [D 20:42:28.749594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6243. [D 20:42:28.749609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6244. [D 20:42:28.749624] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6245. [D 20:42:28.755083] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6245. [D 20:42:28.755103] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 38/70. [D 20:42:28.755218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.755277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.755291] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.870201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.870223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.870236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.870276] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2984 [D 20:42:28.870291] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:28.870310] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 39/70. [D 20:42:28.874181] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2984 [D 20:42:28.874221] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 40/70. [D 20:42:28.874282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 6245. [D 20:42:28.874299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 6246. [D 20:42:28.874314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 6247. [D 20:42:28.874330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 6248. [D 20:42:28.874345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 6249. [D 20:42:28.874360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 6250. [D 20:42:28.874375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6251. [D 20:42:28.874400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6252. [D 20:42:28.874415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6253. [D 20:42:28.874430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 6254. [D 20:42:28.874450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 6255. [D 20:42:28.874465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 6256. [D 20:42:28.874480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 6257. [D 20:42:28.874506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 6258. [D 20:42:28.874528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6259. [D 20:42:28.874545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6260. [D 20:42:28.874560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6261. [D 20:42:28.874575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 6262. [D 20:42:28.874591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 6263. [D 20:42:28.874606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 6264. [D 20:42:28.874621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 6265. [D 20:42:28.874636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 6266. [D 20:42:28.874681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6267. [D 20:42:28.874696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6268. [D 20:42:28.874732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6269. [D 20:42:28.874747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 6270. [D 20:42:28.874762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 6271. [D 20:42:28.874777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 6272. [D 20:42:28.874792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 6273. [D 20:42:28.874807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 6274. [D 20:42:28.874821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6275. [D 20:42:28.874836] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6276. [D 20:42:28.880158] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6276. [D 20:42:28.880178] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 41/70. [D 20:42:28.880289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.880342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.880355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.928232] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.928253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.928266] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.928303] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2986 [D 20:42:28.928318] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:28.928337] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 42/70. [D 20:42:28.931612] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2986 [D 20:42:28.931638] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 43/70. [D 20:42:28.931695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6276. [D 20:42:28.931713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6277. [D 20:42:28.931728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 6278. [D 20:42:28.931742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 6279. [D 20:42:28.931757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 6280. [D 20:42:28.931772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 6281. [D 20:42:28.931787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 6282. [D 20:42:28.931833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6283. [D 20:42:28.931848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6284. [D 20:42:28.931863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6285. [D 20:42:28.931878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 6286. [D 20:42:28.931893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 6287. [D 20:42:28.931907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 6288. [D 20:42:28.931922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 6289. [D 20:42:28.931936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 6290. [D 20:42:28.931951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6291. [D 20:42:28.931966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6292. [D 20:42:28.931980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6293. [D 20:42:28.931995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6294. [D 20:42:28.932010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6295. [D 20:42:28.932024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6296. [D 20:42:28.932039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6297. [D 20:42:28.932054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6298. [D 20:42:28.932068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6299. [D 20:42:28.932086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6300. [D 20:42:28.932100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6301. [D 20:42:28.932116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6302. [D 20:42:28.932131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6303. [D 20:42:28.932145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6304. [D 20:42:28.932160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6305. [D 20:42:28.932175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6306. [D 20:42:28.932190] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6307. [D 20:42:28.937576] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6307. [D 20:42:28.937596] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 44/70. [D 20:42:28.937708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.937760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.937773] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:28.957062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:28.957083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.957096] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:28.957133] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2989 [D 20:42:28.957148] element 0: offset: 0x2aaaab020600, size: 24 [D 20:42:28.957167] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 45/70. [D 20:42:28.961017] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2989 [D 20:42:28.961053] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 46/70. [D 20:42:28.961105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6307. [D 20:42:28.961135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6308. [D 20:42:28.961151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6309. [D 20:42:28.961166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6310. [D 20:42:28.961181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6311. [D 20:42:28.961209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6312. [D 20:42:28.961224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6313. [D 20:42:28.961246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6314. [D 20:42:28.961260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6315. [D 20:42:28.961275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6316. [D 20:42:28.961290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6317. [D 20:42:28.961305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6318. [D 20:42:28.961330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6319. [D 20:42:28.961345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6320. [D 20:42:28.961360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6321. [D 20:42:28.961375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6322. [D 20:42:28.961389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6323. [D 20:42:28.961405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6324. [D 20:42:28.961419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6325. [D 20:42:28.961434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6326. [D 20:42:28.961449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6327. [D 20:42:28.961464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6328. [D 20:42:28.961478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6329. [D 20:42:28.961494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6330. [D 20:42:28.961543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6331. [D 20:42:28.961562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6332. [D 20:42:28.961583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6333. [D 20:42:28.961600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6334. [D 20:42:28.961614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6335. [D 20:42:28.961629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6336. [D 20:42:28.961644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6337. [D 20:42:28.961659] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6338. [D 20:42:28.967073] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6338. [D 20:42:28.967093] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 47/70. [D 20:42:28.967205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:28.967258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:28.967271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.038915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.038937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.038951] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.038989] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2992 [D 20:42:29.039004] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:29.039023] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 48/70. [D 20:42:29.042718] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2992 [D 20:42:29.042747] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 49/70. [D 20:42:29.042806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6338. [D 20:42:29.042823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6339. [D 20:42:29.042838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6340. [D 20:42:29.042852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6341. [D 20:42:29.042867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6342. [D 20:42:29.042882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6343. [D 20:42:29.042897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6344. [D 20:42:29.042912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6345. [D 20:42:29.042927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6346. [D 20:42:29.042954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6347. [D 20:42:29.042969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6348. [D 20:42:29.042984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6349. [D 20:42:29.042998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6350. [D 20:42:29.043013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6351. [D 20:42:29.043028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6352. [D 20:42:29.043042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6353. [D 20:42:29.043057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6354. [D 20:42:29.043072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6355. [D 20:42:29.043086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6356. [D 20:42:29.043101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6357. [D 20:42:29.043116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6358. [D 20:42:29.043131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6359. [D 20:42:29.043165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6360. [D 20:42:29.043180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6361. [D 20:42:29.043194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6362. [D 20:42:29.043209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6363. [D 20:42:29.043224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6364. [D 20:42:29.043279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6365. [D 20:42:29.043294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6366. [D 20:42:29.043309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6367. [D 20:42:29.043330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6368. [D 20:42:29.043351] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6369. [D 20:42:29.048694] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6369. [D 20:42:29.048714] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 50/70. [D 20:42:29.048824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.048877] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.048890] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.100670] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.100691] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.100705] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.100742] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2995 [D 20:42:29.100757] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:29.100776] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 51/70. [D 20:42:29.104604] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2995 [D 20:42:29.104634] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 52/70. [D 20:42:29.104683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6369. [D 20:42:29.104700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6370. [D 20:42:29.104715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6371. [D 20:42:29.104730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6372. [D 20:42:29.104744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6373. [D 20:42:29.104759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6374. [D 20:42:29.104774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6375. [D 20:42:29.104789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6376. [D 20:42:29.104825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6377. [D 20:42:29.104855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6378. [D 20:42:29.104880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6379. [D 20:42:29.104895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6380. [D 20:42:29.104910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6381. [D 20:42:29.104924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6382. [D 20:42:29.104939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6383. [D 20:42:29.104954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6384. [D 20:42:29.104980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6385. [D 20:42:29.104996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6386. [D 20:42:29.105010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6387. [D 20:42:29.105025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6388. [D 20:42:29.105040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6389. [D 20:42:29.105068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6390. [D 20:42:29.105083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6391. [D 20:42:29.105098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6392. [D 20:42:29.105160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6393. [D 20:42:29.105179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6394. [D 20:42:29.105195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6395. [D 20:42:29.105210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6396. [D 20:42:29.105224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6397. [D 20:42:29.105240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6398. [D 20:42:29.105255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6399. [D 20:42:29.105270] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6400. [D 20:42:29.110567] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6400. [D 20:42:29.110587] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 53/70. [D 20:42:29.113593] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.113614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.113629] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.139588] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.139609] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.139623] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.139654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 2998 [D 20:42:29.139673] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:29.142041] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 54/70. [D 20:42:29.145700] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 2998 [D 20:42:29.145732] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 55/70. [D 20:42:29.145785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6400. [D 20:42:29.145801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6401. [D 20:42:29.145816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6402. [D 20:42:29.145831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6403. [D 20:42:29.145848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6404. [D 20:42:29.145863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6405. [D 20:42:29.145893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6406. [D 20:42:29.145917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6407. [D 20:42:29.145932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6408. [D 20:42:29.145947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6409. [D 20:42:29.145966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6410. [D 20:42:29.145980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 6411. [D 20:42:29.145995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 6412. [D 20:42:29.146009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 6413. [D 20:42:29.146024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 6414. [D 20:42:29.146046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 6415. [D 20:42:29.146072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 6416. [D 20:42:29.146088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 6417. [D 20:42:29.146102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 6418. [D 20:42:29.146130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 6419. [D 20:42:29.146145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 6420. [D 20:42:29.146202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 6421. [D 20:42:29.146228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 6422. [D 20:42:29.146243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 6423. [D 20:42:29.146258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 6424. [D 20:42:29.146272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 6425. [D 20:42:29.146287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 6426. [D 20:42:29.146302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 6427. [D 20:42:29.146317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 6428. [D 20:42:29.146331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 6429. [D 20:42:29.146349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 6430. [D 20:42:29.146364] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 6431. [D 20:42:29.152921] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6431. [D 20:42:29.152941] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 56/70. [D 20:42:29.153142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.153196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.153209] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.163063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.163084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.163097] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.163137] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3001 [D 20:42:29.163152] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:29.163171] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 57/70. [D 20:42:29.166890] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3001 [D 20:42:29.166919] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 58/70. [D 20:42:29.166974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6431. [D 20:42:29.167004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6432. [D 20:42:29.167019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 6433. [D 20:42:29.167034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 6434. [D 20:42:29.167049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 6435. [D 20:42:29.167066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 6436. [D 20:42:29.167080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 6437. [D 20:42:29.167095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6438. [D 20:42:29.167115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6439. [D 20:42:29.167130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6440. [D 20:42:29.167145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 6441. [D 20:42:29.167159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 6442. [D 20:42:29.167177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 6443. [D 20:42:29.167194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 6444. [D 20:42:29.167209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 6445. [D 20:42:29.167223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6446. [D 20:42:29.167238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6447. [D 20:42:29.167266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6448. [D 20:42:29.167282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6449. [D 20:42:29.167324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6450. [D 20:42:29.167340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6451. [D 20:42:29.167361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6452. [D 20:42:29.167380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6453. [D 20:42:29.167394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6454. [D 20:42:29.167409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6455. [D 20:42:29.167424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6456. [D 20:42:29.167439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6457. [D 20:42:29.167453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6458. [D 20:42:29.167477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6459. [D 20:42:29.167492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6460. [D 20:42:29.167506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6461. [D 20:42:29.167521] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6462. [D 20:42:29.172914] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6462. [D 20:42:29.172934] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 59/70. [D 20:42:29.173046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.173098] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.173111] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.259233] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.259254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.259268] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.259306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3004 [D 20:42:29.259321] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:29.259340] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 60/70. [D 20:42:29.263176] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3004 [D 20:42:29.263214] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 0/70. [D 20:42:29.263267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6462. [D 20:42:29.263287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6463. [D 20:42:29.263302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6464. [D 20:42:29.263316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6465. [D 20:42:29.263331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6466. [D 20:42:29.263346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6467. [D 20:42:29.263377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6468. [D 20:42:29.263411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6469. [D 20:42:29.263426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6470. [D 20:42:29.263440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6471. [D 20:42:29.263455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6472. [D 20:42:29.263470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6473. [D 20:42:29.263484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6474. [D 20:42:29.263513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6475. [D 20:42:29.263528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6476. [D 20:42:29.263542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6477. [D 20:42:29.263557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6478. [D 20:42:29.263572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6479. [D 20:42:29.263591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6480. [D 20:42:29.263606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6481. [D 20:42:29.263622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6482. [D 20:42:29.263637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6483. [D 20:42:29.263651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6484. [D 20:42:29.263666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6485. [D 20:42:29.263689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6486. [D 20:42:29.263743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6487. [D 20:42:29.263758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6488. [D 20:42:29.263778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6489. [D 20:42:29.263798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6490. [D 20:42:29.263815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6491. [D 20:42:29.263829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6492. [D 20:42:29.263844] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6493. [D 20:42:29.269189] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6493. [D 20:42:29.269209] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 1/70. [D 20:42:29.269321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.269373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.269387] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.298363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.298384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.298397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.298435] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3008 [D 20:42:29.298450] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:29.298469] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 2/70. [D 20:42:29.302363] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3008 [D 20:42:29.302408] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 3/70. [D 20:42:29.302458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 6493. [D 20:42:29.302474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 6494. [D 20:42:29.302489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 6495. [D 20:42:29.302504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 6496. [D 20:42:29.302518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 6497. [D 20:42:29.302533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 6498. [D 20:42:29.302548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6499. [D 20:42:29.302563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6500. [D 20:42:29.302609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6501. [D 20:42:29.302634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 6502. [D 20:42:29.302650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 6503. [D 20:42:29.302664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 6504. [D 20:42:29.302678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 6505. [D 20:42:29.302694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 6506. [D 20:42:29.302717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6507. [D 20:42:29.302732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6508. [D 20:42:29.302747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6509. [D 20:42:29.302762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 6510. [D 20:42:29.302777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 6511. [D 20:42:29.302792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 6512. [D 20:42:29.302807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 6513. [D 20:42:29.302822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 6514. [D 20:42:29.302837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6515. [D 20:42:29.302864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6516. [D 20:42:29.302912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6517. [D 20:42:29.302933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 6518. [D 20:42:29.302951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 6519. [D 20:42:29.302968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 6520. [D 20:42:29.302983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 6521. [D 20:42:29.302998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 6522. [D 20:42:29.303012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6523. [D 20:42:29.303028] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6524. [D 20:42:29.308418] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6524. [D 20:42:29.308438] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 4/70. [D 20:42:29.308551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.308603] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.308617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.448965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.448987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.449000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.449038] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3011 [D 20:42:29.449053] element 0: offset: 0x2aaaab014ca0, size: 24 [D 20:42:29.449072] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 5/70. [D 20:42:29.452887] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3011 [D 20:42:29.452937] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 6/70. [D 20:42:29.452992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 6524. [D 20:42:29.453008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 6525. [D 20:42:29.453023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 6526. [D 20:42:29.453038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 6527. [D 20:42:29.453053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 6528. [D 20:42:29.453067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 6529. [D 20:42:29.453082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6530. [D 20:42:29.453103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6531. [D 20:42:29.453133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6532. [D 20:42:29.453148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 6533. [D 20:42:29.453162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 6534. [D 20:42:29.453177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 6535. [D 20:42:29.453202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 6536. [D 20:42:29.453217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 6537. [D 20:42:29.453232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6538. [D 20:42:29.453257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6539. [D 20:42:29.453272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6540. [D 20:42:29.453287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 6541. [D 20:42:29.453301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 6542. [D 20:42:29.453317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 6543. [D 20:42:29.453339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 6544. [D 20:42:29.453394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 6545. [D 20:42:29.453414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6546. [D 20:42:29.453436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6547. [D 20:42:29.453452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6548. [D 20:42:29.453466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 6549. [D 20:42:29.453481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 6550. [D 20:42:29.453496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 6551. [D 20:42:29.453511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 6552. [D 20:42:29.453526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 6553. [D 20:42:29.453540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6554. [D 20:42:29.453558] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6555. [D 20:42:29.458918] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6555. [D 20:42:29.458938] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 7/70. [D 20:42:29.461937] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.461957] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.461974] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.560572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.560597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.560614] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.560638] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3013 [D 20:42:29.560657] element 0: offset: 0x2aaaab020600, size: 24 [D 20:42:29.560674] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 8/70. [D 20:42:29.564385] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3013 [D 20:42:29.564409] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 9/70. [D 20:42:29.564471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6555. [D 20:42:29.564501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6556. [D 20:42:29.564517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 6557. [D 20:42:29.564534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 6558. [D 20:42:29.564549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 6559. [D 20:42:29.564564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 6560. [D 20:42:29.564579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 6561. [D 20:42:29.564597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6562. [D 20:42:29.564613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6563. [D 20:42:29.564639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6564. [D 20:42:29.564654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 6565. [D 20:42:29.564675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 6566. [D 20:42:29.564695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 6567. [D 20:42:29.564710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 6568. [D 20:42:29.564724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 6569. [D 20:42:29.564739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6570. [D 20:42:29.564754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6571. [D 20:42:29.564769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6572. [D 20:42:29.564783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6573. [D 20:42:29.564810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6574. [D 20:42:29.564824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6575. [D 20:42:29.564839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6576. [D 20:42:29.564863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6577. [D 20:42:29.564883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6578. [D 20:42:29.564898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6579. [D 20:42:29.564912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6580. [D 20:42:29.564928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6581. [D 20:42:29.564942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6582. [D 20:42:29.564957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6583. [D 20:42:29.564972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6584. [D 20:42:29.564986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6585. [D 20:42:29.565057] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6586. [D 20:42:29.570449] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6586. [D 20:42:29.570468] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 10/70. [D 20:42:29.571673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.571734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.571748] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.617843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.617864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.617877] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.617918] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3016 [D 20:42:29.617934] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:29.617954] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 11/70. [D 20:42:29.621861] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3016 [D 20:42:29.621904] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 12/70. [D 20:42:29.621963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6586. [D 20:42:29.621980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6587. [D 20:42:29.621994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6588. [D 20:42:29.622009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6589. [D 20:42:29.622024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6590. [D 20:42:29.622039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6591. [D 20:42:29.622053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6592. [D 20:42:29.622068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6593. [D 20:42:29.622092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6594. [D 20:42:29.622107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6595. [D 20:42:29.622121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6596. [D 20:42:29.622142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6597. [D 20:42:29.622157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6598. [D 20:42:29.622171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6599. [D 20:42:29.622197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6600. [D 20:42:29.622212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6601. [D 20:42:29.622231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6602. [D 20:42:29.622246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6603. [D 20:42:29.622261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6604. [D 20:42:29.622275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6605. [D 20:42:29.622290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6606. [D 20:42:29.622305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6607. [D 20:42:29.622320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6608. [D 20:42:29.622342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6609. [D 20:42:29.622401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6610. [D 20:42:29.622422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6611. [D 20:42:29.622439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6612. [D 20:42:29.622453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6613. [D 20:42:29.622468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6614. [D 20:42:29.622482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6615. [D 20:42:29.622497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6616. [D 20:42:29.622512] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6617. [D 20:42:29.627887] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6617. [D 20:42:29.627907] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 13/70. [D 20:42:29.628019] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.628072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.628085] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.698029] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.698050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.698064] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.698102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3020 [D 20:42:29.698117] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:29.698137] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 14/70. [D 20:42:29.702004] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3020 [D 20:42:29.702042] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 15/70. [D 20:42:29.702110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 6617. [D 20:42:29.702127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 6618. [D 20:42:29.702142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 6619. [D 20:42:29.702157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 6620. [D 20:42:29.702172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 6621. [D 20:42:29.702187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 6622. [D 20:42:29.702218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6623. [D 20:42:29.702233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6624. [D 20:42:29.702248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6625. [D 20:42:29.702269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 6626. [D 20:42:29.702283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 6627. [D 20:42:29.702298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 6628. [D 20:42:29.702313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 6629. [D 20:42:29.702338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 6630. [D 20:42:29.702354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6631. [D 20:42:29.702368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6632. [D 20:42:29.702383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6633. [D 20:42:29.702398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 6634. [D 20:42:29.702412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 6635. [D 20:42:29.702427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 6636. [D 20:42:29.702442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 6637. [D 20:42:29.702457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 6638. [D 20:42:29.702500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6639. [D 20:42:29.702515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6640. [D 20:42:29.702539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6641. [D 20:42:29.702564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 6642. [D 20:42:29.702579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 6643. [D 20:42:29.702594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 6644. [D 20:42:29.702609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 6645. [D 20:42:29.702624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 6646. [D 20:42:29.702639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6647. [D 20:42:29.702654] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6648. [D 20:42:29.708067] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6648. [D 20:42:29.708087] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 16/70. [D 20:42:29.708199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.708252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.708265] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.788932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.788953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.788966] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.789003] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3022 [D 20:42:29.789019] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:29.789038] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 17/70. [D 20:42:29.792867] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3022 [D 20:42:29.792913] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 18/70. [D 20:42:29.792967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6648. [D 20:42:29.792984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6649. [D 20:42:29.792999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6650. [D 20:42:29.793014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6651. [D 20:42:29.793028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6652. [D 20:42:29.793043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6653. [D 20:42:29.793058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6654. [D 20:42:29.793079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6655. [D 20:42:29.793094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6656. [D 20:42:29.793109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6657. [D 20:42:29.793138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6658. [D 20:42:29.793164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6659. [D 20:42:29.793178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6660. [D 20:42:29.793193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6661. [D 20:42:29.793209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6662. [D 20:42:29.793226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6663. [D 20:42:29.793240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6664. [D 20:42:29.793255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6665. [D 20:42:29.793283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6666. [D 20:42:29.793298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6667. [D 20:42:29.793313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6668. [D 20:42:29.793359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6669. [D 20:42:29.793385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6670. [D 20:42:29.793403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6671. [D 20:42:29.793418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6672. [D 20:42:29.793433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6673. [D 20:42:29.793447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6674. [D 20:42:29.793462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6675. [D 20:42:29.793478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6676. [D 20:42:29.793493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6677. [D 20:42:29.793507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6678. [D 20:42:29.793522] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6679. [D 20:42:29.798891] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6679. [D 20:42:29.798911] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 19/70. [D 20:42:29.799602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.799622] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.799636] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.858539] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.858561] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.858577] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.858602] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3025 [D 20:42:29.858619] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:29.858635] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 20/70. [D 20:42:29.862159] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3025 [D 20:42:29.862182] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 21/70. [D 20:42:29.862234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6679. [D 20:42:29.862251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6680. [D 20:42:29.862266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 6681. [D 20:42:29.862286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 6682. [D 20:42:29.862300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 6683. [D 20:42:29.862314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 6684. [D 20:42:29.862329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 6685. [D 20:42:29.862344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6686. [D 20:42:29.862358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6687. [D 20:42:29.862373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6688. [D 20:42:29.862399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 6689. [D 20:42:29.862414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 6690. [D 20:42:29.862429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 6691. [D 20:42:29.862443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 6692. [D 20:42:29.862458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 6693. [D 20:42:29.862472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6694. [D 20:42:29.862501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6695. [D 20:42:29.862516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6696. [D 20:42:29.862531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6697. [D 20:42:29.862545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6698. [D 20:42:29.862560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6699. [D 20:42:29.862575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6700. [D 20:42:29.862589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6701. [D 20:42:29.862604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6702. [D 20:42:29.862619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6703. [D 20:42:29.862633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6704. [D 20:42:29.862648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6705. [D 20:42:29.862663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6706. [D 20:42:29.862677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6707. [D 20:42:29.862693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6708. [D 20:42:29.862718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6709. [D 20:42:29.862733] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6710. [D 20:42:29.868182] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6710. [D 20:42:29.868224] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 22/70. [D 20:42:29.871238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.871254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.871267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.918874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.918894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.918907] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.918930] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3028 [D 20:42:29.918945] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:29.918960] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 23/70. [D 20:42:29.922893] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3028 [D 20:42:29.922916] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 24/70. [D 20:42:29.922970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6710. [D 20:42:29.922986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6711. [D 20:42:29.923001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6712. [D 20:42:29.923016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6713. [D 20:42:29.923030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6714. [D 20:42:29.923049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6715. [D 20:42:29.923064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6716. [D 20:42:29.923081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6717. [D 20:42:29.923096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6718. [D 20:42:29.923111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6719. [D 20:42:29.923125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6720. [D 20:42:29.923140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6721. [D 20:42:29.923155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6722. [D 20:42:29.923169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6723. [D 20:42:29.923185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6724. [D 20:42:29.923227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6725. [D 20:42:29.923248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6726. [D 20:42:29.923263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6727. [D 20:42:29.923277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6728. [D 20:42:29.923292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6729. [D 20:42:29.923307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6730. [D 20:42:29.923322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6731. [D 20:42:29.923336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6732. [D 20:42:29.923351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6733. [D 20:42:29.923365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6734. [D 20:42:29.923380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6735. [D 20:42:29.923395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6736. [D 20:42:29.923409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6737. [D 20:42:29.923424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6738. [D 20:42:29.923450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6739. [D 20:42:29.923464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6740. [D 20:42:29.923479] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6741. [D 20:42:29.928900] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6741. [D 20:42:29.928921] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 25/70. [D 20:42:29.932101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.932121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.932136] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:29.943685] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:29.943747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.943762] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:29.943808] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3031 [D 20:42:29.943823] element 0: offset: 0x2aaaab014ca0, size: 24 [D 20:42:29.943843] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 26/70. [D 20:42:29.947619] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3031 [D 20:42:29.947645] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 27/70. [D 20:42:29.947699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6741. [D 20:42:29.947717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6742. [D 20:42:29.947745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6743. [D 20:42:29.947764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6744. [D 20:42:29.947781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6745. [D 20:42:29.947795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6746. [D 20:42:29.947810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6747. [D 20:42:29.947824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6748. [D 20:42:29.947839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6749. [D 20:42:29.947854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6750. [D 20:42:29.947869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6751. [D 20:42:29.947898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 6752. [D 20:42:29.947913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 6753. [D 20:42:29.947939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 6754. [D 20:42:29.947954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 6755. [D 20:42:29.947969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 6756. [D 20:42:29.947983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 6757. [D 20:42:29.947998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 6758. [D 20:42:29.948012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 6759. [D 20:42:29.948027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 6760. [D 20:42:29.948042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 6761. [D 20:42:29.948057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 6762. [D 20:42:29.948071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 6763. [D 20:42:29.948086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 6764. [D 20:42:29.948100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 6765. [D 20:42:29.948115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 6766. [D 20:42:29.948130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 6767. [D 20:42:29.948144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 6768. [D 20:42:29.948159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 6769. [D 20:42:29.948192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 6770. [D 20:42:29.948207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 6771. [D 20:42:29.948222] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 6772. [D 20:42:29.953637] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6772. [D 20:42:29.953666] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 28/70. [D 20:42:29.953772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:29.953833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:29.953846] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.037561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.037582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.037595] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.037635] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3034 [D 20:42:30.037650] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:30.037669] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 29/70. [D 20:42:30.041571] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3034 [D 20:42:30.041600] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 30/70. [D 20:42:30.041660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 6772. [D 20:42:30.041677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 6773. [D 20:42:30.041692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 6774. [D 20:42:30.041722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 6775. [D 20:42:30.041737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 6776. [D 20:42:30.041751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 6777. [D 20:42:30.041766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 6778. [D 20:42:30.041781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6779. [D 20:42:30.041796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6780. [D 20:42:30.041836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6781. [D 20:42:30.041852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 6782. [D 20:42:30.041872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 6783. [D 20:42:30.041887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 6784. [D 20:42:30.041901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 6785. [D 20:42:30.041916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 6786. [D 20:42:30.041930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6787. [D 20:42:30.041945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6788. [D 20:42:30.041959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6789. [D 20:42:30.041975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 6790. [D 20:42:30.042005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 6791. [D 20:42:30.042020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 6792. [D 20:42:30.042036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 6793. [D 20:42:30.042051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 6794. [D 20:42:30.042066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6795. [D 20:42:30.042082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6796. [D 20:42:30.042097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6797. [D 20:42:30.042112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 6798. [D 20:42:30.042127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 6799. [D 20:42:30.042177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 6800. [D 20:42:30.042198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 6801. [D 20:42:30.042216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 6802. [D 20:42:30.042236] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6803. [D 20:42:30.047546] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6803. [D 20:42:30.047565] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 31/70. [D 20:42:30.050633] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.050653] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.050668] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.115324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.115345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.115363] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.115387] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3037 [D 20:42:30.115404] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:30.115421] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 32/70. [D 20:42:30.115446] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.115466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.115479] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:30.115499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3041 [D 20:42:30.115524] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:30.115539] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 33/70. [D 20:42:30.119617] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3037 [D 20:42:30.119641] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 34/70. [D 20:42:30.119698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6803. [D 20:42:30.119717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6804. [D 20:42:30.119732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6805. [D 20:42:30.119747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6806. [D 20:42:30.119762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6807. [D 20:42:30.119776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6808. [D 20:42:30.119799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6809. [D 20:42:30.119816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6810. [D 20:42:30.119831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6811. [D 20:42:30.119845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6812. [D 20:42:30.119860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6813. [D 20:42:30.119875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6814. [D 20:42:30.119890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6815. [D 20:42:30.119904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6816. [D 20:42:30.119919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6817. [D 20:42:30.119933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6818. [D 20:42:30.119948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6819. [D 20:42:30.119963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6820. [D 20:42:30.119985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6821. [D 20:42:30.119999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6822. [D 20:42:30.120014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6823. [D 20:42:30.120028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6824. [D 20:42:30.120043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6825. [D 20:42:30.120057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6826. [D 20:42:30.120072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6827. [D 20:42:30.120086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6828. [D 20:42:30.120101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6829. [D 20:42:30.120115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6830. [D 20:42:30.120130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6831. [D 20:42:30.120144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6832. [D 20:42:30.120162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6833. [D 20:42:30.120176] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6834. [D 20:42:30.123305] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3041 [D 20:42:30.123323] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 35/70. [D 20:42:30.125625] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6834. [D 20:42:30.125645] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 36/70. [D 20:42:30.125661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6834. [D 20:42:30.125675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 6835. [D 20:42:30.125690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 6836. [D 20:42:30.125705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 6837. [D 20:42:30.125719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 6838. [D 20:42:30.125735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 6839. [D 20:42:30.125753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6840. [D 20:42:30.125768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6841. [D 20:42:30.125786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6842. [D 20:42:30.125801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 6843. [D 20:42:30.125815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 6844. [D 20:42:30.125829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 6845. [D 20:42:30.125844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 6846. [D 20:42:30.125863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 6847. [D 20:42:30.125878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6848. [D 20:42:30.125892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6849. [D 20:42:30.125907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6850. [D 20:42:30.125922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6851. [D 20:42:30.125936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6852. [D 20:42:30.125955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6853. [D 20:42:30.125974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6854. [D 20:42:30.125989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6855. [D 20:42:30.126003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6856. [D 20:42:30.126018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6857. [D 20:42:30.126033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6858. [D 20:42:30.126047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6859. [D 20:42:30.126083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6860. [D 20:42:30.126098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6861. [D 20:42:30.126113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6862. [D 20:42:30.126129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6863. [D 20:42:30.126143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6864. [D 20:42:30.126158] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6865. [D 20:42:30.127599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.127616] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.127629] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:30.131535] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 6865. [D 20:42:30.131568] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 37/70. [D 20:42:30.134649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.134665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.134678] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.185943] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.185962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.185975] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.185998] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3043 [D 20:42:30.186013] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:30.186027] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 38/70. [D 20:42:30.189844] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3043 [D 20:42:30.189869] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 39/70. [D 20:42:30.189921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6865. [D 20:42:30.189940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6866. [D 20:42:30.189955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6867. [D 20:42:30.189969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6868. [D 20:42:30.189984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6869. [D 20:42:30.189999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6870. [D 20:42:30.190013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6871. [D 20:42:30.190028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6872. [D 20:42:30.190050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6873. [D 20:42:30.190065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6874. [D 20:42:30.190079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6875. [D 20:42:30.190094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 6876. [D 20:42:30.190109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 6877. [D 20:42:30.190123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 6878. [D 20:42:30.190138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 6879. [D 20:42:30.190153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 6880. [D 20:42:30.190168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 6881. [D 20:42:30.190182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 6882. [D 20:42:30.190197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 6883. [D 20:42:30.190212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 6884. [D 20:42:30.190227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 6885. [D 20:42:30.190242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 6886. [D 20:42:30.190256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 6887. [D 20:42:30.190271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 6888. [D 20:42:30.190285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 6889. [D 20:42:30.190299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 6890. [D 20:42:30.190320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 6891. [D 20:42:30.190335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 6892. [D 20:42:30.190350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 6893. [D 20:42:30.190364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 6894. [D 20:42:30.190380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 6895. [D 20:42:30.190395] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 6896. [D 20:42:30.195850] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6896. [D 20:42:30.195871] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 40/70. [D 20:42:30.198923] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.198942] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.198958] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.257591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.257613] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.257629] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.257651] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3046 [D 20:42:30.257670] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:30.257687] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 41/70. [D 20:42:30.261405] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3046 [D 20:42:30.261430] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 42/70. [D 20:42:30.261484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6896. [D 20:42:30.261501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6897. [D 20:42:30.261516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6898. [D 20:42:30.261531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6899. [D 20:42:30.261546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6900. [D 20:42:30.261561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6901. [D 20:42:30.261580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6902. [D 20:42:30.261594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6903. [D 20:42:30.261612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6904. [D 20:42:30.261627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6905. [D 20:42:30.261642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6906. [D 20:42:30.261657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 6907. [D 20:42:30.261672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 6908. [D 20:42:30.261689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 6909. [D 20:42:30.261704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 6910. [D 20:42:30.261718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 6911. [D 20:42:30.261733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 6912. [D 20:42:30.261755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 6913. [D 20:42:30.261809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 6914. [D 20:42:30.261824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 6915. [D 20:42:30.261839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 6916. [D 20:42:30.261854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 6917. [D 20:42:30.261868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 6918. [D 20:42:30.261883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 6919. [D 20:42:30.261898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 6920. [D 20:42:30.261913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 6921. [D 20:42:30.261928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 6922. [D 20:42:30.261942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 6923. [D 20:42:30.261968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 6924. [D 20:42:30.261982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 6925. [D 20:42:30.261997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 6926. [D 20:42:30.262012] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 6927. [D 20:42:30.267418] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6927. [D 20:42:30.267438] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 43/70. [D 20:42:30.267598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.267614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.267627] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.347656] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.347719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.347734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.347779] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3049 [D 20:42:30.347794] element 0: offset: 0x2aaaab028280, size: 24 [D 20:42:30.347816] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 44/70. [D 20:42:30.351689] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3049 [D 20:42:30.351715] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 45/70. [D 20:42:30.351770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 6927. [D 20:42:30.351789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 6928. [D 20:42:30.351804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 6929. [D 20:42:30.351826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 6930. [D 20:42:30.351854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 6931. [D 20:42:30.351869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 6932. [D 20:42:30.351902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 6933. [D 20:42:30.351917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 6934. [D 20:42:30.351932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 6935. [D 20:42:30.351950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 6936. [D 20:42:30.351965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 6937. [D 20:42:30.351979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 6938. [D 20:42:30.351994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 6939. [D 20:42:30.352009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 6940. [D 20:42:30.352028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 6941. [D 20:42:30.352043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 6942. [D 20:42:30.352057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 6943. [D 20:42:30.352072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 6944. [D 20:42:30.352118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 6945. [D 20:42:30.352134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 6946. [D 20:42:30.352163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 6947. [D 20:42:30.352181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 6948. [D 20:42:30.352196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 6949. [D 20:42:30.352226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 6950. [D 20:42:30.352241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 6951. [D 20:42:30.352255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 6952. [D 20:42:30.352270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 6953. [D 20:42:30.352284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 6954. [D 20:42:30.352299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 6955. [D 20:42:30.352314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 6956. [D 20:42:30.352349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 6957. [D 20:42:30.352367] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 6958. [D 20:42:30.357653] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6958. [D 20:42:30.357677] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 46/70. [D 20:42:30.357798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.357860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.357874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.408612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.408634] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.408647] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.408687] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3052 [D 20:42:30.408702] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:30.408722] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 47/70. [D 20:42:30.412312] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3052 [D 20:42:30.412343] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 48/70. [D 20:42:30.412524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 6958. [D 20:42:30.412549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 6959. [D 20:42:30.412571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 6960. [D 20:42:30.412590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 6961. [D 20:42:30.412624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 6962. [D 20:42:30.412646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 6963. [D 20:42:30.412665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 6964. [D 20:42:30.412683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6965. [D 20:42:30.412701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6966. [D 20:42:30.412719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6967. [D 20:42:30.412738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 6968. [D 20:42:30.412756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 6969. [D 20:42:30.412774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 6970. [D 20:42:30.412793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 6971. [D 20:42:30.412811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 6972. [D 20:42:30.412829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6973. [D 20:42:30.412848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6974. [D 20:42:30.412876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6975. [D 20:42:30.412894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 6976. [D 20:42:30.412913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 6977. [D 20:42:30.412931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 6978. [D 20:42:30.412949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 6979. [D 20:42:30.412967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 6980. [D 20:42:30.412986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6981. [D 20:42:30.413004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6982. [D 20:42:30.413023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6983. [D 20:42:30.413041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 6984. [D 20:42:30.413060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 6985. [D 20:42:30.413078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 6986. [D 20:42:30.413097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 6987. [D 20:42:30.413115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 6988. [D 20:42:30.413130] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6989. [D 20:42:30.418484] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 6989. [D 20:42:30.418508] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 49/70. [D 20:42:30.418619] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.418670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.418684] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.445530] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.445550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.445563] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.445601] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3055 [D 20:42:30.445616] element 0: offset: 0x2aaaab014cd0, size: 24 [D 20:42:30.445635] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 50/70. [D 20:42:30.449397] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3055 [D 20:42:30.449431] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 51/70. [D 20:42:30.449485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 6989. [D 20:42:30.449503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 6990. [D 20:42:30.449518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 6991. [D 20:42:30.449535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 6992. [D 20:42:30.449562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 6993. [D 20:42:30.449577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 6994. [D 20:42:30.449593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 6995. [D 20:42:30.449608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 6996. [D 20:42:30.449622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 6997. [D 20:42:30.449637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 6998. [D 20:42:30.449666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 6999. [D 20:42:30.449684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7000. [D 20:42:30.449705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7001. [D 20:42:30.449720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7002. [D 20:42:30.449735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7003. [D 20:42:30.449749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7004. [D 20:42:30.449764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7005. [D 20:42:30.449779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7006. [D 20:42:30.449794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7007. [D 20:42:30.449808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7008. [D 20:42:30.449823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7009. [D 20:42:30.449838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7010. [D 20:42:30.449863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7011. [D 20:42:30.449878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7012. [D 20:42:30.449897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7013. [D 20:42:30.449914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7014. [D 20:42:30.449929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7015. [D 20:42:30.449944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7016. [D 20:42:30.449961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7017. [D 20:42:30.449975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7018. [D 20:42:30.449991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7019. [D 20:42:30.450006] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7020. [D 20:42:30.457558] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7020. [D 20:42:30.457583] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 52/70. [D 20:42:30.457784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.457844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.457858] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.466979] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.467000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.467013] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.467053] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3058 [D 20:42:30.467067] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:30.467087] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 53/70. [D 20:42:30.470946] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3058 [D 20:42:30.470973] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 54/70. [D 20:42:30.471022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7020. [D 20:42:30.471039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7021. [D 20:42:30.471054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7022. [D 20:42:30.471068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7023. [D 20:42:30.471084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7024. [D 20:42:30.471098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7025. [D 20:42:30.471113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7026. [D 20:42:30.471128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7027. [D 20:42:30.471164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7028. [D 20:42:30.471194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7029. [D 20:42:30.471209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7030. [D 20:42:30.471223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7031. [D 20:42:30.471238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7032. [D 20:42:30.471252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7033. [D 20:42:30.471266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7034. [D 20:42:30.471281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7035. [D 20:42:30.471295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7036. [D 20:42:30.471310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7037. [D 20:42:30.471327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7038. [D 20:42:30.471343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7039. [D 20:42:30.471358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7040. [D 20:42:30.471373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7041. [D 20:42:30.471389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7042. [D 20:42:30.471415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7043. [D 20:42:30.471431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7044. [D 20:42:30.471482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7045. [D 20:42:30.471501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7046. [D 20:42:30.471518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7047. [D 20:42:30.471538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7048. [D 20:42:30.471554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7049. [D 20:42:30.471569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7050. [D 20:42:30.471584] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7051. [D 20:42:30.476944] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7051. [D 20:42:30.476964] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 55/70. [D 20:42:30.477076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.477128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.477142] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.506946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.506968] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.506981] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.507019] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3062 [D 20:42:30.507034] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:30.507054] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 56/70. [D 20:42:30.510746] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3062 [D 20:42:30.510776] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 57/70. [D 20:42:30.510835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7051. [D 20:42:30.510852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7052. [D 20:42:30.510867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7053. [D 20:42:30.510883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7054. [D 20:42:30.510900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7055. [D 20:42:30.510915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7056. [D 20:42:30.510993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7057. [D 20:42:30.511011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7058. [D 20:42:30.511026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7059. [D 20:42:30.511059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7060. [D 20:42:30.511074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7061. [D 20:42:30.511146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7062. [D 20:42:30.511168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7063. [D 20:42:30.511186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7064. [D 20:42:30.511308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7065. [D 20:42:30.511328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7066. [D 20:42:30.511342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7067. [D 20:42:30.511357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7068. [D 20:42:30.511371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7069. [D 20:42:30.511391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7070. [D 20:42:30.511406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7071. [D 20:42:30.511472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7072. [D 20:42:30.511502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7073. [D 20:42:30.511521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7074. [D 20:42:30.511604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7075. [D 20:42:30.512238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7076. [D 20:42:30.512259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7077. [D 20:42:30.512277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7078. [D 20:42:30.512325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7079. [D 20:42:30.512344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7080. [D 20:42:30.512361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7081. [D 20:42:30.512379] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7082. [D 20:42:30.516799] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7082. [D 20:42:30.516823] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 58/70. [D 20:42:30.516919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.516978] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.516992] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.596114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.596134] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.596147] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.596187] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3065 [D 20:42:30.596203] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:30.596222] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 59/70. [D 20:42:30.599624] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3065 [D 20:42:30.599649] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 60/70. [D 20:42:30.599701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7082. [D 20:42:30.599721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7083. [D 20:42:30.599736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7084. [D 20:42:30.599751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7085. [D 20:42:30.599766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7086. [D 20:42:30.599781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7087. [D 20:42:30.599795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7088. [D 20:42:30.599813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7089. [D 20:42:30.599828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7090. [D 20:42:30.599842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7091. [D 20:42:30.599857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7092. [D 20:42:30.599872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7093. [D 20:42:30.599887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7094. [D 20:42:30.599902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7095. [D 20:42:30.599917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7096. [D 20:42:30.599932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7097. [D 20:42:30.599946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7098. [D 20:42:30.599961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7099. [D 20:42:30.599976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7100. [D 20:42:30.599996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7101. [D 20:42:30.600013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7102. [D 20:42:30.600028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7103. [D 20:42:30.600042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7104. [D 20:42:30.600064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7105. [D 20:42:30.600078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7106. [D 20:42:30.600093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7107. [D 20:42:30.600107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7108. [D 20:42:30.600123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7109. [D 20:42:30.600168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7110. [D 20:42:30.600199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7111. [D 20:42:30.600214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7112. [D 20:42:30.600229] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7113. [D 20:42:30.605640] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7113. [D 20:42:30.605660] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 0/70. [D 20:42:30.605773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.605825] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.605839] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.684415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.684437] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.684450] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.684487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3067 [D 20:42:30.684502] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:30.684521] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 1/70. [D 20:42:30.688230] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3067 [D 20:42:30.688263] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 2/70. [D 20:42:30.688348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7113. [D 20:42:30.688369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7114. [D 20:42:30.688384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7115. [D 20:42:30.688422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7116. [D 20:42:30.688437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7117. [D 20:42:30.688452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7118. [D 20:42:30.688480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7119. [D 20:42:30.688495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7120. [D 20:42:30.688509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7121. [D 20:42:30.688528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7122. [D 20:42:30.688543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7123. [D 20:42:30.688557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7124. [D 20:42:30.688572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7125. [D 20:42:30.688591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7126. [D 20:42:30.688606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7127. [D 20:42:30.688621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7128. [D 20:42:30.688635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7129. [D 20:42:30.688654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7130. [D 20:42:30.688683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7131. [D 20:42:30.688715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7132. [D 20:42:30.688731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7133. [D 20:42:30.688746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7134. [D 20:42:30.688761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7135. [D 20:42:30.688775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7136. [D 20:42:30.688790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7137. [D 20:42:30.688805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7138. [D 20:42:30.688926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7139. [D 20:42:30.688946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7140. [D 20:42:30.688960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7141. [D 20:42:30.688975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7142. [D 20:42:30.688989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7143. [D 20:42:30.689007] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7144. [D 20:42:30.694279] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7144. [D 20:42:30.694303] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 3/70. [D 20:42:30.694414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.694464] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.694478] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.747313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.747335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.747348] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.747384] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3070 [D 20:42:30.747399] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:30.747418] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 4/70. [D 20:42:30.750918] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3070 [D 20:42:30.750944] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 5/70. [D 20:42:30.751038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7144. [D 20:42:30.751058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7145. [D 20:42:30.751073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7146. [D 20:42:30.751088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7147. [D 20:42:30.751103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7148. [D 20:42:30.751134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7149. [D 20:42:30.751149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7150. [D 20:42:30.751164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7151. [D 20:42:30.751179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7152. [D 20:42:30.751193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7153. [D 20:42:30.751208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7154. [D 20:42:30.751223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7155. [D 20:42:30.751237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7156. [D 20:42:30.751349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7157. [D 20:42:30.751368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7158. [D 20:42:30.751383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7159. [D 20:42:30.751398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7160. [D 20:42:30.751415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7161. [D 20:42:30.751430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7162. [D 20:42:30.751445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7163. [D 20:42:30.751460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7164. [D 20:42:30.751474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7165. [D 20:42:30.751489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7166. [D 20:42:30.751504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7167. [D 20:42:30.751518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7168. [D 20:42:30.751604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7169. [D 20:42:30.751621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7170. [D 20:42:30.751636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7171. [D 20:42:30.751651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7172. [D 20:42:30.751666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7173. [D 20:42:30.751762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7174. [D 20:42:30.751917] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7175. [D 20:42:30.756984] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7175. [D 20:42:30.757008] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 6/70. [D 20:42:30.757121] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.757181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.757195] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.828555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.828576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.828589] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.828628] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3073 [D 20:42:30.828643] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:30.828665] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 7/70. [D 20:42:30.832380] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3073 [D 20:42:30.832409] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 8/70. [D 20:42:30.832499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7175. [D 20:42:30.832520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7176. [D 20:42:30.832534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7177. [D 20:42:30.832558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7178. [D 20:42:30.832579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7179. [D 20:42:30.832594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7180. [D 20:42:30.832609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7181. [D 20:42:30.832631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7182. [D 20:42:30.832645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7183. [D 20:42:30.832663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7184. [D 20:42:30.832678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7185. [D 20:42:30.832693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7186. [D 20:42:30.832720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7187. [D 20:42:30.832735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7188. [D 20:42:30.832749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7189. [D 20:42:30.832763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7190. [D 20:42:30.832778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7191. [D 20:42:30.832793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7192. [D 20:42:30.832807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7193. [D 20:42:30.832824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7194. [D 20:42:30.832838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7195. [D 20:42:30.832988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7196. [D 20:42:30.833008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7197. [D 20:42:30.833037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7198. [D 20:42:30.833052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7199. [D 20:42:30.833067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7200. [D 20:42:30.833081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7201. [D 20:42:30.833096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7202. [D 20:42:30.833110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7203. [D 20:42:30.833125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7204. [D 20:42:30.833140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7205. [D 20:42:30.833155] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7206. [D 20:42:30.838427] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7206. [D 20:42:30.838450] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 9/70. [D 20:42:30.838564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.838615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.838629] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.895188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.895210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.895223] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.895260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3076 [D 20:42:30.895275] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:30.895294] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 10/70. [D 20:42:30.899081] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3076 [D 20:42:30.899112] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 11/70. [D 20:42:30.899171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7206. [D 20:42:30.899188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7207. [D 20:42:30.899203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7208. [D 20:42:30.899219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7209. [D 20:42:30.899236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7210. [D 20:42:30.899251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7211. [D 20:42:30.899280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7212. [D 20:42:30.899295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7213. [D 20:42:30.899310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7214. [D 20:42:30.899325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7215. [D 20:42:30.899352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7216. [D 20:42:30.899367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7217. [D 20:42:30.899390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7218. [D 20:42:30.899417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7219. [D 20:42:30.899432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7220. [D 20:42:30.899447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7221. [D 20:42:30.899462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7222. [D 20:42:30.899476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7223. [D 20:42:30.899491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7224. [D 20:42:30.899506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7225. [D 20:42:30.899520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7226. [D 20:42:30.899535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7227. [D 20:42:30.899558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7228. [D 20:42:30.899573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7229. [D 20:42:30.899589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7230. [D 20:42:30.899606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7231. [D 20:42:30.899625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7232. [D 20:42:30.899640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7233. [D 20:42:30.899655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7234. [D 20:42:30.899670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7235. [D 20:42:30.899684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7236. [D 20:42:30.899699] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7237. [D 20:42:30.905120] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7237. [D 20:42:30.905139] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 12/70. [D 20:42:30.905252] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.905312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.905325] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:30.979841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:30.979862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.979875] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:30.979915] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3080 [D 20:42:30.979930] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:30.979950] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 13/70. [D 20:42:30.983624] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3080 [D 20:42:30.983653] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 14/70. [D 20:42:30.983709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7237. [D 20:42:30.983731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7238. [D 20:42:30.983746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7239. [D 20:42:30.983761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7240. [D 20:42:30.983788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7241. [D 20:42:30.983804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7242. [D 20:42:30.983819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7243. [D 20:42:30.983834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7244. [D 20:42:30.983848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7245. [D 20:42:30.983863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7246. [D 20:42:30.983907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7247. [D 20:42:30.983928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7248. [D 20:42:30.983942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7249. [D 20:42:30.983957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7250. [D 20:42:30.983971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7251. [D 20:42:30.983986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7252. [D 20:42:30.984001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7253. [D 20:42:30.984016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7254. [D 20:42:30.984030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7255. [D 20:42:30.984045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7256. [D 20:42:30.984060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7257. [D 20:42:30.984074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7258. [D 20:42:30.984089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7259. [D 20:42:30.984104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7260. [D 20:42:30.984129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7261. [D 20:42:30.984144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7262. [D 20:42:30.984159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7263. [D 20:42:30.984174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7264. [D 20:42:30.984188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7265. [D 20:42:30.984203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7266. [D 20:42:30.984226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7267. [D 20:42:30.984285] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7268. [D 20:42:30.989675] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7268. [D 20:42:30.989694] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 15/70. [D 20:42:30.989805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:30.989858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:30.989871] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.069200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.069222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.069235] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.069273] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3083 [D 20:42:31.069288] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:31.069307] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 16/70. [D 20:42:31.073220] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3083 [D 20:42:31.073250] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 17/70. [D 20:42:31.073302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7268. [D 20:42:31.073319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7269. [D 20:42:31.073335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7270. [D 20:42:31.073349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7271. [D 20:42:31.073364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7272. [D 20:42:31.073379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7273. [D 20:42:31.073394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7274. [D 20:42:31.073413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7275. [D 20:42:31.073463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7276. [D 20:42:31.073479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7277. [D 20:42:31.073493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7278. [D 20:42:31.073508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7279. [D 20:42:31.073522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7280. [D 20:42:31.073537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7281. [D 20:42:31.073563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7282. [D 20:42:31.073577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7283. [D 20:42:31.073592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7284. [D 20:42:31.073610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7285. [D 20:42:31.073627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7286. [D 20:42:31.073642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7287. [D 20:42:31.073664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7288. [D 20:42:31.073691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7289. [D 20:42:31.073706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7290. [D 20:42:31.073720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7291. [D 20:42:31.073774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7292. [D 20:42:31.073789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7293. [D 20:42:31.073813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7294. [D 20:42:31.073832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7295. [D 20:42:31.073849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7296. [D 20:42:31.073864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7297. [D 20:42:31.073878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7298. [D 20:42:31.073895] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7299. [D 20:42:31.079239] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7299. [D 20:42:31.079258] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 18/70. [D 20:42:31.082334] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.082355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.082373] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.275602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.275624] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.275641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.275673] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3085 [D 20:42:31.275689] element 0: offset: 0x2aaaab039180, size: 24 [D 20:42:31.275705] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 19/70. [D 20:42:31.279395] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3085 [D 20:42:31.279420] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 20/70. [D 20:42:31.279483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 7299. [D 20:42:31.279500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 7300. [D 20:42:31.279515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7301. [D 20:42:31.279530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7302. [D 20:42:31.279545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7303. [D 20:42:31.279560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7304. [D 20:42:31.279574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7305. [D 20:42:31.279589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7306. [D 20:42:31.279607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7307. [D 20:42:31.279622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7308. [D 20:42:31.279637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7309. [D 20:42:31.279651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7310. [D 20:42:31.279681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7311. [D 20:42:31.279697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7312. [D 20:42:31.279712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7313. [D 20:42:31.279755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7314. [D 20:42:31.279770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7315. [D 20:42:31.279789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7316. [D 20:42:31.279804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7317. [D 20:42:31.279819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7318. [D 20:42:31.279833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7319. [D 20:42:31.279848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7320. [D 20:42:31.279862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7321. [D 20:42:31.279878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7322. [D 20:42:31.279892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7323. [D 20:42:31.279907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7324. [D 20:42:31.279921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7325. [D 20:42:31.279936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7326. [D 20:42:31.279951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7327. [D 20:42:31.279965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7328. [D 20:42:31.279980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7329. [D 20:42:31.279995] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7330. [D 20:42:31.285362] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7330. [D 20:42:31.285382] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 21/70. [D 20:42:31.287609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.287629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.287643] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.291640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.291702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.291717] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.291762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3088 [D 20:42:31.291778] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:31.291798] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 22/70. [D 20:42:31.295720] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3088 [D 20:42:31.295750] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 23/70. [D 20:42:31.295804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7330. [D 20:42:31.295821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7331. [D 20:42:31.295836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7332. [D 20:42:31.295861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7333. [D 20:42:31.295876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7334. [D 20:42:31.295891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7335. [D 20:42:31.295919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7336. [D 20:42:31.295941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7337. [D 20:42:31.295956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7338. [D 20:42:31.295970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7339. [D 20:42:31.295989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7340. [D 20:42:31.296004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7341. [D 20:42:31.296018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7342. [D 20:42:31.296033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7343. [D 20:42:31.296048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7344. [D 20:42:31.296079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7345. [D 20:42:31.296095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7346. [D 20:42:31.296110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7347. [D 20:42:31.296125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7348. [D 20:42:31.296140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7349. [D 20:42:31.296155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7350. [D 20:42:31.296178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7351. [D 20:42:31.296226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7352. [D 20:42:31.296249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7353. [D 20:42:31.296265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7354. [D 20:42:31.296281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7355. [D 20:42:31.296296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7356. [D 20:42:31.296310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7357. [D 20:42:31.296327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7358. [D 20:42:31.296342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7359. [D 20:42:31.296356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7360. [D 20:42:31.296371] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7361. [D 20:42:31.303223] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7361. [D 20:42:31.303248] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 24/70. [D 20:42:31.303444] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.303493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.303507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.313504] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.313526] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.313539] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.313576] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3091 [D 20:42:31.313591] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:31.313611] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 25/70. [D 20:42:31.317466] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3091 [D 20:42:31.317494] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 26/70. [D 20:42:31.317549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7361. [D 20:42:31.317566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7362. [D 20:42:31.317581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7363. [D 20:42:31.317596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7364. [D 20:42:31.317612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7365. [D 20:42:31.317627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7366. [D 20:42:31.317642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7367. [D 20:42:31.317658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7368. [D 20:42:31.317681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7369. [D 20:42:31.317696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7370. [D 20:42:31.317711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7371. [D 20:42:31.317740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7372. [D 20:42:31.317754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7373. [D 20:42:31.317769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7374. [D 20:42:31.317784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7375. [D 20:42:31.317799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7376. [D 20:42:31.317814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7377. [D 20:42:31.317829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7378. [D 20:42:31.317844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7379. [D 20:42:31.317859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7380. [D 20:42:31.317874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7381. [D 20:42:31.317889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7382. [D 20:42:31.317904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7383. [D 20:42:31.317918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7384. [D 20:42:31.317934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7385. [D 20:42:31.317994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7386. [D 20:42:31.318014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7387. [D 20:42:31.318035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7388. [D 20:42:31.318051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7389. [D 20:42:31.318066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7390. [D 20:42:31.318081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7391. [D 20:42:31.318096] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7392. [D 20:42:31.323510] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7392. [D 20:42:31.323530] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 27/70. [D 20:42:31.323641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.323694] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.323707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.346781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.346802] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.346815] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.346854] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3095 [D 20:42:31.346869] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:31.346888] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 28/70. [D 20:42:31.350753] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3095 [D 20:42:31.350792] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 29/70. [D 20:42:31.350846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7392. [D 20:42:31.350864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7393. [D 20:42:31.350879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7394. [D 20:42:31.350893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7395. [D 20:42:31.350908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7396. [D 20:42:31.350923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7397. [D 20:42:31.350937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7398. [D 20:42:31.350971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7399. [D 20:42:31.350985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7400. [D 20:42:31.351000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7401. [D 20:42:31.351020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7402. [D 20:42:31.351034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7403. [D 20:42:31.351049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7404. [D 20:42:31.351064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7405. [D 20:42:31.351079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7406. [D 20:42:31.351093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7407. [D 20:42:31.351115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7408. [D 20:42:31.351141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7409. [D 20:42:31.351156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7410. [D 20:42:31.351170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7411. [D 20:42:31.351186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7412. [D 20:42:31.351200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7413. [D 20:42:31.351215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7414. [D 20:42:31.351275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7415. [D 20:42:31.351291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7416. [D 20:42:31.351309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7417. [D 20:42:31.351329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7418. [D 20:42:31.351345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7419. [D 20:42:31.351360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7420. [D 20:42:31.351381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7421. [D 20:42:31.351396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7422. [D 20:42:31.351412] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7423. [D 20:42:31.356780] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7423. [D 20:42:31.356800] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 30/70. [D 20:42:31.356911] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.356963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.356978] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.414222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.414244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.414257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.414295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3097 [D 20:42:31.414311] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:31.414329] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 31/70. [D 20:42:31.418241] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3097 [D 20:42:31.418272] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 32/70. [D 20:42:31.418330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7423. [D 20:42:31.418347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7424. [D 20:42:31.418362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7425. [D 20:42:31.418379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7426. [D 20:42:31.418396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7427. [D 20:42:31.418411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7428. [D 20:42:31.418425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7429. [D 20:42:31.418440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7430. [D 20:42:31.418455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7431. [D 20:42:31.418470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7432. [D 20:42:31.418513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7433. [D 20:42:31.418528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7434. [D 20:42:31.418548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7435. [D 20:42:31.418563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7436. [D 20:42:31.418578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7437. [D 20:42:31.418593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7438. [D 20:42:31.418607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7439. [D 20:42:31.418622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7440. [D 20:42:31.418637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7441. [D 20:42:31.418651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7442. [D 20:42:31.418666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7443. [D 20:42:31.418681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7444. [D 20:42:31.418696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7445. [D 20:42:31.418715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7446. [D 20:42:31.418732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7447. [D 20:42:31.418746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7448. [D 20:42:31.418761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7449. [D 20:42:31.418776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7450. [D 20:42:31.418791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7451. [D 20:42:31.418806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7452. [D 20:42:31.418821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7453. [D 20:42:31.418876] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7454. [D 20:42:31.424271] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7454. [D 20:42:31.424291] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 33/70. [D 20:42:31.424408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.424468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.424481] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.520012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.520033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.520046] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.520086] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3100 [D 20:42:31.520101] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:31.520120] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 34/70. [D 20:42:31.523701] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3100 [D 20:42:31.523725] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 35/70. [D 20:42:31.523823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7454. [D 20:42:31.523843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7455. [D 20:42:31.523858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7456. [D 20:42:31.523872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7457. [D 20:42:31.523887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7458. [D 20:42:31.523917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7459. [D 20:42:31.523932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7460. [D 20:42:31.524008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7461. [D 20:42:31.524026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7462. [D 20:42:31.524041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7463. [D 20:42:31.524056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7464. [D 20:42:31.524070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7465. [D 20:42:31.524089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7466. [D 20:42:31.524166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7467. [D 20:42:31.524187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7468. [D 20:42:31.524205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7469. [D 20:42:31.524327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7470. [D 20:42:31.524344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7471. [D 20:42:31.524359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7472. [D 20:42:31.524373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7473. [D 20:42:31.524388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7474. [D 20:42:31.524408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7475. [D 20:42:31.524422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7476. [D 20:42:31.524437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7477. [D 20:42:31.524505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7478. [D 20:42:31.524531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7479. [D 20:42:31.524546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7480. [D 20:42:31.524566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7481. [D 20:42:31.524643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7482. [D 20:42:31.524796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7483. [D 20:42:31.524813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7484. [D 20:42:31.524828] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7485. [D 20:42:31.529748] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7485. [D 20:42:31.529771] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 36/70. [D 20:42:31.529886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.529938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.529952] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.558922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.558944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.558957] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.558995] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3103 [D 20:42:31.559010] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:31.559032] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 37/70. [D 20:42:31.562757] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3103 [D 20:42:31.562789] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 38/70. [D 20:42:31.562849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7485. [D 20:42:31.562866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7486. [D 20:42:31.562891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7487. [D 20:42:31.562907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7488. [D 20:42:31.562921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7489. [D 20:42:31.562936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7490. [D 20:42:31.562952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7491. [D 20:42:31.562973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7492. [D 20:42:31.562991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7493. [D 20:42:31.563006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7494. [D 20:42:31.563025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7495. [D 20:42:31.563040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7496. [D 20:42:31.563054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7497. [D 20:42:31.563069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7498. [D 20:42:31.563084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7499. [D 20:42:31.563109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7500. [D 20:42:31.563124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7501. [D 20:42:31.563138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7502. [D 20:42:31.563156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7503. [D 20:42:31.563173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7504. [D 20:42:31.563188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7505. [D 20:42:31.563204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7506. [D 20:42:31.563245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7507. [D 20:42:31.563260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7508. [D 20:42:31.563284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7509. [D 20:42:31.563299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7510. [D 20:42:31.563313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7511. [D 20:42:31.563328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7512. [D 20:42:31.563343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7513. [D 20:42:31.563358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7514. [D 20:42:31.563373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7515. [D 20:42:31.563388] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7516. [D 20:42:31.568812] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7516. [D 20:42:31.568832] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 39/70. [D 20:42:31.568945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.569004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.569018] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.650861] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.650883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.650896] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.650936] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3106 [D 20:42:31.650950] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:31.650970] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 40/70. [D 20:42:31.654907] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3106 [D 20:42:31.654942] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 41/70. [D 20:42:31.655009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7516. [D 20:42:31.655026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7517. [D 20:42:31.655041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7518. [D 20:42:31.655055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7519. [D 20:42:31.655070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7520. [D 20:42:31.655085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7521. [D 20:42:31.655100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7522. [D 20:42:31.655132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7523. [D 20:42:31.655147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7524. [D 20:42:31.655161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7525. [D 20:42:31.655182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7526. [D 20:42:31.655196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7527. [D 20:42:31.655211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7528. [D 20:42:31.655226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7529. [D 20:42:31.655241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7530. [D 20:42:31.655266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7531. [D 20:42:31.655281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7532. [D 20:42:31.655307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7533. [D 20:42:31.655322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7534. [D 20:42:31.655339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7535. [D 20:42:31.655353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7536. [D 20:42:31.655368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7537. [D 20:42:31.655383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7538. [D 20:42:31.655432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7539. [D 20:42:31.655449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7540. [D 20:42:31.655468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7541. [D 20:42:31.655494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7542. [D 20:42:31.655509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7543. [D 20:42:31.655524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7544. [D 20:42:31.655538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7545. [D 20:42:31.655553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7546. [D 20:42:31.655568] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7547. [D 20:42:31.660978] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7547. [D 20:42:31.660998] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 42/70. [D 20:42:31.661111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.661163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.661176] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.733006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.733027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.733040] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.733079] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3110 [D 20:42:31.733094] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:31.733113] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 43/70. [D 20:42:31.737005] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3110 [D 20:42:31.737054] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 44/70. [D 20:42:31.737107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7547. [D 20:42:31.737123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7548. [D 20:42:31.737138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7549. [D 20:42:31.737155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7550. [D 20:42:31.737169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7551. [D 20:42:31.737184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7552. [D 20:42:31.737199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7553. [D 20:42:31.737221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7554. [D 20:42:31.737235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7555. [D 20:42:31.737250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7556. [D 20:42:31.737271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7557. [D 20:42:31.737285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7558. [D 20:42:31.737300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7559. [D 20:42:31.737314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7560. [D 20:42:31.737339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7561. [D 20:42:31.737354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7562. [D 20:42:31.737369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7563. [D 20:42:31.737384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7564. [D 20:42:31.737399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7565. [D 20:42:31.737413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7566. [D 20:42:31.737428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7567. [D 20:42:31.737443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7568. [D 20:42:31.737458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7569. [D 20:42:31.737503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7570. [D 20:42:31.737524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7571. [D 20:42:31.737542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7572. [D 20:42:31.737567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7573. [D 20:42:31.737582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7574. [D 20:42:31.737597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7575. [D 20:42:31.737611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7576. [D 20:42:31.737626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7577. [D 20:42:31.737641] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7578. [D 20:42:31.743046] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7578. [D 20:42:31.743065] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 45/70. [D 20:42:31.746051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.746072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.746089] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.815367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.815389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.815406] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.815431] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3112 [D 20:42:31.815447] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:31.815464] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 46/70. [D 20:42:31.819168] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3112 [D 20:42:31.819199] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 47/70. [D 20:42:31.819257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7578. [D 20:42:31.819275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7579. [D 20:42:31.819290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7580. [D 20:42:31.819307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7581. [D 20:42:31.819322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7582. [D 20:42:31.819336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7583. [D 20:42:31.819351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7584. [D 20:42:31.819367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7585. [D 20:42:31.819381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7586. [D 20:42:31.819396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7587. [D 20:42:31.819411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7588. [D 20:42:31.819439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7589. [D 20:42:31.819454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7590. [D 20:42:31.819480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7591. [D 20:42:31.819495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7592. [D 20:42:31.819510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7593. [D 20:42:31.819524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7594. [D 20:42:31.819539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7595. [D 20:42:31.819554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7596. [D 20:42:31.819568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7597. [D 20:42:31.819583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7598. [D 20:42:31.819598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7599. [D 20:42:31.819616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7600. [D 20:42:31.819640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7601. [D 20:42:31.819655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7602. [D 20:42:31.819669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7603. [D 20:42:31.819684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7604. [D 20:42:31.819698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7605. [D 20:42:31.819712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7606. [D 20:42:31.819727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7607. [D 20:42:31.819745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7608. [D 20:42:31.819760] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7609. [D 20:42:31.825890] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7609. [D 20:42:31.825914] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 48/70. [D 20:42:31.828931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.828951] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.828966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.839615] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.839636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.839652] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.839675] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3115 [D 20:42:31.839693] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:31.839710] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 49/70. [D 20:42:31.846020] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3115 [D 20:42:31.846044] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 50/70. [D 20:42:31.846097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 7609. [D 20:42:31.846114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 7610. [D 20:42:31.846129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7611. [D 20:42:31.846144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7612. [D 20:42:31.846159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7613. [D 20:42:31.846174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7614. [D 20:42:31.846189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7615. [D 20:42:31.846204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7616. [D 20:42:31.846219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7617. [D 20:42:31.846234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7618. [D 20:42:31.846249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7619. [D 20:42:31.846264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7620. [D 20:42:31.846279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7621. [D 20:42:31.846294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7622. [D 20:42:31.846308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7623. [D 20:42:31.846323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7624. [D 20:42:31.846338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7625. [D 20:42:31.846353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7626. [D 20:42:31.846368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7627. [D 20:42:31.846383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7628. [D 20:42:31.846398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7629. [D 20:42:31.846452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7630. [D 20:42:31.846466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7631. [D 20:42:31.846481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7632. [D 20:42:31.846495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7633. [D 20:42:31.846510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7634. [D 20:42:31.846524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7635. [D 20:42:31.846539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7636. [D 20:42:31.846553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7637. [D 20:42:31.846568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7638. [D 20:42:31.846582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7639. [D 20:42:31.846597] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7640. [D 20:42:31.852044] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7640. [D 20:42:31.852064] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 51/70. [D 20:42:31.855083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.855102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.855117] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.871260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.871281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.871298] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.871320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3118 [D 20:42:31.871338] element 0: offset: 0x2aaaab0206c0, size: 24 [D 20:42:31.871355] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 52/70. [D 20:42:31.875034] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3118 [D 20:42:31.875065] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 53/70. [D 20:42:31.875117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7640. [D 20:42:31.875134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7641. [D 20:42:31.875149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7642. [D 20:42:31.875164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7643. [D 20:42:31.875180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7644. [D 20:42:31.875195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7645. [D 20:42:31.875210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7646. [D 20:42:31.875225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7647. [D 20:42:31.875239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7648. [D 20:42:31.875263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7649. [D 20:42:31.875295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7650. [D 20:42:31.875313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7651. [D 20:42:31.875334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7652. [D 20:42:31.875349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7653. [D 20:42:31.875363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7654. [D 20:42:31.875378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7655. [D 20:42:31.875393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7656. [D 20:42:31.875407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7657. [D 20:42:31.875422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7658. [D 20:42:31.875436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7659. [D 20:42:31.875451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7660. [D 20:42:31.875466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7661. [D 20:42:31.875481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7662. [D 20:42:31.875495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7663. [D 20:42:31.875510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7664. [D 20:42:31.875529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7665. [D 20:42:31.875545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7666. [D 20:42:31.875559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7667. [D 20:42:31.875574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7668. [D 20:42:31.875590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7669. [D 20:42:31.875614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7670. [D 20:42:31.875632] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7671. [D 20:42:31.881086] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7671. [D 20:42:31.881106] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 54/70. [D 20:42:31.884135] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.884154] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.884170] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:31.923429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:31.923451] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.923467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:31.923490] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3122 [D 20:42:31.923508] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:31.923524] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 55/70. [D 20:42:31.927219] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3122 [D 20:42:31.927243] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 56/70. [D 20:42:31.927301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7671. [D 20:42:31.927318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7672. [D 20:42:31.927335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7673. [D 20:42:31.927350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7674. [D 20:42:31.927377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7675. [D 20:42:31.927391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7676. [D 20:42:31.927406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7677. [D 20:42:31.927421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7678. [D 20:42:31.927436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7679. [D 20:42:31.927483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7680. [D 20:42:31.927498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7681. [D 20:42:31.927513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7682. [D 20:42:31.927527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7683. [D 20:42:31.927542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7684. [D 20:42:31.927557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7685. [D 20:42:31.927571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7686. [D 20:42:31.927586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7687. [D 20:42:31.927604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7688. [D 20:42:31.927619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7689. [D 20:42:31.927634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7690. [D 20:42:31.927649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7691. [D 20:42:31.927663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7692. [D 20:42:31.927680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7693. [D 20:42:31.927705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7694. [D 20:42:31.927720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7695. [D 20:42:31.927734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7696. [D 20:42:31.927749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7697. [D 20:42:31.927764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7698. [D 20:42:31.927779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7699. [D 20:42:31.927838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7700. [D 20:42:31.927870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7701. [D 20:42:31.927889] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7702. [D 20:42:31.933240] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7702. [D 20:42:31.933262] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 57/70. [D 20:42:31.936271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:31.936290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:31.936305] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.059888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.059953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.059968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.060014] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3124 [D 20:42:32.060030] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:32.060050] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 58/70. [D 20:42:32.063636] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3124 [D 20:42:32.063662] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 59/70. [D 20:42:32.063712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7702. [D 20:42:32.063729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7703. [D 20:42:32.063744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7704. [D 20:42:32.063759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7705. [D 20:42:32.063774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7706. [D 20:42:32.063789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7707. [D 20:42:32.063804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7708. [D 20:42:32.063818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7709. [D 20:42:32.063836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7710. [D 20:42:32.063851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7711. [D 20:42:32.063865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7712. [D 20:42:32.063880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7713. [D 20:42:32.063896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7714. [D 20:42:32.063944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7715. [D 20:42:32.063967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7716. [D 20:42:32.063982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7717. [D 20:42:32.063997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7718. [D 20:42:32.064011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7719. [D 20:42:32.064026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7720. [D 20:42:32.064041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7721. [D 20:42:32.064056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7722. [D 20:42:32.064070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7723. [D 20:42:32.064085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7724. [D 20:42:32.064099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7725. [D 20:42:32.064125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7726. [D 20:42:32.064140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7727. [D 20:42:32.064155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7728. [D 20:42:32.064169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7729. [D 20:42:32.064184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7730. [D 20:42:32.064198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7731. [D 20:42:32.064213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7732. [D 20:42:32.064236] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7733. [D 20:42:32.069663] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7733. [D 20:42:32.069683] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 60/70. [D 20:42:32.069798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.069862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.069876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.141156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.141177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.141190] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.141229] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3127 [D 20:42:32.141245] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:32.141264] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 0/70. [D 20:42:32.145221] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3127 [D 20:42:32.145271] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 1/70. [D 20:42:32.145325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7733. [D 20:42:32.145342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7734. [D 20:42:32.145357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7735. [D 20:42:32.145372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7736. [D 20:42:32.145387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7737. [D 20:42:32.145402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7738. [D 20:42:32.145417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7739. [D 20:42:32.145438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7740. [D 20:42:32.145453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7741. [D 20:42:32.145467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7742. [D 20:42:32.145488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7743. [D 20:42:32.145513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7744. [D 20:42:32.145528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7745. [D 20:42:32.145543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7746. [D 20:42:32.145562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7747. [D 20:42:32.145576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7748. [D 20:42:32.145591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7749. [D 20:42:32.145606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7750. [D 20:42:32.145621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7751. [D 20:42:32.145636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7752. [D 20:42:32.145650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7753. [D 20:42:32.145665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7754. [D 20:42:32.145722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7755. [D 20:42:32.145744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7756. [D 20:42:32.145761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7757. [D 20:42:32.145788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7758. [D 20:42:32.145803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7759. [D 20:42:32.145818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7760. [D 20:42:32.145833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7761. [D 20:42:32.145847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7762. [D 20:42:32.145862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7763. [D 20:42:32.145877] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7764. [D 20:42:32.151249] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7764. [D 20:42:32.151269] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 2/70. [D 20:42:32.154306] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.154326] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.154341] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.742021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.742043] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.742061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.742174] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3130 [D 20:42:32.742197] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:32.742216] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 3/70. [D 20:42:32.745423] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3130 [D 20:42:32.745446] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 4/70. [D 20:42:32.745494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7764. [D 20:42:32.745514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7765. [D 20:42:32.745533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7766. [D 20:42:32.745551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7767. [D 20:42:32.745568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7768. [D 20:42:32.745586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7769. [D 20:42:32.745604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7770. [D 20:42:32.745622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7771. [D 20:42:32.745639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7772. [D 20:42:32.745657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7773. [D 20:42:32.745672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7774. [D 20:42:32.745690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7775. [D 20:42:32.745708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7776. [D 20:42:32.745725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7777. [D 20:42:32.745743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7778. [D 20:42:32.745761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7779. [D 20:42:32.745779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7780. [D 20:42:32.745797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7781. [D 20:42:32.745814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7782. [D 20:42:32.745832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7783. [D 20:42:32.745850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7784. [D 20:42:32.745868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7785. [D 20:42:32.745885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7786. [D 20:42:32.745903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7787. [D 20:42:32.745921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7788. [D 20:42:32.745939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7789. [D 20:42:32.745954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7790. [D 20:42:32.745969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7791. [D 20:42:32.745983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7792. [D 20:42:32.745998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7793. [D 20:42:32.746012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7794. [D 20:42:32.746027] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7795. [D 20:42:32.751419] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7795. [D 20:42:32.751435] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 5/70. [D 20:42:32.754489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.754505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.754519] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.836534] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.836597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.836612] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.836657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3133 [D 20:42:32.836672] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:32.836692] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 6/70. [D 20:42:32.840074] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3133 [D 20:42:32.840100] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 7/70. [D 20:42:32.844879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7795. [D 20:42:32.844901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7796. [D 20:42:32.844916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7797. [D 20:42:32.844930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7798. [D 20:42:32.844945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7799. [D 20:42:32.844960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7800. [D 20:42:32.844975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7801. [D 20:42:32.844989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7802. [D 20:42:32.845004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7803. [D 20:42:32.845018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7804. [D 20:42:32.845033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7805. [D 20:42:32.845048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7806. [D 20:42:32.845063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7807. [D 20:42:32.845077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7808. [D 20:42:32.845092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7809. [D 20:42:32.845106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7810. [D 20:42:32.845125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7811. [D 20:42:32.845140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7812. [D 20:42:32.845155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7813. [D 20:42:32.845170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7814. [D 20:42:32.845184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7815. [D 20:42:32.845199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7816. [D 20:42:32.845214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7817. [D 20:42:32.845229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7818. [D 20:42:32.845244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7819. [D 20:42:32.845259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7820. [D 20:42:32.845273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7821. [D 20:42:32.845288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7822. [D 20:42:32.845303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7823. [D 20:42:32.845318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7824. [D 20:42:32.845333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7825. [D 20:42:32.845348] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7826. [D 20:42:32.850837] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7826. [D 20:42:32.850853] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 8/70. [D 20:42:32.850941] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.851000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.851014] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.919318] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.919337] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.919350] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.919389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3136 [D 20:42:32.919404] element 0: offset: 0x2aaaab0206c0, size: 24 [D 20:42:32.919423] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 9/70. [D 20:42:32.922870] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3136 [D 20:42:32.922897] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 10/70. [D 20:42:32.922952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 7826. [D 20:42:32.922968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 7827. [D 20:42:32.922983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 7828. [D 20:42:32.922998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 7829. [D 20:42:32.923013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 7830. [D 20:42:32.923028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 7831. [D 20:42:32.923043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 7832. [D 20:42:32.923058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 7833. [D 20:42:32.923073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 7834. [D 20:42:32.923087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 7835. [D 20:42:32.923102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 7836. [D 20:42:32.923117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 7837. [D 20:42:32.923131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 7838. [D 20:42:32.923146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 7839. [D 20:42:32.923161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 7840. [D 20:42:32.923175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 7841. [D 20:42:32.923190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 7842. [D 20:42:32.923204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 7843. [D 20:42:32.923219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 7844. [D 20:42:32.923233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 7845. [D 20:42:32.923248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 7846. [D 20:42:32.923263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 7847. [D 20:42:32.923277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 7848. [D 20:42:32.923292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 7849. [D 20:42:32.923306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 7850. [D 20:42:32.923321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 7851. [D 20:42:32.923336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 7852. [D 20:42:32.923350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 7853. [D 20:42:32.923365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 7854. [D 20:42:32.923379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 7855. [D 20:42:32.923394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 7856. [D 20:42:32.923409] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 7857. [D 20:42:32.928838] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7857. [D 20:42:32.928853] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 11/70. [D 20:42:32.928938] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.928992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.929006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.972574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.972592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.972604] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.972642] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3140 [D 20:42:32.972657] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:32.972678] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 12/70. [D 20:42:32.976252] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3140 [D 20:42:32.976277] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 13/70. [D 20:42:32.976414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 7857. [D 20:42:32.976432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 7858. [D 20:42:32.976447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 7859. [D 20:42:32.976462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 7860. [D 20:42:32.976476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 7861. [D 20:42:32.976491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 7862. [D 20:42:32.976506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 7863. [D 20:42:32.976520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 7864. [D 20:42:32.976535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 7865. [D 20:42:32.976550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 7866. [D 20:42:32.976565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 7867. [D 20:42:32.976579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 7868. [D 20:42:32.976594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 7869. [D 20:42:32.976609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 7870. [D 20:42:32.976623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 7871. [D 20:42:32.976638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 7872. [D 20:42:32.976653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 7873. [D 20:42:32.976667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 7874. [D 20:42:32.976682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 7875. [D 20:42:32.976697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 7876. [D 20:42:32.976712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 7877. [D 20:42:32.976727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 7878. [D 20:42:32.976741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 7879. [D 20:42:32.976756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 7880. [D 20:42:32.976771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 7881. [D 20:42:32.976790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 7882. [D 20:42:32.976805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 7883. [D 20:42:32.976819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 7884. [D 20:42:32.976834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 7885. [D 20:42:32.976849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 7886. [D 20:42:32.976864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 7887. [D 20:42:32.976878] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 7888. [D 20:42:32.987103] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7888. [D 20:42:32.987124] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 14/70. [D 20:42:32.987208] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:32.987261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.987274] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:32.992192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:32.992210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:32.992222] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:32.992260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3142 [D 20:42:32.992274] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:32.992293] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 15/70. [D 20:42:32.995646] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3142 [D 20:42:32.995670] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 16/70. [D 20:42:32.995727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7888. [D 20:42:32.995745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7889. [D 20:42:32.995759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7890. [D 20:42:32.995774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7891. [D 20:42:32.995788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7892. [D 20:42:32.995803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7893. [D 20:42:32.995817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7894. [D 20:42:32.995832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7895. [D 20:42:32.995846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7896. [D 20:42:32.995861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7897. [D 20:42:32.995875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7898. [D 20:42:32.995890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7899. [D 20:42:32.995905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7900. [D 20:42:32.995919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7901. [D 20:42:32.995934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7902. [D 20:42:32.995949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7903. [D 20:42:32.995964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7904. [D 20:42:32.995979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7905. [D 20:42:32.995993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7906. [D 20:42:32.996008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7907. [D 20:42:32.996022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7908. [D 20:42:32.996037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7909. [D 20:42:32.996052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7910. [D 20:42:32.996066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7911. [D 20:42:32.996081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7912. [D 20:42:32.996095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7913. [D 20:42:32.996110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7914. [D 20:42:32.996124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7915. [D 20:42:32.996139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7916. [D 20:42:32.996154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7917. [D 20:42:32.996168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7918. [D 20:42:32.996183] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7919. [D 20:42:33.001689] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7919. [D 20:42:33.001706] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 17/70. [D 20:42:33.001794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.001849] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.001862] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.046144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.046163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.046176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.046213] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3145 [D 20:42:33.046228] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:33.046247] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 18/70. [D 20:42:33.049780] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3145 [D 20:42:33.049806] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 19/70. [D 20:42:33.049855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7919. [D 20:42:33.049871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7920. [D 20:42:33.049886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7921. [D 20:42:33.049901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7922. [D 20:42:33.049916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7923. [D 20:42:33.049932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7924. [D 20:42:33.049946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7925. [D 20:42:33.049961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7926. [D 20:42:33.049976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7927. [D 20:42:33.049991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7928. [D 20:42:33.050006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7929. [D 20:42:33.050021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7930. [D 20:42:33.050035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7931. [D 20:42:33.050050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7932. [D 20:42:33.050065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7933. [D 20:42:33.050080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7934. [D 20:42:33.050095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7935. [D 20:42:33.050110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7936. [D 20:42:33.050124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7937. [D 20:42:33.050139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 7938. [D 20:42:33.050154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 7939. [D 20:42:33.050169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 7940. [D 20:42:33.050184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 7941. [D 20:42:33.050198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 7942. [D 20:42:33.050213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 7943. [D 20:42:33.050228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 7944. [D 20:42:33.050243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 7945. [D 20:42:33.050258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 7946. [D 20:42:33.050272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 7947. [D 20:42:33.050287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 7948. [D 20:42:33.050302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 7949. [D 20:42:33.050317] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 7950. [D 20:42:33.055797] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7950. [D 20:42:33.055813] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 20/70. [D 20:42:33.055898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.055954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.055968] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.130286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.130305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.130318] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.130356] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3148 [D 20:42:33.130371] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:33.130390] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 21/70. [D 20:42:33.133934] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3148 [D 20:42:33.133960] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 22/70. [D 20:42:33.134012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 7950. [D 20:42:33.134029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 7951. [D 20:42:33.134044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 7952. [D 20:42:33.134059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 7953. [D 20:42:33.134073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 7954. [D 20:42:33.134088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 7955. [D 20:42:33.134102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 7956. [D 20:42:33.134117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 7957. [D 20:42:33.134132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 7958. [D 20:42:33.134147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 7959. [D 20:42:33.134161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 7960. [D 20:42:33.134176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 7961. [D 20:42:33.134191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 7962. [D 20:42:33.134205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 7963. [D 20:42:33.134220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 7964. [D 20:42:33.134235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 7965. [D 20:42:33.134249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 7966. [D 20:42:33.134264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 7967. [D 20:42:33.134279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 7968. [D 20:42:33.134293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 7969. [D 20:42:33.134308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 7970. [D 20:42:33.134323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 7971. [D 20:42:33.134337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 7972. [D 20:42:33.134352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 7973. [D 20:42:33.134368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 7974. [D 20:42:33.134382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 7975. [D 20:42:33.134397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 7976. [D 20:42:33.134411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 7977. [D 20:42:33.134426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 7978. [D 20:42:33.134441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 7979. [D 20:42:33.134456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 7980. [D 20:42:33.134470] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 7981. [D 20:42:33.139969] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 7981. [D 20:42:33.139984] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 23/70. [D 20:42:33.140067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.140122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.140135] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.189395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.189414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.189426] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.189463] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3151 [D 20:42:33.189479] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:33.189498] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 24/70. [D 20:42:33.193019] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3151 [D 20:42:33.193045] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 25/70. [D 20:42:33.193095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 7981. [D 20:42:33.193112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 7982. [D 20:42:33.193127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 7983. [D 20:42:33.193142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 7984. [D 20:42:33.193156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 7985. [D 20:42:33.193171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 7986. [D 20:42:33.193186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 7987. [D 20:42:33.193201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 7988. [D 20:42:33.193215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 7989. [D 20:42:33.193230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 7990. [D 20:42:33.193245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 7991. [D 20:42:33.193259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 7992. [D 20:42:33.193274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 7993. [D 20:42:33.193289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 7994. [D 20:42:33.193305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 7995. [D 20:42:33.193320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 7996. [D 20:42:33.193334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 7997. [D 20:42:33.193349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 7998. [D 20:42:33.193364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 7999. [D 20:42:33.193379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8000. [D 20:42:33.193394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8001. [D 20:42:33.193409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8002. [D 20:42:33.193424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8003. [D 20:42:33.193439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8004. [D 20:42:33.193454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8005. [D 20:42:33.193469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8006. [D 20:42:33.193484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8007. [D 20:42:33.193499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8008. [D 20:42:33.193514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8009. [D 20:42:33.193529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8010. [D 20:42:33.193544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8011. [D 20:42:33.193559] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8012. [D 20:42:33.199043] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8012. [D 20:42:33.199059] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 26/70. [D 20:42:33.199143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.199198] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.199212] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.299128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.299146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.299158] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.299197] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3154 [D 20:42:33.299212] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:33.299231] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 27/70. [D 20:42:33.302679] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3154 [D 20:42:33.302706] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 28/70. [D 20:42:33.302754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8012. [D 20:42:33.302771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8013. [D 20:42:33.302786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8014. [D 20:42:33.302801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8015. [D 20:42:33.302817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8016. [D 20:42:33.302831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8017. [D 20:42:33.302846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8018. [D 20:42:33.302860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8019. [D 20:42:33.302875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8020. [D 20:42:33.302890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8021. [D 20:42:33.302904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8022. [D 20:42:33.302919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8023. [D 20:42:33.302933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8024. [D 20:42:33.302948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8025. [D 20:42:33.302963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8026. [D 20:42:33.302977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8027. [D 20:42:33.302992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8028. [D 20:42:33.303006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8029. [D 20:42:33.303021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8030. [D 20:42:33.303036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8031. [D 20:42:33.303050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8032. [D 20:42:33.303065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8033. [D 20:42:33.303080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8034. [D 20:42:33.303094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8035. [D 20:42:33.303109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8036. [D 20:42:33.303123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8037. [D 20:42:33.303138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8038. [D 20:42:33.303152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8039. [D 20:42:33.303167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8040. [D 20:42:33.303182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8041. [D 20:42:33.303196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8042. [D 20:42:33.303211] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8043. [D 20:42:33.308635] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8043. [D 20:42:33.308651] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 29/70. [D 20:42:33.308735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.308789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.308804] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.350072] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.350090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.350103] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.350140] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3158 [D 20:42:33.350155] element 0: offset: 0x2aaaab0206c0, size: 24 [D 20:42:33.350174] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 30/70. [D 20:42:33.353625] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3158 [D 20:42:33.353650] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 31/70. [D 20:42:33.353702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8043. [D 20:42:33.353719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8044. [D 20:42:33.353734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8045. [D 20:42:33.353748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8046. [D 20:42:33.353763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8047. [D 20:42:33.353778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8048. [D 20:42:33.353793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8049. [D 20:42:33.353808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8050. [D 20:42:33.353823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8051. [D 20:42:33.353838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8052. [D 20:42:33.353853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8053. [D 20:42:33.353868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8054. [D 20:42:33.353883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8055. [D 20:42:33.353898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8056. [D 20:42:33.353913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8057. [D 20:42:33.353928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8058. [D 20:42:33.353943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8059. [D 20:42:33.353957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8060. [D 20:42:33.353973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8061. [D 20:42:33.353987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8062. [D 20:42:33.354002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8063. [D 20:42:33.354018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8064. [D 20:42:33.354032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8065. [D 20:42:33.354048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8066. [D 20:42:33.354063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8067. [D 20:42:33.354078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8068. [D 20:42:33.354092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8069. [D 20:42:33.354107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8070. [D 20:42:33.354121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8071. [D 20:42:33.354135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8072. [D 20:42:33.354150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8073. [D 20:42:33.354164] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8074. [D 20:42:33.359648] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8074. [D 20:42:33.359664] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 32/70. [D 20:42:33.359748] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.359803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.359817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.379756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.379774] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.379787] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.379825] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3160 [D 20:42:33.379840] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:33.379859] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 33/70. [D 20:42:33.383515] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3160 [D 20:42:33.383542] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 34/70. [D 20:42:33.383679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8074. [D 20:42:33.383696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8075. [D 20:42:33.383710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8076. [D 20:42:33.383725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8077. [D 20:42:33.383739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8078. [D 20:42:33.383753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8079. [D 20:42:33.383768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8080. [D 20:42:33.383783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8081. [D 20:42:33.383797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8082. [D 20:42:33.383811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8083. [D 20:42:33.383826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8084. [D 20:42:33.383840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8085. [D 20:42:33.383855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8086. [D 20:42:33.383871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8087. [D 20:42:33.383885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8088. [D 20:42:33.383900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8089. [D 20:42:33.383915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8090. [D 20:42:33.383930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8091. [D 20:42:33.383945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8092. [D 20:42:33.383960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8093. [D 20:42:33.383975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8094. [D 20:42:33.383990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8095. [D 20:42:33.384005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8096. [D 20:42:33.384020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8097. [D 20:42:33.384035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8098. [D 20:42:33.384050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8099. [D 20:42:33.384065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8100. [D 20:42:33.384080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8101. [D 20:42:33.384095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8102. [D 20:42:33.384110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8103. [D 20:42:33.384125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8104. [D 20:42:33.384140] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8105. [D 20:42:33.391184] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8105. [D 20:42:33.391205] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 35/70. [D 20:42:33.391291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.391349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.391362] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.393280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.393295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.393307] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.393345] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3163 [D 20:42:33.393360] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:33.393380] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 36/70. [D 20:42:33.396943] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3163 [D 20:42:33.396969] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 37/70. [D 20:42:33.397021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 8105. [D 20:42:33.397037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 8106. [D 20:42:33.397052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 8107. [D 20:42:33.397068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 8108. [D 20:42:33.397083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 8109. [D 20:42:33.397098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 8110. [D 20:42:33.397113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 8111. [D 20:42:33.397127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 8112. [D 20:42:33.397142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 8113. [D 20:42:33.397157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 8114. [D 20:42:33.397171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 8115. [D 20:42:33.397186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 8116. [D 20:42:33.397200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 8117. [D 20:42:33.397215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 8118. [D 20:42:33.397230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 8119. [D 20:42:33.397245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 8120. [D 20:42:33.397259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 8121. [D 20:42:33.397274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 8122. [D 20:42:33.397289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 8123. [D 20:42:33.397303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 8124. [D 20:42:33.397318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 8125. [D 20:42:33.397333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 8126. [D 20:42:33.397347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 8127. [D 20:42:33.397362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 8128. [D 20:42:33.397376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 8129. [D 20:42:33.397391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 8130. [D 20:42:33.397406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 8131. [D 20:42:33.397421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 8132. [D 20:42:33.397435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 8133. [D 20:42:33.397450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 8134. [D 20:42:33.397465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 8135. [D 20:42:33.397479] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 8136. [D 20:42:33.402944] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8136. [D 20:42:33.402959] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 38/70. [D 20:42:33.403043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.403098] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.403112] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.449074] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.449093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.449105] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.449143] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3166 [D 20:42:33.449158] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:33.449178] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 39/70. [D 20:42:33.452680] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3166 [D 20:42:33.452706] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 40/70. [D 20:42:33.452756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8136. [D 20:42:33.452772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8137. [D 20:42:33.452787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8138. [D 20:42:33.452802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8139. [D 20:42:33.452820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8140. [D 20:42:33.452835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8141. [D 20:42:33.452849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8142. [D 20:42:33.452864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8143. [D 20:42:33.452879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8144. [D 20:42:33.452894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8145. [D 20:42:33.452908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8146. [D 20:42:33.452923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8147. [D 20:42:33.452938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8148. [D 20:42:33.452953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8149. [D 20:42:33.452967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8150. [D 20:42:33.452982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8151. [D 20:42:33.452997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8152. [D 20:42:33.453012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8153. [D 20:42:33.453027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8154. [D 20:42:33.453041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8155. [D 20:42:33.453056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8156. [D 20:42:33.453071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8157. [D 20:42:33.871447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8158. [D 20:42:33.871532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8159. [D 20:42:33.871550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8160. [D 20:42:33.871564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8161. [D 20:42:33.871579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8162. [D 20:42:33.871594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8163. [D 20:42:33.871609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8164. [D 20:42:33.871627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8165. [D 20:42:33.871642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8166. [D 20:42:33.871657] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8167. [D 20:42:33.873511] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8167. [D 20:42:33.873578] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 41/70. [D 20:42:33.877545] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.877568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.877582] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:33.877614] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3169 [D 20:42:33.877631] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:33.877646] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 42/70. [D 20:42:33.877683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.877698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.877711] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:33.877732] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3173 [D 20:42:33.877747] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:33.877761] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 43/70. [D 20:42:33.877783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.877797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.877810] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:33.877830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3175 [D 20:42:33.877845] element 0: offset: 0x2aaaab00fd20, size: 24 [D 20:42:33.877860] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 44/70. [D 20:42:33.877886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.877904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.877917] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:33.887529] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 3173 [D 20:42:33.887638] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 45/70. [D 20:42:33.887747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8167. [D 20:42:33.887768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8168. [D 20:42:33.887783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8169. [D 20:42:33.887798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8170. [D 20:42:33.887813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8171. [D 20:42:33.887829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8172. [D 20:42:33.887844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8173. [D 20:42:33.887859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8174. [D 20:42:33.887873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8175. [D 20:42:33.887889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8176. [D 20:42:33.887903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8177. [D 20:42:33.887918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8178. [D 20:42:33.887933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8179. [D 20:42:33.887948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8180. [D 20:42:33.887963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8181. [D 20:42:33.887978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8182. [D 20:42:33.887994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8183. [D 20:42:33.888009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8184. [D 20:42:33.888024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8185. [D 20:42:33.888039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8186. [D 20:42:33.888053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8187. [D 20:42:33.888068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8188. [D 20:42:33.888083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8189. [D 20:42:33.888098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8190. [D 20:42:33.888112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8191. [D 20:42:33.888127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8192. [D 20:42:33.888142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8193. [D 20:42:33.888156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8194. [D 20:42:33.888171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8195. [D 20:42:33.888186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8196. [D 20:42:33.888201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8197. [D 20:42:33.888215] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8198. [D 20:42:33.891383] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3175 [D 20:42:33.891405] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 46/70. [D 20:42:33.891656] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3169 [D 20:42:33.891675] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 47/70. [D 20:42:33.893675] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8198. [D 20:42:33.893693] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 48/70. [D 20:42:33.893709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8198. [D 20:42:33.893728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8199. [D 20:42:33.893743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8200. [D 20:42:33.893757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8201. [D 20:42:33.893772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8202. [D 20:42:33.893787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8203. [D 20:42:33.893831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8204. [D 20:42:33.893851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8205. [D 20:42:33.893865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8206. [D 20:42:33.893880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8207. [D 20:42:33.893895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8208. [D 20:42:33.893910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8209. [D 20:42:33.893925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8210. [D 20:42:33.893940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8211. [D 20:42:33.893954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8212. [D 20:42:33.893970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8213. [D 20:42:33.893985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8214. [D 20:42:33.893999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8215. [D 20:42:33.894018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8216. [D 20:42:33.894040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8217. [D 20:42:33.894054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8218. [D 20:42:33.894073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8219. [D 20:42:33.894088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8220. [D 20:42:33.894102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8221. [D 20:42:33.894117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8222. [D 20:42:33.894132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8223. [D 20:42:33.894151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8224. [D 20:42:33.894165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8225. [D 20:42:33.894185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8226. [D 20:42:33.894200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8227. [D 20:42:33.894215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8228. [D 20:42:33.894230] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8229. [D 20:42:33.894252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 8230. [D 20:42:33.894267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 8231. [D 20:42:33.894282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 8232. [D 20:42:33.894297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 8233. [D 20:42:33.894312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 8234. [D 20:42:33.894327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 8235. [D 20:42:33.894342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 8236. [D 20:42:33.894362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 8237. [D 20:42:33.894377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 8238. [D 20:42:33.894391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 8239. [D 20:42:33.894407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 8240. [D 20:42:33.894422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 8241. [D 20:42:33.894437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 8242. [D 20:42:33.894452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 8243. [D 20:42:33.894468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 8244. [D 20:42:33.894486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 8245. [D 20:42:33.894501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 8246. [D 20:42:33.894518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 8247. [D 20:42:33.894534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 8248. [D 20:42:33.894548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 8249. [D 20:42:33.894563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 8250. [D 20:42:33.894579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 8251. [D 20:42:33.894598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 8252. [D 20:42:33.894613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 8253. [D 20:42:33.894628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 8254. [D 20:42:33.894644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 8255. [D 20:42:33.894659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 8256. [D 20:42:33.894674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 8257. [D 20:42:33.894693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 8258. [D 20:42:33.894708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 8259. [D 20:42:33.894722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 8260. [D 20:42:33.894739] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 8261. [D 20:42:33.895657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.895676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.895690] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:33.899597] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 8261. [D 20:42:33.899615] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 49/70. [D 20:42:33.905443] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 8260. [D 20:42:33.905461] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 50/70. [D 20:42:33.908533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.908549] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.908563] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:33.908627] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.908642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.908656] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:33.929893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:33.929927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.929945] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:33.929985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3179 [D 20:42:33.930003] element 0: offset: 0x2aaaab0207c0, size: 24 [D 20:42:33.930019] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 51/70. [D 20:42:33.935713] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3179 [D 20:42:33.935801] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 52/70. [D 20:42:33.935864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8260. [D 20:42:33.935883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 8261. [D 20:42:33.935898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 8262. [D 20:42:33.935913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 8263. [D 20:42:33.935927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 8264. [D 20:42:33.935942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 8265. [D 20:42:33.935973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8266. [D 20:42:33.935987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8267. [D 20:42:33.936002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8268. [D 20:42:33.936026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 8269. [D 20:42:33.936041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 8270. [D 20:42:33.936055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 8271. [D 20:42:33.936070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 8272. [D 20:42:33.936084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 8273. [D 20:42:33.936103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8274. [D 20:42:33.936119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8275. [D 20:42:33.936134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8276. [D 20:42:33.936148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 8277. [D 20:42:33.936163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 8278. [D 20:42:33.936178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 8279. [D 20:42:33.936193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 8280. [D 20:42:33.936208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 8281. [D 20:42:33.936257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8282. [D 20:42:33.936281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8283. [D 20:42:33.936296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8284. [D 20:42:33.936311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 8285. [D 20:42:33.936326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 8286. [D 20:42:33.936341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 8287. [D 20:42:33.936357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 8288. [D 20:42:33.936371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 8289. [D 20:42:33.936386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8290. [D 20:42:33.936400] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8291. [D 20:42:33.941763] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8291. [D 20:42:33.941785] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 53/70. [D 20:42:33.944776] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:33.944797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:33.944813] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.008573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.008597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.008613] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.008654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3181 [D 20:42:34.008671] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:34.008686] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 54/70. [D 20:42:34.012307] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3181 [D 20:42:34.012394] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 55/70. [D 20:42:34.015848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 8291. [D 20:42:34.015872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 8292. [D 20:42:34.015890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 8293. [D 20:42:34.015905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 8294. [D 20:42:34.015920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 8295. [D 20:42:34.015934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 8296. [D 20:42:34.015949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 8297. [D 20:42:34.015963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 8298. [D 20:42:34.015978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 8299. [D 20:42:34.016001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 8300. [D 20:42:34.016016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 8301. [D 20:42:34.016030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 8302. [D 20:42:34.016049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 8303. [D 20:42:34.016064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 8304. [D 20:42:34.016079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 8305. [D 20:42:34.016094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 8306. [D 20:42:34.016109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 8307. [D 20:42:34.016124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 8308. [D 20:42:34.016139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 8309. [D 20:42:34.016185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 8310. [D 20:42:34.016214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 8311. [D 20:42:34.016229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 8312. [D 20:42:34.016243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 8313. [D 20:42:34.016258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 8314. [D 20:42:34.016273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 8315. [D 20:42:34.016287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 8316. [D 20:42:34.016302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 8317. [D 20:42:34.016321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 8318. [D 20:42:34.016335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 8319. [D 20:42:34.016350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 8320. [D 20:42:34.016364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 8321. [D 20:42:34.016379] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 8322. [D 20:42:34.019604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.019631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.019649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:34.019692] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3185 [D 20:42:34.019709] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:34.019725] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:42:34.021746] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8322. [D 20:42:34.021769] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 57/70. [D 20:42:34.024820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.024845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.024860] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:34.028194] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3185 [D 20:42:34.028217] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 58/70. [D 20:42:34.028279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8322. [D 20:42:34.028296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 8323. [D 20:42:34.028311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 8324. [D 20:42:34.028326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 8325. [D 20:42:34.028343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 8326. [D 20:42:34.028358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 8327. [D 20:42:34.028373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8328. [D 20:42:34.028387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8329. [D 20:42:34.028407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8330. [D 20:42:34.028421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 8331. [D 20:42:34.028436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 8332. [D 20:42:34.028464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 8333. [D 20:42:34.028479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 8334. [D 20:42:34.028494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 8335. [D 20:42:34.028509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8336. [D 20:42:34.028547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8337. [D 20:42:34.028562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8338. [D 20:42:34.028582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 8339. [D 20:42:34.028597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 8340. [D 20:42:34.028612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 8341. [D 20:42:34.028626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 8342. [D 20:42:34.028641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 8343. [D 20:42:34.028655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8344. [D 20:42:34.028670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8345. [D 20:42:34.028685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8346. [D 20:42:34.028699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 8347. [D 20:42:34.028714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 8348. [D 20:42:34.028729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 8349. [D 20:42:34.028743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 8350. [D 20:42:34.028773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 8351. [D 20:42:34.028818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8352. [D 20:42:34.028840] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8353. [D 20:42:34.036235] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8353. [D 20:42:34.036258] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 59/70. [D 20:42:34.039638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.039658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.039676] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.039698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.039713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.039726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.039749] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3187 [D 20:42:34.039775] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:34.039790] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 60/70. [D 20:42:34.047687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.047750] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.047765] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:34.047809] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3190 [D 20:42:34.047824] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:34.047845] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 0/70. [D 20:42:34.051189] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3187 [D 20:42:34.051268] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 1/70. [D 20:42:34.051343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8353. [D 20:42:34.051363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8354. [D 20:42:34.051378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 8355. [D 20:42:34.051393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 8356. [D 20:42:34.051413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 8357. [D 20:42:34.051427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 8358. [D 20:42:34.051442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 8359. [D 20:42:34.051456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8360. [D 20:42:34.051471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8361. [D 20:42:34.051486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8362. [D 20:42:34.051503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 8363. [D 20:42:34.051517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 8364. [D 20:42:34.051537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 8365. [D 20:42:34.051551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 8366. [D 20:42:34.051566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 8367. [D 20:42:34.051581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8368. [D 20:42:34.051595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8369. [D 20:42:34.051610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8370. [D 20:42:34.051647] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3190 [D 20:42:34.051629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8371. [D 20:42:34.051688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8372. [D 20:42:34.051744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8373. [D 20:42:34.051759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8374. [D 20:42:34.051773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8375. [D 20:42:34.051788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8376. [D 20:42:34.051802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8377. [D 20:42:34.051817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8378. [D 20:42:34.051831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8379. [D 20:42:34.051846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8380. [D 20:42:34.051860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8381. [D 20:42:34.051875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8382. [D 20:42:34.051890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8383. [D 20:42:34.051904] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8384. [D 20:42:34.051925] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 2/70. [D 20:42:34.057230] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8384. [D 20:42:34.057253] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 3/70. [D 20:42:34.057271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8384. [D 20:42:34.057286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8385. [D 20:42:34.057301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8386. [D 20:42:34.057315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8387. [D 20:42:34.057330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8388. [D 20:42:34.057344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8389. [D 20:42:34.057359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8390. [D 20:42:34.057378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8391. [D 20:42:34.057392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8392. [D 20:42:34.057407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8393. [D 20:42:34.057426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8394. [D 20:42:34.057440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8395. [D 20:42:34.057455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8396. [D 20:42:34.057470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8397. [D 20:42:34.057485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8398. [D 20:42:34.057499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8399. [D 20:42:34.057514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8400. [D 20:42:34.057545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8401. [D 20:42:34.057563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8402. [D 20:42:34.057582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8403. [D 20:42:34.057597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8404. [D 20:42:34.057611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8405. [D 20:42:34.057626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8406. [D 20:42:34.057642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8407. [D 20:42:34.057656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8408. [D 20:42:34.057671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8409. [D 20:42:34.057686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8410. [D 20:42:34.057704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8411. [D 20:42:34.057719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8412. [D 20:42:34.057733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8413. [D 20:42:34.057748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8414. [D 20:42:34.057775] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8415. [D 20:42:34.057863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.057924] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.057938] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:34.063230] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 8415. [D 20:42:34.063253] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 4/70. [D 20:42:34.063329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.063352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.063365] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.097200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.097222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.097235] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.097275] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3194 [D 20:42:34.097290] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:34.097310] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 5/70. [D 20:42:34.101037] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3194 [D 20:42:34.101069] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 6/70. [D 20:42:34.101128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 8415. [D 20:42:34.101145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 8416. [D 20:42:34.101163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 8417. [D 20:42:34.101179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 8418. [D 20:42:34.101194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 8419. [D 20:42:34.101209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 8420. [D 20:42:34.101224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8421. [D 20:42:34.101246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8422. [D 20:42:34.101261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8423. [D 20:42:34.101275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 8424. [D 20:42:34.101294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 8425. [D 20:42:34.101309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 8426. [D 20:42:34.101324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 8427. [D 20:42:34.101339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 8428. [D 20:42:34.101353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8429. [D 20:42:34.101368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8430. [D 20:42:34.101383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8431. [D 20:42:34.101417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 8432. [D 20:42:34.101432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 8433. [D 20:42:34.101455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 8434. [D 20:42:34.101470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 8435. [D 20:42:34.101485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 8436. [D 20:42:34.101499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8437. [D 20:42:34.101514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8438. [D 20:42:34.101529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8439. [D 20:42:34.101543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 8440. [D 20:42:34.101558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 8441. [D 20:42:34.101572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 8442. [D 20:42:34.101591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 8443. [D 20:42:34.101606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 8444. [D 20:42:34.101621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8445. [D 20:42:34.101635] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8446. [D 20:42:34.107066] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8446. [D 20:42:34.107085] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 7/70. [D 20:42:34.107190] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.107248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.107261] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.139287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.139309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.139322] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.139361] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3196 [D 20:42:34.139376] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:34.139396] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 8/70. [D 20:42:34.143852] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3196 [D 20:42:34.143878] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 9/70. [D 20:42:34.143944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8446. [D 20:42:34.144024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8447. [D 20:42:34.144044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8448. [D 20:42:34.144060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8449. [D 20:42:34.144075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8450. [D 20:42:34.144090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8451. [D 20:42:34.144109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8452. [D 20:42:34.144124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8453. [D 20:42:34.144139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8454. [D 20:42:34.144159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8455. [D 20:42:34.144174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8456. [D 20:42:34.144189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8457. [D 20:42:34.144207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8458. [D 20:42:34.144222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8459. [D 20:42:34.144236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8460. [D 20:42:34.144251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8461. [D 20:42:34.144266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8462. [D 20:42:34.144280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8463. [D 20:42:34.144296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8464. [D 20:42:34.144330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8465. [D 20:42:34.144348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8466. [D 20:42:34.144367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8467. [D 20:42:34.144382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8468. [D 20:42:34.144397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8469. [D 20:42:34.144412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8470. [D 20:42:34.144429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8471. [D 20:42:34.144444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8472. [D 20:42:34.144458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8473. [D 20:42:34.144473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8474. [D 20:42:34.144492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8475. [D 20:42:34.144507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8476. [D 20:42:34.144522] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8477. [D 20:42:34.149979] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8477. [D 20:42:34.150002] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 10/70. [D 20:42:34.150108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.150130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.150143] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.197668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.197688] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.197702] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.197725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3200 [D 20:42:34.197739] element 0: offset: 0x2aaaab027ae0, size: 24 [D 20:42:34.197757] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 11/70. [D 20:42:34.201611] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3200 [D 20:42:34.201675] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 12/70. [D 20:42:34.201736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 8477. [D 20:42:34.201761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 8478. [D 20:42:34.201776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 8479. [D 20:42:34.201803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 8480. [D 20:42:34.201818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 8481. [D 20:42:34.201832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 8482. [D 20:42:34.201847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8483. [D 20:42:34.201862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8484. [D 20:42:34.201885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8485. [D 20:42:34.201900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 8486. [D 20:42:34.201914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 8487. [D 20:42:34.201933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 8488. [D 20:42:34.201948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 8489. [D 20:42:34.201962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 8490. [D 20:42:34.201977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8491. [D 20:42:34.201992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8492. [D 20:42:34.202007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8493. [D 20:42:34.202022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 8494. [D 20:42:34.202057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 8495. [D 20:42:34.202076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 8496. [D 20:42:34.202095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 8497. [D 20:42:34.202110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 8498. [D 20:42:34.202125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8499. [D 20:42:34.202140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8500. [D 20:42:34.202157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8501. [D 20:42:34.202171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 8502. [D 20:42:34.202186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 8503. [D 20:42:34.202214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 8504. [D 20:42:34.202229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 8505. [D 20:42:34.202243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 8506. [D 20:42:34.202258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8507. [D 20:42:34.202272] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8508. [D 20:42:34.207674] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8508. [D 20:42:34.207694] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 13/70. [D 20:42:34.207790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.207815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.207828] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.315661] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.315683] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.315695] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.315733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3202 [D 20:42:34.315748] element 0: offset: 0x2aaaab030fb0, size: 24 [D 20:42:34.315764] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 14/70. [D 20:42:34.319449] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3202 [D 20:42:34.319523] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 15/70. [D 20:42:34.319664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8508. [D 20:42:34.319690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8509. [D 20:42:34.319706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8510. [D 20:42:34.319721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8511. [D 20:42:34.319736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8512. [D 20:42:34.319750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8513. [D 20:42:34.319765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8514. [D 20:42:34.319780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8515. [D 20:42:34.319801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8516. [D 20:42:34.319839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8517. [D 20:42:34.319854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8518. [D 20:42:34.319873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8519. [D 20:42:34.319887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8520. [D 20:42:34.319902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8521. [D 20:42:34.319916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8522. [D 20:42:34.319931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8523. [D 20:42:34.319949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8524. [D 20:42:34.319966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8525. [D 20:42:34.319992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8526. [D 20:42:34.320033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8527. [D 20:42:34.320054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8528. [D 20:42:34.320076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8529. [D 20:42:34.320091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8530. [D 20:42:34.320105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8531. [D 20:42:34.320120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8532. [D 20:42:34.320134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8533. [D 20:42:34.320149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8534. [D 20:42:34.320164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8535. [D 20:42:34.320182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8536. [D 20:42:34.320197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8537. [D 20:42:34.320226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8538. [D 20:42:34.320241] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8539. [D 20:42:34.326898] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8539. [D 20:42:34.326923] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 16/70. [D 20:42:34.327020] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.327045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.327059] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.328087] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.328107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.328120] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.328158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3206 [D 20:42:34.328172] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:34.328191] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 17/70. [D 20:42:34.334262] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3206 [D 20:42:34.334289] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 18/70. [D 20:42:34.334362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 8539. [D 20:42:34.334428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 8540. [D 20:42:34.334444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 8541. [D 20:42:34.334460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 8542. [D 20:42:34.334476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 8543. [D 20:42:34.334491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 8544. [D 20:42:34.334513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8545. [D 20:42:34.334527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8546. [D 20:42:34.334543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8547. [D 20:42:34.334565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 8548. [D 20:42:34.334580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 8549. [D 20:42:34.334595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 8550. [D 20:42:34.334639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 8551. [D 20:42:34.334656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 8552. [D 20:42:34.334673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8553. [D 20:42:34.334688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8554. [D 20:42:34.334702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8555. [D 20:42:34.334733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 8556. [D 20:42:34.334751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 8557. [D 20:42:34.334766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 8558. [D 20:42:34.334786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 8559. [D 20:42:34.334800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 8560. [D 20:42:34.334819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8561. [D 20:42:34.334834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8562. [D 20:42:34.334849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8563. [D 20:42:34.334864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 8564. [D 20:42:34.334883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 8565. [D 20:42:34.334897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 8566. [D 20:42:34.334912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 8567. [D 20:42:34.334926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 8568. [D 20:42:34.334952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8569. [D 20:42:34.334967] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8570. [D 20:42:34.340368] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8570. [D 20:42:34.340391] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 19/70. [D 20:42:34.340465] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.340487] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.340500] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.372507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.372528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.372541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.372564] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3208 [D 20:42:34.372578] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:34.372594] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 20/70. [D 20:42:34.376349] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3208 [D 20:42:34.376412] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 21/70. [D 20:42:34.376475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8570. [D 20:42:34.376501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8571. [D 20:42:34.376517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 8572. [D 20:42:34.376544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 8573. [D 20:42:34.376559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 8574. [D 20:42:34.376574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 8575. [D 20:42:34.376589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 8576. [D 20:42:34.376604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8577. [D 20:42:34.376618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8578. [D 20:42:34.376637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8579. [D 20:42:34.376657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 8580. [D 20:42:34.376673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 8581. [D 20:42:34.376688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 8582. [D 20:42:34.376710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 8583. [D 20:42:34.376738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 8584. [D 20:42:34.376757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8585. [D 20:42:34.376776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8586. [D 20:42:34.376791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8587. [D 20:42:34.376806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8588. [D 20:42:34.376820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8589. [D 20:42:34.376835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8590. [D 20:42:34.376849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8591. [D 20:42:34.376867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8592. [D 20:42:34.376894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8593. [D 20:42:34.376909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8594. [D 20:42:34.376924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8595. [D 20:42:34.376939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8596. [D 20:42:34.376972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8597. [D 20:42:34.376987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8598. [D 20:42:34.377011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8599. [D 20:42:34.377026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8600. [D 20:42:34.377040] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8601. [D 20:42:34.382433] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8601. [D 20:42:34.382453] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 22/70. [D 20:42:34.382550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.382574] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.382587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.399637] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.399657] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.399670] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.399705] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3211 [D 20:42:34.399720] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:34.399739] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 23/70. [D 20:42:34.403410] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3211 [D 20:42:34.403488] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 24/70. [D 20:42:34.403544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 8601. [D 20:42:34.403570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 8602. [D 20:42:34.403585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 8603. [D 20:42:34.403600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 8604. [D 20:42:34.403615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 8605. [D 20:42:34.403639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 8606. [D 20:42:34.403654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 8607. [D 20:42:34.403673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 8608. [D 20:42:34.403687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 8609. [D 20:42:34.403702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 8610. [D 20:42:34.403717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 8611. [D 20:42:34.403732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 8612. [D 20:42:34.403746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 8613. [D 20:42:34.403761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 8614. [D 20:42:34.403776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 8615. [D 20:42:34.403791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 8616. [D 20:42:34.403806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 8617. [D 20:42:34.403851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 8618. [D 20:42:34.403870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 8619. [D 20:42:34.403884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 8620. [D 20:42:34.403899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 8621. [D 20:42:34.403914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 8622. [D 20:42:34.403929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 8623. [D 20:42:34.403943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 8624. [D 20:42:34.403958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 8625. [D 20:42:34.403972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 8626. [D 20:42:34.403987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 8627. [D 20:42:34.404013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 8628. [D 20:42:34.404027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 8629. [D 20:42:34.404042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 8630. [D 20:42:34.404057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 8631. [D 20:42:34.404072] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 8632. [D 20:42:34.409478] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8632. [D 20:42:34.409498] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 25/70. [D 20:42:34.409594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.409619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.409632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.440857] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.440879] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.440891] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.440928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3214 [D 20:42:34.440943] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:34.440961] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 26/70. [D 20:42:34.446881] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3214 [D 20:42:34.446961] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 27/70. [D 20:42:34.447022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8632. [D 20:42:34.447046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8633. [D 20:42:34.447061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8634. [D 20:42:34.447076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8635. [D 20:42:34.447091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8636. [D 20:42:34.447105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8637. [D 20:42:34.447120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8638. [D 20:42:34.447135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8639. [D 20:42:34.447149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8640. [D 20:42:34.447164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8641. [D 20:42:34.447179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8642. [D 20:42:34.447194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8643. [D 20:42:34.447209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8644. [D 20:42:34.447223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8645. [D 20:42:34.447238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8646. [D 20:42:34.447253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8647. [D 20:42:34.447268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8648. [D 20:42:34.447282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8649. [D 20:42:34.447336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8650. [D 20:42:34.447355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8651. [D 20:42:34.447370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8652. [D 20:42:34.447385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8653. [D 20:42:34.447399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8654. [D 20:42:34.447414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8655. [D 20:42:34.447429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8656. [D 20:42:34.447443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8657. [D 20:42:34.447458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8658. [D 20:42:34.447473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8659. [D 20:42:34.447487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8660. [D 20:42:34.447502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8661. [D 20:42:34.447517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8662. [D 20:42:34.447533] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8663. [D 20:42:34.452960] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8663. [D 20:42:34.452980] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 28/70. [D 20:42:34.453081] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.453105] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.453119] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.573223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.573243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.573256] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.573296] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3217 [D 20:42:34.573311] element 0: offset: 0x2aaaab027810, size: 24 [D 20:42:34.573328] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 29/70. [D 20:42:34.576835] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3217 [D 20:42:34.576912] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 30/70. [D 20:42:34.576973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8663. [D 20:42:34.577000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8664. [D 20:42:34.577016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8665. [D 20:42:34.577031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8666. [D 20:42:34.577046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8667. [D 20:42:34.577060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8668. [D 20:42:34.577075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8669. [D 20:42:34.577090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8670. [D 20:42:34.577106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8671. [D 20:42:34.577148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8672. [D 20:42:34.577167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8673. [D 20:42:34.577186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8674. [D 20:42:34.577204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8675. [D 20:42:34.577223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8676. [D 20:42:34.577241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8677. [D 20:42:34.577259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8678. [D 20:42:34.577278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8679. [D 20:42:34.577296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8680. [D 20:42:34.577314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8681. [D 20:42:34.577345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8682. [D 20:42:34.577363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8683. [D 20:42:34.577381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8684. [D 20:42:34.577397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8685. [D 20:42:34.577413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8686. [D 20:42:34.577431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8687. [D 20:42:34.577449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8688. [D 20:42:34.577468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8689. [D 20:42:34.577487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8690. [D 20:42:34.577505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8691. [D 20:42:34.577524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8692. [D 20:42:34.577539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8693. [D 20:42:34.577554] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8694. [D 20:42:34.582874] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8694. [D 20:42:34.582899] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 31/70. [D 20:42:34.582988] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.583011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.583025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.614419] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.614439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.614452] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.614489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3221 [D 20:42:34.614504] element 0: offset: 0x2aaaab030fb0, size: 24 [D 20:42:34.614521] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 32/70. [D 20:42:34.618207] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3221 [D 20:42:34.618271] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 33/70. [D 20:42:34.618331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8694. [D 20:42:34.618358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8695. [D 20:42:34.618385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8696. [D 20:42:34.618404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8697. [D 20:42:34.618421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8698. [D 20:42:34.618436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8699. [D 20:42:34.618451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8700. [D 20:42:34.618482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8701. [D 20:42:34.618497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8702. [D 20:42:34.618511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8703. [D 20:42:34.618531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8704. [D 20:42:34.618545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8705. [D 20:42:34.618560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8706. [D 20:42:34.618575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8707. [D 20:42:34.618590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8708. [D 20:42:34.618604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8709. [D 20:42:34.618619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8710. [D 20:42:34.618651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8711. [D 20:42:34.618666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8712. [D 20:42:34.618682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8713. [D 20:42:34.618703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8714. [D 20:42:34.618718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8715. [D 20:42:34.618744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8716. [D 20:42:34.618759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8717. [D 20:42:34.618774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8718. [D 20:42:34.618789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8719. [D 20:42:34.618804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8720. [D 20:42:34.618819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8721. [D 20:42:34.618837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8722. [D 20:42:34.618852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8723. [D 20:42:34.618867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8724. [D 20:42:34.618882] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8725. [D 20:42:34.628599] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8725. [D 20:42:34.628624] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 34/70. [D 20:42:34.628759] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.628783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.628796] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.635896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.635916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.635929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.635965] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3223 [D 20:42:34.635980] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:34.635997] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 35/70. [D 20:42:34.639681] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3223 [D 20:42:34.639709] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 36/70. [D 20:42:34.639762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 8725. [D 20:42:34.639779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 8726. [D 20:42:34.639794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 8727. [D 20:42:34.639809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 8728. [D 20:42:34.639833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 8729. [D 20:42:34.639848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 8730. [D 20:42:34.639879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 8731. [D 20:42:34.639897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 8732. [D 20:42:34.639914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 8733. [D 20:42:34.639928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 8734. [D 20:42:34.639943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 8735. [D 20:42:34.639958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 8736. [D 20:42:34.639973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 8737. [D 20:42:34.639988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 8738. [D 20:42:34.640002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 8739. [D 20:42:34.640036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 8740. [D 20:42:34.640061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 8741. [D 20:42:34.640082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 8742. [D 20:42:34.640097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 8743. [D 20:42:34.640112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 8744. [D 20:42:34.640126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 8745. [D 20:42:34.640141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 8746. [D 20:42:34.640155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 8747. [D 20:42:34.640170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 8748. [D 20:42:34.640184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 8749. [D 20:42:34.640202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 8750. [D 20:42:34.640219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 8751. [D 20:42:34.640233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 8752. [D 20:42:34.640256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 8753. [D 20:42:34.640313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 8754. [D 20:42:34.640328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 8755. [D 20:42:34.640342] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 8756. [D 20:42:34.645711] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8756. [D 20:42:34.645731] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 37/70. [D 20:42:34.645835] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.645889] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.645903] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.698215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.698236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.698250] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.698286] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3226 [D 20:42:34.698302] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:34.698321] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 38/70. [D 20:42:34.701960] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3226 [D 20:42:34.701989] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 39/70. [D 20:42:34.702042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8756. [D 20:42:34.702059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8757. [D 20:42:34.702074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8758. [D 20:42:34.702090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8759. [D 20:42:34.702105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8760. [D 20:42:34.702120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8761. [D 20:42:34.702134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8762. [D 20:42:34.702149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8763. [D 20:42:34.702163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8764. [D 20:42:34.702178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8765. [D 20:42:34.702193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8766. [D 20:42:34.702208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8767. [D 20:42:34.702245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8768. [D 20:42:34.702260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8769. [D 20:42:34.702279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8770. [D 20:42:34.702293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8771. [D 20:42:34.702308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8772. [D 20:42:34.702322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8773. [D 20:42:34.702337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8774. [D 20:42:34.702351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8775. [D 20:42:34.702366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8776. [D 20:42:34.702393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8777. [D 20:42:34.702408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8778. [D 20:42:34.702422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8779. [D 20:42:34.702438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8780. [D 20:42:34.702475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8781. [D 20:42:34.702490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8782. [D 20:42:34.702512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8783. [D 20:42:34.702527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8784. [D 20:42:34.702543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8785. [D 20:42:34.702558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8786. [D 20:42:34.702572] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8787. [D 20:42:34.708004] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8787. [D 20:42:34.708024] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 40/70. [D 20:42:34.708127] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.708185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.708199] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.764942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.764962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.764976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.765015] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3229 [D 20:42:34.765030] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:34.765049] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 41/70. [D 20:42:34.768848] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3229 [D 20:42:34.768878] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 42/70. [D 20:42:34.768938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 8787. [D 20:42:34.768955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 8788. [D 20:42:34.768970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 8789. [D 20:42:34.768985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 8790. [D 20:42:34.769016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 8791. [D 20:42:34.769031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 8792. [D 20:42:34.769050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 8793. [D 20:42:34.769067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 8794. [D 20:42:34.769082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 8795. [D 20:42:34.769097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 8796. [D 20:42:34.769112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 8797. [D 20:42:34.769127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 8798. [D 20:42:34.769142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 8799. [D 20:42:34.769157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 8800. [D 20:42:34.769190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 8801. [D 20:42:34.769204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 8802. [D 20:42:34.769225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 8803. [D 20:42:34.769239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 8804. [D 20:42:34.769254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 8805. [D 20:42:34.769268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 8806. [D 20:42:34.769283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 8807. [D 20:42:34.769309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 8808. [D 20:42:34.769324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 8809. [D 20:42:34.769339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 8810. [D 20:42:34.769354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 8811. [D 20:42:34.769368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 8812. [D 20:42:34.769383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 8813. [D 20:42:34.769424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 8814. [D 20:42:34.769446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 8815. [D 20:42:34.769461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 8816. [D 20:42:34.769475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 8817. [D 20:42:34.769490] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 8818. [D 20:42:34.774896] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8818. [D 20:42:34.774915] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 43/70. [D 20:42:34.775017] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.775068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.775082] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.807205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.807226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.807239] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.807277] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3232 [D 20:42:34.807292] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:34.807311] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 44/70. [D 20:42:34.810995] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3232 [D 20:42:34.811031] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 45/70. [D 20:42:34.811086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8818. [D 20:42:34.811102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8819. [D 20:42:34.811117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8820. [D 20:42:34.811132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8821. [D 20:42:34.811147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8822. [D 20:42:34.811162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8823. [D 20:42:34.811176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8824. [D 20:42:34.811195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8825. [D 20:42:34.811210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8826. [D 20:42:34.811234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8827. [D 20:42:34.811249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8828. [D 20:42:34.811264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8829. [D 20:42:34.811279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8830. [D 20:42:34.811293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8831. [D 20:42:34.811308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8832. [D 20:42:34.811323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8833. [D 20:42:34.811338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8834. [D 20:42:34.811374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8835. [D 20:42:34.811395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8836. [D 20:42:34.811410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8837. [D 20:42:34.811424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8838. [D 20:42:34.811439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8839. [D 20:42:34.811454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8840. [D 20:42:34.811469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8841. [D 20:42:34.811484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8842. [D 20:42:34.811498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8843. [D 20:42:34.811513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8844. [D 20:42:34.811528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8845. [D 20:42:34.811542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8846. [D 20:42:34.811557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8847. [D 20:42:34.811571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8848. [D 20:42:34.811586] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8849. [D 20:42:34.817007] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8849. [D 20:42:34.817026] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 46/70. [D 20:42:34.817128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.817178] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.817192] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.849735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.849756] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.849769] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.849806] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3236 [D 20:42:34.849821] element 0: offset: 0x2aaaab030fb0, size: 24 [D 20:42:34.849841] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 47/70. [D 20:42:34.853620] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3236 [D 20:42:34.853655] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 48/70. [D 20:42:34.853705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8849. [D 20:42:34.853722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8850. [D 20:42:34.853737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8851. [D 20:42:34.853752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8852. [D 20:42:34.853768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8853. [D 20:42:34.853782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8854. [D 20:42:34.853797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8855. [D 20:42:34.853811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8856. [D 20:42:34.853831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8857. [D 20:42:34.853846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8858. [D 20:42:34.853861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8859. [D 20:42:34.853878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8860. [D 20:42:34.853894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8861. [D 20:42:34.853909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8862. [D 20:42:34.853925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8863. [D 20:42:34.853963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8864. [D 20:42:34.853978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8865. [D 20:42:34.853998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8866. [D 20:42:34.854013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8867. [D 20:42:34.854027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8868. [D 20:42:34.854042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8869. [D 20:42:34.854056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8870. [D 20:42:34.854071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8871. [D 20:42:34.854085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8872. [D 20:42:34.854104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8873. [D 20:42:34.854120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8874. [D 20:42:34.854135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8875. [D 20:42:34.854156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8876. [D 20:42:34.854197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8877. [D 20:42:34.854213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8878. [D 20:42:34.854234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8879. [D 20:42:34.854249] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8880. [D 20:42:34.859648] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8880. [D 20:42:34.859667] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 49/70. [D 20:42:34.859769] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.859820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.859834] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.915053] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.915075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.915088] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.915125] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3239 [D 20:42:34.915141] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:34.915160] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 50/70. [D 20:42:34.918794] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3239 [D 20:42:34.918830] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 51/70. [D 20:42:34.918887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8880. [D 20:42:34.918905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8881. [D 20:42:34.918920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8882. [D 20:42:34.918943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8883. [D 20:42:34.918958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8884. [D 20:42:34.918973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8885. [D 20:42:34.918987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8886. [D 20:42:34.919006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8887. [D 20:42:34.919021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8888. [D 20:42:34.919036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8889. [D 20:42:34.919054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8890. [D 20:42:34.919070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8891. [D 20:42:34.919084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8892. [D 20:42:34.919100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8893. [D 20:42:34.919136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8894. [D 20:42:34.919166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8895. [D 20:42:34.919181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8896. [D 20:42:34.919196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8897. [D 20:42:34.919211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8898. [D 20:42:34.919226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8899. [D 20:42:34.919241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8900. [D 20:42:34.919256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8901. [D 20:42:34.919270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8902. [D 20:42:34.919285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8903. [D 20:42:34.919300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8904. [D 20:42:34.919315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8905. [D 20:42:34.919330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8906. [D 20:42:34.919372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8907. [D 20:42:34.919394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8908. [D 20:42:34.919409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8909. [D 20:42:34.919424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8910. [D 20:42:34.919439] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8911. [D 20:42:34.924824] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8911. [D 20:42:34.924844] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 52/70. [D 20:42:34.924947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:34.924998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.925012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:34.996103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:34.996125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:34.996138] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:34.996175] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3241 [D 20:42:34.996190] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:34.996210] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 53/70. [D 20:42:34.999674] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3241 [D 20:42:34.999699] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 54/70. [D 20:42:34.999753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8911. [D 20:42:34.999770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8912. [D 20:42:34.999784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8913. [D 20:42:34.999799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8914. [D 20:42:34.999815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8915. [D 20:42:34.999833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8916. [D 20:42:34.999849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8917. [D 20:42:34.999864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8918. [D 20:42:34.999879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8919. [D 20:42:34.999894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8920. [D 20:42:34.999909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8921. [D 20:42:34.999943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8922. [D 20:42:34.999958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8923. [D 20:42:34.999977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8924. [D 20:42:34.999991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8925. [D 20:42:35.000006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8926. [D 20:42:35.000035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8927. [D 20:42:35.000051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8928. [D 20:42:35.000066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8929. [D 20:42:35.000080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8930. [D 20:42:35.000097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8931. [D 20:42:35.000112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8932. [D 20:42:35.000127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8933. [D 20:42:35.000143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8934. [D 20:42:35.000184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8935. [D 20:42:35.000206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8936. [D 20:42:35.000221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8937. [D 20:42:35.000235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 8938. [D 20:42:35.000261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 8939. [D 20:42:35.000276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 8940. [D 20:42:35.000291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 8941. [D 20:42:35.000306] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8942. [D 20:42:35.005672] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8942. [D 20:42:35.005692] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 55/70. [D 20:42:35.005797] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.005850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.005864] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.057811] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.057832] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.057845] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.057881] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3245 [D 20:42:35.057896] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:35.057916] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 56/70. [D 20:42:35.061613] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3245 [D 20:42:35.061649] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 57/70. [D 20:42:35.061703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8942. [D 20:42:35.061733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 8943. [D 20:42:35.061748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 8944. [D 20:42:35.061764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 8945. [D 20:42:35.061779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 8946. [D 20:42:35.061794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 8947. [D 20:42:35.061813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8948. [D 20:42:35.061828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8949. [D 20:42:35.061843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8950. [D 20:42:35.061858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 8951. [D 20:42:35.061882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 8952. [D 20:42:35.061897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 8953. [D 20:42:35.061911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 8954. [D 20:42:35.061930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 8955. [D 20:42:35.061944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8956. [D 20:42:35.061959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8957. [D 20:42:35.061974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8958. [D 20:42:35.061988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8959. [D 20:42:35.062003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8960. [D 20:42:35.062018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8961. [D 20:42:35.062033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8962. [D 20:42:35.062067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8963. [D 20:42:35.062086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8964. [D 20:42:35.062115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8965. [D 20:42:35.062130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8966. [D 20:42:35.062145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8967. [D 20:42:35.062160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8968. [D 20:42:35.062175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8969. [D 20:42:35.062190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8970. [D 20:42:35.062205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8971. [D 20:42:35.062223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8972. [D 20:42:35.062238] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8973. [D 20:42:35.067659] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 8973. [D 20:42:35.067678] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 58/70. [D 20:42:35.067782] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.067834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.067848] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.168679] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.168700] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.168714] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.168752] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3247 [D 20:42:35.168767] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:35.168786] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 59/70. [D 20:42:35.172266] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3247 [D 20:42:35.172294] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 60/70. [D 20:42:35.172386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8973. [D 20:42:35.172454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8974. [D 20:42:35.172471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 8975. [D 20:42:35.172486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 8976. [D 20:42:35.172556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 8977. [D 20:42:35.172573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 8978. [D 20:42:35.172642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 8979. [D 20:42:35.172753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8980. [D 20:42:35.172772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8981. [D 20:42:35.172786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8982. [D 20:42:35.172855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 8983. [D 20:42:35.173006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 8984. [D 20:42:35.173024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 8985. [D 20:42:35.173039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 8986. [D 20:42:35.173108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 8987. [D 20:42:35.173125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8988. [D 20:42:35.173219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8989. [D 20:42:35.173237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8990. [D 20:42:35.173307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 8991. [D 20:42:35.173431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 8992. [D 20:42:35.173450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 8993. [D 20:42:35.173464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 8994. [D 20:42:35.173532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 8995. [D 20:42:35.173549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8996. [D 20:42:35.173642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8997. [D 20:42:35.173707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8998. [D 20:42:35.173776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 8999. [D 20:42:35.173836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9000. [D 20:42:35.173959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9001. [D 20:42:35.173977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9002. [D 20:42:35.173992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9003. [D 20:42:35.174061] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9004. [D 20:42:35.178363] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9004. [D 20:42:35.178385] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 0/70. [D 20:42:35.178487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.178538] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.178552] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.227522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.227542] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.227556] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.227593] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3251 [D 20:42:35.227608] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:35.227630] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 1/70. [D 20:42:35.230930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.230996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.231010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:35.231050] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3253 [D 20:42:35.231066] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:35.231085] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 2/70. [D 20:42:35.231426] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3251 [D 20:42:35.231453] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 3/70. [D 20:42:35.231549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9004. [D 20:42:35.231571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9005. [D 20:42:35.231586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9006. [D 20:42:35.231600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9007. [D 20:42:35.231627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9008. [D 20:42:35.231646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9009. [D 20:42:35.231719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9010. [D 20:42:35.231736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9011. [D 20:42:35.231753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9012. [D 20:42:35.231768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9013. [D 20:42:35.231784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9014. [D 20:42:35.231802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9015. [D 20:42:35.231817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9016. [D 20:42:35.231832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9017. [D 20:42:35.231847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9018. [D 20:42:35.231869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9019. [D 20:42:35.231884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9020. [D 20:42:35.231899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9021. [D 20:42:35.231913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9022. [D 20:42:35.231928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9023. [D 20:42:35.231943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9024. [D 20:42:35.231962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9025. [D 20:42:35.231976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9026. [D 20:42:35.231991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9027. [D 20:42:35.232006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9028. [D 20:42:35.232020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9029. [D 20:42:35.232038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9030. [D 20:42:35.232053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9031. [D 20:42:35.232067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9032. [D 20:42:35.232082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9033. [D 20:42:35.232098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9034. [D 20:42:35.232134] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9035. [D 20:42:35.235666] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3253 [D 20:42:35.235689] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 4/70. [D 20:42:35.237491] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9035. [D 20:42:35.237511] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 5/70. [D 20:42:35.237527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9035. [D 20:42:35.237543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9036. [D 20:42:35.237557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9037. [D 20:42:35.237572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9038. [D 20:42:35.237587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9039. [D 20:42:35.237601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9040. [D 20:42:35.237617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9041. [D 20:42:35.237631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9042. [D 20:42:35.237646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9043. [D 20:42:35.237660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9044. [D 20:42:35.237676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9045. [D 20:42:35.237690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9046. [D 20:42:35.237705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9047. [D 20:42:35.237720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9048. [D 20:42:35.237734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9049. [D 20:42:35.237749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9050. [D 20:42:35.237764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9051. [D 20:42:35.237779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9052. [D 20:42:35.237793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9053. [D 20:42:35.237808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9054. [D 20:42:35.237823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9055. [D 20:42:35.237838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9056. [D 20:42:35.237852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9057. [D 20:42:35.237867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9058. [D 20:42:35.237882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9059. [D 20:42:35.237896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9060. [D 20:42:35.237911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9061. [D 20:42:35.237926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9062. [D 20:42:35.237941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9063. [D 20:42:35.237975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9064. [D 20:42:35.237990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9065. [D 20:42:35.238004] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9066. [D 20:42:35.238085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.238153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.238167] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:35.243408] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 9066. [D 20:42:35.243431] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 6/70. [D 20:42:35.243491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.243512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.243525] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.300804] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.300826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.300838] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.300877] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3256 [D 20:42:35.300892] element 0: offset: 0x2aaaab031010, size: 24 [D 20:42:35.300911] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 7/70. [D 20:42:35.304627] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3256 [D 20:42:35.304661] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 8/70. [D 20:42:35.304716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9066. [D 20:42:35.304733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9067. [D 20:42:35.304748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9068. [D 20:42:35.304776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9069. [D 20:42:35.304792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9070. [D 20:42:35.304807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9071. [D 20:42:35.304822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9072. [D 20:42:35.304837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9073. [D 20:42:35.304851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9074. [D 20:42:35.304867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9075. [D 20:42:35.304882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9076. [D 20:42:35.304896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9077. [D 20:42:35.304912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9078. [D 20:42:35.304936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9079. [D 20:42:35.304970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9080. [D 20:42:35.304985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9081. [D 20:42:35.305006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9082. [D 20:42:35.305020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9083. [D 20:42:35.305035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9084. [D 20:42:35.305049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9085. [D 20:42:35.305064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9086. [D 20:42:35.305078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9087. [D 20:42:35.305093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9088. [D 20:42:35.305108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9089. [D 20:42:35.305135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9090. [D 20:42:35.305151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9091. [D 20:42:35.305167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9092. [D 20:42:35.305208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9093. [D 20:42:35.305230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9094. [D 20:42:35.305245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9095. [D 20:42:35.305260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9096. [D 20:42:35.305275] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9097. [D 20:42:35.314218] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9097. [D 20:42:35.314243] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 9/70. [D 20:42:35.314385] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.314435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.314448] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.322149] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.322170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.322182] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.322220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3259 [D 20:42:35.322234] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:35.322253] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 10/70. [D 20:42:35.325917] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3259 [D 20:42:35.325954] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 11/70. [D 20:42:35.326002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9097. [D 20:42:35.326032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9098. [D 20:42:35.326047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9099. [D 20:42:35.326068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9100. [D 20:42:35.326082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 9101. [D 20:42:35.326097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 9102. [D 20:42:35.326116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 9103. [D 20:42:35.326131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 9104. [D 20:42:35.326146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 9105. [D 20:42:35.326161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 9106. [D 20:42:35.326178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 9107. [D 20:42:35.326194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 9108. [D 20:42:35.326209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 9109. [D 20:42:35.326224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 9110. [D 20:42:35.326259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 9111. [D 20:42:35.326274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 9112. [D 20:42:35.326294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 9113. [D 20:42:35.326308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 9114. [D 20:42:35.326323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 9115. [D 20:42:35.326337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 9116. [D 20:42:35.326364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 9117. [D 20:42:35.326379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 9118. [D 20:42:35.326393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 9119. [D 20:42:35.326408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 9120. [D 20:42:35.326423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 9121. [D 20:42:35.326437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 9122. [D 20:42:35.326459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 9123. [D 20:42:35.326500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 9124. [D 20:42:35.326522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 9125. [D 20:42:35.326537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 9126. [D 20:42:35.326552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 9127. [D 20:42:35.326567] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 9128. [D 20:42:35.331968] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9128. [D 20:42:35.331987] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 12/70. [D 20:42:35.332091] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.332144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.332157] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.346955] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.346976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.346989] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.347026] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3263 [D 20:42:35.347041] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:35.347062] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 13/70. [D 20:42:35.350605] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3263 [D 20:42:35.350636] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 14/70. [D 20:42:35.350686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9128. [D 20:42:35.350703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9129. [D 20:42:35.350718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9130. [D 20:42:35.350734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9131. [D 20:42:35.350749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9132. [D 20:42:35.350764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9133. [D 20:42:35.350779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9134. [D 20:42:35.350793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9135. [D 20:42:35.350808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9136. [D 20:42:35.350823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9137. [D 20:42:35.350838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9138. [D 20:42:35.350853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9139. [D 20:42:35.350890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9140. [D 20:42:35.350909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9141. [D 20:42:35.350924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9142. [D 20:42:35.350939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9143. [D 20:42:35.350953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9144. [D 20:42:35.350968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9145. [D 20:42:35.350983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9146. [D 20:42:35.350998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9147. [D 20:42:35.351013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9148. [D 20:42:35.351028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9149. [D 20:42:35.351045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9150. [D 20:42:35.351059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9151. [D 20:42:35.351081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9152. [D 20:42:35.351129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9153. [D 20:42:35.351150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9154. [D 20:42:35.351166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9155. [D 20:42:35.351182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9156. [D 20:42:35.351196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9157. [D 20:42:35.351210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9158. [D 20:42:35.351225] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9159. [D 20:42:35.356628] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9159. [D 20:42:35.356647] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 15/70. [D 20:42:35.356749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.356808] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.356822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.402970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.402990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.403003] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.403042] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3265 [D 20:42:35.403057] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:35.403078] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 16/70. [D 20:42:35.406707] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3265 [D 20:42:35.406733] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 17/70. [D 20:42:35.406785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9159. [D 20:42:35.406801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9160. [D 20:42:35.406817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9161. [D 20:42:35.406831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9162. [D 20:42:35.406847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9163. [D 20:42:35.406861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9164. [D 20:42:35.406876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9165. [D 20:42:35.406891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9166. [D 20:42:35.406913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9167. [D 20:42:35.406928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9168. [D 20:42:35.406946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9169. [D 20:42:35.406962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9170. [D 20:42:35.406976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9171. [D 20:42:35.406991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9172. [D 20:42:35.407011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9173. [D 20:42:35.407028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9174. [D 20:42:35.407043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9175. [D 20:42:35.407059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9176. [D 20:42:35.407093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9177. [D 20:42:35.407108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9178. [D 20:42:35.407132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9179. [D 20:42:35.407147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9180. [D 20:42:35.407162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9181. [D 20:42:35.407176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9182. [D 20:42:35.407191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9183. [D 20:42:35.407205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9184. [D 20:42:35.407220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9185. [D 20:42:35.407235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9186. [D 20:42:35.407249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9187. [D 20:42:35.407269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9188. [D 20:42:35.407283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9189. [D 20:42:35.407298] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9190. [D 20:42:35.412701] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9190. [D 20:42:35.412721] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 18/70. [D 20:42:35.412825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.412884] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.412898] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.451334] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.451355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.451368] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.451407] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3268 [D 20:42:35.451422] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:35.451442] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 19/70. [D 20:42:35.454984] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3268 [D 20:42:35.455013] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 20/70. [D 20:42:35.455067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9190. [D 20:42:35.455084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9191. [D 20:42:35.455099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9192. [D 20:42:35.455113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9193. [D 20:42:35.455128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9194. [D 20:42:35.455143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9195. [D 20:42:35.455158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9196. [D 20:42:35.455173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9197. [D 20:42:35.455187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9198. [D 20:42:35.455202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9199. [D 20:42:35.455217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9200. [D 20:42:35.455232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9201. [D 20:42:35.455267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9202. [D 20:42:35.455282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9203. [D 20:42:35.455301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9204. [D 20:42:35.455316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9205. [D 20:42:35.455331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9206. [D 20:42:35.455345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9207. [D 20:42:35.455360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9208. [D 20:42:35.455374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9209. [D 20:42:35.455389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9210. [D 20:42:35.455417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9211. [D 20:42:35.455433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9212. [D 20:42:35.455447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9213. [D 20:42:35.455462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9214. [D 20:42:35.455478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9215. [D 20:42:35.455518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9216. [D 20:42:35.455539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9217. [D 20:42:35.455554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9218. [D 20:42:35.455569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9219. [D 20:42:35.455584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9220. [D 20:42:35.455599] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9221. [D 20:42:35.461028] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9221. [D 20:42:35.461048] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 21/70. [D 20:42:35.461152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.461211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.461225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.601641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.601663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.601676] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.601715] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3271 [D 20:42:35.601730] element 0: offset: 0x2aaaab031010, size: 24 [D 20:42:35.601750] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 22/70. [D 20:42:35.605479] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3271 [D 20:42:35.605515] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 23/70. [D 20:42:35.605569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9221. [D 20:42:35.605586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9222. [D 20:42:35.605601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9223. [D 20:42:35.605616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9224. [D 20:42:35.605631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9225. [D 20:42:35.605645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9226. [D 20:42:35.605660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9227. [D 20:42:35.605689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9228. [D 20:42:35.605705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9229. [D 20:42:35.605720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9230. [D 20:42:35.605734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9231. [D 20:42:35.605749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9232. [D 20:42:35.605764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9233. [D 20:42:35.605778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9234. [D 20:42:35.605822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9235. [D 20:42:35.605836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9236. [D 20:42:35.605856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9237. [D 20:42:35.605871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9238. [D 20:42:35.605885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9239. [D 20:42:35.605900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9240. [D 20:42:35.605914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9241. [D 20:42:35.605929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9242. [D 20:42:35.605943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9243. [D 20:42:35.605958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9244. [D 20:42:35.605973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9245. [D 20:42:35.605987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9246. [D 20:42:35.606002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9247. [D 20:42:35.606017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9248. [D 20:42:35.606056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9249. [D 20:42:35.606071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9250. [D 20:42:35.606095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9251. [D 20:42:35.606125] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9252. [D 20:42:35.611442] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9252. [D 20:42:35.611462] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 24/70. [D 20:42:35.611565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.611618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.611635] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.644593] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.644614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.644627] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.644664] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3275 [D 20:42:35.644679] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:35.644698] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 25/70. [D 20:42:35.647932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.647989] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.648002] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:35.648041] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3277 [D 20:42:35.648056] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:35.648075] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 26/70. [D 20:42:35.648466] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3275 [D 20:42:35.648506] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 27/70. [D 20:42:35.648809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9252. [D 20:42:35.648835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9253. [D 20:42:35.648857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9254. [D 20:42:35.648876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9255. [D 20:42:35.648895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9256. [D 20:42:35.648918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9257. [D 20:42:35.648940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9258. [D 20:42:35.648958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9259. [D 20:42:35.648976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9260. [D 20:42:35.648995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9261. [D 20:42:35.649011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9262. [D 20:42:35.649026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9263. [D 20:42:35.649045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9264. [D 20:42:35.649063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9265. [D 20:42:35.649081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9266. [D 20:42:35.649100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9267. [D 20:42:35.649118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9268. [D 20:42:35.649136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9269. [D 20:42:35.649155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9270. [D 20:42:35.649188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9271. [D 20:42:35.649207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9272. [D 20:42:35.649225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9273. [D 20:42:35.649243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9274. [D 20:42:35.649262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9275. [D 20:42:35.649281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9276. [D 20:42:35.649300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9277. [D 20:42:35.649318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9278. [D 20:42:35.649337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9279. [D 20:42:35.649355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9280. [D 20:42:35.649374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9281. [D 20:42:35.649393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9282. [D 20:42:35.649409] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9283. [D 20:42:35.653459] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3277 [D 20:42:35.653487] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 28/70. [D 20:42:35.654717] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9283. [D 20:42:35.654740] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 29/70. [D 20:42:35.654763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9283. [D 20:42:35.654781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9284. [D 20:42:35.654800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9285. [D 20:42:35.654818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9286. [D 20:42:35.654836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9287. [D 20:42:35.654854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9288. [D 20:42:35.654870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9289. [D 20:42:35.654891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9290. [D 20:42:35.654910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9291. [D 20:42:35.654928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9292. [D 20:42:35.654947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9293. [D 20:42:35.654965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9294. [D 20:42:35.654984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9295. [D 20:42:35.655002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9296. [D 20:42:35.655020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9297. [D 20:42:35.655039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9298. [D 20:42:35.655057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9299. [D 20:42:35.655075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9300. [D 20:42:35.655094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9301. [D 20:42:35.655112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9302. [D 20:42:35.655130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9303. [D 20:42:35.655149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9304. [D 20:42:35.655167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9305. [D 20:42:35.655186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9306. [D 20:42:35.655204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9307. [D 20:42:35.655222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9308. [D 20:42:35.655241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9309. [D 20:42:35.655260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9310. [D 20:42:35.655279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9311. [D 20:42:35.655298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9312. [D 20:42:35.655313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9313. [D 20:42:35.655327] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9314. [D 20:42:35.655405] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.655470] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.655484] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:35.660682] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 9314. [D 20:42:35.660709] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 30/70. [D 20:42:35.660772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.660794] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.660807] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.702749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.702770] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.702783] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.702822] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3281 [D 20:42:35.702837] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:35.702857] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 31/70. [D 20:42:35.706602] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3281 [D 20:42:35.706637] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 32/70. [D 20:42:35.706692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9314. [D 20:42:35.706708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9315. [D 20:42:35.706723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9316. [D 20:42:35.706738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9317. [D 20:42:35.706753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9318. [D 20:42:35.706768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9319. [D 20:42:35.706782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9320. [D 20:42:35.706801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9321. [D 20:42:35.706816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9322. [D 20:42:35.706831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9323. [D 20:42:35.706846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9324. [D 20:42:35.706863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9325. [D 20:42:35.706878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9326. [D 20:42:35.706892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9327. [D 20:42:35.706908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9328. [D 20:42:35.706946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9329. [D 20:42:35.706960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9330. [D 20:42:35.706980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9331. [D 20:42:35.706995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9332. [D 20:42:35.707009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9333. [D 20:42:35.707024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9334. [D 20:42:35.707038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9335. [D 20:42:35.707053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9336. [D 20:42:35.707067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9337. [D 20:42:35.707087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9338. [D 20:42:35.707103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9339. [D 20:42:35.707118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9340. [D 20:42:35.707140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9341. [D 20:42:35.707181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9342. [D 20:42:35.707196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9343. [D 20:42:35.707218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9344. [D 20:42:35.707232] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9345. [D 20:42:35.712653] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9345. [D 20:42:35.712673] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 33/70. [D 20:42:35.712775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.712828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.712841] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.758807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.758828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.758840] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.758878] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3283 [D 20:42:35.758893] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:35.758913] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 34/70. [D 20:42:35.762604] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3283 [D 20:42:35.762640] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 35/70. [D 20:42:35.762693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9345. [D 20:42:35.762710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9346. [D 20:42:35.762724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9347. [D 20:42:35.762740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9348. [D 20:42:35.762754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9349. [D 20:42:35.762769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9350. [D 20:42:35.762784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9351. [D 20:42:35.762813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9352. [D 20:42:35.762829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9353. [D 20:42:35.762844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9354. [D 20:42:35.762858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9355. [D 20:42:35.762873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9356. [D 20:42:35.762888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9357. [D 20:42:35.762902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9358. [D 20:42:35.762917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9359. [D 20:42:35.762949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9360. [D 20:42:35.762964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9361. [D 20:42:35.762984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9362. [D 20:42:35.762999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9363. [D 20:42:35.763013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9364. [D 20:42:35.763028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9365. [D 20:42:35.763042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9366. [D 20:42:35.763057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9367. [D 20:42:35.763071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9368. [D 20:42:35.763090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9369. [D 20:42:35.763106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9370. [D 20:42:35.763120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9371. [D 20:42:35.763135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9372. [D 20:42:35.763156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9373. [D 20:42:35.763200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9374. [D 20:42:35.763222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9375. [D 20:42:35.763249] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9376. [D 20:42:35.768613] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9376. [D 20:42:35.768632] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 36/70. [D 20:42:35.768733] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.768784] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.768798] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.851565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.851586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.851599] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.851641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3286 [D 20:42:35.851656] element 0: offset: 0x2aaaab031010, size: 24 [D 20:42:35.851676] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 37/70. [D 20:42:35.855353] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3286 [D 20:42:35.855388] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 38/70. [D 20:42:35.855451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9376. [D 20:42:35.855468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9377. [D 20:42:35.855489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9378. [D 20:42:35.855520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9379. [D 20:42:35.855536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 9380. [D 20:42:35.855551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 9381. [D 20:42:35.855567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 9382. [D 20:42:35.855581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 9383. [D 20:42:35.855603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 9384. [D 20:42:35.855643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 9385. [D 20:42:35.855658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 9386. [D 20:42:35.855673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 9387. [D 20:42:35.855688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 9388. [D 20:42:35.855702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 9389. [D 20:42:35.855717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 9390. [D 20:42:35.855734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 9391. [D 20:42:35.855758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 9392. [D 20:42:35.855774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 9393. [D 20:42:35.855790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 9394. [D 20:42:35.855808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 9395. [D 20:42:35.855823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 9396. [D 20:42:35.855838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 9397. [D 20:42:35.855853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 9398. [D 20:42:35.855868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 9399. [D 20:42:35.855883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 9400. [D 20:42:35.855898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 9401. [D 20:42:35.855913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 9402. [D 20:42:35.855928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 9403. [D 20:42:35.855943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 9404. [D 20:42:35.855958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 9405. [D 20:42:35.855980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 9406. [D 20:42:35.856039] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 9407. [D 20:42:35.861387] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9407. [D 20:42:35.861407] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 39/70. [D 20:42:35.861511] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.861567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.861581] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.914037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.914058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.914071] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.914111] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3289 [D 20:42:35.914126] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:35.914145] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 40/70. [D 20:42:35.917878] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3289 [D 20:42:35.917913] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 41/70. [D 20:42:35.917966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9407. [D 20:42:35.917995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9408. [D 20:42:35.918010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9409. [D 20:42:35.918025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9410. [D 20:42:35.918040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9411. [D 20:42:35.918054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9412. [D 20:42:35.918069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9413. [D 20:42:35.918088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9414. [D 20:42:35.918103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9415. [D 20:42:35.918118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9416. [D 20:42:35.918152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9417. [D 20:42:35.918167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9418. [D 20:42:35.918181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9419. [D 20:42:35.918200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9420. [D 20:42:35.918215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9421. [D 20:42:35.918229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9422. [D 20:42:35.918244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9423. [D 20:42:35.918262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9424. [D 20:42:35.918279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9425. [D 20:42:35.918293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9426. [D 20:42:35.918324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9427. [D 20:42:35.918346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9428. [D 20:42:35.918365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9429. [D 20:42:35.918380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9430. [D 20:42:35.918396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9431. [D 20:42:35.918410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9432. [D 20:42:35.918425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9433. [D 20:42:35.918439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9434. [D 20:42:35.918454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9435. [D 20:42:35.918468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9436. [D 20:42:35.918483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9437. [D 20:42:35.918500] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9438. [D 20:42:35.923907] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9438. [D 20:42:35.923926] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 42/70. [D 20:42:35.924031] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.924083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.924097] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:35.952157] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.952178] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.952190] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:35.952228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3293 [D 20:42:35.952243] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:35.952265] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 43/70. [D 20:42:35.955467] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:35.955524] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.955543] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:35.955582] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3295 [D 20:42:35.955597] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:35.955615] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 44/70. [D 20:42:35.956363] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3293 [D 20:42:35.956411] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 45/70. [D 20:42:35.956463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9438. [D 20:42:35.956479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9439. [D 20:42:35.956494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9440. [D 20:42:35.956515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9441. [D 20:42:35.956530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9442. [D 20:42:35.956544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9443. [D 20:42:35.956559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9444. [D 20:42:35.956578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9445. [D 20:42:35.956592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9446. [D 20:42:35.956607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9447. [D 20:42:35.956621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9448. [D 20:42:35.956636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9449. [D 20:42:35.956651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9450. [D 20:42:35.956666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9451. [D 20:42:35.956710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9452. [D 20:42:35.956724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9453. [D 20:42:35.956757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9454. [D 20:42:35.956772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9455. [D 20:42:35.956787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9456. [D 20:42:35.956802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9457. [D 20:42:35.956816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9458. [D 20:42:35.956832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9459. [D 20:42:35.956850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9460. [D 20:42:35.956867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9461. [D 20:42:35.956882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9462. [D 20:42:35.956897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9463. [D 20:42:35.956912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9464. [D 20:42:35.956953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9465. [D 20:42:35.956978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9466. [D 20:42:35.956993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9467. [D 20:42:35.957008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9468. [D 20:42:35.957023] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9469. [D 20:42:35.962340] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9469. [D 20:42:35.962360] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 46/70. [D 20:42:35.963646] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3295 [D 20:42:35.963720] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 47/70. [D 20:42:35.963744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.963766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.963781] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:35.963833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9469. [D 20:42:35.963850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9470. [D 20:42:35.963865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9471. [D 20:42:35.963880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9472. [D 20:42:35.963895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9473. [D 20:42:35.963910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9474. [D 20:42:35.963925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9475. [D 20:42:35.963939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9476. [D 20:42:35.963954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9477. [D 20:42:35.963969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9478. [D 20:42:35.963984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9479. [D 20:42:35.964014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9480. [D 20:42:35.964029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9481. [D 20:42:35.964048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9482. [D 20:42:35.964063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9483. [D 20:42:35.964078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9484. [D 20:42:35.964093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9485. [D 20:42:35.964107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9486. [D 20:42:35.964122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9487. [D 20:42:35.964140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9488. [D 20:42:35.964157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9489. [D 20:42:35.964172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9490. [D 20:42:35.964186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9491. [D 20:42:35.964219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9492. [D 20:42:35.964250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9493. [D 20:42:35.964268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9494. [D 20:42:35.964283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9495. [D 20:42:35.964298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9496. [D 20:42:35.964313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9497. [D 20:42:35.964327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9498. [D 20:42:35.964342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9499. [D 20:42:35.964357] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9500. [D 20:42:35.969795] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9500. [D 20:42:35.969815] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 48/70. [D 20:42:35.971728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:35.971753] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:35.971766] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.001039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.001059] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.001072] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.001110] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3298 [D 20:42:36.001125] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:36.001145] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 49/70. [D 20:42:36.004894] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3298 [D 20:42:36.004961] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 50/70. [D 20:42:36.005020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9500. [D 20:42:36.005048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9501. [D 20:42:36.005063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9502. [D 20:42:36.005078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9503. [D 20:42:36.005093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9504. [D 20:42:36.005110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9505. [D 20:42:36.005124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9506. [D 20:42:36.005139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9507. [D 20:42:36.005174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9508. [D 20:42:36.005189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9509. [D 20:42:36.005203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9510. [D 20:42:36.005222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9511. [D 20:42:36.005237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9512. [D 20:42:36.005252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9513. [D 20:42:36.005266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9514. [D 20:42:36.005281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9515. [D 20:42:36.005296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9516. [D 20:42:36.005310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9517. [D 20:42:36.005325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9518. [D 20:42:36.005357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9519. [D 20:42:36.005376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9520. [D 20:42:36.005396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9521. [D 20:42:36.005410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9522. [D 20:42:36.005425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9523. [D 20:42:36.005439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9524. [D 20:42:36.005457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9525. [D 20:42:36.005471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9526. [D 20:42:36.005486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9527. [D 20:42:36.005500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9528. [D 20:42:36.005519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9529. [D 20:42:36.005534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9530. [D 20:42:36.005548] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9531. [D 20:42:36.010949] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9531. [D 20:42:36.010969] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 51/70. [D 20:42:36.011066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.011091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.011105] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.112470] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.112490] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.112503] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.112539] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3301 [D 20:42:36.112554] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:36.112571] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 52/70. [D 20:42:36.116344] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3301 [D 20:42:36.116408] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 53/70. [D 20:42:36.116468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9531. [D 20:42:36.116492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9532. [D 20:42:36.116509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9533. [D 20:42:36.116537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9534. [D 20:42:36.116552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9535. [D 20:42:36.116567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9536. [D 20:42:36.116582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9537. [D 20:42:36.116597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9538. [D 20:42:36.116612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9539. [D 20:42:36.116630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9540. [D 20:42:36.116645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9541. [D 20:42:36.116660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9542. [D 20:42:36.116675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9543. [D 20:42:36.116690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9544. [D 20:42:36.116705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9545. [D 20:42:36.116732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9546. [D 20:42:36.116747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9547. [D 20:42:36.116770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9548. [D 20:42:36.116786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9549. [D 20:42:36.116800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9550. [D 20:42:36.116815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9551. [D 20:42:36.116829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9552. [D 20:42:36.116844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9553. [D 20:42:36.116858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9554. [D 20:42:36.116873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9555. [D 20:42:36.116888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9556. [D 20:42:36.116902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9557. [D 20:42:36.116917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9558. [D 20:42:36.116943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9559. [D 20:42:36.116958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9560. [D 20:42:36.117009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9561. [D 20:42:36.117026] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9562. [D 20:42:36.122441] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9562. [D 20:42:36.122461] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 54/70. [D 20:42:36.122558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.122582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.122595] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.168852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.168872] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.168885] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.168921] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3304 [D 20:42:36.168936] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:36.168953] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 55/70. [D 20:42:36.172625] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3304 [D 20:42:36.172687] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 56/70. [D 20:42:36.172746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9562. [D 20:42:36.172772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9563. [D 20:42:36.172787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9564. [D 20:42:36.172817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9565. [D 20:42:36.172834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9566. [D 20:42:36.172848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9567. [D 20:42:36.172863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9568. [D 20:42:36.172878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9569. [D 20:42:36.172897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9570. [D 20:42:36.172912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9571. [D 20:42:36.172927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9572. [D 20:42:36.172945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9573. [D 20:42:36.172960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9574. [D 20:42:36.172978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9575. [D 20:42:36.172993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9576. [D 20:42:36.173008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9577. [D 20:42:36.173023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9578. [D 20:42:36.173038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9579. [D 20:42:36.173053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9580. [D 20:42:36.173087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9581. [D 20:42:36.173110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9582. [D 20:42:36.173125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9583. [D 20:42:36.173140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9584. [D 20:42:36.173155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9585. [D 20:42:36.173183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9586. [D 20:42:36.173198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9587. [D 20:42:36.173213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9588. [D 20:42:36.173227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9589. [D 20:42:36.173242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9590. [D 20:42:36.173257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9591. [D 20:42:36.173271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9592. [D 20:42:36.173286] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9593. [D 20:42:36.178716] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9593. [D 20:42:36.178737] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 57/70. [D 20:42:36.178832] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.178856] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.178869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.223027] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.223048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.223061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.223096] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3308 [D 20:42:36.223111] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:36.223128] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 58/70. [D 20:42:36.226766] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3308 [D 20:42:36.226842] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 59/70. [D 20:42:36.226901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9593. [D 20:42:36.226925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9594. [D 20:42:36.226940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9595. [D 20:42:36.226956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9596. [D 20:42:36.226971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9597. [D 20:42:36.226985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9598. [D 20:42:36.227000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9599. [D 20:42:36.227015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9600. [D 20:42:36.227029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9601. [D 20:42:36.227044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9602. [D 20:42:36.227060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9603. [D 20:42:36.227074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9604. [D 20:42:36.227089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9605. [D 20:42:36.227104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9606. [D 20:42:36.227118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9607. [D 20:42:36.227134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9608. [D 20:42:36.227175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9609. [D 20:42:36.227194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9610. [D 20:42:36.227209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9611. [D 20:42:36.227224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9612. [D 20:42:36.227239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9613. [D 20:42:36.227253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9614. [D 20:42:36.227268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9615. [D 20:42:36.227282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9616. [D 20:42:36.227297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9617. [D 20:42:36.227312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9618. [D 20:42:36.227326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9619. [D 20:42:36.227345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9620. [D 20:42:36.227360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9621. [D 20:42:36.227375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9622. [D 20:42:36.227403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9623. [D 20:42:36.227446] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9624. [D 20:42:36.232867] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9624. [D 20:42:36.232887] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 60/70. [D 20:42:36.232982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.233006] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.233020] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.281786] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.281806] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.281819] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.281857] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3310 [D 20:42:36.281872] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:36.281890] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 0/70. [D 20:42:36.285583] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3310 [D 20:42:36.285648] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 1/70. [D 20:42:36.285704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9624. [D 20:42:36.285745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9625. [D 20:42:36.285761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9626. [D 20:42:36.285778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9627. [D 20:42:36.285795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9628. [D 20:42:36.285809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9629. [D 20:42:36.285824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9630. [D 20:42:36.285856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9631. [D 20:42:36.285871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9632. [D 20:42:36.285885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9633. [D 20:42:36.285904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9634. [D 20:42:36.285918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9635. [D 20:42:36.285933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9636. [D 20:42:36.285948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9637. [D 20:42:36.285964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9638. [D 20:42:36.285979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9639. [D 20:42:36.285994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9640. [D 20:42:36.286025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9641. [D 20:42:36.286041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9642. [D 20:42:36.286065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9643. [D 20:42:36.286080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9644. [D 20:42:36.286095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9645. [D 20:42:36.286110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9646. [D 20:42:36.286124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9647. [D 20:42:36.286142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9648. [D 20:42:36.286156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9649. [D 20:42:36.286171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9650. [D 20:42:36.286186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9651. [D 20:42:36.286205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9652. [D 20:42:36.286219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9653. [D 20:42:36.286234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9654. [D 20:42:36.286249] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9655. [D 20:42:36.291641] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9655. [D 20:42:36.291665] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 2/70. [D 20:42:36.291790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.291813] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.291826] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.318608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.318629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.318641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.318678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3313 [D 20:42:36.318692] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:36.318709] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 3/70. [D 20:42:36.322279] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3313 [D 20:42:36.322357] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 4/70. [D 20:42:36.322415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9655. [D 20:42:36.322439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9656. [D 20:42:36.322454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9657. [D 20:42:36.322469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9658. [D 20:42:36.322484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 9659. [D 20:42:36.322499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 9660. [D 20:42:36.322514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 9661. [D 20:42:36.322529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 9662. [D 20:42:36.322543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 9663. [D 20:42:36.322558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 9664. [D 20:42:36.322573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 9665. [D 20:42:36.322588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 9666. [D 20:42:36.322602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 9667. [D 20:42:36.322618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 9668. [D 20:42:36.322658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 9669. [D 20:42:36.322677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 9670. [D 20:42:36.322692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 9671. [D 20:42:36.322707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 9672. [D 20:42:36.322722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 9673. [D 20:42:36.322736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 9674. [D 20:42:36.322751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 9675. [D 20:42:36.322766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 9676. [D 20:42:36.322780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 9677. [D 20:42:36.322795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 9678. [D 20:42:36.322822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 9679. [D 20:42:36.322837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 9680. [D 20:42:36.322852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 9681. [D 20:42:36.322866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 9682. [D 20:42:36.322923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 9683. [D 20:42:36.322943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 9684. [D 20:42:36.322958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 9685. [D 20:42:36.322973] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 9686. [D 20:42:36.328346] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9686. [D 20:42:36.328366] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 5/70. [D 20:42:36.328461] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.328486] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.328499] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.379317] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.379339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.379352] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.379389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3316 [D 20:42:36.379404] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:36.379421] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 6/70. [D 20:42:36.383169] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3316 [D 20:42:36.383232] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 7/70. [D 20:42:36.383287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9686. [D 20:42:36.383316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9687. [D 20:42:36.383331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9688. [D 20:42:36.383346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9689. [D 20:42:36.383361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9690. [D 20:42:36.383377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9691. [D 20:42:36.383392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9692. [D 20:42:36.383407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9693. [D 20:42:36.383440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9694. [D 20:42:36.383455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9695. [D 20:42:36.383470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9696. [D 20:42:36.383489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9697. [D 20:42:36.383503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9698. [D 20:42:36.383518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9699. [D 20:42:36.383532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9700. [D 20:42:36.383547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9701. [D 20:42:36.383562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9702. [D 20:42:36.383577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9703. [D 20:42:36.383592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9704. [D 20:42:36.383623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9705. [D 20:42:36.383642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9706. [D 20:42:36.383668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9707. [D 20:42:36.383683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9708. [D 20:42:36.383698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9709. [D 20:42:36.383712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9710. [D 20:42:36.383729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9711. [D 20:42:36.383744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9712. [D 20:42:36.383759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9713. [D 20:42:36.383773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9714. [D 20:42:36.383792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9715. [D 20:42:36.383806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9716. [D 20:42:36.383821] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9717. [D 20:42:36.389259] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9717. [D 20:42:36.389279] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 8/70. [D 20:42:36.389374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.389398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.389411] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.421044] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.421065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.421078] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.421114] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3320 [D 20:42:36.421129] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:36.421146] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 9/70. [D 20:42:36.424746] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3320 [D 20:42:36.424823] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 10/70. [D 20:42:36.424887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9717. [D 20:42:36.424919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9718. [D 20:42:36.424934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9719. [D 20:42:36.424949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9720. [D 20:42:36.424964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9721. [D 20:42:36.424979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9722. [D 20:42:36.424997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9723. [D 20:42:36.425012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9724. [D 20:42:36.425027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9725. [D 20:42:36.425042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9726. [D 20:42:36.425057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9727. [D 20:42:36.425072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9728. [D 20:42:36.425086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9729. [D 20:42:36.425101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9730. [D 20:42:36.425117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9731. [D 20:42:36.425153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9732. [D 20:42:36.425172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9733. [D 20:42:36.425187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9734. [D 20:42:36.425202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9735. [D 20:42:36.425217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9736. [D 20:42:36.425231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9737. [D 20:42:36.425246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9738. [D 20:42:36.425260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9739. [D 20:42:36.425275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9740. [D 20:42:36.425289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9741. [D 20:42:36.425304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9742. [D 20:42:36.425319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9743. [D 20:42:36.425334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9744. [D 20:42:36.425348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9745. [D 20:42:36.425369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9746. [D 20:42:36.425417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9747. [D 20:42:36.425444] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9748. [D 20:42:36.430867] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9748. [D 20:42:36.430887] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 11/70. [D 20:42:36.430983] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.431007] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.431020] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.511868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.511889] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.511901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.511940] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3322 [D 20:42:36.511955] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:36.511972] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 12/70. [D 20:42:36.515572] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3322 [D 20:42:36.515673] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 13/70. [D 20:42:36.515780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9748. [D 20:42:36.515822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9749. [D 20:42:36.515838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9750. [D 20:42:36.515852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9751. [D 20:42:36.515867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 9752. [D 20:42:36.515882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 9753. [D 20:42:36.515897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 9754. [D 20:42:36.515912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 9755. [D 20:42:36.515927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 9756. [D 20:42:36.515941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 9757. [D 20:42:36.515956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 9758. [D 20:42:36.515971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 9759. [D 20:42:36.515986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 9760. [D 20:42:36.516001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 9761. [D 20:42:36.516016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 9762. [D 20:42:36.516030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 9763. [D 20:42:36.516045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 9764. [D 20:42:36.516060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 9765. [D 20:42:36.516075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 9766. [D 20:42:36.516089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 9767. [D 20:42:36.516104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 9768. [D 20:42:36.516118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 9769. [D 20:42:36.516133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 9770. [D 20:42:36.516157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 9771. [D 20:42:36.516171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 9772. [D 20:42:36.516185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 9773. [D 20:42:36.516200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 9774. [D 20:42:36.516214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 9775. [D 20:42:36.516229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 9776. [D 20:42:36.516243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 9777. [D 20:42:36.516259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 9778. [D 20:42:36.516273] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 9779. [D 20:42:36.521762] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9779. [D 20:42:36.521784] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 14/70. [D 20:42:36.521865] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.521888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.521901] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.580170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.580192] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.580205] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.580243] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3325 [D 20:42:36.580257] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:36.580274] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 15/70. [D 20:42:36.583735] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3325 [D 20:42:36.583809] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 16/70. [D 20:42:36.583883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9779. [D 20:42:36.583910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9780. [D 20:42:36.583926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9781. [D 20:42:36.583941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9782. [D 20:42:36.583955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9783. [D 20:42:36.583974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9784. [D 20:42:36.583989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9785. [D 20:42:36.584003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9786. [D 20:42:36.584017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9787. [D 20:42:36.584032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9788. [D 20:42:36.584046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9789. [D 20:42:36.584061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9790. [D 20:42:36.584075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9791. [D 20:42:36.584090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9792. [D 20:42:36.584104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9793. [D 20:42:36.584119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9794. [D 20:42:36.584145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9795. [D 20:42:36.584160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9796. [D 20:42:36.584175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9797. [D 20:42:36.584189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9798. [D 20:42:36.584203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9799. [D 20:42:36.584218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9800. [D 20:42:36.584232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9801. [D 20:42:36.584247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9802. [D 20:42:36.584261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9803. [D 20:42:36.584276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9804. [D 20:42:36.584291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9805. [D 20:42:36.584305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9806. [D 20:42:36.584319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9807. [D 20:42:36.584334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9808. [D 20:42:36.584349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9809. [D 20:42:36.584364] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9810. [D 20:42:36.589839] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9810. [D 20:42:36.589861] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 17/70. [D 20:42:36.589942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.589964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.589977] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.687691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.687711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.687724] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.687762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3329 [D 20:42:36.687776] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:36.687793] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 18/70. [D 20:42:36.691435] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3329 [D 20:42:36.691498] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 19/70. [D 20:42:36.691555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9810. [D 20:42:36.691583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9811. [D 20:42:36.691599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9812. [D 20:42:36.691614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9813. [D 20:42:36.691629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9814. [D 20:42:36.691661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9815. [D 20:42:36.691676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9816. [D 20:42:36.691690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9817. [D 20:42:36.691705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9818. [D 20:42:36.691719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9819. [D 20:42:36.691734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9820. [D 20:42:36.691749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9821. [D 20:42:36.691785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9822. [D 20:42:36.691799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9823. [D 20:42:36.691814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9824. [D 20:42:36.691829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9825. [D 20:42:36.691844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9826. [D 20:42:36.691859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9827. [D 20:42:36.691874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9828. [D 20:42:36.691888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9829. [D 20:42:36.691903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9830. [D 20:42:36.691918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9831. [D 20:42:36.691933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9832. [D 20:42:36.691948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9833. [D 20:42:36.691963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9834. [D 20:42:36.692005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9835. [D 20:42:36.692036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9836. [D 20:42:36.692054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9837. [D 20:42:36.692069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9838. [D 20:42:36.692084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9839. [D 20:42:36.692099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9840. [D 20:42:36.692113] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9841. [D 20:42:36.697525] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9841. [D 20:42:36.697546] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 20/70. [D 20:42:36.697641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.697665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.697679] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.777872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.777892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.777905] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.777940] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3331 [D 20:42:36.777955] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:36.777972] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 21/70. [D 20:42:36.781541] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3331 [D 20:42:36.781618] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 22/70. [D 20:42:36.781676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9841. [D 20:42:36.781699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9842. [D 20:42:36.781715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9843. [D 20:42:36.781730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9844. [D 20:42:36.781745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 9845. [D 20:42:36.781759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 9846. [D 20:42:36.781774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 9847. [D 20:42:36.781789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 9848. [D 20:42:36.781804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 9849. [D 20:42:36.781819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 9850. [D 20:42:36.781834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 9851. [D 20:42:36.781849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 9852. [D 20:42:36.781863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 9853. [D 20:42:36.781885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 9854. [D 20:42:36.781924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 9855. [D 20:42:36.781944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 9856. [D 20:42:36.781958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 9857. [D 20:42:36.781972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 9858. [D 20:42:36.781987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 9859. [D 20:42:36.782002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 9860. [D 20:42:36.782016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 9861. [D 20:42:36.782031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 9862. [D 20:42:36.782045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 9863. [D 20:42:36.782060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 9864. [D 20:42:36.782075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 9865. [D 20:42:36.782091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 9866. [D 20:42:36.782114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 9867. [D 20:42:36.782129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 9868. [D 20:42:36.782144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 9869. [D 20:42:36.782160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 9870. [D 20:42:36.782206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 9871. [D 20:42:36.782223] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 9872. [D 20:42:36.787602] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9872. [D 20:42:36.787622] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 23/70. [D 20:42:36.790614] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.790635] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.790651] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.883986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.884012] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.884025] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.884066] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3334 [D 20:42:36.884081] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:36.884099] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 24/70. [D 20:42:36.887691] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3334 [D 20:42:36.887725] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 25/70. [D 20:42:36.887787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 9872. [D 20:42:36.887804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 9873. [D 20:42:36.887820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9874. [D 20:42:36.887835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9875. [D 20:42:36.887849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9876. [D 20:42:36.887864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9877. [D 20:42:36.887886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9878. [D 20:42:36.887901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9879. [D 20:42:36.887916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9880. [D 20:42:36.887938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9881. [D 20:42:36.887965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9882. [D 20:42:36.887980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9883. [D 20:42:36.887999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9884. [D 20:42:36.888013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9885. [D 20:42:36.888028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9886. [D 20:42:36.888042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9887. [D 20:42:36.888057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9888. [D 20:42:36.888076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9889. [D 20:42:36.888092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9890. [D 20:42:36.888107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9891. [D 20:42:36.888122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9892. [D 20:42:36.888169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9893. [D 20:42:36.888186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9894. [D 20:42:36.888205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9895. [D 20:42:36.888220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9896. [D 20:42:36.888234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9897. [D 20:42:36.888252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9898. [D 20:42:36.888266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9899. [D 20:42:36.888281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9900. [D 20:42:36.888295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9901. [D 20:42:36.888314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9902. [D 20:42:36.888329] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9903. [D 20:42:36.893668] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9903. [D 20:42:36.893688] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 26/70. [D 20:42:36.893794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.893848] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.893861] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.932607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.932628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.932641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.932678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3338 [D 20:42:36.932693] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:36.932713] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 27/70. [D 20:42:36.936521] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3338 [D 20:42:36.936559] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 28/70. [D 20:42:36.936615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 9903. [D 20:42:36.936632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 9904. [D 20:42:36.936647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 9905. [D 20:42:36.936671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 9906. [D 20:42:36.936686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 9907. [D 20:42:36.936700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 9908. [D 20:42:36.936729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 9909. [D 20:42:36.936745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 9910. [D 20:42:36.936760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 9911. [D 20:42:36.936775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 9912. [D 20:42:36.936790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 9913. [D 20:42:36.936805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 9914. [D 20:42:36.936819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 9915. [D 20:42:36.936835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 9916. [D 20:42:36.936867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 9917. [D 20:42:36.936881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 9918. [D 20:42:36.936901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 9919. [D 20:42:36.936916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 9920. [D 20:42:36.936931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 9921. [D 20:42:36.936946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 9922. [D 20:42:36.936960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 9923. [D 20:42:36.936975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 9924. [D 20:42:36.936990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 9925. [D 20:42:36.937005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 9926. [D 20:42:36.937023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 9927. [D 20:42:36.937038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 9928. [D 20:42:36.937086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 9929. [D 20:42:36.937102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 9930. [D 20:42:36.937125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 9931. [D 20:42:36.937140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 9932. [D 20:42:36.937155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 9933. [D 20:42:36.937169] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 9934. [D 20:42:36.942583] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9934. [D 20:42:36.942602] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 29/70. [D 20:42:36.942704] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.942755] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.942768] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:36.961406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:36.961426] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.961439] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:36.961475] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3340 [D 20:42:36.961490] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:36.961509] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 30/70. [D 20:42:36.965226] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3340 [D 20:42:36.965261] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 31/70. [D 20:42:36.965317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 9934. [D 20:42:36.965334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 9935. [D 20:42:36.965349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 9936. [D 20:42:36.965372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 9937. [D 20:42:36.965388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 9938. [D 20:42:36.965419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 9939. [D 20:42:36.965434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 9940. [D 20:42:36.965448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 9941. [D 20:42:36.965463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 9942. [D 20:42:36.965477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 9943. [D 20:42:36.965492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 9944. [D 20:42:36.965507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 9945. [D 20:42:36.965522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 9946. [D 20:42:36.965537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 9947. [D 20:42:36.965568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 9948. [D 20:42:36.965583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 9949. [D 20:42:36.965603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 9950. [D 20:42:36.965618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 9951. [D 20:42:36.965633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 9952. [D 20:42:36.965648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 9953. [D 20:42:36.965663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 9954. [D 20:42:36.965678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 9955. [D 20:42:36.965693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 9956. [D 20:42:36.965708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 9957. [D 20:42:36.965723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 9958. [D 20:42:36.965738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 9959. [D 20:42:36.965753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 9960. [D 20:42:36.965806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 9961. [D 20:42:36.965838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 9962. [D 20:42:36.965853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 9963. [D 20:42:36.965868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 9964. [D 20:42:36.965883] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 9965. [D 20:42:36.971197] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9965. [D 20:42:36.971216] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 32/70. [D 20:42:36.971320] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:36.971372] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:36.971386] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.062216] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.062238] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.062251] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.062289] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3343 [D 20:42:37.062304] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:37.062326] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 33/70. [D 20:42:37.066045] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3343 [D 20:42:37.066081] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 34/70. [D 20:42:37.066138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 9965. [D 20:42:37.066155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 9966. [D 20:42:37.066170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 9967. [D 20:42:37.066193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 9968. [D 20:42:37.066208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 9969. [D 20:42:37.066238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 9970. [D 20:42:37.066253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 9971. [D 20:42:37.066268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 9972. [D 20:42:37.066282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 9973. [D 20:42:37.066297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 9974. [D 20:42:37.066311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 9975. [D 20:42:37.066326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 9976. [D 20:42:37.066341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 9977. [D 20:42:37.066356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 9978. [D 20:42:37.066390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 9979. [D 20:42:37.066404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 9980. [D 20:42:37.066424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 9981. [D 20:42:37.066439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 9982. [D 20:42:37.066454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 9983. [D 20:42:37.066469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 9984. [D 20:42:37.066484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 9985. [D 20:42:37.066499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 9986. [D 20:42:37.066514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 9987. [D 20:42:37.066529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 9988. [D 20:42:37.066544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 9989. [D 20:42:37.066559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 9990. [D 20:42:37.066574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 9991. [D 20:42:37.066612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 9992. [D 20:42:37.066627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 9993. [D 20:42:37.066665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 9994. [D 20:42:37.066680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 9995. [D 20:42:37.066695] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 9996. [D 20:42:37.072093] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 9996. [D 20:42:37.072112] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 35/70. [D 20:42:37.072214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.072267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.072281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.112778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.112799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.112812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.112849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3346 [D 20:42:37.112864] element 0: offset: 0x2aaaab027910, size: 24 [D 20:42:37.112885] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 36/70. [D 20:42:37.116606] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3346 [D 20:42:37.116643] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 37/70. [D 20:42:37.116696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 9996. [D 20:42:37.116713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 9997. [D 20:42:37.116728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 9998. [D 20:42:37.116757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 9999. [D 20:42:37.116772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10000. [D 20:42:37.116787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10001. [D 20:42:37.116801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10002. [D 20:42:37.116816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10003. [D 20:42:37.116831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10004. [D 20:42:37.116845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10005. [D 20:42:37.116860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10006. [D 20:42:37.116875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10007. [D 20:42:37.116890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10008. [D 20:42:37.116904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10009. [D 20:42:37.116920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10010. [D 20:42:37.116951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10011. [D 20:42:37.116966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10012. [D 20:42:37.116986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10013. [D 20:42:37.117001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10014. [D 20:42:37.117015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10015. [D 20:42:37.117034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10016. [D 20:42:37.117049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10017. [D 20:42:37.117063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10018. [D 20:42:37.117078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10019. [D 20:42:37.117093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10020. [D 20:42:37.117123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10021. [D 20:42:37.117142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10022. [D 20:42:37.117161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10023. [D 20:42:37.117178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10024. [D 20:42:37.117193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10025. [D 20:42:37.117208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10026. [D 20:42:37.117223] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10027. [D 20:42:37.119192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.119247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.119261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:37.119303] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3349 [D 20:42:37.119318] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:37.119338] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 38/70. [D 20:42:37.122583] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10027. [D 20:42:37.122610] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 39/70. [D 20:42:37.122738] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.122760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.122773] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:37.126429] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3349 [D 20:42:37.126453] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 40/70. [D 20:42:37.126511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10027. [D 20:42:37.126529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10028. [D 20:42:37.126544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10029. [D 20:42:37.126566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10030. [D 20:42:37.126582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10031. [D 20:42:37.126611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10032. [D 20:42:37.126627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10033. [D 20:42:37.126642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10034. [D 20:42:37.126657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10035. [D 20:42:37.126672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10036. [D 20:42:37.126687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10037. [D 20:42:37.126702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10038. [D 20:42:37.126717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10039. [D 20:42:37.126732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10040. [D 20:42:37.126747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10041. [D 20:42:37.126779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10042. [D 20:42:37.126794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10043. [D 20:42:37.126815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10044. [D 20:42:37.126829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10045. [D 20:42:37.126844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10046. [D 20:42:37.126859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10047. [D 20:42:37.126873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10048. [D 20:42:37.126888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10049. [D 20:42:37.126902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10050. [D 20:42:37.126921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10051. [D 20:42:37.126937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10052. [D 20:42:37.126952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10053. [D 20:42:37.126967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10054. [D 20:42:37.126982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10055. [D 20:42:37.127027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10056. [D 20:42:37.127045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10057. [D 20:42:37.127060] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10058. [D 20:42:37.132389] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10058. [D 20:42:37.132409] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 41/70. [D 20:42:37.132514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.132568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.132581] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.148172] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.148193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.148206] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.148246] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3353 [D 20:42:37.148261] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:37.148281] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 42/70. [D 20:42:37.151686] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3353 [D 20:42:37.151711] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 43/70. [D 20:42:37.151764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10058. [D 20:42:37.151781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 10059. [D 20:42:37.151797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 10060. [D 20:42:37.151812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 10061. [D 20:42:37.151827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 10062. [D 20:42:37.151842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 10063. [D 20:42:37.151857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10064. [D 20:42:37.151872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10065. [D 20:42:37.151887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10066. [D 20:42:37.151902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 10067. [D 20:42:37.151917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 10068. [D 20:42:37.151932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 10069. [D 20:42:37.151948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 10070. [D 20:42:37.151985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 10071. [D 20:42:37.152006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10072. [D 20:42:37.152020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10073. [D 20:42:37.152035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10074. [D 20:42:37.152049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10075. [D 20:42:37.152064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10076. [D 20:42:37.152079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10077. [D 20:42:37.152093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10078. [D 20:42:37.152108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10079. [D 20:42:37.152123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10080. [D 20:42:37.152137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10081. [D 20:42:37.152152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10082. [D 20:42:37.152167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10083. [D 20:42:37.152182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10084. [D 20:42:37.152196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10085. [D 20:42:37.152220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10086. [D 20:42:37.152269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10087. [D 20:42:37.152292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10088. [D 20:42:37.152311] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10089. [D 20:42:37.157729] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10089. [D 20:42:37.157749] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 44/70. [D 20:42:37.157852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.157906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.157919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.234377] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.234398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.234411] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.234447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3356 [D 20:42:37.234462] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:37.234482] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 45/70. [D 20:42:37.238076] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3356 [D 20:42:37.238107] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 46/70. [D 20:42:37.238160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10089. [D 20:42:37.238177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 10090. [D 20:42:37.238192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 10091. [D 20:42:37.238207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 10092. [D 20:42:37.238221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 10093. [D 20:42:37.238236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 10094. [D 20:42:37.238250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10095. [D 20:42:37.238285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10096. [D 20:42:37.238299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10097. [D 20:42:37.238327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 10098. [D 20:42:37.238343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 10099. [D 20:42:37.238358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 10100. [D 20:42:37.238373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 10101. [D 20:42:37.238388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 10102. [D 20:42:37.238403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10103. [D 20:42:37.238418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10104. [D 20:42:37.238433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10105. [D 20:42:37.238463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10106. [D 20:42:37.238478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10107. [D 20:42:37.238501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10108. [D 20:42:37.238517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10109. [D 20:42:37.238532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10110. [D 20:42:37.238547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10111. [D 20:42:37.238561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10112. [D 20:42:37.238576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10113. [D 20:42:37.238591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10114. [D 20:42:37.238618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10115. [D 20:42:37.238633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10116. [D 20:42:37.238647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10117. [D 20:42:37.238662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10118. [D 20:42:37.238677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10119. [D 20:42:37.238691] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10120. [D 20:42:37.244098] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10120. [D 20:42:37.244118] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 47/70. [D 20:42:37.244222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.244281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.244295] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.302384] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.302405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.302418] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.302456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3359 [D 20:42:37.302471] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:37.302494] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 48/70. [D 20:42:37.306266] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3359 [D 20:42:37.306295] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 49/70. [D 20:42:37.306351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10120. [D 20:42:37.306368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 10121. [D 20:42:37.306396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 10122. [D 20:42:37.306411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 10123. [D 20:42:37.306427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 10124. [D 20:42:37.306441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 10125. [D 20:42:37.306457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10126. [D 20:42:37.306475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10127. [D 20:42:37.306490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10128. [D 20:42:37.306512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 10129. [D 20:42:37.306538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 10130. [D 20:42:37.306554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 10131. [D 20:42:37.306568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 10132. [D 20:42:37.306587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 10133. [D 20:42:37.306602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10134. [D 20:42:37.306616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10135. [D 20:42:37.306631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10136. [D 20:42:37.306646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10137. [D 20:42:37.306661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10138. [D 20:42:37.306675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10139. [D 20:42:37.306690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10140. [D 20:42:37.306739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10141. [D 20:42:37.306760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10142. [D 20:42:37.306775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10143. [D 20:42:37.306789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10144. [D 20:42:37.306818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10145. [D 20:42:37.306834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10146. [D 20:42:37.306849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10147. [D 20:42:37.306863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10148. [D 20:42:37.306878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10149. [D 20:42:37.306893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10150. [D 20:42:37.306908] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10151. [D 20:42:37.312289] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10151. [D 20:42:37.312308] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 50/70. [D 20:42:37.312411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.312462] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.312475] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.345022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.345043] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.345056] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.345094] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3361 [D 20:42:37.345109] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:37.345128] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 51/70. [D 20:42:37.348796] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3361 [D 20:42:37.348832] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 52/70. [D 20:42:37.348884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10151. [D 20:42:37.348901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10152. [D 20:42:37.348916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10153. [D 20:42:37.348931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10154. [D 20:42:37.348945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10155. [D 20:42:37.348960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10156. [D 20:42:37.348975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10157. [D 20:42:37.348990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10158. [D 20:42:37.349009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10159. [D 20:42:37.349040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10160. [D 20:42:37.349058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10161. [D 20:42:37.349074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10162. [D 20:42:37.349089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10163. [D 20:42:37.349111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10164. [D 20:42:37.349145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10165. [D 20:42:37.349160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10166. [D 20:42:37.349180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10167. [D 20:42:37.349195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10168. [D 20:42:37.349210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10169. [D 20:42:37.349224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10170. [D 20:42:37.349239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10171. [D 20:42:37.349254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10172. [D 20:42:37.349268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10173. [D 20:42:37.349283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10174. [D 20:42:37.349298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10175. [D 20:42:37.349312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10176. [D 20:42:37.349328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10177. [D 20:42:37.349367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10178. [D 20:42:37.349382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10179. [D 20:42:37.349407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10180. [D 20:42:37.349421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10181. [D 20:42:37.349436] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10182. [D 20:42:37.354849] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10182. [D 20:42:37.354869] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 53/70. [D 20:42:37.354970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.355023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.355036] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.410166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.410187] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.410200] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.410238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3364 [D 20:42:37.410253] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:37.410272] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 54/70. [D 20:42:37.413979] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3364 [D 20:42:37.414015] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 55/70. [D 20:42:37.414064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10182. [D 20:42:37.414081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10183. [D 20:42:37.414095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10184. [D 20:42:37.414111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10185. [D 20:42:37.414129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10186. [D 20:42:37.414143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10187. [D 20:42:37.414158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10188. [D 20:42:37.414188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10189. [D 20:42:37.414204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10190. [D 20:42:37.414218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10191. [D 20:42:37.414233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10192. [D 20:42:37.414248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10193. [D 20:42:37.414262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10194. [D 20:42:37.414277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10195. [D 20:42:37.414292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10196. [D 20:42:37.414325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10197. [D 20:42:37.414340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10198. [D 20:42:37.414360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10199. [D 20:42:37.414375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10200. [D 20:42:37.414390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10201. [D 20:42:37.414405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10202. [D 20:42:37.414420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10203. [D 20:42:37.414435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10204. [D 20:42:37.414449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10205. [D 20:42:37.414468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10206. [D 20:42:37.414484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10207. [D 20:42:37.414500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10208. [D 20:42:37.414514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10209. [D 20:42:37.414530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10210. [D 20:42:37.414575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10211. [D 20:42:37.414597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10212. [D 20:42:37.414612] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10213. [D 20:42:37.420025] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10213. [D 20:42:37.420044] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 56/70. [D 20:42:37.420147] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.420200] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.420213] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.524862] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.524883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.524896] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.524933] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3367 [D 20:42:37.524948] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:37.524969] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 57/70. [D 20:42:37.528692] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3367 [D 20:42:37.528723] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 58/70. [D 20:42:37.528782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10213. [D 20:42:37.528810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10214. [D 20:42:37.528831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10215. [D 20:42:37.528853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10216. [D 20:42:37.528868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10217. [D 20:42:37.528882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10218. [D 20:42:37.528901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10219. [D 20:42:37.528916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10220. [D 20:42:37.528931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10221. [D 20:42:37.528945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10222. [D 20:42:37.528960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10223. [D 20:42:37.528975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10224. [D 20:42:37.528990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10225. [D 20:42:37.529004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10226. [D 20:42:37.529052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10227. [D 20:42:37.529067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10228. [D 20:42:37.529087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10229. [D 20:42:37.529102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10230. [D 20:42:37.529117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10231. [D 20:42:37.529132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10232. [D 20:42:37.529147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10233. [D 20:42:37.529162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10234. [D 20:42:37.529177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10235. [D 20:42:37.529192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10236. [D 20:42:37.529208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10237. [D 20:42:37.529223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10238. [D 20:42:37.529238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10239. [D 20:42:37.529253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10240. [D 20:42:37.529298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10241. [D 20:42:37.529315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10242. [D 20:42:37.529331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10243. [D 20:42:37.529346] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10244. [D 20:42:37.534750] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10244. [D 20:42:37.534770] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 59/70. [D 20:42:37.534872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.534924] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.534938] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.578071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.578091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.578104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.578141] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3370 [D 20:42:37.578156] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:37.578175] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 60/70. [D 20:42:37.581745] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3370 [D 20:42:37.581776] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 0/70. [D 20:42:37.581831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10244. [D 20:42:37.581848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10245. [D 20:42:37.581863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10246. [D 20:42:37.581878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10247. [D 20:42:37.581892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10248. [D 20:42:37.581907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10249. [D 20:42:37.581922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10250. [D 20:42:37.581937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10251. [D 20:42:37.581951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10252. [D 20:42:37.581966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10253. [D 20:42:37.581981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10254. [D 20:42:37.581996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10255. [D 20:42:37.582031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10256. [D 20:42:37.582050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10257. [D 20:42:37.582065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10258. [D 20:42:37.582080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10259. [D 20:42:37.582095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10260. [D 20:42:37.582110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10261. [D 20:42:37.582125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10262. [D 20:42:37.582139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10263. [D 20:42:37.582154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10264. [D 20:42:37.582170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10265. [D 20:42:37.582198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10266. [D 20:42:37.582213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10267. [D 20:42:37.582262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10268. [D 20:42:37.582277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10269. [D 20:42:37.582301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10270. [D 20:42:37.582316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10271. [D 20:42:37.582332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10272. [D 20:42:37.582347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10273. [D 20:42:37.582362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10274. [D 20:42:37.582376] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10275. [D 20:42:37.587719] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10275. [D 20:42:37.587739] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 1/70. [D 20:42:37.587844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.587903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.587917] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.594615] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.594636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.594649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.594687] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3374 [D 20:42:37.594702] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:37.594721] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 2/70. [D 20:42:37.598361] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3374 [D 20:42:37.598398] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 3/70. [D 20:42:37.598450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10275. [D 20:42:37.598467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10276. [D 20:42:37.598481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10277. [D 20:42:37.598496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10278. [D 20:42:37.598512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10279. [D 20:42:37.598526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10280. [D 20:42:37.598555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10281. [D 20:42:37.598570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10282. [D 20:42:37.598586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10283. [D 20:42:37.598600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10284. [D 20:42:37.598615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10285. [D 20:42:37.598630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10286. [D 20:42:37.598644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10287. [D 20:42:37.598659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10288. [D 20:42:37.598675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10289. [D 20:42:37.598708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10290. [D 20:42:37.598722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10291. [D 20:42:37.598743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10292. [D 20:42:37.598757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10293. [D 20:42:37.598772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10294. [D 20:42:37.598787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10295. [D 20:42:37.598802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10296. [D 20:42:37.598817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10297. [D 20:42:37.598832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10298. [D 20:42:37.598850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10299. [D 20:42:37.598867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10300. [D 20:42:37.598882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10301. [D 20:42:37.598897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10302. [D 20:42:37.598919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10303. [D 20:42:37.598963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10304. [D 20:42:37.598998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10305. [D 20:42:37.599014] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10306. [D 20:42:37.604408] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10306. [D 20:42:37.604427] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 4/70. [D 20:42:37.604531] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.604582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.604596] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.628422] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.628443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.628456] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.628494] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3376 [D 20:42:37.628509] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:37.628528] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 5/70. [D 20:42:37.632254] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3376 [D 20:42:37.632282] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 6/70. [D 20:42:37.632341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 10306. [D 20:42:37.632358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 10307. [D 20:42:37.632373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 10308. [D 20:42:37.632402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 10309. [D 20:42:37.632418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 10310. [D 20:42:37.632432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 10311. [D 20:42:37.632447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 10312. [D 20:42:37.632461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10313. [D 20:42:37.632476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10314. [D 20:42:37.632491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10315. [D 20:42:37.632506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 10316. [D 20:42:37.632520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 10317. [D 20:42:37.632535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 10318. [D 20:42:37.632550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 10319. [D 20:42:37.632594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 10320. [D 20:42:37.632609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10321. [D 20:42:37.632629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10322. [D 20:42:37.632644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10323. [D 20:42:37.632659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 10324. [D 20:42:37.632674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 10325. [D 20:42:37.632689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 10326. [D 20:42:37.632704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 10327. [D 20:42:37.632719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 10328. [D 20:42:37.632738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10329. [D 20:42:37.632754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10330. [D 20:42:37.632769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10331. [D 20:42:37.632784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 10332. [D 20:42:37.632814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 10333. [D 20:42:37.632841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 10334. [D 20:42:37.632859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 10335. [D 20:42:37.632874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 10336. [D 20:42:37.632890] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10337. [D 20:42:37.638261] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10337. [D 20:42:37.638280] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 7/70. [D 20:42:37.638381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.638433] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.638446] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.674555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.674576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.674589] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.674625] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3379 [D 20:42:37.674640] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:37.674660] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 8/70. [D 20:42:37.678314] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3379 [D 20:42:37.678349] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 9/70. [D 20:42:37.678401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10337. [D 20:42:37.678418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10338. [D 20:42:37.678433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10339. [D 20:42:37.678448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10340. [D 20:42:37.678463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10341. [D 20:42:37.678477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10342. [D 20:42:37.678508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10343. [D 20:42:37.678523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10344. [D 20:42:37.678539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10345. [D 20:42:37.678554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10346. [D 20:42:37.678568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10347. [D 20:42:37.678583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10348. [D 20:42:37.678598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10349. [D 20:42:37.678612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10350. [D 20:42:37.678628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10351. [D 20:42:37.678660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10352. [D 20:42:37.678674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10353. [D 20:42:37.678694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10354. [D 20:42:37.678709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10355. [D 20:42:37.678723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10356. [D 20:42:37.678738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10357. [D 20:42:37.678753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10358. [D 20:42:37.678768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10359. [D 20:42:37.678782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10360. [D 20:42:37.678800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10361. [D 20:42:37.678817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10362. [D 20:42:37.678832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10363. [D 20:42:37.678854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10364. [D 20:42:37.678894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10365. [D 20:42:37.678910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10366. [D 20:42:37.678946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10367. [D 20:42:37.678961] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10368. [D 20:42:37.684353] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10368. [D 20:42:37.684373] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 10/70. [D 20:42:37.684476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.684528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.684542] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.817885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.817906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.817918] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.817957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3383 [D 20:42:37.817972] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:37.817991] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 11/70. [D 20:42:37.821602] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3383 [D 20:42:37.821637] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 12/70. [D 20:42:37.821690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 10368. [D 20:42:37.821706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 10369. [D 20:42:37.821721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 10370. [D 20:42:37.821736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 10371. [D 20:42:37.821751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 10372. [D 20:42:37.821766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 10373. [D 20:42:37.821781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10374. [D 20:42:37.821812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10375. [D 20:42:37.821827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10376. [D 20:42:37.821841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 10377. [D 20:42:37.821856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 10378. [D 20:42:37.821871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 10379. [D 20:42:37.821886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 10380. [D 20:42:37.821901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 10381. [D 20:42:37.821945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10382. [D 20:42:37.821960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10383. [D 20:42:37.821980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10384. [D 20:42:37.821994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 10385. [D 20:42:37.822009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 10386. [D 20:42:37.822024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 10387. [D 20:42:37.822039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 10388. [D 20:42:37.822053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 10389. [D 20:42:37.822068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10390. [D 20:42:37.822087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10391. [D 20:42:37.822103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10392. [D 20:42:37.822118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 10393. [D 20:42:37.822133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 10394. [D 20:42:37.822154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 10395. [D 20:42:37.822196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 10396. [D 20:42:37.822218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 10397. [D 20:42:37.822234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10398. [D 20:42:37.822261] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10399. [D 20:42:37.827567] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10399. [D 20:42:37.827586] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 13/70. [D 20:42:37.827691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.827742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.827756] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.856644] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.856664] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.856677] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.856714] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3385 [D 20:42:37.856730] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:37.856749] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 14/70. [D 20:42:37.860309] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3385 [D 20:42:37.860339] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 15/70. [D 20:42:37.860395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10399. [D 20:42:37.860411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10400. [D 20:42:37.860426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10401. [D 20:42:37.860441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10402. [D 20:42:37.860456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10403. [D 20:42:37.860471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10404. [D 20:42:37.860486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10405. [D 20:42:37.860500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10406. [D 20:42:37.860515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10407. [D 20:42:37.860530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10408. [D 20:42:37.860545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10409. [D 20:42:37.860589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10410. [D 20:42:37.860604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10411. [D 20:42:37.860624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10412. [D 20:42:37.860638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10413. [D 20:42:37.860653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10414. [D 20:42:37.860668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10415. [D 20:42:37.860683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10416. [D 20:42:37.860698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10417. [D 20:42:37.860713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10418. [D 20:42:37.860729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10419. [D 20:42:37.860747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10420. [D 20:42:37.860762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10421. [D 20:42:37.860796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10422. [D 20:42:37.860835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10423. [D 20:42:37.860857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10424. [D 20:42:37.860873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10425. [D 20:42:37.860887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10426. [D 20:42:37.860902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10427. [D 20:42:37.860917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10428. [D 20:42:37.860932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10429. [D 20:42:37.860946] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10430. [D 20:42:37.866317] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10430. [D 20:42:37.866337] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 16/70. [D 20:42:37.866441] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.866500] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.866514] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.888217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.888237] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.888250] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.888288] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3388 [D 20:42:37.888303] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:37.888324] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 17/70. [D 20:42:37.891701] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3388 [D 20:42:37.891724] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 18/70. [D 20:42:37.891775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10430. [D 20:42:37.891792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10431. [D 20:42:37.891808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10432. [D 20:42:37.891823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10433. [D 20:42:37.891838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10434. [D 20:42:37.891853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10435. [D 20:42:37.891868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10436. [D 20:42:37.891884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10437. [D 20:42:37.891898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10438. [D 20:42:37.891913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10439. [D 20:42:37.891929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10440. [D 20:42:37.891943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10441. [D 20:42:37.891958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10442. [D 20:42:37.892009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10443. [D 20:42:37.892029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10444. [D 20:42:37.892044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10445. [D 20:42:37.892059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10446. [D 20:42:37.892073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10447. [D 20:42:37.892088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10448. [D 20:42:37.892103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10449. [D 20:42:37.892117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10450. [D 20:42:37.892132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10451. [D 20:42:37.892146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10452. [D 20:42:37.892161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10453. [D 20:42:37.892178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10454. [D 20:42:37.892195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10455. [D 20:42:37.892209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10456. [D 20:42:37.892233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10457. [D 20:42:37.892276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10458. [D 20:42:37.892292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10459. [D 20:42:37.892313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10460. [D 20:42:37.892329] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10461. [D 20:42:37.897651] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10461. [D 20:42:37.897670] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 19/70. [D 20:42:37.897775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.897827] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.897840] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.927597] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.927617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.927631] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.927674] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3391 [D 20:42:37.927689] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:37.927710] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 20/70. [D 20:42:37.931363] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3391 [D 20:42:37.931400] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 21/70. [D 20:42:37.931452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10461. [D 20:42:37.931469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10462. [D 20:42:37.931484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10463. [D 20:42:37.931499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10464. [D 20:42:37.931515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10465. [D 20:42:37.931529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10466. [D 20:42:37.931544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10467. [D 20:42:37.931558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10468. [D 20:42:37.931578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10469. [D 20:42:37.931607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10470. [D 20:42:37.931622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10471. [D 20:42:37.931636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10472. [D 20:42:37.931651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10473. [D 20:42:37.931669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10474. [D 20:42:37.931684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10475. [D 20:42:37.931731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10476. [D 20:42:37.931752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10477. [D 20:42:37.931766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10478. [D 20:42:37.931781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10479. [D 20:42:37.931795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10480. [D 20:42:37.931810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10481. [D 20:42:37.931824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10482. [D 20:42:37.931839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10483. [D 20:42:37.931853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10484. [D 20:42:37.931868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10485. [D 20:42:37.931885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10486. [D 20:42:37.931901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10487. [D 20:42:37.931916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10488. [D 20:42:37.931931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10489. [D 20:42:37.931945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10490. [D 20:42:37.932015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10491. [D 20:42:37.932032] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10492. [D 20:42:37.937375] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10492. [D 20:42:37.937395] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 22/70. [D 20:42:37.937499] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.937552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.937566] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:37.978138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:37.978158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.978171] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:37.978209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3395 [D 20:42:37.978225] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:37.978243] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 23/70. [D 20:42:37.981864] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3395 [D 20:42:37.981900] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 24/70. [D 20:42:37.981953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 10492. [D 20:42:37.981969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 10493. [D 20:42:37.981984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 10494. [D 20:42:37.982000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 10495. [D 20:42:37.982014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 10496. [D 20:42:37.982044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 10497. [D 20:42:37.982059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10498. [D 20:42:37.982074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10499. [D 20:42:37.982089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10500. [D 20:42:37.982103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 10501. [D 20:42:37.982118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 10502. [D 20:42:37.982133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 10503. [D 20:42:37.982148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 10504. [D 20:42:37.982162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 10505. [D 20:42:37.982177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10506. [D 20:42:37.982224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10507. [D 20:42:37.982244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10508. [D 20:42:37.982259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 10509. [D 20:42:37.982273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 10510. [D 20:42:37.982288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 10511. [D 20:42:37.982302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 10512. [D 20:42:37.982317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 10513. [D 20:42:37.982331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10514. [D 20:42:37.982346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10515. [D 20:42:37.982361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10516. [D 20:42:37.982378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 10517. [D 20:42:37.982394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 10518. [D 20:42:37.982409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 10519. [D 20:42:37.982424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 10520. [D 20:42:37.982467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 10521. [D 20:42:37.982502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10522. [D 20:42:37.982518] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10523. [D 20:42:37.987905] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10523. [D 20:42:37.987925] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 25/70. [D 20:42:37.988009] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:37.988060] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:37.988074] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.040543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.040567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.040580] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.040618] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3397 [D 20:42:38.040633] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:38.040652] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 26/70. [D 20:42:38.044261] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3397 [D 20:42:38.044287] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 27/70. [D 20:42:38.044345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10523. [D 20:42:38.044364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10524. [D 20:42:38.044379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10525. [D 20:42:38.044394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10526. [D 20:42:38.044410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10527. [D 20:42:38.044439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10528. [D 20:42:38.044454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10529. [D 20:42:38.044468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10530. [D 20:42:38.044483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10531. [D 20:42:38.044498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10532. [D 20:42:38.044512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10533. [D 20:42:38.044531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10534. [D 20:42:38.044546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10535. [D 20:42:38.044560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10536. [D 20:42:38.044575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10537. [D 20:42:38.044589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10538. [D 20:42:38.044604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10539. [D 20:42:38.044619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10540. [D 20:42:38.044634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10541. [D 20:42:38.044648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10542. [D 20:42:38.044663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10543. [D 20:42:38.044677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10544. [D 20:42:38.044692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10545. [D 20:42:38.044706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10546. [D 20:42:38.044720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10547. [D 20:42:38.044735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10548. [D 20:42:38.044749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10549. [D 20:42:38.044773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10550. [D 20:42:38.044789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10551. [D 20:42:38.044803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10552. [D 20:42:38.044819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10553. [D 20:42:38.044834] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10554. [D 20:42:38.050268] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10554. [D 20:42:38.050288] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 28/70. [D 20:42:38.050390] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.050446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.050459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.121605] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.121625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.121638] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.121678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3401 [D 20:42:38.121693] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:38.121713] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 29/70. [D 20:42:38.125313] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3401 [D 20:42:38.125345] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 30/70. [D 20:42:38.125403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 10554. [D 20:42:38.125420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 10555. [D 20:42:38.125435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 10556. [D 20:42:38.125451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 10557. [D 20:42:38.125465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 10558. [D 20:42:38.125481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 10559. [D 20:42:38.125509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10560. [D 20:42:38.125524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10561. [D 20:42:38.125539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10562. [D 20:42:38.125567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 10563. [D 20:42:38.125583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 10564. [D 20:42:38.125597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 10565. [D 20:42:38.125613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 10566. [D 20:42:38.125628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 10567. [D 20:42:38.125643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10568. [D 20:42:38.125673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10569. [D 20:42:38.125689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10570. [D 20:42:38.125709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 10571. [D 20:42:38.125728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 10572. [D 20:42:38.125743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 10573. [D 20:42:38.125758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 10574. [D 20:42:38.125772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 10575. [D 20:42:38.125790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10576. [D 20:42:38.125804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10577. [D 20:42:38.125819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10578. [D 20:42:38.125834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 10579. [D 20:42:38.125853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 10580. [D 20:42:38.125868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 10581. [D 20:42:38.125883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 10582. [D 20:42:38.125898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 10583. [D 20:42:38.125913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10584. [D 20:42:38.125928] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10585. [D 20:42:38.131359] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10585. [D 20:42:38.131379] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 31/70. [D 20:42:38.131485] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.131544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.131558] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.180241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.180262] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.180275] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.180314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3403 [D 20:42:38.180329] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:38.180350] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 32/70. [D 20:42:38.183696] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3403 [D 20:42:38.183720] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 33/70. [D 20:42:38.183770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10585. [D 20:42:38.183793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10586. [D 20:42:38.183808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10587. [D 20:42:38.183824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10588. [D 20:42:38.183839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10589. [D 20:42:38.183854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10590. [D 20:42:38.183869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10591. [D 20:42:38.183886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10592. [D 20:42:38.183901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10593. [D 20:42:38.183916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10594. [D 20:42:38.183931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10595. [D 20:42:38.183946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10596. [D 20:42:38.183961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10597. [D 20:42:38.183977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10598. [D 20:42:38.183991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10599. [D 20:42:38.184007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10600. [D 20:42:38.184022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10601. [D 20:42:38.184037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10602. [D 20:42:38.184052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10603. [D 20:42:38.184106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10604. [D 20:42:38.184127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10605. [D 20:42:38.184141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10606. [D 20:42:38.184157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10607. [D 20:42:38.184171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10608. [D 20:42:38.184186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10609. [D 20:42:38.184201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10610. [D 20:42:38.184216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10611. [D 20:42:38.184231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10612. [D 20:42:38.184246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10613. [D 20:42:38.184261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10614. [D 20:42:38.184288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10615. [D 20:42:38.184304] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10616. [D 20:42:38.189708] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10616. [D 20:42:38.189730] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 34/70. [D 20:42:38.189836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.189890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.189904] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.240975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.240996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.241009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.241046] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3406 [D 20:42:38.241061] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:38.241081] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 35/70. [D 20:42:38.244551] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3406 [D 20:42:38.244579] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 36/70. [D 20:42:38.244685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10616. [D 20:42:38.244706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10617. [D 20:42:38.244722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10618. [D 20:42:38.244737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10619. [D 20:42:38.244767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10620. [D 20:42:38.244791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10621. [D 20:42:38.244806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10622. [D 20:42:38.244821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10623. [D 20:42:38.244836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10624. [D 20:42:38.244850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10625. [D 20:42:38.244880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10626. [D 20:42:38.244894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10627. [D 20:42:38.244909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10628. [D 20:42:38.244924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10629. [D 20:42:38.244939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10630. [D 20:42:38.244954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10631. [D 20:42:38.244975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10632. [D 20:42:38.244990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10633. [D 20:42:38.245011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10634. [D 20:42:38.245038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10635. [D 20:42:38.245057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10636. [D 20:42:38.245074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10637. [D 20:42:38.245093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10638. [D 20:42:38.245113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10639. [D 20:42:38.245131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10640. [D 20:42:38.245149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10641. [D 20:42:38.245166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10642. [D 20:42:38.245184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10643. [D 20:42:38.245202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10644. [D 20:42:38.245220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10645. [D 20:42:38.245238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10646. [D 20:42:38.245255] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10647. [D 20:42:38.250615] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10647. [D 20:42:38.250635] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 37/70. [D 20:42:38.250737] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.250789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.250803] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.281345] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.281366] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.281379] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.281416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3409 [D 20:42:38.281431] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:38.281451] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 38/70. [D 20:42:38.285008] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3409 [D 20:42:38.285037] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 39/70. [D 20:42:38.285088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10647. [D 20:42:38.285109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10648. [D 20:42:38.285124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10649. [D 20:42:38.285139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10650. [D 20:42:38.285154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10651. [D 20:42:38.285169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10652. [D 20:42:38.285184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10653. [D 20:42:38.285199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10654. [D 20:42:38.285214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10655. [D 20:42:38.285229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10656. [D 20:42:38.285245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10657. [D 20:42:38.285261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10658. [D 20:42:38.285294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10659. [D 20:42:38.285313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10660. [D 20:42:38.285328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10661. [D 20:42:38.285343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10662. [D 20:42:38.285358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10663. [D 20:42:38.285373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10664. [D 20:42:38.285387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10665. [D 20:42:38.285402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10666. [D 20:42:38.285417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10667. [D 20:42:38.285444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10668. [D 20:42:38.285459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10669. [D 20:42:38.285475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10670. [D 20:42:38.285524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10671. [D 20:42:38.285539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10672. [D 20:42:38.285561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10673. [D 20:42:38.285576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10674. [D 20:42:38.285591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10675. [D 20:42:38.285605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10676. [D 20:42:38.285620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10677. [D 20:42:38.285635] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10678. [D 20:42:38.291055] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10678. [D 20:42:38.291074] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 40/70. [D 20:42:38.291178] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.291236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.291250] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.354085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.354106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.354119] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.354158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3412 [D 20:42:38.354173] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:38.354193] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 41/70. [D 20:42:38.357871] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3412 [D 20:42:38.357906] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 42/70. [D 20:42:38.357958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10678. [D 20:42:38.357975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10679. [D 20:42:38.357989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10680. [D 20:42:38.358005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10681. [D 20:42:38.358020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10682. [D 20:42:38.358035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10683. [D 20:42:38.358050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10684. [D 20:42:38.358081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10685. [D 20:42:38.358096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10686. [D 20:42:38.358111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10687. [D 20:42:38.358126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10688. [D 20:42:38.358141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10689. [D 20:42:38.358156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10690. [D 20:42:38.358171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10691. [D 20:42:38.358186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10692. [D 20:42:38.358233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10693. [D 20:42:38.358254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10694. [D 20:42:38.358269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10695. [D 20:42:38.358284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10696. [D 20:42:38.358298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10697. [D 20:42:38.358313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10698. [D 20:42:38.358328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10699. [D 20:42:38.358343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10700. [D 20:42:38.358357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10701. [D 20:42:38.358372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10702. [D 20:42:38.358387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10703. [D 20:42:38.358402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10704. [D 20:42:38.358417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10705. [D 20:42:38.358433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10706. [D 20:42:38.358474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10707. [D 20:42:38.358493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10708. [D 20:42:38.358512] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10709. [D 20:42:38.363884] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10709. [D 20:42:38.363903] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 43/70. [D 20:42:38.364007] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.364060] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.364073] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.422536] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.422558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.422571] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.422609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3415 [D 20:42:38.422624] element 0: offset: 0x2aaaab0279d0, size: 24 [D 20:42:38.422644] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 44/70. [D 20:42:38.426385] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3415 [D 20:42:38.426422] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 45/70. [D 20:42:38.426476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10709. [D 20:42:38.426493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10710. [D 20:42:38.426508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10711. [D 20:42:38.426523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10712. [D 20:42:38.426538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10713. [D 20:42:38.426552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10714. [D 20:42:38.426567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10715. [D 20:42:38.426597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10716. [D 20:42:38.426613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10717. [D 20:42:38.426628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10718. [D 20:42:38.426643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10719. [D 20:42:38.426658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10720. [D 20:42:38.426673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10721. [D 20:42:38.426688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10722. [D 20:42:38.426731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10723. [D 20:42:38.426746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10724. [D 20:42:38.426767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10725. [D 20:42:38.426782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10726. [D 20:42:38.426796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10727. [D 20:42:38.426811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10728. [D 20:42:38.426825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10729. [D 20:42:38.426840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10730. [D 20:42:38.426855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10731. [D 20:42:38.426873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10732. [D 20:42:38.426890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10733. [D 20:42:38.426904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10734. [D 20:42:38.426926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10735. [D 20:42:38.426964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10736. [D 20:42:38.426980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10737. [D 20:42:38.427004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10738. [D 20:42:38.427030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10739. [D 20:42:38.427046] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10740. [D 20:42:38.432400] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10740. [D 20:42:38.432419] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 46/70. [D 20:42:38.432522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.432574] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.432587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.501609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.501630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.501643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.501681] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3418 [D 20:42:38.501696] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:38.501715] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 47/70. [D 20:42:38.505339] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3418 [D 20:42:38.505371] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 48/70. [D 20:42:38.505426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10740. [D 20:42:38.505442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10741. [D 20:42:38.505459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10742. [D 20:42:38.505476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10743. [D 20:42:38.505491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10744. [D 20:42:38.505505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10745. [D 20:42:38.505549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10746. [D 20:42:38.505565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10747. [D 20:42:38.505579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10748. [D 20:42:38.505594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10749. [D 20:42:38.505609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10750. [D 20:42:38.505624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10751. [D 20:42:38.505639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10752. [D 20:42:38.505654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10753. [D 20:42:38.505670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10754. [D 20:42:38.505699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10755. [D 20:42:38.505714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10756. [D 20:42:38.505734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10757. [D 20:42:38.505753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10758. [D 20:42:38.505768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10759. [D 20:42:38.505784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10760. [D 20:42:38.505798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10761. [D 20:42:38.505816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10762. [D 20:42:38.505842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10763. [D 20:42:38.505858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10764. [D 20:42:38.505872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10765. [D 20:42:38.505887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10766. [D 20:42:38.505902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10767. [D 20:42:38.505917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10768. [D 20:42:38.505931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10769. [D 20:42:38.505946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10770. [D 20:42:38.505961] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10771. [D 20:42:38.511394] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10771. [D 20:42:38.511413] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 49/70. [D 20:42:38.511519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.511578] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.511592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.579125] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.579147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.579160] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.579200] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3421 [D 20:42:38.579215] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:38.579235] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 50/70. [D 20:42:38.582864] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3421 [D 20:42:38.582893] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 51/70. [D 20:42:38.582944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10771. [D 20:42:38.582961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10772. [D 20:42:38.582976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10773. [D 20:42:38.582991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10774. [D 20:42:38.583005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10775. [D 20:42:38.583020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10776. [D 20:42:38.583035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10777. [D 20:42:38.583050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10778. [D 20:42:38.583064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10779. [D 20:42:38.583079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10780. [D 20:42:38.583094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10781. [D 20:42:38.583109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10782. [D 20:42:38.583145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10783. [D 20:42:38.583159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10784. [D 20:42:38.583179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10785. [D 20:42:38.583194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10786. [D 20:42:38.583209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10787. [D 20:42:38.583223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10788. [D 20:42:38.583238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10789. [D 20:42:38.583253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10790. [D 20:42:38.583268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10791. [D 20:42:38.583285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10792. [D 20:42:38.583301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10793. [D 20:42:38.583323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10794. [D 20:42:38.583338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10795. [D 20:42:38.583353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10796. [D 20:42:38.583368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10797. [D 20:42:38.583418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10798. [D 20:42:38.583438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10799. [D 20:42:38.583455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10800. [D 20:42:38.583470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10801. [D 20:42:38.583485] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10802. [D 20:42:38.588870] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10802. [D 20:42:38.588890] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 52/70. [D 20:42:38.588992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.589050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.589064] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.605163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.605184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.605197] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.605236] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3425 [D 20:42:38.605251] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:38.605272] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 53/70. [D 20:42:38.608948] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3425 [D 20:42:38.608982] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 54/70. [D 20:42:38.609034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 10802. [D 20:42:38.609050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 10803. [D 20:42:38.609065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 10804. [D 20:42:38.609081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 10805. [D 20:42:38.609095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 10806. [D 20:42:38.609114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 10807. [D 20:42:38.609129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10808. [D 20:42:38.609152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10809. [D 20:42:38.609167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10810. [D 20:42:38.609182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 10811. [D 20:42:38.609197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 10812. [D 20:42:38.609211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 10813. [D 20:42:38.609226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 10814. [D 20:42:38.609241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 10815. [D 20:42:38.609256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10816. [D 20:42:38.609291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10817. [D 20:42:38.609306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10818. [D 20:42:38.609326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 10819. [D 20:42:38.609340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 10820. [D 20:42:38.609355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 10821. [D 20:42:38.609370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 10822. [D 20:42:38.609385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 10823. [D 20:42:38.609399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10824. [D 20:42:38.609414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10825. [D 20:42:38.609433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10826. [D 20:42:38.609468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 10827. [D 20:42:38.609484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 10828. [D 20:42:38.609521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 10829. [D 20:42:38.609536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 10830. [D 20:42:38.609558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 10831. [D 20:42:38.609576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10832. [D 20:42:38.609592] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10833. [D 20:42:38.614987] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10833. [D 20:42:38.615006] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 55/70. [D 20:42:38.615109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.615162] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.615176] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.657661] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.657683] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.657696] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.657735] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3427 [D 20:42:38.657750] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:38.657772] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 56/70. [D 20:42:38.661350] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3427 [D 20:42:38.661380] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 57/70. [D 20:42:38.661430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10833. [D 20:42:38.661447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10834. [D 20:42:38.661462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10835. [D 20:42:38.661479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10836. [D 20:42:38.661494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10837. [D 20:42:38.661509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10838. [D 20:42:38.661524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10839. [D 20:42:38.661538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10840. [D 20:42:38.661553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10841. [D 20:42:38.661568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10842. [D 20:42:38.661583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10843. [D 20:42:38.661598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10844. [D 20:42:38.661634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10845. [D 20:42:38.661649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10846. [D 20:42:38.661668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10847. [D 20:42:38.661683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10848. [D 20:42:38.661698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10849. [D 20:42:38.661713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10850. [D 20:42:38.661728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10851. [D 20:42:38.661742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10852. [D 20:42:38.661758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10853. [D 20:42:38.661773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10854. [D 20:42:38.661790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10855. [D 20:42:38.661805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10856. [D 20:42:38.661840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10857. [D 20:42:38.661882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10858. [D 20:42:38.661899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10859. [D 20:42:38.661915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10860. [D 20:42:38.661931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10861. [D 20:42:38.661946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10862. [D 20:42:38.661961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10863. [D 20:42:38.661975] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10864. [D 20:42:38.667392] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10864. [D 20:42:38.667412] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 58/70. [D 20:42:38.667514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.667572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.667586] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.776592] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.776612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.776625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.776664] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3430 [D 20:42:38.776679] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:38.776698] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 59/70. [D 20:42:38.780413] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3430 [D 20:42:38.780448] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 60/70. [D 20:42:38.780500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10864. [D 20:42:38.780517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10865. [D 20:42:38.780533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10866. [D 20:42:38.780548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10867. [D 20:42:38.780563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10868. [D 20:42:38.780578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10869. [D 20:42:38.780593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10870. [D 20:42:38.780612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10871. [D 20:42:38.780627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10872. [D 20:42:38.780644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10873. [D 20:42:38.780660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10874. [D 20:42:38.780675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10875. [D 20:42:38.780690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10876. [D 20:42:38.780705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10877. [D 20:42:38.780720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10878. [D 20:42:38.780735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10879. [D 20:42:38.780751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10880. [D 20:42:38.780792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10881. [D 20:42:38.780807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10882. [D 20:42:38.780827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10883. [D 20:42:38.780842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10884. [D 20:42:38.780857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10885. [D 20:42:38.780885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10886. [D 20:42:38.780899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10887. [D 20:42:38.780914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10888. [D 20:42:38.780928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10889. [D 20:42:38.780944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10890. [D 20:42:38.780961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10891. [D 20:42:38.780976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10892. [D 20:42:38.780991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10893. [D 20:42:38.781034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10894. [D 20:42:38.781050] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10895. [D 20:42:38.786423] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10895. [D 20:42:38.786443] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 0/70. [D 20:42:38.786546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.786596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.786610] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.896963] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.896984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.896997] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.897035] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3434 [D 20:42:38.897050] element 0: offset: 0x2aaaab0279d0, size: 24 [D 20:42:38.897069] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 1/70. [D 20:42:38.900596] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3434 [D 20:42:38.900625] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 2/70. [D 20:42:38.900680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 10895. [D 20:42:38.900697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 10896. [D 20:42:38.900712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 10897. [D 20:42:38.900727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 10898. [D 20:42:38.900742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 10899. [D 20:42:38.900757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 10900. [D 20:42:38.900772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10901. [D 20:42:38.900787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10902. [D 20:42:38.900802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10903. [D 20:42:38.900816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 10904. [D 20:42:38.900831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 10905. [D 20:42:38.900847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 10906. [D 20:42:38.900879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 10907. [D 20:42:38.900894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 10908. [D 20:42:38.900913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10909. [D 20:42:38.900928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10910. [D 20:42:38.900943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10911. [D 20:42:38.900958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 10912. [D 20:42:38.900973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 10913. [D 20:42:38.900988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 10914. [D 20:42:38.901003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 10915. [D 20:42:38.901018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 10916. [D 20:42:38.901035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10917. [D 20:42:38.901050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10918. [D 20:42:38.901072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10919. [D 20:42:38.901114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 10920. [D 20:42:38.901132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 10921. [D 20:42:38.901150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 10922. [D 20:42:38.901166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 10923. [D 20:42:38.901182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 10924. [D 20:42:38.901196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10925. [D 20:42:38.901211] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10926. [D 20:42:38.906633] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10926. [D 20:42:38.906653] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 3/70. [D 20:42:38.906756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.906816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.906829] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.929062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.929082] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.929095] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.929135] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3436 [D 20:42:38.929150] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:38.929169] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 4/70. [D 20:42:38.932827] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3436 [D 20:42:38.932862] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 5/70. [D 20:42:38.932915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 10926. [D 20:42:38.932932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 10927. [D 20:42:38.932964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 10928. [D 20:42:38.932986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 10929. [D 20:42:38.933001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 10930. [D 20:42:38.933016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 10931. [D 20:42:38.933035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 10932. [D 20:42:38.933049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 10933. [D 20:42:38.933064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 10934. [D 20:42:38.933079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 10935. [D 20:42:38.933094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 10936. [D 20:42:38.933109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 10937. [D 20:42:38.933124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 10938. [D 20:42:38.933149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 10939. [D 20:42:38.933183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 10940. [D 20:42:38.933198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 10941. [D 20:42:38.933218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 10942. [D 20:42:38.933232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 10943. [D 20:42:38.933247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 10944. [D 20:42:38.933262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 10945. [D 20:42:38.933276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 10946. [D 20:42:38.933305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 10947. [D 20:42:38.933321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 10948. [D 20:42:38.933336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 10949. [D 20:42:38.933351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 10950. [D 20:42:38.933366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 10951. [D 20:42:38.933381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 10952. [D 20:42:38.933420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 10953. [D 20:42:38.933442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 10954. [D 20:42:38.933457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 10955. [D 20:42:38.933472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 10956. [D 20:42:38.933487] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 10957. [D 20:42:38.938801] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10957. [D 20:42:38.938820] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 6/70. [D 20:42:38.938923] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.938974] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.938987] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:38.964775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:38.964795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.964808] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:38.964846] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3439 [D 20:42:38.964861] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:38.964880] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 7/70. [D 20:42:38.968612] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3439 [D 20:42:38.968643] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 8/70. [D 20:42:38.968699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10957. [D 20:42:38.968716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10958. [D 20:42:38.968743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 10959. [D 20:42:38.968765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 10960. [D 20:42:38.968779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 10961. [D 20:42:38.968794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 10962. [D 20:42:38.968812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 10963. [D 20:42:38.968828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10964. [D 20:42:38.968843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10965. [D 20:42:38.968858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10966. [D 20:42:38.968875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 10967. [D 20:42:38.968891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 10968. [D 20:42:38.968906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 10969. [D 20:42:38.968927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 10970. [D 20:42:38.968961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 10971. [D 20:42:38.968976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10972. [D 20:42:38.968997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10973. [D 20:42:38.969012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10974. [D 20:42:38.969027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10975. [D 20:42:38.969042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10976. [D 20:42:38.969056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10977. [D 20:42:38.969083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10978. [D 20:42:38.969099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10979. [D 20:42:38.969113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10980. [D 20:42:38.969128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10981. [D 20:42:38.969181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10982. [D 20:42:38.969198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10983. [D 20:42:38.969217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10984. [D 20:42:38.969232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10985. [D 20:42:38.969251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10986. [D 20:42:38.969267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10987. [D 20:42:38.969282] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10988. [D 20:42:38.974578] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 10988. [D 20:42:38.974597] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 9/70. [D 20:42:38.974700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:38.974750] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:38.974764] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.037457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.037478] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.037492] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.037529] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3442 [D 20:42:39.037545] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:39.037564] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 10/70. [D 20:42:39.041196] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3442 [D 20:42:39.041226] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 11/70. [D 20:42:39.041284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10988. [D 20:42:39.041301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10989. [D 20:42:39.041315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10990. [D 20:42:39.041330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10991. [D 20:42:39.041345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10992. [D 20:42:39.041360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10993. [D 20:42:39.041381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10994. [D 20:42:39.041405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10995. [D 20:42:39.041420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10996. [D 20:42:39.041450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10997. [D 20:42:39.041465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10998. [D 20:42:39.041481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10999. [D 20:42:39.041496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 11000. [D 20:42:39.041511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 11001. [D 20:42:39.041526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 11002. [D 20:42:39.041541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 11003. [D 20:42:39.041572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 11004. [D 20:42:39.041591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 11005. [D 20:42:39.041611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 11006. [D 20:42:39.041626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 11007. [D 20:42:39.041641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 11008. [D 20:42:39.041656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 11009. [D 20:42:39.041672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 11010. [D 20:42:39.041687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 11011. [D 20:42:39.041702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 11012. [D 20:42:39.041729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 11013. [D 20:42:39.041744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 11014. [D 20:42:39.041759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 11015. [D 20:42:39.041773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 11016. [D 20:42:39.041788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 11017. [D 20:42:39.041802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 11018. [D 20:42:39.041817] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 11019. [D 20:42:39.047211] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11019. [D 20:42:39.047230] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 12/70. [D 20:42:39.047334] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.047394] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.047408] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.082300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.082321] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.082334] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.082373] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3445 [D 20:42:39.082388] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:39.082410] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 13/70. [D 20:42:39.086065] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3445 [D 20:42:39.086095] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 14/70. [D 20:42:39.086152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11019. [D 20:42:39.086169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11020. [D 20:42:39.086183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 11021. [D 20:42:39.086198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 11022. [D 20:42:39.086213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 11023. [D 20:42:39.086228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 11024. [D 20:42:39.086249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 11025. [D 20:42:39.086273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11026. [D 20:42:39.086288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11027. [D 20:42:39.086317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11028. [D 20:42:39.086332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 11029. [D 20:42:39.086347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 11030. [D 20:42:39.086361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 11031. [D 20:42:39.086377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 11032. [D 20:42:39.086391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 11033. [D 20:42:39.086413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11034. [D 20:42:39.086445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11035. [D 20:42:39.086460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11036. [D 20:42:39.086483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 11037. [D 20:42:39.086498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 11038. [D 20:42:39.086513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 11039. [D 20:42:39.086528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 11040. [D 20:42:39.086543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 11041. [D 20:42:39.086573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11042. [D 20:42:39.086588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11043. [D 20:42:39.086603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11044. [D 20:42:39.086618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 11045. [D 20:42:39.086632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 11046. [D 20:42:39.086647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 11047. [D 20:42:39.086662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 11048. [D 20:42:39.086676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 11049. [D 20:42:39.086691] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11050. [D 20:42:39.092097] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11050. [D 20:42:39.092117] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 15/70. [D 20:42:39.092222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.092282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.092295] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.134641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.134661] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.134675] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.134713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3449 [D 20:42:39.134729] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:39.134750] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 16/70. [D 20:42:39.138438] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3449 [D 20:42:39.138472] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 17/70. [D 20:42:39.138525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 11050. [D 20:42:39.138543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 11051. [D 20:42:39.138558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 11052. [D 20:42:39.138593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 11053. [D 20:42:39.138608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 11054. [D 20:42:39.138623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 11055. [D 20:42:39.138641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11056. [D 20:42:39.138657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11057. [D 20:42:39.138672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11058. [D 20:42:39.138687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 11059. [D 20:42:39.138704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 11060. [D 20:42:39.138721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 11061. [D 20:42:39.138736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 11062. [D 20:42:39.138751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 11063. [D 20:42:39.138786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11064. [D 20:42:39.138801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11065. [D 20:42:39.138822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11066. [D 20:42:39.138836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 11067. [D 20:42:39.138851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 11068. [D 20:42:39.138866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 11069. [D 20:42:39.138892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 11070. [D 20:42:39.138908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 11071. [D 20:42:39.138923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11072. [D 20:42:39.138937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11073. [D 20:42:39.138952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11074. [D 20:42:39.138968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 11075. [D 20:42:39.139004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 11076. [D 20:42:39.139023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 11077. [D 20:42:39.139042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 11078. [D 20:42:39.139056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 11079. [D 20:42:39.139071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11080. [D 20:42:39.139086] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11081. [D 20:42:39.144461] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11081. [D 20:42:39.144480] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 18/70. [D 20:42:39.144582] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.144635] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.144649] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.237872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.237893] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.237906] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.237945] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3451 [D 20:42:39.237960] element 0: offset: 0x2aaaab0279d0, size: 24 [D 20:42:39.237980] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 19/70. [D 20:42:39.241646] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3451 [D 20:42:39.241681] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 20/70. [D 20:42:39.241738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11081. [D 20:42:39.241755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11082. [D 20:42:39.241769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11083. [D 20:42:39.241799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11084. [D 20:42:39.241814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11085. [D 20:42:39.241828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11086. [D 20:42:39.241847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11087. [D 20:42:39.241863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11088. [D 20:42:39.241878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11089. [D 20:42:39.241893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11090. [D 20:42:39.241908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11091. [D 20:42:39.241922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11092. [D 20:42:39.241937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11093. [D 20:42:39.241952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11094. [D 20:42:39.241986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11095. [D 20:42:39.242001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11096. [D 20:42:39.242021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11097. [D 20:42:39.242036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11098. [D 20:42:39.242050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11099. [D 20:42:39.242065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11100. [D 20:42:39.242080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11101. [D 20:42:39.242094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11102. [D 20:42:39.242109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11103. [D 20:42:39.242124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11104. [D 20:42:39.242139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11105. [D 20:42:39.242168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11106. [D 20:42:39.242206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11107. [D 20:42:39.242221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11108. [D 20:42:39.242245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11109. [D 20:42:39.242260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11110. [D 20:42:39.242274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11111. [D 20:42:39.242289] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11112. [D 20:42:39.247670] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11112. [D 20:42:39.247693] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 21/70. [D 20:42:39.247798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.247850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.247864] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.307825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.307846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.307859] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.307897] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3454 [D 20:42:39.307912] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:39.307931] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 22/70. [D 20:42:39.311585] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3454 [D 20:42:39.311619] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 23/70. [D 20:42:39.311671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 11112. [D 20:42:39.311691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 11113. [D 20:42:39.311706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 11114. [D 20:42:39.311721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 11115. [D 20:42:39.311762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 11116. [D 20:42:39.311778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 11117. [D 20:42:39.311792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 11118. [D 20:42:39.311807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 11119. [D 20:42:39.311822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 11120. [D 20:42:39.311837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 11121. [D 20:42:39.311852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 11122. [D 20:42:39.311867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 11123. [D 20:42:39.311881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 11124. [D 20:42:39.311896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 11125. [D 20:42:39.311911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 11126. [D 20:42:39.311926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 11127. [D 20:42:39.311960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 11128. [D 20:42:39.311974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 11129. [D 20:42:39.311995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 11130. [D 20:42:39.312010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 11131. [D 20:42:39.312025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 11132. [D 20:42:39.312039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 11133. [D 20:42:39.312054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 11134. [D 20:42:39.312069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 11135. [D 20:42:39.312083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 11136. [D 20:42:39.312102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 11137. [D 20:42:39.312118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 11138. [D 20:42:39.312133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 11139. [D 20:42:39.312148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 11140. [D 20:42:39.312163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 11141. [D 20:42:39.312208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 11142. [D 20:42:39.312230] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 11143. [D 20:42:39.317638] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11143. [D 20:42:39.317658] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 24/70. [D 20:42:39.317760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.317811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.317824] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.371976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.371997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.372010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.372047] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3457 [D 20:42:39.372062] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:39.372082] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 25/70. [D 20:42:39.375691] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3457 [D 20:42:39.375722] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 26/70. [D 20:42:39.375777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11143. [D 20:42:39.375794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11144. [D 20:42:39.375808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11145. [D 20:42:39.375839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11146. [D 20:42:39.375854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11147. [D 20:42:39.375868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11148. [D 20:42:39.375883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11149. [D 20:42:39.375898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11150. [D 20:42:39.375923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11151. [D 20:42:39.375938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11152. [D 20:42:39.375953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11153. [D 20:42:39.375971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11154. [D 20:42:39.375986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11155. [D 20:42:39.376001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11156. [D 20:42:39.376016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11157. [D 20:42:39.376030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11158. [D 20:42:39.376045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11159. [D 20:42:39.376060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11160. [D 20:42:39.376096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11161. [D 20:42:39.376113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11162. [D 20:42:39.376141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11163. [D 20:42:39.376157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11164. [D 20:42:39.376171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11165. [D 20:42:39.376187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11166. [D 20:42:39.376202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11167. [D 20:42:39.376217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11168. [D 20:42:39.376231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11169. [D 20:42:39.376250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11170. [D 20:42:39.376265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11171. [D 20:42:39.376280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11172. [D 20:42:39.376295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11173. [D 20:42:39.376310] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11174. [D 20:42:39.383532] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11174. [D 20:42:39.383557] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 27/70. [D 20:42:39.383702] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.383751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.383765] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.393285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.393306] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.393319] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.393356] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3461 [D 20:42:39.393371] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:39.393391] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 28/70. [D 20:42:39.397041] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3461 [D 20:42:39.397070] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 29/70. [D 20:42:39.397127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 11174. [D 20:42:39.397144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 11175. [D 20:42:39.397163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 11176. [D 20:42:39.397180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 11177. [D 20:42:39.397195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 11178. [D 20:42:39.397210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 11179. [D 20:42:39.397226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11180. [D 20:42:39.397247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11181. [D 20:42:39.397261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11182. [D 20:42:39.397281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 11183. [D 20:42:39.397295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 11184. [D 20:42:39.397310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 11185. [D 20:42:39.397325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 11186. [D 20:42:39.397340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 11187. [D 20:42:39.397354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11188. [D 20:42:39.397369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11189. [D 20:42:39.397385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11190. [D 20:42:39.397416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 11191. [D 20:42:39.397434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 11192. [D 20:42:39.397454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 11193. [D 20:42:39.397469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 11194. [D 20:42:39.397484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 11195. [D 20:42:39.397499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11196. [D 20:42:39.397516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11197. [D 20:42:39.397531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11198. [D 20:42:39.397545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 11199. [D 20:42:39.397560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 11200. [D 20:42:39.397579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 11201. [D 20:42:39.397594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 11202. [D 20:42:39.397609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 11203. [D 20:42:39.397624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11204. [D 20:42:39.397657] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11205. [D 20:42:39.403083] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11205. [D 20:42:39.403103] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 30/70. [D 20:42:39.403208] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.403269] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.403283] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.446526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.446548] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.446560] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.446600] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3463 [D 20:42:39.446615] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:39.446636] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 31/70. [D 20:42:39.450293] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3463 [D 20:42:39.450327] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 32/70. [D 20:42:39.450384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11205. [D 20:42:39.450401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11206. [D 20:42:39.450416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 11207. [D 20:42:39.450439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 11208. [D 20:42:39.450453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 11209. [D 20:42:39.450468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 11210. [D 20:42:39.450497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 11211. [D 20:42:39.450513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11212. [D 20:42:39.450528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11213. [D 20:42:39.450542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11214. [D 20:42:39.450557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 11215. [D 20:42:39.450572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 11216. [D 20:42:39.450586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 11217. [D 20:42:39.450601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 11218. [D 20:42:39.450634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 11219. [D 20:42:39.450649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11220. [D 20:42:39.450669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11221. [D 20:42:39.450683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11222. [D 20:42:39.450698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 11223. [D 20:42:39.450712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 11224. [D 20:42:39.450727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 11225. [D 20:42:39.450741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 11226. [D 20:42:39.450756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 11227. [D 20:42:39.450771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11228. [D 20:42:39.450786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11229. [D 20:42:39.450800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11230. [D 20:42:39.450815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 11231. [D 20:42:39.450830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 11232. [D 20:42:39.450871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 11233. [D 20:42:39.450893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 11234. [D 20:42:39.450908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 11235. [D 20:42:39.450923] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11236. [D 20:42:39.456303] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11236. [D 20:42:39.456323] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 33/70. [D 20:42:39.456427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.456479] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.456492] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.534778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.534799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.534812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.534850] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3466 [D 20:42:39.534865] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:39.534884] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 34/70. [D 20:42:39.538590] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3466 [D 20:42:39.538621] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 35/70. [D 20:42:39.538671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 11236. [D 20:42:39.538690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 11237. [D 20:42:39.538704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 11238. [D 20:42:39.538734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 11239. [D 20:42:39.538751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 11240. [D 20:42:39.538766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 11241. [D 20:42:39.538781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 11242. [D 20:42:39.538795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 11243. [D 20:42:39.538811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 11244. [D 20:42:39.538826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 11245. [D 20:42:39.538841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 11246. [D 20:42:39.538856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 11247. [D 20:42:39.538871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 11248. [D 20:42:39.538886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 11249. [D 20:42:39.538902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 11250. [D 20:42:39.538917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 11251. [D 20:42:39.538956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 11252. [D 20:42:39.538971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 11253. [D 20:42:39.538991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 11254. [D 20:42:39.539006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 11255. [D 20:42:39.539021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 11256. [D 20:42:39.539036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 11257. [D 20:42:39.539051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 11258. [D 20:42:39.539066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 11259. [D 20:42:39.539093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 11260. [D 20:42:39.539108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 11261. [D 20:42:39.539124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 11262. [D 20:42:39.539139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 11263. [D 20:42:39.539191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 11264. [D 20:42:39.539210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 11265. [D 20:42:39.539229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 11266. [D 20:42:39.539243] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 11267. [D 20:42:39.544628] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11267. [D 20:42:39.544647] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 36/70. [D 20:42:39.544751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.544805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.544819] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.599662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.599687] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.599700] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.599739] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3469 [D 20:42:39.599754] element 0: offset: 0x2aaaab0279d0, size: 24 [D 20:42:39.599774] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 37/70. [D 20:42:39.603298] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3469 [D 20:42:39.603328] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 38/70. [D 20:42:39.603378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11267. [D 20:42:39.603395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11268. [D 20:42:39.603410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11269. [D 20:42:39.603426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11270. [D 20:42:39.603441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11271. [D 20:42:39.603456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11272. [D 20:42:39.603471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11273. [D 20:42:39.603485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11274. [D 20:42:39.603500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11275. [D 20:42:39.603515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11276. [D 20:42:39.603530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11277. [D 20:42:39.603545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11278. [D 20:42:39.603580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11279. [D 20:42:39.603599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11280. [D 20:42:39.603614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11281. [D 20:42:39.603628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11282. [D 20:42:39.603643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11283. [D 20:42:39.603657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11284. [D 20:42:39.603672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11285. [D 20:42:39.603691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11286. [D 20:42:39.603706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11287. [D 20:42:39.603720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11288. [D 20:42:39.603737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11289. [D 20:42:39.603762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11290. [D 20:42:39.603778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11291. [D 20:42:39.603793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11292. [D 20:42:39.603807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11293. [D 20:42:39.603823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11294. [D 20:42:39.603838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11295. [D 20:42:39.603853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11296. [D 20:42:39.603868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11297. [D 20:42:39.603882] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11298. [D 20:42:39.609301] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11298. [D 20:42:39.609321] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 39/70. [D 20:42:39.609424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.609483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.609496] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.716668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.716689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.716702] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.716741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3472 [D 20:42:39.716756] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:39.716775] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 40/70. [D 20:42:39.720446] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3472 [D 20:42:39.720481] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 41/70. [D 20:42:39.720534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 11298. [D 20:42:39.720562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 11299. [D 20:42:39.720578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 11300. [D 20:42:39.720593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 11301. [D 20:42:39.720609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 11302. [D 20:42:39.720624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 11303. [D 20:42:39.720639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 11304. [D 20:42:39.720658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11305. [D 20:42:39.720672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11306. [D 20:42:39.720688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11307. [D 20:42:39.720717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 11308. [D 20:42:39.720732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 11309. [D 20:42:39.720747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 11310. [D 20:42:39.720766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 11311. [D 20:42:39.720780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 11312. [D 20:42:39.720795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11313. [D 20:42:39.720809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11314. [D 20:42:39.720824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11315. [D 20:42:39.720839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 11316. [D 20:42:39.720854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 11317. [D 20:42:39.720869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 11318. [D 20:42:39.720919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 11319. [D 20:42:39.720935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 11320. [D 20:42:39.720950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11321. [D 20:42:39.720965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11322. [D 20:42:39.720980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11323. [D 20:42:39.720995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 11324. [D 20:42:39.721009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 11325. [D 20:42:39.721024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 11326. [D 20:42:39.721038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 11327. [D 20:42:39.721057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 11328. [D 20:42:39.721072] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11329. [D 20:42:39.726426] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11329. [D 20:42:39.726445] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 42/70. [D 20:42:39.726549] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.726600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.726613] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.774491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.774512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.774525] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.774562] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3476 [D 20:42:39.774577] element 0: offset: 0x2aaaab031040, size: 24 [D 20:42:39.774597] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 43/70. [D 20:42:39.778169] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3476 [D 20:42:39.778198] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 44/70. [D 20:42:39.782959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11329. [D 20:42:39.782983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11330. [D 20:42:39.783001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11331. [D 20:42:39.783017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11332. [D 20:42:39.783031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11333. [D 20:42:39.783046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11334. [D 20:42:39.783061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11335. [D 20:42:39.783498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11336. [D 20:42:39.783522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11337. [D 20:42:39.783550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11338. [D 20:42:39.783574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11339. [D 20:42:39.783589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11340. [D 20:42:39.783741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11341. [D 20:42:39.783762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11342. [D 20:42:39.783777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11343. [D 20:42:39.783791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11344. [D 20:42:39.783806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11345. [D 20:42:39.783837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11346. [D 20:42:39.783853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11347. [D 20:42:39.783867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11348. [D 20:42:39.783887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11349. [D 20:42:39.783902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11350. [D 20:42:39.783929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11351. [D 20:42:39.783946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11352. [D 20:42:39.783960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11353. [D 20:42:39.783976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11354. [D 20:42:39.784003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11355. [D 20:42:39.784022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11356. [D 20:42:39.784037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11357. [D 20:42:39.784056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11358. [D 20:42:39.784070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11359. [D 20:42:39.784085] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11360. [D 20:42:39.784304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.784365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.784380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:39.784424] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3478 [D 20:42:39.784439] element 0: offset: 0x2aaaab031220, size: 24 [D 20:42:39.784459] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 45/70. [D 20:42:39.794681] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11360. [D 20:42:39.794709] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 46/70. [D 20:42:39.794852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.794874] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.794887] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:39.798454] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3478 [D 20:42:39.798483] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 47/70. [D 20:42:39.799828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11360. [D 20:42:39.799849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11361. [D 20:42:39.799867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11362. [D 20:42:39.799882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11363. [D 20:42:39.799897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11364. [D 20:42:39.799912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11365. [D 20:42:39.799927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11366. [D 20:42:39.799941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11367. [D 20:42:39.799957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11368. [D 20:42:39.799978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11369. [D 20:42:39.799992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11370. [D 20:42:39.800007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11371. [D 20:42:39.800026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11372. [D 20:42:39.800041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11373. [D 20:42:39.800056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11374. [D 20:42:39.800071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11375. [D 20:42:39.800086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11376. [D 20:42:39.800101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11377. [D 20:42:39.800116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11378. [D 20:42:39.800160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11379. [D 20:42:39.800175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11380. [D 20:42:39.800198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11381. [D 20:42:39.800214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11382. [D 20:42:39.800228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11383. [D 20:42:39.800243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11384. [D 20:42:39.800258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11385. [D 20:42:39.800273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11386. [D 20:42:39.800288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11387. [D 20:42:39.800303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11388. [D 20:42:39.800318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11389. [D 20:42:39.800336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11390. [D 20:42:39.800351] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11391. [D 20:42:39.800518] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.800576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.800590] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:39.800634] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3482 [D 20:42:39.800649] element 0: offset: 0x2aaaab0279d0, size: 24 [D 20:42:39.800669] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 48/70. [D 20:42:39.805761] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11391. [D 20:42:39.805789] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 49/70. [D 20:42:39.805931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.805953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.805966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:39.809625] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3482 [D 20:42:39.809654] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 50/70. [D 20:42:39.809791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11391. [D 20:42:39.809808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11392. [D 20:42:39.809824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11393. [D 20:42:39.809840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11394. [D 20:42:39.809855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11395. [D 20:42:39.809870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11396. [D 20:42:39.809889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11397. [D 20:42:39.809904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11398. [D 20:42:39.809919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11399. [D 20:42:39.809940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11400. [D 20:42:39.809955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11401. [D 20:42:39.809970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11402. [D 20:42:39.809989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11403. [D 20:42:39.810004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11404. [D 20:42:39.810019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11405. [D 20:42:39.810033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11406. [D 20:42:39.810048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11407. [D 20:42:39.810080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11408. [D 20:42:39.810101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11409. [D 20:42:39.810135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11410. [D 20:42:39.810156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11411. [D 20:42:39.810171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11412. [D 20:42:39.810186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11413. [D 20:42:39.810201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11414. [D 20:42:39.810216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11415. [D 20:42:39.810231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11416. [D 20:42:39.810246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11417. [D 20:42:39.810261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11418. [D 20:42:39.810275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11419. [D 20:42:39.810295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11420. [D 20:42:39.810309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11421. [D 20:42:39.810324] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11422. [D 20:42:39.818804] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11422. [D 20:42:39.818828] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 51/70. [D 20:42:39.818929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.818984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.818998] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.824120] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.824140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.824153] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.824193] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3485 [D 20:42:39.824208] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:39.824231] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 52/70. [D 20:42:39.827718] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3485 [D 20:42:39.827745] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 53/70. [D 20:42:39.827797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11422. [D 20:42:39.827815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11423. [D 20:42:39.827831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11424. [D 20:42:39.827849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11425. [D 20:42:39.827864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11426. [D 20:42:39.827879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11427. [D 20:42:39.827898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11428. [D 20:42:39.827913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11429. [D 20:42:39.827928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11430. [D 20:42:39.827942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11431. [D 20:42:39.827957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11432. [D 20:42:39.827972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11433. [D 20:42:39.827994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11434. [D 20:42:39.828028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11435. [D 20:42:39.828047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11436. [D 20:42:39.828082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11437. [D 20:42:39.828097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11438. [D 20:42:39.828111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11439. [D 20:42:39.828126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11440. [D 20:42:39.828141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11441. [D 20:42:39.828156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11442. [D 20:42:39.828170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11443. [D 20:42:39.828185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11444. [D 20:42:39.828199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11445. [D 20:42:39.828214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11446. [D 20:42:39.828229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11447. [D 20:42:39.828245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11448. [D 20:42:39.828283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11449. [D 20:42:39.828304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11450. [D 20:42:39.828327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11451. [D 20:42:39.828342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11452. [D 20:42:39.828358] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11453. [D 20:42:39.836039] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11453. [D 20:42:39.836064] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 54/70. [D 20:42:39.836203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.836264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.836278] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.844947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.844970] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.844983] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.845022] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3488 [D 20:42:39.845037] element 0: offset: 0x2aaaab017310, size: 24 [D 20:42:39.845057] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 55/70. [D 20:42:39.848694] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3488 [D 20:42:39.848730] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 56/70. [D 20:42:39.848784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11453. [D 20:42:39.848801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11454. [D 20:42:39.848816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11455. [D 20:42:39.848831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11456. [D 20:42:39.848846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11457. [D 20:42:39.848861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11458. [D 20:42:39.848876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11459. [D 20:42:39.848894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11460. [D 20:42:39.848909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11461. [D 20:42:39.848924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11462. [D 20:42:39.848939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11463. [D 20:42:39.848956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11464. [D 20:42:39.848971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11465. [D 20:42:39.848986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11466. [D 20:42:39.849001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11467. [D 20:42:39.849038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11468. [D 20:42:39.849053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11469. [D 20:42:39.849073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11470. [D 20:42:39.849088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11471. [D 20:42:39.849103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11472. [D 20:42:39.849117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11473. [D 20:42:39.849132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11474. [D 20:42:39.849147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11475. [D 20:42:39.849161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11476. [D 20:42:39.849181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11477. [D 20:42:39.849199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11478. [D 20:42:39.849214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11479. [D 20:42:39.849230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11480. [D 20:42:39.849271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11481. [D 20:42:39.849287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11482. [D 20:42:39.849309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11483. [D 20:42:39.849325] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11484. [D 20:42:39.859464] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11484. [D 20:42:39.859484] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 57/70. [D 20:42:39.859632] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.859686] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.859700] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.866482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.866503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.866516] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.866554] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3490 [D 20:42:39.866569] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:39.866589] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 58/70. [D 20:42:39.870235] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3490 [D 20:42:39.870264] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 59/70. [D 20:42:39.871902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11484. [D 20:42:39.871926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11485. [D 20:42:39.871948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11486. [D 20:42:39.871967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11487. [D 20:42:39.871985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11488. [D 20:42:39.872003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11489. [D 20:42:39.872022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11490. [D 20:42:39.872038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11491. [D 20:42:39.872053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11492. [D 20:42:39.872071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11493. [D 20:42:39.872090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11494. [D 20:42:39.872108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11495. [D 20:42:39.872126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11496. [D 20:42:39.872144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11497. [D 20:42:39.872162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11498. [D 20:42:39.872180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11499. [D 20:42:39.872199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11500. [D 20:42:39.872217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11501. [D 20:42:39.872235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11502. [D 20:42:39.872254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11503. [D 20:42:39.872272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11504. [D 20:42:39.872290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11505. [D 20:42:39.872308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11506. [D 20:42:39.872326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11507. [D 20:42:39.872345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11508. [D 20:42:39.872363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11509. [D 20:42:39.872381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11510. [D 20:42:39.872399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11511. [D 20:42:39.872417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11512. [D 20:42:39.872435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11513. [D 20:42:39.872454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11514. [D 20:42:39.872469] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11515. [D 20:42:39.872535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.872600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.872615] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:39.872660] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3494 [D 20:42:39.872675] element 0: offset: 0x2aaaab027b70, size: 24 [D 20:42:39.872696] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 60/70. [D 20:42:39.878050] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11515. [D 20:42:39.878076] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 0/70. [D 20:42:39.878220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.878241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.878254] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:39.881829] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3494 [D 20:42:39.881859] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 1/70. [D 20:42:39.881991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11515. [D 20:42:39.882009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11516. [D 20:42:39.882024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11517. [D 20:42:39.882040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11518. [D 20:42:39.882064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11519. [D 20:42:39.882080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11520. [D 20:42:39.882094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11521. [D 20:42:39.882113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11522. [D 20:42:39.882128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11523. [D 20:42:39.882143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11524. [D 20:42:39.882158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11525. [D 20:42:39.882172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11526. [D 20:42:39.882187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11527. [D 20:42:39.882202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11528. [D 20:42:39.882216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11529. [D 20:42:39.882231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11530. [D 20:42:39.882266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11531. [D 20:42:39.882280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11532. [D 20:42:39.882300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11533. [D 20:42:39.882314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11534. [D 20:42:39.882329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11535. [D 20:42:39.882344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11536. [D 20:42:39.882358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11537. [D 20:42:39.882373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11538. [D 20:42:39.882387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11539. [D 20:42:39.882406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11540. [D 20:42:39.882423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11541. [D 20:42:39.882437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11542. [D 20:42:39.882458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11543. [D 20:42:39.882499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11544. [D 20:42:39.882515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11545. [D 20:42:39.882537] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11546. [D 20:42:39.889616] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 11546. [D 20:42:39.889637] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 2/70. [D 20:42:39.889741] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.889792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.889805] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.894945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.894966] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.894979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.895020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3497 [D 20:42:39.895035] element 0: offset: 0x5b0030, size: 24 [D 20:42:39.895055] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 3/70. [D 20:42:39.898720] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3497 [D 20:42:39.898756] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 4/70. [D 20:42:39.898810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11546. [D 20:42:39.898827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11547. [D 20:42:39.898842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11548. [D 20:42:39.898857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11549. [D 20:42:39.898872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11550. [D 20:42:39.898887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11551. [D 20:42:39.898902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11552. [D 20:42:39.898921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11553. [D 20:42:39.898936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11554. [D 20:42:39.898951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11555. [D 20:42:39.898966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11556. [D 20:42:39.898983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11557. [D 20:42:39.899000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11558. [D 20:42:39.899014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11559. [D 20:42:39.899030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11560. [D 20:42:39.899067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11561. [D 20:42:39.899082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11562. [D 20:42:39.899102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11563. [D 20:42:39.899117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11564. [D 20:42:39.899132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11565. [D 20:42:39.899147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11566. [D 20:42:39.899162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11567. [D 20:42:39.899177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11568. [D 20:42:39.899192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11569. [D 20:42:39.899210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11570. [D 20:42:39.899227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11571. [D 20:42:39.899242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11572. [D 20:42:39.899257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11573. [D 20:42:39.899300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11574. [D 20:42:39.899316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11575. [D 20:42:39.899338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11576. [D 20:42:39.899354] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11577. [D 20:42:39.907326] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 11577. [D 20:42:39.907350] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 5/70. [D 20:42:39.907492] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.907543] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.907557] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.916122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.916143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.916156] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.916195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3500 [D 20:42:39.916210] element 0: offset: 0x691fe0, size: 24 [D 20:42:39.916230] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 6/70. [D 20:42:39.919747] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3500 [D 20:42:39.919773] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 7/70. [D 20:42:39.919826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11577. [D 20:42:39.919843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11578. [D 20:42:39.919858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11579. [D 20:42:39.919879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11580. [D 20:42:39.919894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11581. [D 20:42:39.919909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11582. [D 20:42:39.919924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11583. [D 20:42:39.919942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11584. [D 20:42:39.919957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11585. [D 20:42:39.919972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11586. [D 20:42:39.919987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11587. [D 20:42:39.920002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11588. [D 20:42:39.920017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11589. [D 20:42:39.920034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11590. [D 20:42:39.920050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11591. [D 20:42:39.920065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11592. [D 20:42:39.920080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11593. [D 20:42:39.920115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11594. [D 20:42:39.920131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11595. [D 20:42:39.920170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11596. [D 20:42:39.920185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11597. [D 20:42:39.920199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11598. [D 20:42:39.920214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11599. [D 20:42:39.920228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11600. [D 20:42:39.920243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11601. [D 20:42:39.920258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11602. [D 20:42:39.920272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11603. [D 20:42:39.920287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11604. [D 20:42:39.920301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11605. [D 20:42:39.920316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11606. [D 20:42:39.920332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11607. [D 20:42:39.920347] openib_post_sr_rdmaw: ibv_post_send wr_id 61e600 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11608. [D 20:42:39.929216] openib_check_cq: completed rdma wr_id 61e600, nic_wr_credit 11608. [D 20:42:39.929239] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 8/70. [D 20:42:39.929379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.929431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.929445] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:39.937284] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.937308] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.937321] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:39.937358] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3503 [D 20:42:39.937373] element 0: offset: 0x691fe0, size: 24 [D 20:42:39.937392] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 9/70. [D 20:42:39.941049] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3503 [D 20:42:39.941078] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 10/70. [D 20:42:39.942981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11608. [D 20:42:39.943000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 11609. [D 20:42:39.943015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 11610. [D 20:42:39.943030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 11611. [D 20:42:39.943044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 11612. [D 20:42:39.943059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 11613. [D 20:42:39.943073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11614. [D 20:42:39.943088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11615. [D 20:42:39.943102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11616. [D 20:42:39.943116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 11617. [D 20:42:39.943131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 11618. [D 20:42:39.943145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 11619. [D 20:42:39.943160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 11620. [D 20:42:39.943175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 11621. [D 20:42:39.943189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11622. [D 20:42:39.943204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11623. [D 20:42:39.943218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11624. [D 20:42:39.943233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 11625. [D 20:42:39.943247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 11626. [D 20:42:39.943262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 11627. [D 20:42:39.943276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 11628. [D 20:42:39.943291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 11629. [D 20:42:39.943306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11630. [D 20:42:39.943320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11631. [D 20:42:39.943335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11632. [D 20:42:39.943349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 11633. [D 20:42:39.943364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 11634. [D 20:42:39.943378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 11635. [D 20:42:39.943393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 11636. [D 20:42:39.943408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 11637. [D 20:42:39.943423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11638. [D 20:42:39.943438] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11639. [D 20:42:39.943627] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:39.943705] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.943720] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:39.943764] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3505 [D 20:42:39.943779] element 0: offset: 0x67edf0, size: 24 [D 20:42:39.943797] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 11/70. [D 20:42:39.954737] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 11639. [D 20:42:39.954763] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 12/70. [D 20:42:39.954884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.954906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.954919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:39.958551] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3505 [D 20:42:39.958579] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 13/70. [D 20:42:39.960492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11639. [D 20:42:39.960512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11640. [D 20:42:39.960526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11641. [D 20:42:39.960541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11642. [D 20:42:39.960556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11643. [D 20:42:39.960570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11644. [D 20:42:39.960585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11645. [D 20:42:39.960599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11646. [D 20:42:39.960614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11647. [D 20:42:39.960628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11648. [D 20:42:39.960643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11649. [D 20:42:39.960657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11650. [D 20:42:39.960672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11651. [D 20:42:39.960687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11652. [D 20:42:39.960701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11653. [D 20:42:39.960716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11654. [D 20:42:39.960730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11655. [D 20:42:39.960745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11656. [D 20:42:39.960759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11657. [D 20:42:39.960774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11658. [D 20:42:39.960788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11659. [D 20:42:39.960813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11660. [D 20:42:39.960835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11661. [D 20:42:39.960851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11662. [D 20:42:39.960865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11663. [D 20:42:39.960880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11664. [D 20:42:39.960894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11665. [D 20:42:39.960909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11666. [D 20:42:39.960923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11667. [D 20:42:39.960938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11668. [D 20:42:39.960953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11669. [D 20:42:39.960968] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11670. [D 20:42:39.966596] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 11670. [D 20:42:39.966620] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 14/70. [D 20:42:39.966717] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:39.966765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:39.966778] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.001309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.001330] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.001343] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.001383] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3508 [D 20:42:40.001399] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.001418] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 15/70. [D 20:42:40.004897] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3508 [D 20:42:40.004928] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 16/70. [D 20:42:40.004989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 11670. [D 20:42:40.005008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 11671. [D 20:42:40.005162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 11672. [D 20:42:40.005182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 11673. [D 20:42:40.005336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 11674. [D 20:42:40.005434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 11675. [D 20:42:40.005488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 11676. [D 20:42:40.005598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11677. [D 20:42:40.005699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11678. [D 20:42:40.005818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11679. [D 20:42:40.005928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 11680. [D 20:42:40.006028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 11681. [D 20:42:40.006136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 11682. [D 20:42:40.006237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 11683. [D 20:42:40.006341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 11684. [D 20:42:40.006449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11685. [D 20:42:40.006549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11686. [D 20:42:40.006657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11687. [D 20:42:40.006778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 11688. [D 20:42:40.006885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 11689. [D 20:42:40.006987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 11690. [D 20:42:40.007094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 11691. [D 20:42:40.007196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 11692. [D 20:42:40.007304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11693. [D 20:42:40.007410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11694. [D 20:42:40.007510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11695. [D 20:42:40.007616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 11696. [D 20:42:40.007730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 11697. [D 20:42:40.007747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 11698. [D 20:42:40.007773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 11699. [D 20:42:40.007789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 11700. [D 20:42:40.007981] openib_post_sr_rdmaw: ibv_post_send wr_id 62fd30 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11701. [D 20:42:40.010922] openib_check_cq: completed rdma wr_id 62fd30, nic_wr_credit 11701. [D 20:42:40.010946] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 17/70. [D 20:42:40.011040] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.011095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.011109] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.062271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.062290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.062303] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.062341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3511 [D 20:42:40.062357] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.062375] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 18/70. [D 20:42:40.065883] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3511 [D 20:42:40.065912] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 19/70. [D 20:42:40.065976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11701. [D 20:42:40.066005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11702. [D 20:42:40.066022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 11703. [D 20:42:40.066189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 11704. [D 20:42:40.066207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 11705. [D 20:42:40.066353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 11706. [D 20:42:40.066457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 11707. [D 20:42:40.066560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11708. [D 20:42:40.066662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11709. [D 20:42:40.066767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11710. [D 20:42:40.066873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 11711. [D 20:42:40.066991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 11712. [D 20:42:40.067101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 11713. [D 20:42:40.067202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 11714. [D 20:42:40.067309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 11715. [D 20:42:40.067410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11716. [D 20:42:40.067516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11717. [D 20:42:40.067624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11718. [D 20:42:40.067729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 11719. [D 20:42:40.067850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 11720. [D 20:42:40.067960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 11721. [D 20:42:40.068061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 11722. [D 20:42:40.068167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 11723. [D 20:42:40.068282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11724. [D 20:42:40.068391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11725. [D 20:42:40.068493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11726. [D 20:42:40.068597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 11727. [D 20:42:40.068704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 11728. [D 20:42:40.068805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 11729. [D 20:42:40.068914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 11730. [D 20:42:40.069015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 11731. [D 20:42:40.069136] openib_post_sr_rdmaw: ibv_post_send wr_id 66e460 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11732. [D 20:42:40.071866] openib_check_cq: completed rdma wr_id 66e460, nic_wr_credit 11732. [D 20:42:40.071889] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 20/70. [D 20:42:40.072129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.072186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.072201] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.090780] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.090800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.090813] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.090852] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3514 [D 20:42:40.090867] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.090886] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 21/70. [D 20:42:40.094242] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3514 [D 20:42:40.094273] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 22/70. [D 20:42:40.094334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 11732. [D 20:42:40.094356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 11733. [D 20:42:40.094372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 11734. [D 20:42:40.094401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 11735. [D 20:42:40.094420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 11736. [D 20:42:40.094438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 11737. [D 20:42:40.094463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 11738. [D 20:42:40.094481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 11739. [D 20:42:40.094500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 11740. [D 20:42:40.094518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 11741. [D 20:42:40.094536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 11742. [D 20:42:40.094555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 11743. [D 20:42:40.094573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 11744. [D 20:42:40.094592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 11745. [D 20:42:40.094610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 11746. [D 20:42:40.094628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 11747. [D 20:42:40.094645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 11748. [D 20:42:40.094660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 11749. [D 20:42:40.094679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 11750. [D 20:42:40.094698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 11751. [D 20:42:40.094716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 11752. [D 20:42:40.094734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 11753. [D 20:42:40.094753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 11754. [D 20:42:40.094771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 11755. [D 20:42:40.094790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 11756. [D 20:42:40.094808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 11757. [D 20:42:40.094827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 11758. [D 20:42:40.094846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 11759. [D 20:42:40.094864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 11760. [D 20:42:40.094879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 11761. [D 20:42:40.094894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 11762. [D 20:42:40.094909] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 11763. [D 20:42:40.097655] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.097712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.097726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:40.097768] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3518 [D 20:42:40.097783] element 0: offset: 0x61e400, size: 24 [D 20:42:40.097804] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 23/70. [D 20:42:40.100252] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11763. [D 20:42:40.100280] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 24/70. [D 20:42:40.100430] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.100452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.100465] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:40.103715] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3518 [D 20:42:40.103737] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 25/70. [D 20:42:40.103823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 11763. [D 20:42:40.103843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 11764. [D 20:42:40.103863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 11765. [D 20:42:40.103878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 11766. [D 20:42:40.103893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 11767. [D 20:42:40.103908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 11768. [D 20:42:40.103922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 11769. [D 20:42:40.103937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 11770. [D 20:42:40.103951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 11771. [D 20:42:40.103966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 11772. [D 20:42:40.103981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 11773. [D 20:42:40.103995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 11774. [D 20:42:40.104010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 11775. [D 20:42:40.104026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 11776. [D 20:42:40.104040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 11777. [D 20:42:40.104055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 11778. [D 20:42:40.104071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 11779. [D 20:42:40.104085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 11780. [D 20:42:40.104100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 11781. [D 20:42:40.104118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 11782. [D 20:42:40.104133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 11783. [D 20:42:40.104147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 11784. [D 20:42:40.104166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 11785. [D 20:42:40.104181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 11786. [D 20:42:40.104195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 11787. [D 20:42:40.104214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 11788. [D 20:42:40.104228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 11789. [D 20:42:40.104243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 11790. [D 20:42:40.104261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 11791. [D 20:42:40.104275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 11792. [D 20:42:40.104291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 11793. [D 20:42:40.104307] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 11794. [D 20:42:40.109702] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11794. [D 20:42:40.109722] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 26/70. [D 20:42:40.109812] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.109867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.109880] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.140366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.140389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.140402] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.140442] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3520 [D 20:42:40.140457] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.140476] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 27/70. [D 20:42:40.143987] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3520 [D 20:42:40.144019] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 28/70. [D 20:42:40.144070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 11794. [D 20:42:40.144089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 11795. [D 20:42:40.144103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 11796. [D 20:42:40.144118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 11797. [D 20:42:40.144132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 11798. [D 20:42:40.144147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 11799. [D 20:42:40.144181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 11800. [D 20:42:40.144195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11801. [D 20:42:40.144210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11802. [D 20:42:40.144224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11803. [D 20:42:40.144239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 11804. [D 20:42:40.144253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 11805. [D 20:42:40.144268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 11806. [D 20:42:40.144282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 11807. [D 20:42:40.144297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 11808. [D 20:42:40.144311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11809. [D 20:42:40.144326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11810. [D 20:42:40.144340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11811. [D 20:42:40.144355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 11812. [D 20:42:40.144369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 11813. [D 20:42:40.144384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 11814. [D 20:42:40.144398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 11815. [D 20:42:40.144412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 11816. [D 20:42:40.144427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11817. [D 20:42:40.144441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11818. [D 20:42:40.144456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11819. [D 20:42:40.144470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 11820. [D 20:42:40.144485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 11821. [D 20:42:40.144499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 11822. [D 20:42:40.144513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 11823. [D 20:42:40.144529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 11824. [D 20:42:40.144544] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11825. [D 20:42:40.149997] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 11825. [D 20:42:40.150019] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 29/70. [D 20:42:40.150107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.150166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.150179] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.227210] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.227230] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.227243] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.227281] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3523 [D 20:42:40.227296] element 0: offset: 0x657130, size: 24 [D 20:42:40.227315] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 30/70. [D 20:42:40.230694] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3523 [D 20:42:40.230726] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 31/70. [D 20:42:40.230793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 11825. [D 20:42:40.230816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 11826. [D 20:42:40.230832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 11827. [D 20:42:40.230862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 11828. [D 20:42:40.230881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 11829. [D 20:42:40.230900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 11830. [D 20:42:40.230925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 11831. [D 20:42:40.230943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11832. [D 20:42:40.230961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11833. [D 20:42:40.230979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11834. [D 20:42:40.230997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 11835. [D 20:42:40.231016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 11836. [D 20:42:40.231034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 11837. [D 20:42:40.231052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 11838. [D 20:42:40.231071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 11839. [D 20:42:40.231086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11840. [D 20:42:40.231101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11841. [D 20:42:40.231119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11842. [D 20:42:40.231138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 11843. [D 20:42:40.231156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 11844. [D 20:42:40.231174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 11845. [D 20:42:40.231192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 11846. [D 20:42:40.231211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 11847. [D 20:42:40.231229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11848. [D 20:42:40.231247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11849. [D 20:42:40.231266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11850. [D 20:42:40.231284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 11851. [D 20:42:40.231303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 11852. [D 20:42:40.231322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 11853. [D 20:42:40.231337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 11854. [D 20:42:40.231351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 11855. [D 20:42:40.231366] openib_post_sr_rdmaw: ibv_post_send wr_id 66e6b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11856. [D 20:42:40.236747] openib_check_cq: completed rdma wr_id 66e6b0, nic_wr_credit 11856. [D 20:42:40.236771] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 32/70. [D 20:42:40.236862] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.236915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.236929] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.286203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.286223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.286236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.286273] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3526 [D 20:42:40.286288] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.286309] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 33/70. [D 20:42:40.290026] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3526 [D 20:42:40.290061] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 34/70. [D 20:42:40.290112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 11856. [D 20:42:40.290142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 11857. [D 20:42:40.290158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 11858. [D 20:42:40.290180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 11859. [D 20:42:40.290196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 11860. [D 20:42:40.290211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 11861. [D 20:42:40.290230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 11862. [D 20:42:40.290245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11863. [D 20:42:40.290260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11864. [D 20:42:40.290274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11865. [D 20:42:40.290291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 11866. [D 20:42:40.290307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 11867. [D 20:42:40.290322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 11868. [D 20:42:40.290343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 11869. [D 20:42:40.290378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 11870. [D 20:42:40.290393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11871. [D 20:42:40.290413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11872. [D 20:42:40.290428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11873. [D 20:42:40.290443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 11874. [D 20:42:40.290458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 11875. [D 20:42:40.290485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 11876. [D 20:42:40.290500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 11877. [D 20:42:40.290515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 11878. [D 20:42:40.290529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11879. [D 20:42:40.290545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11880. [D 20:42:40.290559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11881. [D 20:42:40.290575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 11882. [D 20:42:40.290615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 11883. [D 20:42:40.290637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 11884. [D 20:42:40.290652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 11885. [D 20:42:40.290667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 11886. [D 20:42:40.290682] openib_post_sr_rdmaw: ibv_post_send wr_id 61e640 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11887. [D 20:42:40.296000] openib_check_cq: completed rdma wr_id 61e640, nic_wr_credit 11887. [D 20:42:40.296022] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 35/70. [D 20:42:40.296123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.296174] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.296188] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.329193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.329215] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.329228] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.329265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3529 [D 20:42:40.329280] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.329300] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 36/70. [D 20:42:40.332928] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3529 [D 20:42:40.332963] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 37/70. [D 20:42:40.333016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11887. [D 20:42:40.333032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11888. [D 20:42:40.333047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 11889. [D 20:42:40.333063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 11890. [D 20:42:40.333078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 11891. [D 20:42:40.333092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 11892. [D 20:42:40.333107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 11893. [D 20:42:40.333137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11894. [D 20:42:40.333153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11895. [D 20:42:40.333168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11896. [D 20:42:40.333183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 11897. [D 20:42:40.333198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 11898. [D 20:42:40.333216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 11899. [D 20:42:40.333238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 11900. [D 20:42:40.333272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 11901. [D 20:42:40.333287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11902. [D 20:42:40.333308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11903. [D 20:42:40.333323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11904. [D 20:42:40.333338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 11905. [D 20:42:40.333353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 11906. [D 20:42:40.333368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 11907. [D 20:42:40.333383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 11908. [D 20:42:40.333402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 11909. [D 20:42:40.333419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11910. [D 20:42:40.333434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11911. [D 20:42:40.333456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11912. [D 20:42:40.333494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 11913. [D 20:42:40.333510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 11914. [D 20:42:40.333544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 11915. [D 20:42:40.333559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 11916. [D 20:42:40.333574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 11917. [D 20:42:40.333589] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11918. [D 20:42:40.338900] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 11918. [D 20:42:40.338920] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 38/70. [D 20:42:40.339023] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.339074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.339088] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.373136] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.373157] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.373170] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.373208] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3533 [D 20:42:40.373223] element 0: offset: 0x657130, size: 24 [D 20:42:40.373242] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 39/70. [D 20:42:40.376485] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.376548] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.376562] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:40.376602] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3535 [D 20:42:40.376617] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.376636] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 40/70. [D 20:42:40.380552] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3533 [D 20:42:40.380580] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 41/70. [D 20:42:40.380604] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3535 [D 20:42:40.380624] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 42/70. [D 20:42:40.380654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11918. [D 20:42:40.380670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 11919. [D 20:42:40.380692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 11920. [D 20:42:40.380709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 11921. [D 20:42:40.380724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 11922. [D 20:42:40.380739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 11923. [D 20:42:40.380754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11924. [D 20:42:40.380768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11925. [D 20:42:40.380783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11926. [D 20:42:40.380799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 11927. [D 20:42:40.380814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 11928. [D 20:42:40.380830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 11929. [D 20:42:40.380861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 11930. [D 20:42:40.380876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 11931. [D 20:42:40.380900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11932. [D 20:42:40.380915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11933. [D 20:42:40.380930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11934. [D 20:42:40.380945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11935. [D 20:42:40.380975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11936. [D 20:42:40.380990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11937. [D 20:42:40.381005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11938. [D 20:42:40.381020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11939. [D 20:42:40.381034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11940. [D 20:42:40.381049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11941. [D 20:42:40.381065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11942. [D 20:42:40.381079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11943. [D 20:42:40.381095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11944. [D 20:42:40.381129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11945. [D 20:42:40.381147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11946. [D 20:42:40.381167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11947. [D 20:42:40.381182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11948. [D 20:42:40.381197] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11949. [D 20:42:40.381216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 11950. [D 20:42:40.381234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 11951. [D 20:42:40.381249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 11952. [D 20:42:40.381264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 11953. [D 20:42:40.381279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 11954. [D 20:42:40.381294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 11955. [D 20:42:40.381309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 11956. [D 20:42:40.381328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 11957. [D 20:42:40.381342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 11958. [D 20:42:40.381358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 11959. [D 20:42:40.381372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 11960. [D 20:42:40.381387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 11961. [D 20:42:40.381402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 11962. [D 20:42:40.381417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 11963. [D 20:42:40.381436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 11964. [D 20:42:40.381451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 11965. [D 20:42:40.381465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 11966. [D 20:42:40.381480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 11967. [D 20:42:40.381504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 11968. [D 20:42:40.381519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 11969. [D 20:42:40.381533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 11970. [D 20:42:40.381548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 11971. [D 20:42:40.381563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 11972. [D 20:42:40.381593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 11973. [D 20:42:40.381608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 11974. [D 20:42:40.381624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 11975. [D 20:42:40.381647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 11976. [D 20:42:40.381732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 11977. [D 20:42:40.381746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 11978. [D 20:42:40.381762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 11979. [D 20:42:40.381777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 11980. [D 20:42:40.381804] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 11981. [D 20:42:40.386529] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 11981. [D 20:42:40.386550] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 43/70. [D 20:42:40.392426] openib_check_cq: completed rdma wr_id 61f8e0, nic_wr_credit 11980. [D 20:42:40.392448] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 44/70. [D 20:42:40.392547] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.392601] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.392615] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:40.392641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.392654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.392667] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.419701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.419721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.419734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.419772] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3538 [D 20:42:40.419787] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.419807] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 45/70. [D 20:42:40.423357] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3538 [D 20:42:40.423389] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 46/70. [D 20:42:40.423452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11980. [D 20:42:40.423469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11981. [D 20:42:40.423484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 11982. [D 20:42:40.423500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 11983. [D 20:42:40.423514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 11984. [D 20:42:40.423529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 11985. [D 20:42:40.423545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 11986. [D 20:42:40.423563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11987. [D 20:42:40.423578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11988. [D 20:42:40.423593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11989. [D 20:42:40.423612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 11990. [D 20:42:40.423640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 11991. [D 20:42:40.423658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 11992. [D 20:42:40.423676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 11993. [D 20:42:40.423694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 11994. [D 20:42:40.423709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11995. [D 20:42:40.423724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11996. [D 20:42:40.423760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11997. [D 20:42:40.423779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 11998. [D 20:42:40.423800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 11999. [D 20:42:40.423815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12000. [D 20:42:40.423830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12001. [D 20:42:40.423845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12002. [D 20:42:40.423861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12003. [D 20:42:40.423889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12004. [D 20:42:40.423904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12005. [D 20:42:40.423918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12006. [D 20:42:40.423933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12007. [D 20:42:40.423948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12008. [D 20:42:40.423962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12009. [D 20:42:40.423977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12010. [D 20:42:40.423992] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12011. [D 20:42:40.429382] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12011. [D 20:42:40.429403] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 47/70. [D 20:42:40.429507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.429566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.429580] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.473620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.473642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.473655] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.473694] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3541 [D 20:42:40.473709] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.473729] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 48/70. [D 20:42:40.477334] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3541 [D 20:42:40.477370] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 49/70. [D 20:42:40.477422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12011. [D 20:42:40.477439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12012. [D 20:42:40.477454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12013. [D 20:42:40.477469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12014. [D 20:42:40.477484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12015. [D 20:42:40.477499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12016. [D 20:42:40.477513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12017. [D 20:42:40.477544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12018. [D 20:42:40.477559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12019. [D 20:42:40.477574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12020. [D 20:42:40.477589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12021. [D 20:42:40.477604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12022. [D 20:42:40.477619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12023. [D 20:42:40.477634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12024. [D 20:42:40.477650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12025. [D 20:42:40.477681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12026. [D 20:42:40.477696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12027. [D 20:42:40.477717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12028. [D 20:42:40.477732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12029. [D 20:42:40.477746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12030. [D 20:42:40.477761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12031. [D 20:42:40.477776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12032. [D 20:42:40.477790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12033. [D 20:42:40.477805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12034. [D 20:42:40.477823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12035. [D 20:42:40.477840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12036. [D 20:42:40.477854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12037. [D 20:42:40.477870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12038. [D 20:42:40.477912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12039. [D 20:42:40.477927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12040. [D 20:42:40.477952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12041. [D 20:42:40.477967] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12042. [D 20:42:40.483345] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 12042. [D 20:42:40.483365] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 50/70. [D 20:42:40.483467] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.483517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.483531] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.542954] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.542976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.542989] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.543026] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3544 [D 20:42:40.543041] element 0: offset: 0x657130, size: 24 [D 20:42:40.543060] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 51/70. [D 20:42:40.546733] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3544 [D 20:42:40.546768] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 52/70. [D 20:42:40.546820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12042. [D 20:42:40.546836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12043. [D 20:42:40.546851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12044. [D 20:42:40.546867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12045. [D 20:42:40.546883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12046. [D 20:42:40.546898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12047. [D 20:42:40.546912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12048. [D 20:42:40.546927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12049. [D 20:42:40.546946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12050. [D 20:42:40.546961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12051. [D 20:42:40.546989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12052. [D 20:42:40.547005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12053. [D 20:42:40.547019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12054. [D 20:42:40.547034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12055. [D 20:42:40.547079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12056. [D 20:42:40.547093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12057. [D 20:42:40.547113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12058. [D 20:42:40.547129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12059. [D 20:42:40.547143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12060. [D 20:42:40.547158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12061. [D 20:42:40.547174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12062. [D 20:42:40.547189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12063. [D 20:42:40.547203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12064. [D 20:42:40.547231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12065. [D 20:42:40.547246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12066. [D 20:42:40.547261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12067. [D 20:42:40.547276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12068. [D 20:42:40.547327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12069. [D 20:42:40.547346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12070. [D 20:42:40.547361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12071. [D 20:42:40.547376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12072. [D 20:42:40.547391] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12073. [D 20:42:40.552739] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12073. [D 20:42:40.552759] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 53/70. [D 20:42:40.552860] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.552913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.552926] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.638018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.638040] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.638053] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.638090] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3547 [D 20:42:40.638105] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.638124] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 54/70. [D 20:42:40.641747] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3547 [D 20:42:40.641777] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 55/70. [D 20:42:40.641834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12073. [D 20:42:40.641851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12074. [D 20:42:40.641867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12075. [D 20:42:40.641884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12076. [D 20:42:40.641899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12077. [D 20:42:40.641914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12078. [D 20:42:40.641943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12079. [D 20:42:40.641958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12080. [D 20:42:40.641973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12081. [D 20:42:40.641992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12082. [D 20:42:40.642007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12083. [D 20:42:40.642022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12084. [D 20:42:40.642040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12085. [D 20:42:40.642056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12086. [D 20:42:40.642071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12087. [D 20:42:40.642087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12088. [D 20:42:40.642119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12089. [D 20:42:40.642138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12090. [D 20:42:40.642166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12091. [D 20:42:40.642182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12092. [D 20:42:40.642197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12093. [D 20:42:40.642211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12094. [D 20:42:40.642226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12095. [D 20:42:40.642241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12096. [D 20:42:40.642255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12097. [D 20:42:40.642274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12098. [D 20:42:40.642289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12099. [D 20:42:40.642303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12100. [D 20:42:40.642318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12101. [D 20:42:40.642332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12102. [D 20:42:40.642347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12103. [D 20:42:40.642362] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12104. [D 20:42:40.651377] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 12104. [D 20:42:40.651402] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 56/70. [D 20:42:40.651544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.651602] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.651616] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.684714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.684736] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.684749] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.684788] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3550 [D 20:42:40.684804] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.684825] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 57/70. [D 20:42:40.688383] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3550 [D 20:42:40.688410] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 58/70. [D 20:42:40.688469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12104. [D 20:42:40.688492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12105. [D 20:42:40.688507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12106. [D 20:42:40.688521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12107. [D 20:42:40.688536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12108. [D 20:42:40.688556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12109. [D 20:42:40.688571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12110. [D 20:42:40.688604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12111. [D 20:42:40.688621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12112. [D 20:42:40.688635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12113. [D 20:42:40.688650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12114. [D 20:42:40.688665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12115. [D 20:42:40.688679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12116. [D 20:42:40.688694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12117. [D 20:42:40.688708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12118. [D 20:42:40.688723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12119. [D 20:42:40.688738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12120. [D 20:42:40.688753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12121. [D 20:42:40.688784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12122. [D 20:42:40.688805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12123. [D 20:42:40.688830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12124. [D 20:42:40.688845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12125. [D 20:42:40.688859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12126. [D 20:42:40.688874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12127. [D 20:42:40.688888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12128. [D 20:42:40.688903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12129. [D 20:42:40.688918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12130. [D 20:42:40.688932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12131. [D 20:42:40.688947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12132. [D 20:42:40.688965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12133. [D 20:42:40.688980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12134. [D 20:42:40.688995] openib_post_sr_rdmaw: ibv_post_send wr_id 63c6d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12135. [D 20:42:40.694356] openib_check_cq: completed rdma wr_id 63c6d0, nic_wr_credit 12135. [D 20:42:40.694375] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 59/70. [D 20:42:40.694477] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.694528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.694542] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.747060] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.747082] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.747095] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.747134] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3553 [D 20:42:40.747149] element 0: offset: 0x657130, size: 24 [D 20:42:40.747168] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 60/70. [D 20:42:40.750735] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3553 [D 20:42:40.750771] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 0/70. [D 20:42:40.750830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12135. [D 20:42:40.750846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12136. [D 20:42:40.750861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12137. [D 20:42:40.750883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12138. [D 20:42:40.750898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12139. [D 20:42:40.750912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12140. [D 20:42:40.750927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12141. [D 20:42:40.750958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12142. [D 20:42:40.750973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12143. [D 20:42:40.750988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12144. [D 20:42:40.751003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12145. [D 20:42:40.751018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12146. [D 20:42:40.751033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12147. [D 20:42:40.751075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12148. [D 20:42:40.751090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12149. [D 20:42:40.751110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12150. [D 20:42:40.751125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12151. [D 20:42:40.751140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12152. [D 20:42:40.751155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12153. [D 20:42:40.751170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12154. [D 20:42:40.751185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12155. [D 20:42:40.751200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12156. [D 20:42:40.751215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12157. [D 20:42:40.751230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12158. [D 20:42:40.751245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12159. [D 20:42:40.751260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12160. [D 20:42:40.751311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12161. [D 20:42:40.751333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12162. [D 20:42:40.751348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12163. [D 20:42:40.751362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12164. [D 20:42:40.751394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12165. [D 20:42:40.751409] openib_post_sr_rdmaw: ibv_post_send wr_id 630250 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12166. [D 20:42:40.756790] openib_check_cq: completed rdma wr_id 630250, nic_wr_credit 12166. [D 20:42:40.756809] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 1/70. [D 20:42:40.756911] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.756963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.756977] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.777137] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.777158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.777171] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.777209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3557 [D 20:42:40.777224] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.777243] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 2/70. [D 20:42:40.780872] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3557 [D 20:42:40.780908] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 3/70. [D 20:42:40.780962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12166. [D 20:42:40.780979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12167. [D 20:42:40.780995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12168. [D 20:42:40.781019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12169. [D 20:42:40.781034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12170. [D 20:42:40.781049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12171. [D 20:42:40.781064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12172. [D 20:42:40.781083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12173. [D 20:42:40.781098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12174. [D 20:42:40.781113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12175. [D 20:42:40.781142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12176. [D 20:42:40.781158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12177. [D 20:42:40.781173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12178. [D 20:42:40.781215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12179. [D 20:42:40.781230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12180. [D 20:42:40.781252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12181. [D 20:42:40.781267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12182. [D 20:42:40.781282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12183. [D 20:42:40.781296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12184. [D 20:42:40.781311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12185. [D 20:42:40.781326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12186. [D 20:42:40.781345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12187. [D 20:42:40.781362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12188. [D 20:42:40.781377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12189. [D 20:42:40.781399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12190. [D 20:42:40.781435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12191. [D 20:42:40.781450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12192. [D 20:42:40.781474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12193. [D 20:42:40.781489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12194. [D 20:42:40.781504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12195. [D 20:42:40.781519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12196. [D 20:42:40.781534] openib_post_sr_rdmaw: ibv_post_send wr_id 636c30 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12197. [D 20:42:40.786303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.786360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.786375] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:40.786417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3559 [D 20:42:40.786432] element 0: offset: 0x657130, size: 24 [D 20:42:40.786453] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 4/70. [D 20:42:40.786926] openib_check_cq: completed rdma wr_id 636c30, nic_wr_credit 12197. [D 20:42:40.786962] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 5/70. [D 20:42:40.787085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.787107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.787120] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:40.790695] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3559 [D 20:42:40.790726] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 6/70. [D 20:42:40.790786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12197. [D 20:42:40.790802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12198. [D 20:42:40.790817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12199. [D 20:42:40.790832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12200. [D 20:42:40.790847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12201. [D 20:42:40.790862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12202. [D 20:42:40.790876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12203. [D 20:42:40.790895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12204. [D 20:42:40.790910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12205. [D 20:42:40.790925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12206. [D 20:42:40.790939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12207. [D 20:42:40.790969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12208. [D 20:42:40.790984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12209. [D 20:42:40.791000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12210. [D 20:42:40.791044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12211. [D 20:42:40.791058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12212. [D 20:42:40.791078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12213. [D 20:42:40.791092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12214. [D 20:42:40.791107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12215. [D 20:42:40.791122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12216. [D 20:42:40.791136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12217. [D 20:42:40.791151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12218. [D 20:42:40.791165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12219. [D 20:42:40.791180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12220. [D 20:42:40.791195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12221. [D 20:42:40.791210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12222. [D 20:42:40.791224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12223. [D 20:42:40.791239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12224. [D 20:42:40.791254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12225. [D 20:42:40.791294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12226. [D 20:42:40.791316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12227. [D 20:42:40.791331] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12228. [D 20:42:40.796661] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12228. [D 20:42:40.796683] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 7/70. [D 20:42:40.796788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.796842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.796856] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.848413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.848434] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.848447] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.848487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3563 [D 20:42:40.848503] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.848522] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 8/70. [D 20:42:40.851753] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3563 [D 20:42:40.851777] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 9/70. [D 20:42:40.851845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12228. [D 20:42:40.851863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12229. [D 20:42:40.851878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12230. [D 20:42:40.851893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12231. [D 20:42:40.851911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12232. [D 20:42:40.851926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12233. [D 20:42:40.851941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12234. [D 20:42:40.851956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12235. [D 20:42:40.851971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12236. [D 20:42:40.851986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12237. [D 20:42:40.852001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12238. [D 20:42:40.852015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12239. [D 20:42:40.852030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12240. [D 20:42:40.852049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12241. [D 20:42:40.852064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12242. [D 20:42:40.852079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12243. [D 20:42:40.852093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12244. [D 20:42:40.852108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12245. [D 20:42:40.852155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12246. [D 20:42:40.852176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12247. [D 20:42:40.852191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12248. [D 20:42:40.852205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12249. [D 20:42:40.852220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12250. [D 20:42:40.852247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12251. [D 20:42:40.852262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12252. [D 20:42:40.852276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12253. [D 20:42:40.852291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12254. [D 20:42:40.852305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12255. [D 20:42:40.852320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12256. [D 20:42:40.852338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12257. [D 20:42:40.852354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12258. [D 20:42:40.852368] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12259. [D 20:42:40.857811] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12259. [D 20:42:40.857830] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 10/70. [D 20:42:40.857934] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.857987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.858000] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:40.919932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:40.919954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.919967] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:40.920004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3566 [D 20:42:40.920019] element 0: offset: 0x657130, size: 24 [D 20:42:40.920039] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 11/70. [D 20:42:40.923659] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3566 [D 20:42:40.923701] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 12/70. [D 20:42:40.923758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12259. [D 20:42:40.923788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12260. [D 20:42:40.923803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12261. [D 20:42:40.923818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12262. [D 20:42:40.923833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12263. [D 20:42:40.923848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12264. [D 20:42:40.923863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12265. [D 20:42:40.923883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12266. [D 20:42:40.923898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12267. [D 20:42:40.923913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12268. [D 20:42:40.923940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12269. [D 20:42:40.923955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12270. [D 20:42:40.923970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12271. [D 20:42:40.923989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12272. [D 20:42:40.924003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12273. [D 20:42:40.924018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12274. [D 20:42:40.924033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12275. [D 20:42:40.924048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12276. [D 20:42:40.924062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12277. [D 20:42:40.924077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12278. [D 20:42:40.924093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12279. [D 20:42:40.924126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12280. [D 20:42:40.924146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12281. [D 20:42:40.924175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12282. [D 20:42:40.924190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12283. [D 20:42:40.924205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12284. [D 20:42:40.924220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12285. [D 20:42:40.924235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12286. [D 20:42:40.924250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12287. [D 20:42:40.924264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12288. [D 20:42:40.924283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12289. [D 20:42:40.924298] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12290. [D 20:42:40.929730] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12290. [D 20:42:40.929753] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 13/70. [D 20:42:40.929858] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:40.929908] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:40.929922] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.000884] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.000906] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.000919] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.000957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3568 [D 20:42:41.000972] element 0: offset: 0x5b0030, size: 24 [D 20:42:41.000991] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 14/70. [D 20:42:41.004418] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3568 [D 20:42:41.004446] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 15/70. [D 20:42:41.004555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12290. [D 20:42:41.004579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12291. [D 20:42:41.004595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12292. [D 20:42:41.004610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12293. [D 20:42:41.004632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12294. [D 20:42:41.004654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12295. [D 20:42:41.004680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12296. [D 20:42:41.004695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12297. [D 20:42:41.004710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12298. [D 20:42:41.004737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12299. [D 20:42:41.004752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12300. [D 20:42:41.004767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12301. [D 20:42:41.004782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12302. [D 20:42:41.004804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12303. [D 20:42:41.004832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12304. [D 20:42:41.004847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12305. [D 20:42:41.004862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12306. [D 20:42:41.004882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12307. [D 20:42:41.004900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12308. [D 20:42:41.004917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12309. [D 20:42:41.004935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12310. [D 20:42:41.004963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12311. [D 20:42:41.004981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12312. [D 20:42:41.004999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12313. [D 20:42:41.005017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12314. [D 20:42:41.005035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12315. [D 20:42:41.005052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12316. [D 20:42:41.005070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12317. [D 20:42:41.005088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12318. [D 20:42:41.005105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12319. [D 20:42:41.005123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12320. [D 20:42:41.005141] openib_post_sr_rdmaw: ibv_post_send wr_id 62feb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12321. [D 20:42:41.010494] openib_check_cq: completed rdma wr_id 62feb0, nic_wr_credit 12321. [D 20:42:41.010517] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 16/70. [D 20:42:41.010617] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.010669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.010683] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.056347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.056368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.056381] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.056419] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3571 [D 20:42:41.056434] element 0: offset: 0x61e400, size: 24 [D 20:42:41.056453] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 17/70. [D 20:42:41.059989] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3571 [D 20:42:41.060020] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 18/70. [D 20:42:41.060074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12321. [D 20:42:41.060096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12322. [D 20:42:41.060111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12323. [D 20:42:41.060125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12324. [D 20:42:41.060142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12325. [D 20:42:41.060162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12326. [D 20:42:41.060177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12327. [D 20:42:41.060192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12328. [D 20:42:41.060217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12329. [D 20:42:41.060246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12330. [D 20:42:41.060261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12331. [D 20:42:41.060276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12332. [D 20:42:41.060291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12333. [D 20:42:41.060308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12334. [D 20:42:41.060325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12335. [D 20:42:41.060339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12336. [D 20:42:41.060354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12337. [D 20:42:41.060369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12338. [D 20:42:41.060404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12339. [D 20:42:41.060425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12340. [D 20:42:41.060441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12341. [D 20:42:41.060455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12342. [D 20:42:41.060470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12343. [D 20:42:41.060485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12344. [D 20:42:41.060502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12345. [D 20:42:41.060517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12346. [D 20:42:41.060531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12347. [D 20:42:41.060546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12348. [D 20:42:41.060575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12349. [D 20:42:41.060590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12350. [D 20:42:41.060605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12351. [D 20:42:41.060620] openib_post_sr_rdmaw: ibv_post_send wr_id 62feb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12352. [D 20:42:41.066015] openib_check_cq: completed rdma wr_id 62feb0, nic_wr_credit 12352. [D 20:42:41.066037] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 19/70. [D 20:42:41.066138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.066189] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.066203] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.088607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.088628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.088641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.088678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3574 [D 20:42:41.088693] element 0: offset: 0x691fe0, size: 24 [D 20:42:41.088714] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 20/70. [D 20:42:41.092302] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3574 [D 20:42:41.092329] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 21/70. [D 20:42:41.092387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12352. [D 20:42:41.092415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12353. [D 20:42:41.092431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12354. [D 20:42:41.092447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12355. [D 20:42:41.092462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12356. [D 20:42:41.092477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12357. [D 20:42:41.092492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12358. [D 20:42:41.092511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12359. [D 20:42:41.092526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12360. [D 20:42:41.092547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12361. [D 20:42:41.092574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12362. [D 20:42:41.092589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12363. [D 20:42:41.092608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12364. [D 20:42:41.092623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12365. [D 20:42:41.092638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12366. [D 20:42:41.092653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12367. [D 20:42:41.092672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12368. [D 20:42:41.092689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12369. [D 20:42:41.092704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12370. [D 20:42:41.092720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12371. [D 20:42:41.092757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12372. [D 20:42:41.092775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12373. [D 20:42:41.092790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12374. [D 20:42:41.092805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12375. [D 20:42:41.092820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12376. [D 20:42:41.092835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12377. [D 20:42:41.092849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12378. [D 20:42:41.092864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12379. [D 20:42:41.092879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12380. [D 20:42:41.092894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12381. [D 20:42:41.092913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12382. [D 20:42:41.092928] openib_post_sr_rdmaw: ibv_post_send wr_id 636c30 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12383. [D 20:42:41.098319] openib_check_cq: completed rdma wr_id 636c30, nic_wr_credit 12383. [D 20:42:41.098340] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 22/70. [D 20:42:41.098440] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.098491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.098505] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.129361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.129382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.129395] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.129433] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3578 [D 20:42:41.129448] element 0: offset: 0x63c760, size: 24 [D 20:42:41.129466] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 23/70. [D 20:42:41.133130] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3578 [D 20:42:41.133166] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 24/70. [D 20:42:41.133215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12383. [D 20:42:41.133232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12384. [D 20:42:41.133247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12385. [D 20:42:41.133266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12386. [D 20:42:41.133281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12387. [D 20:42:41.133296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12388. [D 20:42:41.133311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12389. [D 20:42:41.133330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12390. [D 20:42:41.133345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12391. [D 20:42:41.133360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12392. [D 20:42:41.133389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12393. [D 20:42:41.133404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12394. [D 20:42:41.133419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12395. [D 20:42:41.133435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12396. [D 20:42:41.133478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12397. [D 20:42:41.133493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12398. [D 20:42:41.133514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12399. [D 20:42:41.133529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12400. [D 20:42:41.133544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12401. [D 20:42:41.133559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12402. [D 20:42:41.133574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12403. [D 20:42:41.133589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12404. [D 20:42:41.133604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12405. [D 20:42:41.133619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12406. [D 20:42:41.133635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12407. [D 20:42:41.133650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12408. [D 20:42:41.133666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12409. [D 20:42:41.133681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12410. [D 20:42:41.133722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12411. [D 20:42:41.133744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12412. [D 20:42:41.133759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12413. [D 20:42:41.133775] openib_post_sr_rdmaw: ibv_post_send wr_id 62feb0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12414. [D 20:42:41.139179] openib_check_cq: completed rdma wr_id 62feb0, nic_wr_credit 12414. [D 20:42:41.139200] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 25/70. [D 20:42:41.139303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.139355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.139368] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.192709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.192730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.192743] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.192781] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3580 [D 20:42:41.192796] element 0: offset: 0x61e400, size: 24 [D 20:42:41.192815] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 26/70. [D 20:42:41.196444] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3580 [D 20:42:41.196481] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 27/70. [D 20:42:41.196532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12414. [D 20:42:41.196549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12415. [D 20:42:41.196564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12416. [D 20:42:41.196593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12417. [D 20:42:41.196609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12418. [D 20:42:41.196624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12419. [D 20:42:41.196638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12420. [D 20:42:41.196653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12421. [D 20:42:41.196668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12422. [D 20:42:41.196683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12423. [D 20:42:41.196698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12424. [D 20:42:41.196713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12425. [D 20:42:41.196727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12426. [D 20:42:41.196742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12427. [D 20:42:41.196757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12428. [D 20:42:41.196772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12429. [D 20:42:41.196807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12430. [D 20:42:41.196828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12431. [D 20:42:41.196842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12432. [D 20:42:41.196857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12433. [D 20:42:41.196872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12434. [D 20:42:41.196887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12435. [D 20:42:41.196901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12436. [D 20:42:41.196916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12437. [D 20:42:41.196930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12438. [D 20:42:41.196945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12439. [D 20:42:41.196960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12440. [D 20:42:41.196976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12441. [D 20:42:41.196990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12442. [D 20:42:41.197006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12443. [D 20:42:41.197052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12444. [D 20:42:41.197070] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12445. [D 20:42:41.202452] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12445. [D 20:42:41.202474] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 28/70. [D 20:42:41.202576] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.202628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.202641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.276842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.276863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.276876] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.276913] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3584 [D 20:42:41.276928] element 0: offset: 0x5b0030, size: 24 [D 20:42:41.276948] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 29/70. [D 20:42:41.280770] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3584 [D 20:42:41.280806] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 30/70. [D 20:42:41.280855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12445. [D 20:42:41.280872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12446. [D 20:42:41.280887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12447. [D 20:42:41.280908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12448. [D 20:42:41.280924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12449. [D 20:42:41.280940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12450. [D 20:42:41.280954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12451. [D 20:42:41.280984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12452. [D 20:42:41.281000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12453. [D 20:42:41.281015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12454. [D 20:42:41.281029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12455. [D 20:42:41.281044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12456. [D 20:42:41.281059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12457. [D 20:42:41.281073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12458. [D 20:42:41.281089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12459. [D 20:42:41.281121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12460. [D 20:42:41.281136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12461. [D 20:42:41.281155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12462. [D 20:42:41.281171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12463. [D 20:42:41.281185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12464. [D 20:42:41.281200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12465. [D 20:42:41.281214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12466. [D 20:42:41.281229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12467. [D 20:42:41.281243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12468. [D 20:42:41.281262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12469. [D 20:42:41.281280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12470. [D 20:42:41.281295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12471. [D 20:42:41.281310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12472. [D 20:42:41.281352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12473. [D 20:42:41.281368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12474. [D 20:42:41.281392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12475. [D 20:42:41.281408] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12476. [D 20:42:41.286792] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12476. [D 20:42:41.286811] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 31/70. [D 20:42:41.286915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.286966] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.286980] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.337166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.337187] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.337200] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.337238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3586 [D 20:42:41.337253] element 0: offset: 0x63c760, size: 24 [D 20:42:41.337272] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 32/70. [D 20:42:41.340877] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3586 [D 20:42:41.340911] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 33/70. [D 20:42:41.340966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12476. [D 20:42:41.340984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12477. [D 20:42:41.340999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12478. [D 20:42:41.341023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12479. [D 20:42:41.341038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12480. [D 20:42:41.341052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12481. [D 20:42:41.341067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12482. [D 20:42:41.341086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12483. [D 20:42:41.341101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12484. [D 20:42:41.341116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12485. [D 20:42:41.341131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12486. [D 20:42:41.341146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12487. [D 20:42:41.341161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12488. [D 20:42:41.341177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12489. [D 20:42:41.341220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12490. [D 20:42:41.341235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12491. [D 20:42:41.341256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12492. [D 20:42:41.341284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12493. [D 20:42:41.341300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12494. [D 20:42:41.341315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12495. [D 20:42:41.341330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12496. [D 20:42:41.341344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12497. [D 20:42:41.341363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12498. [D 20:42:41.341379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12499. [D 20:42:41.341393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12500. [D 20:42:41.341408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12501. [D 20:42:41.341429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12502. [D 20:42:41.341469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12503. [D 20:42:41.341490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12504. [D 20:42:41.341505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12505. [D 20:42:41.341520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12506. [D 20:42:41.341535] openib_post_sr_rdmaw: ibv_post_send wr_id 6445d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12507. [D 20:42:41.346932] openib_check_cq: completed rdma wr_id 6445d0, nic_wr_credit 12507. [D 20:42:41.346951] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 34/70. [D 20:42:41.347054] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.347107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.347121] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.420657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.420678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.420692] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.420729] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3589 [D 20:42:41.420744] element 0: offset: 0x657130, size: 24 [D 20:42:41.420763] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 35/70. [D 20:42:41.424384] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3589 [D 20:42:41.424421] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 36/70. [D 20:42:41.424469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12507. [D 20:42:41.424486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12508. [D 20:42:41.424501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12509. [D 20:42:41.424534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12510. [D 20:42:41.424550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12511. [D 20:42:41.424565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12512. [D 20:42:41.424580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12513. [D 20:42:41.424595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12514. [D 20:42:41.424610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12515. [D 20:42:41.424625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12516. [D 20:42:41.424640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12517. [D 20:42:41.424655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12518. [D 20:42:41.424670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12519. [D 20:42:41.424685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12520. [D 20:42:41.424700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12521. [D 20:42:41.424747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12522. [D 20:42:41.424767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12523. [D 20:42:41.424781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12524. [D 20:42:41.424796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12525. [D 20:42:41.424811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12526. [D 20:42:41.424826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12527. [D 20:42:41.424840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12528. [D 20:42:41.424855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12529. [D 20:42:41.424881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12530. [D 20:42:41.424898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12531. [D 20:42:41.424915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12532. [D 20:42:41.424930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12533. [D 20:42:41.424951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12534. [D 20:42:41.424990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12535. [D 20:42:41.425008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12536. [D 20:42:41.425028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12537. [D 20:42:41.425043] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12538. [D 20:42:41.430386] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12538. [D 20:42:41.430405] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 37/70. [D 20:42:41.430507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.430559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.430572] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.557152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.557174] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.557187] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.557224] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3592 [D 20:42:41.557239] element 0: offset: 0x691fe0, size: 24 [D 20:42:41.557258] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 38/70. [D 20:42:41.560911] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3592 [D 20:42:41.560948] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 39/70. [D 20:42:41.561006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12538. [D 20:42:41.561023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12539. [D 20:42:41.561038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12540. [D 20:42:41.561060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12541. [D 20:42:41.561075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12542. [D 20:42:41.561090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12543. [D 20:42:41.561105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12544. [D 20:42:41.561163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12545. [D 20:42:41.561179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12546. [D 20:42:41.561193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12547. [D 20:42:41.561208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12548. [D 20:42:41.561236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12549. [D 20:42:41.561254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12550. [D 20:42:41.561269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12551. [D 20:42:41.561293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12552. [D 20:42:41.561307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12553. [D 20:42:41.561322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12554. [D 20:42:41.561336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12555. [D 20:42:41.561351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12556. [D 20:42:41.561366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12557. [D 20:42:41.561384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12558. [D 20:42:41.561401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12559. [D 20:42:41.561416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12560. [D 20:42:41.561431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12561. [D 20:42:41.561468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12562. [D 20:42:41.561489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12563. [D 20:42:41.561513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12564. [D 20:42:41.561542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12565. [D 20:42:41.561558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12566. [D 20:42:41.561573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12567. [D 20:42:41.561588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12568. [D 20:42:41.561602] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12569. [D 20:42:41.566953] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12569. [D 20:42:41.566975] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 40/70. [D 20:42:41.567078] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.567130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.567143] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.608777] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.608798] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.608811] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.608849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3596 [D 20:42:41.608865] element 0: offset: 0x649250, size: 24 [D 20:42:41.608883] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 41/70. [D 20:42:41.608924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.608938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.608950] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:41.608971] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3598 [D 20:42:41.608985] element 0: offset: 0x63c760, size: 24 [D 20:42:41.609000] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 42/70. [D 20:42:41.615412] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3596 [D 20:42:41.615442] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 43/70. [D 20:42:41.615461] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3598 [D 20:42:41.615482] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 44/70. [D 20:42:41.615566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12569. [D 20:42:41.615585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12570. [D 20:42:41.615613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12571. [D 20:42:41.615634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12572. [D 20:42:41.615654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12573. [D 20:42:41.615680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12574. [D 20:42:41.615886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12575. [D 20:42:41.615910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12576. [D 20:42:41.615925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12577. [D 20:42:41.615940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12578. [D 20:42:41.615963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12579. [D 20:42:41.615981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12580. [D 20:42:41.616006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12581. [D 20:42:41.616024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12582. [D 20:42:41.616042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12583. [D 20:42:41.616060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12584. [D 20:42:41.616078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12585. [D 20:42:41.616096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12586. [D 20:42:41.616115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12587. [D 20:42:41.616133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12588. [D 20:42:41.616151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12589. [D 20:42:41.616170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12590. [D 20:42:41.616188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12591. [D 20:42:41.616207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12592. [D 20:42:41.616225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12593. [D 20:42:41.616244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12594. [D 20:42:41.616262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12595. [D 20:42:41.616281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12596. [D 20:42:41.616300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12597. [D 20:42:41.616318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12598. [D 20:42:41.616336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12599. [D 20:42:41.616355] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12600. [D 20:42:41.616388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12601. [D 20:42:41.616407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12602. [D 20:42:41.616425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12603. [D 20:42:41.616443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12604. [D 20:42:41.616462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12605. [D 20:42:41.616477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12606. [D 20:42:41.616492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12607. [D 20:42:41.616507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12608. [D 20:42:41.616522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12609. [D 20:42:41.616537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12610. [D 20:42:41.616551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12611. [D 20:42:41.616566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12612. [D 20:42:41.616581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12613. [D 20:42:41.616595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12614. [D 20:42:41.616610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12615. [D 20:42:41.616625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12616. [D 20:42:41.616640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12617. [D 20:42:41.616654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12618. [D 20:42:41.616669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12619. [D 20:42:41.616684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12620. [D 20:42:41.616699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12621. [D 20:42:41.616713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12622. [D 20:42:41.616728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12623. [D 20:42:41.616743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12624. [D 20:42:41.616757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12625. [D 20:42:41.616772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12626. [D 20:42:41.616787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12627. [D 20:42:41.616802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12628. [D 20:42:41.616817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12629. [D 20:42:41.616832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12630. [D 20:42:41.616846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12631. [D 20:42:41.616861] openib_post_sr_rdmaw: ibv_post_send wr_id 669520 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12632. [D 20:42:41.621496] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12632. [D 20:42:41.621520] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 45/70. [D 20:42:41.627378] openib_check_cq: completed rdma wr_id 669520, nic_wr_credit 12631. [D 20:42:41.627397] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 46/70. [D 20:42:41.627504] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.627559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.627573] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:41.627598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.627612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.627624] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.645527] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.645548] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.645561] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.645599] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3602 [D 20:42:41.645614] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.645633] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 47/70. [D 20:42:41.649269] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3602 [D 20:42:41.649306] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 48/70. [D 20:42:41.649356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12631. [D 20:42:41.649373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12632. [D 20:42:41.649387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12633. [D 20:42:41.649402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12634. [D 20:42:41.649435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12635. [D 20:42:41.649451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12636. [D 20:42:41.649466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12637. [D 20:42:41.649480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12638. [D 20:42:41.649495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12639. [D 20:42:41.649510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12640. [D 20:42:41.649525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12641. [D 20:42:41.649540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12642. [D 20:42:41.649555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12643. [D 20:42:41.649570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12644. [D 20:42:41.649585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12645. [D 20:42:41.649616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12646. [D 20:42:41.649631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12647. [D 20:42:41.649651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12648. [D 20:42:41.649666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12649. [D 20:42:41.649681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12650. [D 20:42:41.649696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12651. [D 20:42:41.649710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12652. [D 20:42:41.649725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12653. [D 20:42:41.649740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12654. [D 20:42:41.649759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12655. [D 20:42:41.649775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12656. [D 20:42:41.649790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12657. [D 20:42:41.649805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12658. [D 20:42:41.649847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12659. [D 20:42:41.649881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12660. [D 20:42:41.649896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12661. [D 20:42:41.649911] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12662. [D 20:42:41.655291] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12662. [D 20:42:41.655311] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 49/70. [D 20:42:41.655413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.655465] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.655479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.732396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.732418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.732431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.732469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3604 [D 20:42:41.732484] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.732504] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 50/70. [D 20:42:41.736056] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3604 [D 20:42:41.736085] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 51/70. [D 20:42:41.736140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12662. [D 20:42:41.736157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12663. [D 20:42:41.736172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12664. [D 20:42:41.736187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12665. [D 20:42:41.736202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12666. [D 20:42:41.736217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12667. [D 20:42:41.736232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12668. [D 20:42:41.736247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12669. [D 20:42:41.736262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12670. [D 20:42:41.736276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12671. [D 20:42:41.736318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12672. [D 20:42:41.736333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12673. [D 20:42:41.736352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12674. [D 20:42:41.736367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12675. [D 20:42:41.736381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12676. [D 20:42:41.736396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12677. [D 20:42:41.736411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12678. [D 20:42:41.736425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12679. [D 20:42:41.736440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12680. [D 20:42:41.736455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12681. [D 20:42:41.736470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12682. [D 20:42:41.736485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12683. [D 20:42:41.736499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12684. [D 20:42:41.736515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12685. [D 20:42:41.736557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12686. [D 20:42:41.736572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12687. [D 20:42:41.736594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12688. [D 20:42:41.736621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12689. [D 20:42:41.736637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12690. [D 20:42:41.736651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12691. [D 20:42:41.736666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12692. [D 20:42:41.736681] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12693. [D 20:42:41.742098] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12693. [D 20:42:41.742121] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 52/70. [D 20:42:41.742225] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.742283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.742297] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.789591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.789612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.789625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.789666] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3607 [D 20:42:41.789681] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.789701] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 53/70. [D 20:42:41.793216] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3607 [D 20:42:41.793247] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 54/70. [D 20:42:41.793302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12693. [D 20:42:41.793319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12694. [D 20:42:41.793334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12695. [D 20:42:41.793350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12696. [D 20:42:41.793365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12697. [D 20:42:41.793380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12698. [D 20:42:41.793395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12699. [D 20:42:41.793411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12700. [D 20:42:41.793425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12701. [D 20:42:41.793440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12702. [D 20:42:41.793456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12703. [D 20:42:41.793486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12704. [D 20:42:41.793501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12705. [D 20:42:41.793520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12706. [D 20:42:41.793535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12707. [D 20:42:41.793550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12708. [D 20:42:41.793565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12709. [D 20:42:41.793579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12710. [D 20:42:41.793594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12711. [D 20:42:41.793609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12712. [D 20:42:41.793623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12713. [D 20:42:41.793639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12714. [D 20:42:41.793654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12715. [D 20:42:41.793682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12716. [D 20:42:41.793697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12717. [D 20:42:41.793740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12718. [D 20:42:41.793762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12719. [D 20:42:41.793777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12720. [D 20:42:41.793792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12721. [D 20:42:41.793806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12722. [D 20:42:41.793821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12723. [D 20:42:41.793836] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12724. [D 20:42:41.799266] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12724. [D 20:42:41.799288] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 55/70. [D 20:42:41.799393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.799453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.799467] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.829654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.829676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.829688] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.829729] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3612 [D 20:42:41.829744] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.829764] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 56/70. [D 20:42:41.829807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.829821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.829834] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:41.829855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3613 [D 20:42:41.829869] element 0: offset: 0x2aaaab605790, size: 24 [D 20:42:41.829888] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 57/70. [D 20:42:41.835869] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3612 [D 20:42:41.835896] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 58/70. [D 20:42:41.835952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12724. [D 20:42:41.835970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12725. [D 20:42:41.835985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12726. [D 20:42:41.835999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12727. [D 20:42:41.836014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12728. [D 20:42:41.836029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12729. [D 20:42:41.836044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12730. [D 20:42:41.836059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12731. [D 20:42:41.836073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12732. [D 20:42:41.836088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12733. [D 20:42:41.836103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12734. [D 20:42:41.836117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12735. [D 20:42:41.836132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12736. [D 20:42:41.836147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12737. [D 20:42:41.836162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12738. [D 20:42:41.836176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12739. [D 20:42:41.836191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12740. [D 20:42:41.836206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12741. [D 20:42:41.836221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12742. [D 20:42:41.836235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12743. [D 20:42:41.836250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12744. [D 20:42:41.836265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12745. [D 20:42:41.836279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12746. [D 20:42:41.836294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12747. [D 20:42:41.836309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12748. [D 20:42:41.836323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12749. [D 20:42:41.836338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12750. [D 20:42:41.836353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12751. [D 20:42:41.836368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12752. [D 20:42:41.836383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12753. [D 20:42:41.836398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12754. [D 20:42:41.836413] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12755. [D 20:42:41.839753] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3613 [D 20:42:41.839781] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 59/70. [D 20:42:41.841837] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12755. [D 20:42:41.841861] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 60/70. [D 20:42:41.841884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12755. [D 20:42:41.841903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12756. [D 20:42:41.841922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12757. [D 20:42:41.841939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12758. [D 20:42:41.841958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12759. [D 20:42:41.841977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12760. [D 20:42:41.841995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12761. [D 20:42:41.842014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12762. [D 20:42:41.842033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12763. [D 20:42:41.842051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12764. [D 20:42:41.842070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12765. [D 20:42:41.842088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12766. [D 20:42:41.842107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12767. [D 20:42:41.842327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12768. [D 20:42:41.842347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12769. [D 20:42:41.842373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12770. [D 20:42:41.842391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12771. [D 20:42:41.842410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12772. [D 20:42:41.842433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12773. [D 20:42:41.842451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12774. [D 20:42:41.842470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12775. [D 20:42:41.842488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12776. [D 20:42:41.842507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12777. [D 20:42:41.842526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12778. [D 20:42:41.842545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12779. [D 20:42:41.842563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12780. [D 20:42:41.842581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12781. [D 20:42:41.842600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12782. [D 20:42:41.842619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12783. [D 20:42:41.842637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12784. [D 20:42:41.842656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12785. [D 20:42:41.842674] openib_post_sr_rdmaw: ibv_post_send wr_id 669520 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12786. [D 20:42:41.842764] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.842830] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.842845] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:41.847817] openib_check_cq: completed rdma wr_id 669520, nic_wr_credit 12786. [D 20:42:41.847844] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 0/70. [D 20:42:41.847908] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.847929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.847942] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.924349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.924369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.924382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.924422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3616 [D 20:42:41.924437] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.924457] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 1/70. [D 20:42:41.930889] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3616 [D 20:42:41.930917] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 2/70. [D 20:42:41.931018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12786. [D 20:42:41.931088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12787. [D 20:42:41.931104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12788. [D 20:42:41.931119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12789. [D 20:42:41.931133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12790. [D 20:42:41.931147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12791. [D 20:42:41.931162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12792. [D 20:42:41.931175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12793. [D 20:42:41.931190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12794. [D 20:42:41.931204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12795. [D 20:42:41.931218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12796. [D 20:42:41.931232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12797. [D 20:42:41.931247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12798. [D 20:42:41.931261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12799. [D 20:42:41.931275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12800. [D 20:42:41.931289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12801. [D 20:42:41.931303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12802. [D 20:42:41.931317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12803. [D 20:42:41.931331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12804. [D 20:42:41.931345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12805. [D 20:42:41.931360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12806. [D 20:42:41.931374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12807. [D 20:42:41.931388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12808. [D 20:42:41.931402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12809. [D 20:42:41.931416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12810. [D 20:42:41.931430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12811. [D 20:42:41.931445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12812. [D 20:42:41.931459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12813. [D 20:42:41.931473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12814. [D 20:42:41.931487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12815. [D 20:42:41.931503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12816. [D 20:42:41.931517] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12817. [D 20:42:41.937018] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12817. [D 20:42:41.937041] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 3/70. [D 20:42:41.939750] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:41.939775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.939790] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:41.987339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:41.987361] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:41.987375] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:41.987415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3619 [D 20:42:41.987431] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:41.987447] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 4/70. [D 20:42:41.993927] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3619 [D 20:42:41.993951] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 5/70. [D 20:42:41.994062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12817. [D 20:42:41.994085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12818. [D 20:42:41.994100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12819. [D 20:42:41.994115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12820. [D 20:42:41.994130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12821. [D 20:42:41.994144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12822. [D 20:42:41.994159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12823. [D 20:42:41.994174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12824. [D 20:42:41.994189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12825. [D 20:42:41.994203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12826. [D 20:42:41.994218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12827. [D 20:42:41.994233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12828. [D 20:42:41.994248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12829. [D 20:42:41.994262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12830. [D 20:42:41.994277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12831. [D 20:42:41.994291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12832. [D 20:42:41.994306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12833. [D 20:42:41.994321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12834. [D 20:42:41.994336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12835. [D 20:42:41.994350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12836. [D 20:42:41.994365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12837. [D 20:42:41.994380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12838. [D 20:42:41.994395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12839. [D 20:42:41.994409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12840. [D 20:42:41.994424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12841. [D 20:42:41.994439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12842. [D 20:42:41.994453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12843. [D 20:42:41.994468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12844. [D 20:42:41.994483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12845. [D 20:42:41.994498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12846. [D 20:42:41.994513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12847. [D 20:42:41.994528] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12848. [D 20:42:42.000016] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12848. [D 20:42:42.000039] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 6/70. [D 20:42:42.003005] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.003022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.003036] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.058761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.058782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.058796] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.058820] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3622 [D 20:42:42.058836] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.058851] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 7/70. [D 20:42:42.062823] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3622 [D 20:42:42.062846] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 8/70. [D 20:42:42.062957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12848. [D 20:42:42.062978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12849. [D 20:42:42.062993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12850. [D 20:42:42.063008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12851. [D 20:42:42.063023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12852. [D 20:42:42.063037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12853. [D 20:42:42.063052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12854. [D 20:42:42.063066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12855. [D 20:42:42.063081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12856. [D 20:42:42.063096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12857. [D 20:42:42.063111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12858. [D 20:42:42.063125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12859. [D 20:42:42.063140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12860. [D 20:42:42.063155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12861. [D 20:42:42.063170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12862. [D 20:42:42.063184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12863. [D 20:42:42.063199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12864. [D 20:42:42.063213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12865. [D 20:42:42.063228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12866. [D 20:42:42.063243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12867. [D 20:42:42.063258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12868. [D 20:42:42.063272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12869. [D 20:42:42.063287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12870. [D 20:42:42.063301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12871. [D 20:42:42.063316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12872. [D 20:42:42.063331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12873. [D 20:42:42.063345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12874. [D 20:42:42.063360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12875. [D 20:42:42.063375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 12876. [D 20:42:42.063389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 12877. [D 20:42:42.063405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 12878. [D 20:42:42.063420] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 12879. [D 20:42:42.068898] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12879. [D 20:42:42.068918] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 9/70. [D 20:42:42.071803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.071862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.071875] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.093331] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.093351] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.093364] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.093406] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3625 [D 20:42:42.093421] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.093443] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 10/70. [D 20:42:42.097062] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3625 [D 20:42:42.097091] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 11/70. [D 20:42:42.097146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 12879. [D 20:42:42.097163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 12880. [D 20:42:42.097178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 12881. [D 20:42:42.097194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 12882. [D 20:42:42.097210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 12883. [D 20:42:42.097225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 12884. [D 20:42:42.097240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 12885. [D 20:42:42.097255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 12886. [D 20:42:42.097270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 12887. [D 20:42:42.097285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 12888. [D 20:42:42.097301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 12889. [D 20:42:42.097320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 12890. [D 20:42:42.097350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 12891. [D 20:42:42.097365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 12892. [D 20:42:42.097384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 12893. [D 20:42:42.097399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 12894. [D 20:42:42.097414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 12895. [D 20:42:42.097429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 12896. [D 20:42:42.097445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 12897. [D 20:42:42.097459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 12898. [D 20:42:42.097475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 12899. [D 20:42:42.097490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 12900. [D 20:42:42.097506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 12901. [D 20:42:42.097521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 12902. [D 20:42:42.097536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 12903. [D 20:42:42.097552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 12904. [D 20:42:42.097609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 12905. [D 20:42:42.097624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 12906. [D 20:42:42.097639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 12907. [D 20:42:42.097654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 12908. [D 20:42:42.097669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 12909. [D 20:42:42.097683] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 12910. [D 20:42:42.103092] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12910. [D 20:42:42.103112] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 12/70. [D 20:42:42.103218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.103278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.103291] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.183389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.183410] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.183424] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.183463] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3629 [D 20:42:42.183478] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.183500] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 13/70. [D 20:42:42.187037] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3629 [D 20:42:42.187072] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 14/70. [D 20:42:42.187185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 12910. [D 20:42:42.187209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 12911. [D 20:42:42.187231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 12912. [D 20:42:42.187249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 12913. [D 20:42:42.187284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 12914. [D 20:42:42.187302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 12915. [D 20:42:42.187320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 12916. [D 20:42:42.187339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 12917. [D 20:42:42.187357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 12918. [D 20:42:42.187375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 12919. [D 20:42:42.187394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 12920. [D 20:42:42.187412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 12921. [D 20:42:42.187430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 12922. [D 20:42:42.187448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 12923. [D 20:42:42.187467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 12924. [D 20:42:42.187485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 12925. [D 20:42:42.187503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 12926. [D 20:42:42.187522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 12927. [D 20:42:42.187540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 12928. [D 20:42:42.187558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 12929. [D 20:42:42.187574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 12930. [D 20:42:42.187589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 12931. [D 20:42:42.187608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 12932. [D 20:42:42.187626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 12933. [D 20:42:42.187653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 12934. [D 20:42:42.187672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 12935. [D 20:42:42.187691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 12936. [D 20:42:42.187723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 12937. [D 20:42:42.187741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 12938. [D 20:42:42.187759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 12939. [D 20:42:42.187778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 12940. [D 20:42:42.187794] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 12941. [D 20:42:42.193161] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 12941. [D 20:42:42.193184] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 15/70. [D 20:42:42.193278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.193336] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.193350] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.232509] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.232528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.232541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.232579] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3631 [D 20:42:42.232594] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.232615] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 16/70. [D 20:42:42.235945] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3631 [D 20:42:42.235976] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 17/70. [D 20:42:42.236037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 12941. [D 20:42:42.236056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 12942. [D 20:42:42.236072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 12943. [D 20:42:42.236087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 12944. [D 20:42:42.236110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 12945. [D 20:42:42.236130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 12946. [D 20:42:42.236149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 12947. [D 20:42:42.236173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 12948. [D 20:42:42.236191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 12949. [D 20:42:42.236209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 12950. [D 20:42:42.236225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 12951. [D 20:42:42.236241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 12952. [D 20:42:42.236259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 12953. [D 20:42:42.236278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 12954. [D 20:42:42.236295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 12955. [D 20:42:42.236314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 12956. [D 20:42:42.236333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 12957. [D 20:42:42.236364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 12958. [D 20:42:42.236383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 12959. [D 20:42:42.236401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 12960. [D 20:42:42.236419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 12961. [D 20:42:42.236438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 12962. [D 20:42:42.236456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 12963. [D 20:42:42.236474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 12964. [D 20:42:42.236493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 12965. [D 20:42:42.236512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 12966. [D 20:42:42.236530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 12967. [D 20:42:42.236549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 12968. [D 20:42:42.236568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 12969. [D 20:42:42.236583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 12970. [D 20:42:42.236598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 12971. [D 20:42:42.236613] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 12972. [D 20:42:42.241966] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 12972. [D 20:42:42.241990] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 18/70. [D 20:42:42.242083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.242135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.242148] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.288632] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.288653] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.288666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.288703] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3634 [D 20:42:42.288718] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.288737] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 19/70. [D 20:42:42.292382] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3634 [D 20:42:42.292410] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 20/70. [D 20:42:42.292468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 12972. [D 20:42:42.292485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 12973. [D 20:42:42.292503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 12974. [D 20:42:42.292520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 12975. [D 20:42:42.292535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 12976. [D 20:42:42.292550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 12977. [D 20:42:42.292564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 12978. [D 20:42:42.292599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 12979. [D 20:42:42.292627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 12980. [D 20:42:42.292643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 12981. [D 20:42:42.292658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 12982. [D 20:42:42.292673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 12983. [D 20:42:42.292688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 12984. [D 20:42:42.292703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 12985. [D 20:42:42.292719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 12986. [D 20:42:42.292734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 12987. [D 20:42:42.292749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 12988. [D 20:42:42.292780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 12989. [D 20:42:42.292797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 12990. [D 20:42:42.292812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 12991. [D 20:42:42.292831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 12992. [D 20:42:42.292846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 12993. [D 20:42:42.292861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 12994. [D 20:42:42.292890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 12995. [D 20:42:42.292906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 12996. [D 20:42:42.292921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 12997. [D 20:42:42.292935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 12998. [D 20:42:42.292950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 12999. [D 20:42:42.292965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13000. [D 20:42:42.292979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13001. [D 20:42:42.292994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13002. [D 20:42:42.293009] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13003. [D 20:42:42.298423] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13003. [D 20:42:42.298442] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 21/70. [D 20:42:42.298545] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.298603] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.298617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.360127] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.360148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.360161] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.360200] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3638 [D 20:42:42.360215] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.360234] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 22/70. [D 20:42:42.363742] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3638 [D 20:42:42.363767] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 23/70. [D 20:42:42.363826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13003. [D 20:42:42.363849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 13004. [D 20:42:42.363867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 13005. [D 20:42:42.363882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 13006. [D 20:42:42.363897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 13007. [D 20:42:42.363912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 13008. [D 20:42:42.363927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13009. [D 20:42:42.363941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13010. [D 20:42:42.363956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13011. [D 20:42:42.363971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 13012. [D 20:42:42.363986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 13013. [D 20:42:42.364001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 13014. [D 20:42:42.364015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 13015. [D 20:42:42.364030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 13016. [D 20:42:42.364061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13017. [D 20:42:42.364084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13018. [D 20:42:42.364127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13019. [D 20:42:42.364146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13020. [D 20:42:42.364162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13021. [D 20:42:42.364176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13022. [D 20:42:42.364191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13023. [D 20:42:42.364206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13024. [D 20:42:42.364220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13025. [D 20:42:42.364235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13026. [D 20:42:42.364250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13027. [D 20:42:42.364264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13028. [D 20:42:42.364279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13029. [D 20:42:42.364294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13030. [D 20:42:42.364312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13031. [D 20:42:42.364329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13032. [D 20:42:42.364343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13033. [D 20:42:42.364358] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13034. [D 20:42:42.369800] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13034. [D 20:42:42.369823] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 24/70. [D 20:42:42.369928] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.369980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.369993] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.445357] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.445378] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.445391] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.445429] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3640 [D 20:42:42.445443] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.445463] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 25/70. [D 20:42:42.448926] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3640 [D 20:42:42.448957] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 26/70. [D 20:42:42.449018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 13034. [D 20:42:42.449036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 13035. [D 20:42:42.449051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 13036. [D 20:42:42.449067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 13037. [D 20:42:42.449082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 13038. [D 20:42:42.449096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 13039. [D 20:42:42.449111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 13040. [D 20:42:42.449126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13041. [D 20:42:42.449205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13042. [D 20:42:42.449223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13043. [D 20:42:42.449448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 13044. [D 20:42:42.449467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 13045. [D 20:42:42.449534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 13046. [D 20:42:42.449603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 13047. [D 20:42:42.449664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 13048. [D 20:42:42.449744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13049. [D 20:42:42.449807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13050. [D 20:42:42.449869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13051. [D 20:42:42.449932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 13052. [D 20:42:42.449996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 13053. [D 20:42:42.450058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 13054. [D 20:42:42.450123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 13055. [D 20:42:42.450187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 13056. [D 20:42:42.450250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13057. [D 20:42:42.450378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13058. [D 20:42:42.450396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13059. [D 20:42:42.450411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 13060. [D 20:42:42.450482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 13061. [D 20:42:42.450499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 13062. [D 20:42:42.450566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 13063. [D 20:42:42.450691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 13064. [D 20:42:42.450710] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13065. [D 20:42:42.454904] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13065. [D 20:42:42.454926] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 27/70. [D 20:42:42.455030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.455087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.455100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.506313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.506334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.506347] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.506385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3643 [D 20:42:42.506400] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.506420] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 28/70. [D 20:42:42.509898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.509970] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.509984] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:42.510029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3646 [D 20:42:42.510044] element 0: offset: 0x2aaaab604470, size: 24 [D 20:42:42.510063] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 29/70. [D 20:42:42.513419] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3643 [D 20:42:42.513450] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 30/70. [D 20:42:42.513624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13065. [D 20:42:42.513678] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3646 [D 20:42:42.513660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13066. [D 20:42:42.513709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13067. [D 20:42:42.513725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13068. [D 20:42:42.513739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13069. [D 20:42:42.513754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13070. [D 20:42:42.513769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13071. [D 20:42:42.513784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13072. [D 20:42:42.513799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13073. [D 20:42:42.513814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13074. [D 20:42:42.513829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13075. [D 20:42:42.513843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13076. [D 20:42:42.513858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13077. [D 20:42:42.513873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13078. [D 20:42:42.513897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13079. [D 20:42:42.513913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13080. [D 20:42:42.513928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13081. [D 20:42:42.513943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13082. [D 20:42:42.513958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13083. [D 20:42:42.513972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13084. [D 20:42:42.513987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13085. [D 20:42:42.514002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13086. [D 20:42:42.514017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13087. [D 20:42:42.514032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13088. [D 20:42:42.514047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13089. [D 20:42:42.514061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13090. [D 20:42:42.514076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13091. [D 20:42:42.514091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13092. [D 20:42:42.514106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13093. [D 20:42:42.514122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13094. [D 20:42:42.514137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13095. [D 20:42:42.514151] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13096. [D 20:42:42.514173] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 31/70. [D 20:42:42.519524] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13096. [D 20:42:42.519556] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 32/70. [D 20:42:42.519573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 13096. [D 20:42:42.519588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 13097. [D 20:42:42.519603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 13098. [D 20:42:42.519618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 13099. [D 20:42:42.519633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 13100. [D 20:42:42.519647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 13101. [D 20:42:42.519662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 13102. [D 20:42:42.519676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 13103. [D 20:42:42.519691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 13104. [D 20:42:42.519709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 13105. [D 20:42:42.519725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 13106. [D 20:42:42.519740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 13107. [D 20:42:42.519755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 13108. [D 20:42:42.519770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 13109. [D 20:42:42.519785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 13110. [D 20:42:42.519802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 13111. [D 20:42:42.519868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 13112. [D 20:42:42.519892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 13113. [D 20:42:42.519907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 13114. [D 20:42:42.519923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 13115. [D 20:42:42.519938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 13116. [D 20:42:42.519953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 13117. [D 20:42:42.519968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 13118. [D 20:42:42.519983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 13119. [D 20:42:42.519998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 13120. [D 20:42:42.520013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 13121. [D 20:42:42.520028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 13122. [D 20:42:42.520042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 13123. [D 20:42:42.520058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13124. [D 20:42:42.520072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13125. [D 20:42:42.520087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13126. [D 20:42:42.520102] openib_post_sr_rdmaw: ibv_post_send wr_id 667ec0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13127. [D 20:42:42.520242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.520303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.520316] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:42.525536] openib_check_cq: completed rdma wr_id 667ec0, nic_wr_credit 13127. [D 20:42:42.525558] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 33/70. [D 20:42:42.525638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.525660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.525672] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.562476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.562496] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.562509] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.562548] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3650 [D 20:42:42.562563] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:42.562582] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 34/70. [D 20:42:42.566113] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3650 [D 20:42:42.566144] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 35/70. [D 20:42:42.566196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13127. [D 20:42:42.566213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 13128. [D 20:42:42.566229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 13129. [D 20:42:42.566243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 13130. [D 20:42:42.566258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 13131. [D 20:42:42.566274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 13132. [D 20:42:42.566288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13133. [D 20:42:42.566304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13134. [D 20:42:42.566318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13135. [D 20:42:42.566334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 13136. [D 20:42:42.566355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 13137. [D 20:42:42.566389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 13138. [D 20:42:42.566404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 13139. [D 20:42:42.566424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 13140. [D 20:42:42.566439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13141. [D 20:42:42.566454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13142. [D 20:42:42.566469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13143. [D 20:42:42.566484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13144. [D 20:42:42.566499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13145. [D 20:42:42.566525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13146. [D 20:42:42.566541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13147. [D 20:42:42.566556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13148. [D 20:42:42.566571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13149. [D 20:42:42.566586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13150. [D 20:42:42.566601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13151. [D 20:42:42.566645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13152. [D 20:42:42.566668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13153. [D 20:42:42.566683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13154. [D 20:42:42.566698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13155. [D 20:42:42.566714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13156. [D 20:42:42.566729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13157. [D 20:42:42.566744] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13158. [D 20:42:42.572157] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13158. [D 20:42:42.572177] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 36/70. [D 20:42:42.572283] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.572341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.572354] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.632104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.632124] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.632137] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.632177] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3652 [D 20:42:42.632192] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.632212] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 37/70. [D 20:42:42.635742] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3652 [D 20:42:42.635768] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 38/70. [D 20:42:42.635819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13158. [D 20:42:42.635840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13159. [D 20:42:42.635855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13160. [D 20:42:42.635875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13161. [D 20:42:42.635891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13162. [D 20:42:42.635905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13163. [D 20:42:42.635920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13164. [D 20:42:42.635936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13165. [D 20:42:42.635958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13166. [D 20:42:42.635972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13167. [D 20:42:42.635987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13168. [D 20:42:42.636006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13169. [D 20:42:42.636021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13170. [D 20:42:42.636036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13171. [D 20:42:42.636052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13172. [D 20:42:42.636080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13173. [D 20:42:42.636095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13174. [D 20:42:42.636127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13175. [D 20:42:42.636146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13176. [D 20:42:42.636165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13177. [D 20:42:42.636181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13178. [D 20:42:42.636195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13179. [D 20:42:42.636210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13180. [D 20:42:42.636227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13181. [D 20:42:42.636242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13182. [D 20:42:42.636257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13183. [D 20:42:42.636271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13184. [D 20:42:42.636289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13185. [D 20:42:42.636304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13186. [D 20:42:42.636319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13187. [D 20:42:42.636334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13188. [D 20:42:42.636348] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13189. [D 20:42:42.641775] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13189. [D 20:42:42.641795] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 39/70. [D 20:42:42.641900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.641953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.641966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.738095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.738116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.738129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.738165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3655 [D 20:42:42.738180] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:42.738198] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 40/70. [D 20:42:42.741843] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3655 [D 20:42:42.741879] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 41/70. [D 20:42:42.741931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13189. [D 20:42:42.741948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13190. [D 20:42:42.741963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13191. [D 20:42:42.741979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13192. [D 20:42:42.741994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13193. [D 20:42:42.742009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13194. [D 20:42:42.742024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13195. [D 20:42:42.742055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13196. [D 20:42:42.742070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13197. [D 20:42:42.742085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13198. [D 20:42:42.742102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13199. [D 20:42:42.742119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13200. [D 20:42:42.742134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13201. [D 20:42:42.742149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13202. [D 20:42:42.742185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13203. [D 20:42:42.742201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13204. [D 20:42:42.742221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13205. [D 20:42:42.742236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13206. [D 20:42:42.742251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13207. [D 20:42:42.742265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13208. [D 20:42:42.742280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13209. [D 20:42:42.742295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13210. [D 20:42:42.742309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13211. [D 20:42:42.742324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13212. [D 20:42:42.742339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13213. [D 20:42:42.742354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13214. [D 20:42:42.742369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13215. [D 20:42:42.742408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13216. [D 20:42:42.742423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13217. [D 20:42:42.742448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13218. [D 20:42:42.742463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13219. [D 20:42:42.742477] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13220. [D 20:42:42.747849] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13220. [D 20:42:42.747869] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 42/70. [D 20:42:42.747973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.748025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.748038] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.766275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.766296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.766309] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.766347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3659 [D 20:42:42.766362] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.766380] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 43/70. [D 20:42:42.770048] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3659 [D 20:42:42.770085] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 44/70. [D 20:42:42.770138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13220. [D 20:42:42.770156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 13221. [D 20:42:42.770171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 13222. [D 20:42:42.770195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 13223. [D 20:42:42.770210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 13224. [D 20:42:42.770225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 13225. [D 20:42:42.770240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13226. [D 20:42:42.770259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13227. [D 20:42:42.770274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13228. [D 20:42:42.770289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 13229. [D 20:42:42.770304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 13230. [D 20:42:42.770318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 13231. [D 20:42:42.770333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 13232. [D 20:42:42.770348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 13233. [D 20:42:42.770392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13234. [D 20:42:42.770406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13235. [D 20:42:42.770427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13236. [D 20:42:42.770441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13237. [D 20:42:42.770456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13238. [D 20:42:42.770470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13239. [D 20:42:42.770485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13240. [D 20:42:42.770500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13241. [D 20:42:42.770535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13242. [D 20:42:42.770551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13243. [D 20:42:42.770566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13244. [D 20:42:42.770581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13245. [D 20:42:42.770595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13246. [D 20:42:42.770647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13247. [D 20:42:42.770666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13248. [D 20:42:42.770681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13249. [D 20:42:42.770696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13250. [D 20:42:42.770711] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13251. [D 20:42:42.776076] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13251. [D 20:42:42.776095] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 45/70. [D 20:42:42.776197] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.776250] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.776263] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.944273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.944294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.944307] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.944345] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3662 [D 20:42:42.944360] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:42.944379] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 46/70. [D 20:42:42.947750] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3662 [D 20:42:42.947775] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 47/70. [D 20:42:42.947831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 13251. [D 20:42:42.947850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 13252. [D 20:42:42.947865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 13253. [D 20:42:42.947883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 13254. [D 20:42:42.947898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 13255. [D 20:42:42.947912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 13256. [D 20:42:42.947927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13257. [D 20:42:42.947942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13258. [D 20:42:42.947957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13259. [D 20:42:42.947972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 13260. [D 20:42:42.947987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 13261. [D 20:42:42.948002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 13262. [D 20:42:42.948016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 13263. [D 20:42:42.948031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 13264. [D 20:42:42.948046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13265. [D 20:42:42.948060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13266. [D 20:42:42.948076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13267. [D 20:42:42.948119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 13268. [D 20:42:42.948134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 13269. [D 20:42:42.948149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 13270. [D 20:42:42.948164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 13271. [D 20:42:42.948192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 13272. [D 20:42:42.948206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13273. [D 20:42:42.948221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13274. [D 20:42:42.948236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13275. [D 20:42:42.948250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 13276. [D 20:42:42.948265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 13277. [D 20:42:42.948280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 13278. [D 20:42:42.948294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 13279. [D 20:42:42.948309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 13280. [D 20:42:42.948325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13281. [D 20:42:42.948342] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13282. [D 20:42:42.953706] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13282. [D 20:42:42.953726] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 48/70. [D 20:42:42.953833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.953889] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.953903] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.963980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.964000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.964013] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.964051] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3664 [D 20:42:42.964066] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:42.964085] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 49/70. [D 20:42:42.967638] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3664 [D 20:42:42.967670] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 50/70. [D 20:42:42.967733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13282. [D 20:42:42.967750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13283. [D 20:42:42.967766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13284. [D 20:42:42.967781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13285. [D 20:42:42.967797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13286. [D 20:42:42.967812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13287. [D 20:42:42.967827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13288. [D 20:42:42.967851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13289. [D 20:42:42.967884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13290. [D 20:42:42.967899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13291. [D 20:42:42.967914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13292. [D 20:42:42.967928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13293. [D 20:42:42.967943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13294. [D 20:42:42.967957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13295. [D 20:42:42.967977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13296. [D 20:42:42.967994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13297. [D 20:42:42.968008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13298. [D 20:42:42.968024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13299. [D 20:42:42.968057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13300. [D 20:42:42.968071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13301. [D 20:42:42.968092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13302. [D 20:42:42.968112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13303. [D 20:42:42.968126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13304. [D 20:42:42.968141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13305. [D 20:42:42.968156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13306. [D 20:42:42.968171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13307. [D 20:42:42.968186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13308. [D 20:42:42.968211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13309. [D 20:42:42.968226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13310. [D 20:42:42.968241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13311. [D 20:42:42.968256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13312. [D 20:42:42.968270] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13313. [D 20:42:42.976017] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13313. [D 20:42:42.976042] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 51/70. [D 20:42:42.976185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.976242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.976256] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:42.985742] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:42.985763] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.985776] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:42.985815] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3667 [D 20:42:42.985830] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:42.985850] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 52/70. [D 20:42:42.989561] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3667 [D 20:42:42.989596] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 53/70. [D 20:42:42.989648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13313. [D 20:42:42.989665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13314. [D 20:42:42.989680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13315. [D 20:42:42.989695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13316. [D 20:42:42.989710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13317. [D 20:42:42.989741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13318. [D 20:42:42.989756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13319. [D 20:42:42.989771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13320. [D 20:42:42.989787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13321. [D 20:42:42.989802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13322. [D 20:42:42.989817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13323. [D 20:42:42.989832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13324. [D 20:42:42.989847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13325. [D 20:42:42.989862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13326. [D 20:42:42.989905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13327. [D 20:42:42.989920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13328. [D 20:42:42.989940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13329. [D 20:42:42.989956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13330. [D 20:42:42.989971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13331. [D 20:42:42.989985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13332. [D 20:42:42.990001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13333. [D 20:42:42.990016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13334. [D 20:42:42.990031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13335. [D 20:42:42.990048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13336. [D 20:42:42.990064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13337. [D 20:42:42.990079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13338. [D 20:42:42.990094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13339. [D 20:42:42.990109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13340. [D 20:42:42.990150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13341. [D 20:42:42.990172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13342. [D 20:42:42.990188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13343. [D 20:42:42.990203] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13344. [D 20:42:42.995526] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13344. [D 20:42:42.995545] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 54/70. [D 20:42:42.995647] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:42.995699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:42.995718] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.010846] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.010867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.010880] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.010917] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3670 [D 20:42:43.010933] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:43.010952] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 55/70. [D 20:42:43.014623] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3670 [D 20:42:43.014656] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 56/70. [D 20:42:43.014710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 13344. [D 20:42:43.014727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 13345. [D 20:42:43.014742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 13346. [D 20:42:43.014764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 13347. [D 20:42:43.014780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 13348. [D 20:42:43.014795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 13349. [D 20:42:43.014810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 13350. [D 20:42:43.014842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 13351. [D 20:42:43.014857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 13352. [D 20:42:43.014872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 13353. [D 20:42:43.014887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 13354. [D 20:42:43.014901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 13355. [D 20:42:43.014917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 13356. [D 20:42:43.014931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 13357. [D 20:42:43.014975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 13358. [D 20:42:43.014989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 13359. [D 20:42:43.015010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 13360. [D 20:42:43.015025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 13361. [D 20:42:43.015040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 13362. [D 20:42:43.015055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 13363. [D 20:42:43.015070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 13364. [D 20:42:43.015085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 13365. [D 20:42:43.015100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 13366. [D 20:42:43.015119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 13367. [D 20:42:43.015135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 13368. [D 20:42:43.015150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 13369. [D 20:42:43.015166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 13370. [D 20:42:43.015205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 13371. [D 20:42:43.015223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13372. [D 20:42:43.015245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13373. [D 20:42:43.015259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13374. [D 20:42:43.015287] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13375. [D 20:42:43.020587] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13375. [D 20:42:43.020606] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 57/70. [D 20:42:43.020709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.020761] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.020774] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.063712] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.063760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.063775] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.063821] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3673 [D 20:42:43.063836] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:43.063859] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 58/70. [D 20:42:43.067435] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3673 [D 20:42:43.067479] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 59/70. [D 20:42:43.067536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13375. [D 20:42:43.067554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13376. [D 20:42:43.067573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13377. [D 20:42:43.067588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13378. [D 20:42:43.067603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13379. [D 20:42:43.067617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13380. [D 20:42:43.067632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13381. [D 20:42:43.067647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13382. [D 20:42:43.067661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13383. [D 20:42:43.067676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13384. [D 20:42:43.067708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13385. [D 20:42:43.067725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13386. [D 20:42:43.067747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13387. [D 20:42:43.067761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13388. [D 20:42:43.067776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13389. [D 20:42:43.067791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13390. [D 20:42:43.067805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13391. [D 20:42:43.067820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13392. [D 20:42:43.067835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13393. [D 20:42:43.067849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13394. [D 20:42:43.067877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13395. [D 20:42:43.067891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13396. [D 20:42:43.067906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13397. [D 20:42:43.067921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13398. [D 20:42:43.067966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13399. [D 20:42:43.067981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13400. [D 20:42:43.068003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13401. [D 20:42:43.068018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13402. [D 20:42:43.068033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13403. [D 20:42:43.068047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13404. [D 20:42:43.068062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13405. [D 20:42:43.068076] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13406. [D 20:42:43.073460] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13406. [D 20:42:43.073481] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 60/70. [D 20:42:43.073589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.073648] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.073663] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.121058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.121079] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.121092] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.121132] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3676 [D 20:42:43.121148] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:43.121167] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 0/70. [D 20:42:43.124753] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3676 [D 20:42:43.124783] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 1/70. [D 20:42:43.124843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13406. [D 20:42:43.124860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13407. [D 20:42:43.124877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13408. [D 20:42:43.124893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13409. [D 20:42:43.124908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13410. [D 20:42:43.124923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13411. [D 20:42:43.124938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13412. [D 20:42:43.124959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13413. [D 20:42:43.124974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13414. [D 20:42:43.124988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13415. [D 20:42:43.125018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13416. [D 20:42:43.125033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13417. [D 20:42:43.125047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13418. [D 20:42:43.125063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13419. [D 20:42:43.125078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13420. [D 20:42:43.125099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13421. [D 20:42:43.125130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13422. [D 20:42:43.125145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13423. [D 20:42:43.125169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13424. [D 20:42:43.125184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13425. [D 20:42:43.125199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13426. [D 20:42:43.125213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13427. [D 20:42:43.125240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13428. [D 20:42:43.125256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13429. [D 20:42:43.125270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13430. [D 20:42:43.125285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13431. [D 20:42:43.125299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13432. [D 20:42:43.125314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13433. [D 20:42:43.125329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13434. [D 20:42:43.125343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13435. [D 20:42:43.125358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13436. [D 20:42:43.125372] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13437. [D 20:42:43.130795] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13437. [D 20:42:43.130814] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 2/70. [D 20:42:43.130917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.130976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.130990] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.200027] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.200047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.200060] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.200101] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3679 [D 20:42:43.200117] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:43.200137] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 3/70. [D 20:42:43.203802] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3679 [D 20:42:43.203834] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 4/70. [D 20:42:43.203886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13437. [D 20:42:43.203904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13438. [D 20:42:43.203919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13439. [D 20:42:43.203940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13440. [D 20:42:43.203956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13441. [D 20:42:43.203971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13442. [D 20:42:43.203986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13443. [D 20:42:43.204005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13444. [D 20:42:43.204020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13445. [D 20:42:43.204035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13446. [D 20:42:43.204049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13447. [D 20:42:43.204064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13448. [D 20:42:43.204079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13449. [D 20:42:43.204093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13450. [D 20:42:43.204108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13451. [D 20:42:43.204158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13452. [D 20:42:43.204173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13453. [D 20:42:43.204188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13454. [D 20:42:43.204202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13455. [D 20:42:43.204217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13456. [D 20:42:43.204232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13457. [D 20:42:43.204246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13458. [D 20:42:43.204261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13459. [D 20:42:43.204276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13460. [D 20:42:43.204291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13461. [D 20:42:43.204310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13462. [D 20:42:43.204327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13463. [D 20:42:43.204341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13464. [D 20:42:43.204357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13465. [D 20:42:43.204399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13466. [D 20:42:43.204419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13467. [D 20:42:43.204438] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13468. [D 20:42:43.209816] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13468. [D 20:42:43.209835] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 5/70. [D 20:42:43.209941] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.209992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.210006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.295431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.295454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.295467] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.295505] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3682 [D 20:42:43.295520] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:43.295541] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 6/70. [D 20:42:43.299278] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3682 [D 20:42:43.299344] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 7/70. [D 20:42:43.299410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13468. [D 20:42:43.299430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13469. [D 20:42:43.299452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13470. [D 20:42:43.299467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13471. [D 20:42:43.299482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13472. [D 20:42:43.299499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13473. [D 20:42:43.299519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13474. [D 20:42:43.299534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13475. [D 20:42:43.299549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13476. [D 20:42:43.299574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13477. [D 20:42:43.299589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13478. [D 20:42:43.299603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13479. [D 20:42:43.299622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13480. [D 20:42:43.299637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13481. [D 20:42:43.299652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13482. [D 20:42:43.299666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13483. [D 20:42:43.299681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13484. [D 20:42:43.299696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13485. [D 20:42:43.299762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13486. [D 20:42:43.299782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13487. [D 20:42:43.299800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13488. [D 20:42:43.299815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13489. [D 20:42:43.299829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13490. [D 20:42:43.299844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13491. [D 20:42:43.299858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13492. [D 20:42:43.299873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13493. [D 20:42:43.299888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13494. [D 20:42:43.299903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13495. [D 20:42:43.299917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13496. [D 20:42:43.299936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13497. [D 20:42:43.299950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13498. [D 20:42:43.299965] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13499. [D 20:42:43.305362] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13499. [D 20:42:43.305383] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 8/70. [D 20:42:43.305487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.305537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.305551] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.335609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.335630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.335643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.335681] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3686 [D 20:42:43.335696] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:43.335928] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 9/70. [D 20:42:43.342156] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3686 [D 20:42:43.342187] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 10/70. [D 20:42:43.342239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 13499. [D 20:42:43.342256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 13500. [D 20:42:43.342271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 13501. [D 20:42:43.342285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 13502. [D 20:42:43.342300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 13503. [D 20:42:43.342318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 13504. [D 20:42:43.342332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13505. [D 20:42:43.342347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13506. [D 20:42:43.342362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13507. [D 20:42:43.342376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 13508. [D 20:42:43.342391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 13509. [D 20:42:43.342406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 13510. [D 20:42:43.342421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 13511. [D 20:42:43.342436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 13512. [D 20:42:43.342475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13513. [D 20:42:43.342495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13514. [D 20:42:43.342510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13515. [D 20:42:43.342525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 13516. [D 20:42:43.342539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 13517. [D 20:42:43.342554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 13518. [D 20:42:43.342568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 13519. [D 20:42:43.342583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 13520. [D 20:42:43.342609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13521. [D 20:42:43.342625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13522. [D 20:42:43.342639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13523. [D 20:42:43.342657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 13524. [D 20:42:43.342673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 13525. [D 20:42:43.342688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 13526. [D 20:42:43.342702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 13527. [D 20:42:43.342725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 13528. [D 20:42:43.342782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13529. [D 20:42:43.342802] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13530. [D 20:42:43.348177] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13530. [D 20:42:43.348196] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 11/70. [D 20:42:43.351186] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.351207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.351222] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.371896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.371955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.371969] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.372013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3688 [D 20:42:43.372028] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:43.372048] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 12/70. [D 20:42:43.375580] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3688 [D 20:42:43.375610] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 13/70. [D 20:42:43.375673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13530. [D 20:42:43.375690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13531. [D 20:42:43.375705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13532. [D 20:42:43.375723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13533. [D 20:42:43.375750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13534. [D 20:42:43.375766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13535. [D 20:42:43.375780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13536. [D 20:42:43.375795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13537. [D 20:42:43.375810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13538. [D 20:42:43.375835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13539. [D 20:42:43.375858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13540. [D 20:42:43.375873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13541. [D 20:42:43.375887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13542. [D 20:42:43.375902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13543. [D 20:42:43.375917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13544. [D 20:42:43.375932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13545. [D 20:42:43.375946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13546. [D 20:42:43.375961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13547. [D 20:42:43.375975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13548. [D 20:42:43.376000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13549. [D 20:42:43.376018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13550. [D 20:42:43.376032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13551. [D 20:42:43.376048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13552. [D 20:42:43.376089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13553. [D 20:42:43.376108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13554. [D 20:42:43.376129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13555. [D 20:42:43.376143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13556. [D 20:42:43.376158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13557. [D 20:42:43.376173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13558. [D 20:42:43.376188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13559. [D 20:42:43.376202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13560. [D 20:42:43.376217] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13561. [D 20:42:43.381599] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13561. [D 20:42:43.381618] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 14/70. [D 20:42:43.381720] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.381779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.381793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.430563] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.430584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.430598] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.430637] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3691 [D 20:42:43.430652] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:43.430671] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 15/70. [D 20:42:43.434346] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3691 [D 20:42:43.434384] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 16/70. [D 20:42:43.434436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13561. [D 20:42:43.434453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13562. [D 20:42:43.434467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13563. [D 20:42:43.434482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13564. [D 20:42:43.434498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13565. [D 20:42:43.434512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13566. [D 20:42:43.434527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13567. [D 20:42:43.434546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13568. [D 20:42:43.434575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13569. [D 20:42:43.434591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13570. [D 20:42:43.434608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13571. [D 20:42:43.434624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13572. [D 20:42:43.434638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13573. [D 20:42:43.434660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13574. [D 20:42:43.434694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13575. [D 20:42:43.434708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13576. [D 20:42:43.434729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13577. [D 20:42:43.434743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13578. [D 20:42:43.434758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13579. [D 20:42:43.434773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13580. [D 20:42:43.434788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13581. [D 20:42:43.434802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13582. [D 20:42:43.434817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13583. [D 20:42:43.434831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13584. [D 20:42:43.434846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13585. [D 20:42:43.434861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13586. [D 20:42:43.434876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13587. [D 20:42:43.434915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13588. [D 20:42:43.434930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13589. [D 20:42:43.434954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13590. [D 20:42:43.434969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13591. [D 20:42:43.434984] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13592. [D 20:42:43.440387] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13592. [D 20:42:43.440406] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 17/70. [D 20:42:43.440510] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.440562] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.440576] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.513676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.513698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.513711] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.513748] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3695 [D 20:42:43.513763] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:43.513783] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 18/70. [D 20:42:43.517454] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3695 [D 20:42:43.517491] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 19/70. [D 20:42:43.517541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 13592. [D 20:42:43.517558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 13593. [D 20:42:43.517572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 13594. [D 20:42:43.517588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 13595. [D 20:42:43.517602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 13596. [D 20:42:43.517632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 13597. [D 20:42:43.517648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13598. [D 20:42:43.517663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13599. [D 20:42:43.517678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13600. [D 20:42:43.517693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 13601. [D 20:42:43.517707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 13602. [D 20:42:43.517722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 13603. [D 20:42:43.517738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 13604. [D 20:42:43.517752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 13605. [D 20:42:43.517767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13606. [D 20:42:43.517802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13607. [D 20:42:43.517816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13608. [D 20:42:43.517837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 13609. [D 20:42:43.517852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 13610. [D 20:42:43.517867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 13611. [D 20:42:43.517881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 13612. [D 20:42:43.517896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 13613. [D 20:42:43.517911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13614. [D 20:42:43.517926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13615. [D 20:42:43.517944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13616. [D 20:42:43.517961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 13617. [D 20:42:43.517976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 13618. [D 20:42:43.517990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 13619. [D 20:42:43.518005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 13620. [D 20:42:43.518050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 13621. [D 20:42:43.518086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13622. [D 20:42:43.518101] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13623. [D 20:42:43.523476] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13623. [D 20:42:43.523496] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 20/70. [D 20:42:43.523598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.523649] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.523663] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.611919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.611940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.611953] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.611991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3697 [D 20:42:43.612006] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:43.612025] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 21/70. [D 20:42:43.615560] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3697 [D 20:42:43.615592] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 22/70. [D 20:42:43.615650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13623. [D 20:42:43.615669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13624. [D 20:42:43.615684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13625. [D 20:42:43.615699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13626. [D 20:42:43.615714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13627. [D 20:42:43.615737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13628. [D 20:42:43.615751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13629. [D 20:42:43.615766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13630. [D 20:42:43.615796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13631. [D 20:42:43.615811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13632. [D 20:42:43.615826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13633. [D 20:42:43.615840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13634. [D 20:42:43.615855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13635. [D 20:42:43.615870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13636. [D 20:42:43.615884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13637. [D 20:42:43.615899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13638. [D 20:42:43.615914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13639. [D 20:42:43.615928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13640. [D 20:42:43.615943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13641. [D 20:42:43.615959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13642. [D 20:42:43.615996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13643. [D 20:42:43.616015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13644. [D 20:42:43.616035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13645. [D 20:42:43.616050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13646. [D 20:42:43.616065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13647. [D 20:42:43.616093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13648. [D 20:42:43.616108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13649. [D 20:42:43.616123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13650. [D 20:42:43.616138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13651. [D 20:42:43.616156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13652. [D 20:42:43.616171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13653. [D 20:42:43.616186] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13654. [D 20:42:43.621578] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13654. [D 20:42:43.621598] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 23/70. [D 20:42:43.621700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.621751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.621765] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.672604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.672625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.672638] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.672676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3700 [D 20:42:43.672690] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:43.672709] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 24/70. [D 20:42:43.676395] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3700 [D 20:42:43.676431] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 25/70. [D 20:42:43.676483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 13654. [D 20:42:43.676500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 13655. [D 20:42:43.676527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 13656. [D 20:42:43.676545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 13657. [D 20:42:43.676560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 13658. [D 20:42:43.676575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 13659. [D 20:42:43.676594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 13660. [D 20:42:43.676609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 13661. [D 20:42:43.676624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 13662. [D 20:42:43.676639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 13663. [D 20:42:43.676654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 13664. [D 20:42:43.676669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 13665. [D 20:42:43.676683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 13666. [D 20:42:43.676698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 13667. [D 20:42:43.676743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 13668. [D 20:42:43.676757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 13669. [D 20:42:43.676778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 13670. [D 20:42:43.676792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 13671. [D 20:42:43.676807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 13672. [D 20:42:43.676822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 13673. [D 20:42:43.676837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 13674. [D 20:42:43.676851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 13675. [D 20:42:43.676866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 13676. [D 20:42:43.676883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 13677. [D 20:42:43.676900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 13678. [D 20:42:43.676915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 13679. [D 20:42:43.676930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 13680. [D 20:42:43.676991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 13681. [D 20:42:43.677010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13682. [D 20:42:43.677027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13683. [D 20:42:43.677041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13684. [D 20:42:43.677056] openib_post_sr_rdmaw: ibv_post_send wr_id 63a010 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13685. [D 20:42:43.682415] openib_check_cq: completed rdma wr_id 63a010, nic_wr_credit 13685. [D 20:42:43.682435] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 26/70. [D 20:42:43.682537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.682587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.682602] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.810062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.810083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.810097] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.810134] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3703 [D 20:42:43.810149] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:43.810169] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 27/70. [D 20:42:43.813851] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3703 [D 20:42:43.813883] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 28/70. [D 20:42:43.813940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13685. [D 20:42:43.813957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13686. [D 20:42:43.813972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13687. [D 20:42:43.813987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13688. [D 20:42:43.814002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13689. [D 20:42:43.814017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13690. [D 20:42:43.814031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13691. [D 20:42:43.814050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13692. [D 20:42:43.814066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13693. [D 20:42:43.814080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13694. [D 20:42:43.814113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13695. [D 20:42:43.814129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13696. [D 20:42:43.814144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13697. [D 20:42:43.814166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13698. [D 20:42:43.814199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13699. [D 20:42:43.814214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13700. [D 20:42:43.814235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13701. [D 20:42:43.814250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13702. [D 20:42:43.814265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13703. [D 20:42:43.814280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13704. [D 20:42:43.814294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13705. [D 20:42:43.814309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13706. [D 20:42:43.814324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13707. [D 20:42:43.814338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13708. [D 20:42:43.814353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13709. [D 20:42:43.814368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13710. [D 20:42:43.814383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13711. [D 20:42:43.814398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13712. [D 20:42:43.814449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13713. [D 20:42:43.814466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13714. [D 20:42:43.814481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13715. [D 20:42:43.814496] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13716. [D 20:42:43.819889] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13716. [D 20:42:43.819908] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 29/70. [D 20:42:43.820010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.820062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.820076] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.872609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.872630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.872643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.872681] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3706 [D 20:42:43.872696] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:43.872715] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 30/70. [D 20:42:43.876387] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3706 [D 20:42:43.876422] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 31/70. [D 20:42:43.876473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13716. [D 20:42:43.876490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13717. [D 20:42:43.876505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13718. [D 20:42:43.876520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13719. [D 20:42:43.876534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13720. [D 20:42:43.876550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13721. [D 20:42:43.876564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13722. [D 20:42:43.876594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13723. [D 20:42:43.876610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13724. [D 20:42:43.876625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13725. [D 20:42:43.876639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13726. [D 20:42:43.876654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13727. [D 20:42:43.876669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13728. [D 20:42:43.876683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13729. [D 20:42:43.876699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13730. [D 20:42:43.876731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13731. [D 20:42:43.876745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13732. [D 20:42:43.876766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13733. [D 20:42:43.876781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13734. [D 20:42:43.876795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13735. [D 20:42:43.876810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13736. [D 20:42:43.876825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13737. [D 20:42:43.876839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13738. [D 20:42:43.876854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13739. [D 20:42:43.876873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13740. [D 20:42:43.876890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13741. [D 20:42:43.876905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13742. [D 20:42:43.876927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13743. [D 20:42:43.876967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13744. [D 20:42:43.876983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13745. [D 20:42:43.877005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13746. [D 20:42:43.877031] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13747. [D 20:42:43.882403] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13747. [D 20:42:43.882423] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 32/70. [D 20:42:43.882525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.882575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.882589] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.918037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.918057] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.918070] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.918107] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3709 [D 20:42:43.918122] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:43.918141] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 33/70. [D 20:42:43.921755] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3709 [D 20:42:43.921792] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 34/70. [D 20:42:43.921844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 13747. [D 20:42:43.921861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 13748. [D 20:42:43.921876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 13749. [D 20:42:43.921891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 13750. [D 20:42:43.921906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 13751. [D 20:42:43.921920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 13752. [D 20:42:43.921935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 13753. [D 20:42:43.921954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13754. [D 20:42:43.921969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13755. [D 20:42:43.921984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13756. [D 20:42:43.921999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 13757. [D 20:42:43.922016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 13758. [D 20:42:43.922032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 13759. [D 20:42:43.922058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 13760. [D 20:42:43.922072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 13761. [D 20:42:43.922119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13762. [D 20:42:43.922139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13763. [D 20:42:43.922153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13764. [D 20:42:43.922168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 13765. [D 20:42:43.922183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 13766. [D 20:42:43.922198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 13767. [D 20:42:43.922212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 13768. [D 20:42:43.922227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 13769. [D 20:42:43.922242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13770. [D 20:42:43.922256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13771. [D 20:42:43.922273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13772. [D 20:42:43.922290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 13773. [D 20:42:43.922305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 13774. [D 20:42:43.922320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 13775. [D 20:42:43.922362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 13776. [D 20:42:43.922377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 13777. [D 20:42:43.922401] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13778. [D 20:42:43.927733] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13778. [D 20:42:43.927752] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 35/70. [D 20:42:43.927856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.927908] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.927922] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:43.976775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:43.976796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.976809] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:43.976846] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3712 [D 20:42:43.976861] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:43.976880] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 36/70. [D 20:42:43.980591] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3712 [D 20:42:43.980628] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 37/70. [D 20:42:43.980682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13778. [D 20:42:43.980699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13779. [D 20:42:43.980714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13780. [D 20:42:43.980729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13781. [D 20:42:43.980744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13782. [D 20:42:43.980759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13783. [D 20:42:43.980774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13784. [D 20:42:43.980806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13785. [D 20:42:43.980821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13786. [D 20:42:43.980836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13787. [D 20:42:43.980851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13788. [D 20:42:43.980865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13789. [D 20:42:43.980880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13790. [D 20:42:43.980895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13791. [D 20:42:43.980938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13792. [D 20:42:43.980953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13793. [D 20:42:43.980973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13794. [D 20:42:43.980988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13795. [D 20:42:43.981003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13796. [D 20:42:43.981017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13797. [D 20:42:43.981032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13798. [D 20:42:43.981046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13799. [D 20:42:43.981061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13800. [D 20:42:43.981080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13801. [D 20:42:43.981096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13802. [D 20:42:43.981111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13803. [D 20:42:43.981126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13804. [D 20:42:43.981147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13805. [D 20:42:43.981189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13806. [D 20:42:43.981227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13807. [D 20:42:43.981243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13808. [D 20:42:43.981257] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13809. [D 20:42:43.986562] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13809. [D 20:42:43.986582] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 38/70. [D 20:42:43.986682] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:43.986735] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:43.986749] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.029913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.029934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.029947] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.029984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3716 [D 20:42:44.030000] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:44.030019] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 39/70. [D 20:42:44.033598] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3716 [D 20:42:44.033629] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 40/70. [D 20:42:44.033687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 13809. [D 20:42:44.033704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 13810. [D 20:42:44.033719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 13811. [D 20:42:44.033734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 13812. [D 20:42:44.033749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 13813. [D 20:42:44.033764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 13814. [D 20:42:44.033785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 13815. [D 20:42:44.033822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 13816. [D 20:42:44.033838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 13817. [D 20:42:44.033852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 13818. [D 20:42:44.033867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 13819. [D 20:42:44.033882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 13820. [D 20:42:44.033897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 13821. [D 20:42:44.033912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 13822. [D 20:42:44.033927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 13823. [D 20:42:44.033942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 13824. [D 20:42:44.033975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 13825. [D 20:42:44.033994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 13826. [D 20:42:44.034014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 13827. [D 20:42:44.034030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 13828. [D 20:42:44.034045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 13829. [D 20:42:44.034063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 13830. [D 20:42:44.034078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 13831. [D 20:42:44.034093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 13832. [D 20:42:44.034108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 13833. [D 20:42:44.034134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 13834. [D 20:42:44.034150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 13835. [D 20:42:44.034164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 13836. [D 20:42:44.034179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 13837. [D 20:42:44.034252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 13838. [D 20:42:44.034283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 13839. [D 20:42:44.034298] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 13840. [D 20:42:44.044722] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13840. [D 20:42:44.044747] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 41/70. [D 20:42:44.044887] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.044947] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.044961] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.051085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.051107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.051120] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.051159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3718 [D 20:42:44.051175] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:44.051197] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 42/70. [D 20:42:44.054837] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3718 [D 20:42:44.054866] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 43/70. [D 20:42:44.054926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13840. [D 20:42:44.054943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13841. [D 20:42:44.054961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 13842. [D 20:42:44.054977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 13843. [D 20:42:44.054992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 13844. [D 20:42:44.055007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 13845. [D 20:42:44.055022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 13846. [D 20:42:44.055043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13847. [D 20:42:44.055058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13848. [D 20:42:44.055073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13849. [D 20:42:44.055102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 13850. [D 20:42:44.055117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 13851. [D 20:42:44.055131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 13852. [D 20:42:44.055148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 13853. [D 20:42:44.055162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 13854. [D 20:42:44.055183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13855. [D 20:42:44.055215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13856. [D 20:42:44.055230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13857. [D 20:42:44.055253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13858. [D 20:42:44.055269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13859. [D 20:42:44.055284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13860. [D 20:42:44.055298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13861. [D 20:42:44.055313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13862. [D 20:42:44.055343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13863. [D 20:42:44.055358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13864. [D 20:42:44.055373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13865. [D 20:42:44.055387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13866. [D 20:42:44.055402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13867. [D 20:42:44.055417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13868. [D 20:42:44.055431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13869. [D 20:42:44.055446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13870. [D 20:42:44.055461] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13871. [D 20:42:44.060849] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13871. [D 20:42:44.060869] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 44/70. [D 20:42:44.060972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.061033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.061046] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.075663] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.075683] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.075697] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.075740] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3722 [D 20:42:44.075756] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:44.075776] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 45/70. [D 20:42:44.079391] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3722 [D 20:42:44.079428] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 46/70. [D 20:42:44.079479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 13871. [D 20:42:44.079496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 13872. [D 20:42:44.079510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 13873. [D 20:42:44.079526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 13874. [D 20:42:44.079540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 13875. [D 20:42:44.079555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 13876. [D 20:42:44.079570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 13877. [D 20:42:44.079601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 13878. [D 20:42:44.079616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 13879. [D 20:42:44.079631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 13880. [D 20:42:44.079646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 13881. [D 20:42:44.079661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 13882. [D 20:42:44.079675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 13883. [D 20:42:44.079690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 13884. [D 20:42:44.079753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 13885. [D 20:42:44.079774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 13886. [D 20:42:44.079789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 13887. [D 20:42:44.079803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 13888. [D 20:42:44.079818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 13889. [D 20:42:44.079833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 13890. [D 20:42:44.079847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 13891. [D 20:42:44.079862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 13892. [D 20:42:44.079876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 13893. [D 20:42:44.079895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 13894. [D 20:42:44.079911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 13895. [D 20:42:44.079926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 13896. [D 20:42:44.079940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 13897. [D 20:42:44.079956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 13898. [D 20:42:44.079970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 13899. [D 20:42:44.079985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 13900. [D 20:42:44.080000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 13901. [D 20:42:44.080015] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 13902. [D 20:42:44.085455] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13902. [D 20:42:44.085474] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 47/70. [D 20:42:44.085577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.085629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.085643] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.129809] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.129830] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.129843] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.129880] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3724 [D 20:42:44.129895] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:44.129914] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 48/70. [D 20:42:44.133570] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3724 [D 20:42:44.133608] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 49/70. [D 20:42:44.133662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 13902. [D 20:42:44.133679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 13903. [D 20:42:44.133707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 13904. [D 20:42:44.133724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 13905. [D 20:42:44.133739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 13906. [D 20:42:44.133753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 13907. [D 20:42:44.133768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 13908. [D 20:42:44.133783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13909. [D 20:42:44.133798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13910. [D 20:42:44.133813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13911. [D 20:42:44.133827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 13912. [D 20:42:44.133842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 13913. [D 20:42:44.133857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 13914. [D 20:42:44.133871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 13915. [D 20:42:44.133916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 13916. [D 20:42:44.133931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13917. [D 20:42:44.133951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13918. [D 20:42:44.133966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13919. [D 20:42:44.133981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 13920. [D 20:42:44.133995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 13921. [D 20:42:44.134010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 13922. [D 20:42:44.134025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 13923. [D 20:42:44.134039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 13924. [D 20:42:44.134058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13925. [D 20:42:44.134087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13926. [D 20:42:44.134103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13927. [D 20:42:44.134147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 13928. [D 20:42:44.134168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 13929. [D 20:42:44.134188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 13930. [D 20:42:44.134203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 13931. [D 20:42:44.134218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 13932. [D 20:42:44.134232] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13933. [D 20:42:44.139581] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13933. [D 20:42:44.139601] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 50/70. [D 20:42:44.139703] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.139761] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.139774] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.239048] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.239070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.239083] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.239121] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3727 [D 20:42:44.239136] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:44.239155] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 51/70. [D 20:42:44.242868] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3727 [D 20:42:44.242905] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 52/70. [D 20:42:44.242955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 13933. [D 20:42:44.242972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 13934. [D 20:42:44.242987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 13935. [D 20:42:44.243002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 13936. [D 20:42:44.243017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 13937. [D 20:42:44.243032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 13938. [D 20:42:44.243047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 13939. [D 20:42:44.243078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 13940. [D 20:42:44.243093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 13941. [D 20:42:44.243108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 13942. [D 20:42:44.243123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 13943. [D 20:42:44.243138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 13944. [D 20:42:44.243152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 13945. [D 20:42:44.243167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 13946. [D 20:42:44.243182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 13947. [D 20:42:44.243214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 13948. [D 20:42:44.243230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 13949. [D 20:42:44.243250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 13950. [D 20:42:44.243265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 13951. [D 20:42:44.243280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 13952. [D 20:42:44.243294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 13953. [D 20:42:44.243309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 13954. [D 20:42:44.243324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 13955. [D 20:42:44.243338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 13956. [D 20:42:44.243356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 13957. [D 20:42:44.243373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 13958. [D 20:42:44.243388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 13959. [D 20:42:44.243403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 13960. [D 20:42:44.243446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 13961. [D 20:42:44.243469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 13962. [D 20:42:44.243502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 13963. [D 20:42:44.243516] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 13964. [D 20:42:44.248881] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13964. [D 20:42:44.248901] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 53/70. [D 20:42:44.249002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.249055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.249069] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.369569] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.369590] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.369603] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.369640] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3730 [D 20:42:44.369656] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:44.369675] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 54/70. [D 20:42:44.373457] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3730 [D 20:42:44.373493] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 55/70. [D 20:42:44.373546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 13964. [D 20:42:44.373562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 13965. [D 20:42:44.373577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 13966. [D 20:42:44.373592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 13967. [D 20:42:44.373607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 13968. [D 20:42:44.373622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 13969. [D 20:42:44.373654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 13970. [D 20:42:44.373669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13971. [D 20:42:44.373683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13972. [D 20:42:44.373698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13973. [D 20:42:44.373713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 13974. [D 20:42:44.373728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 13975. [D 20:42:44.373742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 13976. [D 20:42:44.373757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 13977. [D 20:42:44.373772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 13978. [D 20:42:44.373804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13979. [D 20:42:44.373819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13980. [D 20:42:44.373839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13981. [D 20:42:44.373854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 13982. [D 20:42:44.373868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 13983. [D 20:42:44.373883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 13984. [D 20:42:44.373898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 13985. [D 20:42:44.373913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 13986. [D 20:42:44.373928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13987. [D 20:42:44.373946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13988. [D 20:42:44.373962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13989. [D 20:42:44.373977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 13990. [D 20:42:44.373992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 13991. [D 20:42:44.374007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 13992. [D 20:42:44.374052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 13993. [D 20:42:44.374075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 13994. [D 20:42:44.374090] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13995. [D 20:42:44.379432] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 13995. [D 20:42:44.379452] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 56/70. [D 20:42:44.379553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.379608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.379622] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.443436] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.443457] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.443470] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.443508] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3734 [D 20:42:44.443523] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:44.443543] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 57/70. [D 20:42:44.447189] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3734 [D 20:42:44.447227] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 58/70. [D 20:42:44.447279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13995. [D 20:42:44.447308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 13996. [D 20:42:44.447324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 13997. [D 20:42:44.447338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 13998. [D 20:42:44.447354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 13999. [D 20:42:44.447368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14000. [D 20:42:44.447388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14001. [D 20:42:44.447403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14002. [D 20:42:44.447418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14003. [D 20:42:44.447433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14004. [D 20:42:44.447458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14005. [D 20:42:44.447472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14006. [D 20:42:44.447487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14007. [D 20:42:44.447506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 14008. [D 20:42:44.447521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14009. [D 20:42:44.447535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14010. [D 20:42:44.447550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14011. [D 20:42:44.447565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14012. [D 20:42:44.447580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14013. [D 20:42:44.447594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14014. [D 20:42:44.447623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14015. [D 20:42:44.447643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14016. [D 20:42:44.447662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14017. [D 20:42:44.447677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14018. [D 20:42:44.447692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14019. [D 20:42:44.447707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14020. [D 20:42:44.447721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14021. [D 20:42:44.447741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14022. [D 20:42:44.447756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14023. [D 20:42:44.447770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14024. [D 20:42:44.447785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14025. [D 20:42:44.447804] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14026. [D 20:42:44.453175] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14026. [D 20:42:44.453195] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 59/70. [D 20:42:44.453296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.453350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.453364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.469676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.469698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.469711] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.469749] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3736 [D 20:42:44.469764] element 0: offset: 0x2aaaab605950, size: 24 [D 20:42:44.469783] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 60/70. [D 20:42:44.473478] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3736 [D 20:42:44.473509] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 0/70. [D 20:42:44.473560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14026. [D 20:42:44.473576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14027. [D 20:42:44.473592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14028. [D 20:42:44.473606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14029. [D 20:42:44.473621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14030. [D 20:42:44.473636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14031. [D 20:42:44.473650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14032. [D 20:42:44.473665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14033. [D 20:42:44.473680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14034. [D 20:42:44.473695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14035. [D 20:42:44.473710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14036. [D 20:42:44.473725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14037. [D 20:42:44.473747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14038. [D 20:42:44.473785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14039. [D 20:42:44.473805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14040. [D 20:42:44.473819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14041. [D 20:42:44.473834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14042. [D 20:42:44.473849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14043. [D 20:42:44.473864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14044. [D 20:42:44.473878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14045. [D 20:42:44.473893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14046. [D 20:42:44.473908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14047. [D 20:42:44.473922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14048. [D 20:42:44.473949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14049. [D 20:42:44.473964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14050. [D 20:42:44.473979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14051. [D 20:42:44.474030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14052. [D 20:42:44.474046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14053. [D 20:42:44.474068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14054. [D 20:42:44.474083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14055. [D 20:42:44.474097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14056. [D 20:42:44.474112] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14057. [D 20:42:44.478841] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.478905] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.478920] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:44.478965] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3739 [D 20:42:44.478980] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:44.479000] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 1/70. [D 20:42:44.479479] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14057. [D 20:42:44.479502] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 2/70. [D 20:42:44.479688] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.479710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.479729] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:44.482902] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3739 [D 20:42:44.482928] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 3/70. [D 20:42:44.482978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14057. [D 20:42:44.482997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14058. [D 20:42:44.483012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14059. [D 20:42:44.483026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14060. [D 20:42:44.483041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14061. [D 20:42:44.483056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14062. [D 20:42:44.483070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14063. [D 20:42:44.483088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14064. [D 20:42:44.483102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14065. [D 20:42:44.483117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14066. [D 20:42:44.483132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14067. [D 20:42:44.483147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14068. [D 20:42:44.483161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14069. [D 20:42:44.483176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14070. [D 20:42:44.483195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14071. [D 20:42:44.483211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14072. [D 20:42:44.483226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14073. [D 20:42:44.483241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14074. [D 20:42:44.483295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14075. [D 20:42:44.483316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14076. [D 20:42:44.483332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14077. [D 20:42:44.483346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14078. [D 20:42:44.483361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14079. [D 20:42:44.483376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14080. [D 20:42:44.483390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14081. [D 20:42:44.483405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14082. [D 20:42:44.483420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14083. [D 20:42:44.483434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14084. [D 20:42:44.483461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14085. [D 20:42:44.483477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14086. [D 20:42:44.483491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14087. [D 20:42:44.483506] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14088. [D 20:42:44.488858] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14088. [D 20:42:44.488878] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 4/70. [D 20:42:44.488985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.489040] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.489053] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.560347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.560369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.560382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.560422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3742 [D 20:42:44.560437] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:44.560456] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 5/70. [D 20:42:44.564024] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3742 [D 20:42:44.564056] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 6/70. [D 20:42:44.564110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 14088. [D 20:42:44.564127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 14089. [D 20:42:44.564142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14090. [D 20:42:44.564157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14091. [D 20:42:44.564175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14092. [D 20:42:44.564189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14093. [D 20:42:44.564204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14094. [D 20:42:44.564219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14095. [D 20:42:44.564234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14096. [D 20:42:44.564256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14097. [D 20:42:44.564288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14098. [D 20:42:44.564302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14099. [D 20:42:44.564322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14100. [D 20:42:44.564336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14101. [D 20:42:44.564351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14102. [D 20:42:44.564365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14103. [D 20:42:44.564380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14104. [D 20:42:44.564395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14105. [D 20:42:44.564409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14106. [D 20:42:44.564424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14107. [D 20:42:44.564439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14108. [D 20:42:44.564466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14109. [D 20:42:44.564518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14110. [D 20:42:44.564535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14111. [D 20:42:44.564555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14112. [D 20:42:44.564569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14113. [D 20:42:44.564584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14114. [D 20:42:44.564599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14115. [D 20:42:44.564614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14116. [D 20:42:44.564628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14117. [D 20:42:44.564647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14118. [D 20:42:44.564662] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14119. [D 20:42:44.570055] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14119. [D 20:42:44.570074] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 7/70. [D 20:42:44.570179] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.570238] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.570252] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.668260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.668281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.668294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.668334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3746 [D 20:42:44.668349] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:44.668369] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 8/70. [D 20:42:44.671761] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3746 [D 20:42:44.671785] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 9/70. [D 20:42:44.673171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14119. [D 20:42:44.673192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 14120. [D 20:42:44.673209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 14121. [D 20:42:44.673224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 14122. [D 20:42:44.673239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 14123. [D 20:42:44.673253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14124. [D 20:42:44.673268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14125. [D 20:42:44.673283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14126. [D 20:42:44.673298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14127. [D 20:42:44.673320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14128. [D 20:42:44.673334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14129. [D 20:42:44.673349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14130. [D 20:42:44.673368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14131. [D 20:42:44.673383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 14132. [D 20:42:44.673398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14133. [D 20:42:44.673413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14134. [D 20:42:44.673427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14135. [D 20:42:44.673442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14136. [D 20:42:44.673457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14137. [D 20:42:44.673492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14138. [D 20:42:44.673507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14139. [D 20:42:44.673532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14140. [D 20:42:44.673547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14141. [D 20:42:44.673562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14142. [D 20:42:44.673576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14143. [D 20:42:44.673591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14144. [D 20:42:44.673608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14145. [D 20:42:44.673623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14146. [D 20:42:44.673638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14147. [D 20:42:44.673652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14148. [D 20:42:44.673672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14149. [D 20:42:44.673699] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14150. [D 20:42:44.675751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.675772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.675798] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:44.675848] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3748 [D 20:42:44.675864] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:44.675899] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 10/70. [D 20:42:44.679149] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14150. [D 20:42:44.679171] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 11/70. [D 20:42:44.679922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.679978] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.679991] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:44.683383] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3748 [D 20:42:44.683412] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 12/70. [D 20:42:44.683464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14150. [D 20:42:44.683482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14151. [D 20:42:44.683497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14152. [D 20:42:44.683512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14153. [D 20:42:44.683536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14154. [D 20:42:44.683551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14155. [D 20:42:44.683565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14156. [D 20:42:44.683585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14157. [D 20:42:44.683603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14158. [D 20:42:44.683619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14159. [D 20:42:44.683634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14160. [D 20:42:44.683649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14161. [D 20:42:44.683663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14162. [D 20:42:44.683678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14163. [D 20:42:44.683693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14164. [D 20:42:44.683707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14165. [D 20:42:44.683722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14166. [D 20:42:44.683742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14167. [D 20:42:44.683784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14168. [D 20:42:44.683798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14169. [D 20:42:44.683813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14170. [D 20:42:44.683828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14171. [D 20:42:44.683843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14172. [D 20:42:44.683857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14173. [D 20:42:44.683872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14174. [D 20:42:44.683886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14175. [D 20:42:44.683901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14176. [D 20:42:44.683915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14177. [D 20:42:44.683931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14178. [D 20:42:44.683946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14179. [D 20:42:44.683960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14180. [D 20:42:44.684003] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14181. [D 20:42:44.689401] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14181. [D 20:42:44.689421] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 13/70. [D 20:42:44.689521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.689566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.689579] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.721867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.721888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.721901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.721940] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3751 [D 20:42:44.721956] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:44.721975] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 14/70. [D 20:42:44.725592] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3751 [D 20:42:44.725629] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 15/70. [D 20:42:44.725684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 14181. [D 20:42:44.725701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 14182. [D 20:42:44.725737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14183. [D 20:42:44.725752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14184. [D 20:42:44.725767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14185. [D 20:42:44.725784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14186. [D 20:42:44.725803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14187. [D 20:42:44.725818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14188. [D 20:42:44.725839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14189. [D 20:42:44.725863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14190. [D 20:42:44.725878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14191. [D 20:42:44.725893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14192. [D 20:42:44.725912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14193. [D 20:42:44.725926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14194. [D 20:42:44.725941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14195. [D 20:42:44.725956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14196. [D 20:42:44.725971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14197. [D 20:42:44.725986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14198. [D 20:42:44.726001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14199. [D 20:42:44.726036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14200. [D 20:42:44.726054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14201. [D 20:42:44.726074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14202. [D 20:42:44.726089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14203. [D 20:42:44.726104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14204. [D 20:42:44.726118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14205. [D 20:42:44.726136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14206. [D 20:42:44.726151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14207. [D 20:42:44.726165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14208. [D 20:42:44.726180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14209. [D 20:42:44.726199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14210. [D 20:42:44.726214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14211. [D 20:42:44.726229] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14212. [D 20:42:44.731604] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14212. [D 20:42:44.731624] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 16/70. [D 20:42:44.731727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.731781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.731794] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.897295] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.897316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.897330] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.897367] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3754 [D 20:42:44.897382] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:44.897402] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 17/70. [D 20:42:44.900999] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3754 [D 20:42:44.901027] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 18/70. [D 20:42:44.901089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14212. [D 20:42:44.901105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14213. [D 20:42:44.901120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14214. [D 20:42:44.901144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14215. [D 20:42:44.901159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14216. [D 20:42:44.901173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14217. [D 20:42:44.901188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14218. [D 20:42:44.901207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14219. [D 20:42:44.901236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14220. [D 20:42:44.901251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14221. [D 20:42:44.901266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14222. [D 20:42:44.901280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14223. [D 20:42:44.901295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14224. [D 20:42:44.901337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14225. [D 20:42:44.901352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14226. [D 20:42:44.901373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14227. [D 20:42:44.901387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14228. [D 20:42:44.901403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14229. [D 20:42:44.901417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14230. [D 20:42:44.901432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14231. [D 20:42:44.901447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14232. [D 20:42:44.901461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14233. [D 20:42:44.901476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14234. [D 20:42:44.901494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14235. [D 20:42:44.901509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14236. [D 20:42:44.901524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14237. [D 20:42:44.901575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14238. [D 20:42:44.901596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14239. [D 20:42:44.901611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14240. [D 20:42:44.901626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14241. [D 20:42:44.901641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14242. [D 20:42:44.901656] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14243. [D 20:42:44.906969] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14243. [D 20:42:44.906990] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 19/70. [D 20:42:44.907091] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.907142] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.907156] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:44.929045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:44.929066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.929079] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:44.929116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3757 [D 20:42:44.929132] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:44.929151] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 20/70. [D 20:42:44.932752] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3757 [D 20:42:44.932779] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 21/70. [D 20:42:44.932838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 14243. [D 20:42:44.932855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 14244. [D 20:42:44.932869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14245. [D 20:42:44.932885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14246. [D 20:42:44.932899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14247. [D 20:42:44.932930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14248. [D 20:42:44.932945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14249. [D 20:42:44.932960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14250. [D 20:42:44.932975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14251. [D 20:42:44.932990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14252. [D 20:42:44.933005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14253. [D 20:42:44.933019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14254. [D 20:42:44.933034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14255. [D 20:42:44.933049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14256. [D 20:42:44.933064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14257. [D 20:42:44.933110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14258. [D 20:42:44.933130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14259. [D 20:42:44.933145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14260. [D 20:42:44.933159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14261. [D 20:42:44.933174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14262. [D 20:42:44.933189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14263. [D 20:42:44.933204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14264. [D 20:42:44.933218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14265. [D 20:42:44.933233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14266. [D 20:42:44.933248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14267. [D 20:42:44.933264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14268. [D 20:42:44.933280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14269. [D 20:42:44.933295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14270. [D 20:42:44.933310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14271. [D 20:42:44.933364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14272. [D 20:42:44.933380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14273. [D 20:42:44.933395] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14274. [D 20:42:44.938781] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14274. [D 20:42:44.938803] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 22/70. [D 20:42:44.938902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:44.938955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:44.938969] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.023519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.023541] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.023554] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.023592] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3761 [D 20:42:45.023607] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:45.023627] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 23/70. [D 20:42:45.027222] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3761 [D 20:42:45.027258] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 24/70. [D 20:42:45.027313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14274. [D 20:42:45.027330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 14275. [D 20:42:45.027345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 14276. [D 20:42:45.027375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 14277. [D 20:42:45.027391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 14278. [D 20:42:45.027405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14279. [D 20:42:45.027420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14280. [D 20:42:45.027435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14281. [D 20:42:45.027449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14282. [D 20:42:45.027464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14283. [D 20:42:45.027479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14284. [D 20:42:45.027494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14285. [D 20:42:45.027509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14286. [D 20:42:45.027524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 14287. [D 20:42:45.027568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14288. [D 20:42:45.027582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14289. [D 20:42:45.027603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14290. [D 20:42:45.027618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14291. [D 20:42:45.027632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14292. [D 20:42:45.027647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14293. [D 20:42:45.027662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14294. [D 20:42:45.027676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14295. [D 20:42:45.027691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14296. [D 20:42:45.027718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14297. [D 20:42:45.027737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14298. [D 20:42:45.027751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14299. [D 20:42:45.027767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14300. [D 20:42:45.027805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14301. [D 20:42:45.027820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14302. [D 20:42:45.027845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14303. [D 20:42:45.027860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14304. [D 20:42:45.027875] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14305. [D 20:42:45.033247] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14305. [D 20:42:45.033267] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 25/70. [D 20:42:45.033367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.033419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.033432] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.091684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.091705] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.091718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.091760] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3763 [D 20:42:45.091776] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:45.091795] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 26/70. [D 20:42:45.095387] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3763 [D 20:42:45.095424] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 27/70. [D 20:42:45.095475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14305. [D 20:42:45.095492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14306. [D 20:42:45.095507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14307. [D 20:42:45.095536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14308. [D 20:42:45.095552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14309. [D 20:42:45.095566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14310. [D 20:42:45.095581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14311. [D 20:42:45.095596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14312. [D 20:42:45.095611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14313. [D 20:42:45.095626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14314. [D 20:42:45.095640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14315. [D 20:42:45.095655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14316. [D 20:42:45.095670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14317. [D 20:42:45.095685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14318. [D 20:42:45.095700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14319. [D 20:42:45.095735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14320. [D 20:42:45.095750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14321. [D 20:42:45.095771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14322. [D 20:42:45.095785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14323. [D 20:42:45.095800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14324. [D 20:42:45.095815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14325. [D 20:42:45.095829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14326. [D 20:42:45.095844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14327. [D 20:42:45.095859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14328. [D 20:42:45.095874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14329. [D 20:42:45.095893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14330. [D 20:42:45.095908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14331. [D 20:42:45.095923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14332. [D 20:42:45.095950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14333. [D 20:42:45.095966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14334. [D 20:42:45.095981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14335. [D 20:42:45.095998] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14336. [D 20:42:45.101436] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14336. [D 20:42:45.101457] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 28/70. [D 20:42:45.101558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.101608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.101622] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.173325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.173346] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.173359] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.173396] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3767 [D 20:42:45.173411] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:45.173430] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 29/70. [D 20:42:45.177000] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3767 [D 20:42:45.177026] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 30/70. [D 20:42:45.177085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 14336. [D 20:42:45.177103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 14337. [D 20:42:45.177120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 14338. [D 20:42:45.177134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 14339. [D 20:42:45.177153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 14340. [D 20:42:45.177174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 14341. [D 20:42:45.177189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14342. [D 20:42:45.177204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14343. [D 20:42:45.177230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14344. [D 20:42:45.177245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 14345. [D 20:42:45.177274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 14346. [D 20:42:45.177289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 14347. [D 20:42:45.177304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 14348. [D 20:42:45.177320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 14349. [D 20:42:45.177337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14350. [D 20:42:45.177351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14351. [D 20:42:45.177366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14352. [D 20:42:45.177388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 14353. [D 20:42:45.177422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 14354. [D 20:42:45.177445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 14355. [D 20:42:45.177460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 14356. [D 20:42:45.177475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 14357. [D 20:42:45.177490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14358. [D 20:42:45.177512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14359. [D 20:42:45.177527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14360. [D 20:42:45.177541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 14361. [D 20:42:45.177556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 14362. [D 20:42:45.177585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 14363. [D 20:42:45.177600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 14364. [D 20:42:45.177615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 14365. [D 20:42:45.177630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14366. [D 20:42:45.177644] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14367. [D 20:42:45.182969] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14367. [D 20:42:45.182991] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 31/70. [D 20:42:45.183093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.183146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.183159] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.256260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.256281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.256294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.256331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3769 [D 20:42:45.256346] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:45.256365] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 32/70. [D 20:42:45.259773] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3769 [D 20:42:45.259797] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 33/70. [D 20:42:45.259847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14367. [D 20:42:45.259864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14368. [D 20:42:45.259879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 14369. [D 20:42:45.259893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 14370. [D 20:42:45.259910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 14371. [D 20:42:45.259925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 14372. [D 20:42:45.259940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 14373. [D 20:42:45.259954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14374. [D 20:42:45.259970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14375. [D 20:42:45.259996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14376. [D 20:42:45.260011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 14377. [D 20:42:45.260032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 14378. [D 20:42:45.260047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 14379. [D 20:42:45.260061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 14380. [D 20:42:45.260076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 14381. [D 20:42:45.260091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14382. [D 20:42:45.260106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14383. [D 20:42:45.260120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14384. [D 20:42:45.260135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14385. [D 20:42:45.260150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14386. [D 20:42:45.260165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14387. [D 20:42:45.260218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14388. [D 20:42:45.260234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14389. [D 20:42:45.260248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14390. [D 20:42:45.260263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14391. [D 20:42:45.260278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14392. [D 20:42:45.260292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14393. [D 20:42:45.260307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14394. [D 20:42:45.260322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14395. [D 20:42:45.260339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14396. [D 20:42:45.260354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14397. [D 20:42:45.260369] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14398. [D 20:42:45.265766] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14398. [D 20:42:45.265786] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 34/70. [D 20:42:45.265891] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.265945] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.265958] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.284564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.284586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.284599] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.284636] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3772 [D 20:42:45.284651] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:45.284670] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 35/70. [D 20:42:45.288304] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3772 [D 20:42:45.288341] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 36/70. [D 20:42:45.288390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14398. [D 20:42:45.288407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14399. [D 20:42:45.288422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14400. [D 20:42:45.288437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14401. [D 20:42:45.288453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14402. [D 20:42:45.288468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14403. [D 20:42:45.288482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14404. [D 20:42:45.288497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14405. [D 20:42:45.288528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14406. [D 20:42:45.288543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14407. [D 20:42:45.288558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14408. [D 20:42:45.288573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14409. [D 20:42:45.288587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14410. [D 20:42:45.288602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14411. [D 20:42:45.288618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14412. [D 20:42:45.288649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14413. [D 20:42:45.288664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14414. [D 20:42:45.288685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14415. [D 20:42:45.288699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14416. [D 20:42:45.288714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14417. [D 20:42:45.288729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14418. [D 20:42:45.288744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14419. [D 20:42:45.288758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14420. [D 20:42:45.288773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14421. [D 20:42:45.288792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14422. [D 20:42:45.288808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14423. [D 20:42:45.288823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14424. [D 20:42:45.288838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14425. [D 20:42:45.288853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14426. [D 20:42:45.288898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14427. [D 20:42:45.288920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14428. [D 20:42:45.288936] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14429. [D 20:42:45.294325] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14429. [D 20:42:45.294346] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 37/70. [D 20:42:45.294448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.294499] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.294512] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.374107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.374129] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.374141] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.374179] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3775 [D 20:42:45.374193] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:45.374212] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 38/70. [D 20:42:45.377816] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3775 [D 20:42:45.377842] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 39/70. [D 20:42:45.377897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14429. [D 20:42:45.377914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14430. [D 20:42:45.377929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14431. [D 20:42:45.377958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14432. [D 20:42:45.377973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14433. [D 20:42:45.377988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14434. [D 20:42:45.378002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14435. [D 20:42:45.378017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14436. [D 20:42:45.378032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14437. [D 20:42:45.378047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14438. [D 20:42:45.378062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14439. [D 20:42:45.378077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14440. [D 20:42:45.378091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14441. [D 20:42:45.378106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14442. [D 20:42:45.378121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14443. [D 20:42:45.378136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14444. [D 20:42:45.378175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14445. [D 20:42:45.378195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14446. [D 20:42:45.378210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14447. [D 20:42:45.378224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14448. [D 20:42:45.378239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14449. [D 20:42:45.378253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14450. [D 20:42:45.378268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14451. [D 20:42:45.378283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14452. [D 20:42:45.378297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14453. [D 20:42:45.378328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14454. [D 20:42:45.378343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14455. [D 20:42:45.378358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14456. [D 20:42:45.378374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14457. [D 20:42:45.378416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14458. [D 20:42:45.378434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14459. [D 20:42:45.378454] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14460. [D 20:42:45.383865] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14460. [D 20:42:45.383887] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 40/70. [D 20:42:45.383987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.384038] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.384052] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.436002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.436023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.436037] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.436074] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3778 [D 20:42:45.436090] element 0: offset: 0x2aaaab60f130, size: 24 [D 20:42:45.436108] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 41/70. [D 20:42:45.439707] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3778 [D 20:42:45.439734] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 42/70. [D 20:42:45.439797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14460. [D 20:42:45.439815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14461. [D 20:42:45.439830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14462. [D 20:42:45.439845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14463. [D 20:42:45.439861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14464. [D 20:42:45.439876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14465. [D 20:42:45.439907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14466. [D 20:42:45.439922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14467. [D 20:42:45.439937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14468. [D 20:42:45.439952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14469. [D 20:42:45.439967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14470. [D 20:42:45.439981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14471. [D 20:42:45.439997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14472. [D 20:42:45.440012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14473. [D 20:42:45.440056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14474. [D 20:42:45.440070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14475. [D 20:42:45.440091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14476. [D 20:42:45.440106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14477. [D 20:42:45.440121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14478. [D 20:42:45.440135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14479. [D 20:42:45.440150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14480. [D 20:42:45.440165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14481. [D 20:42:45.440179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14482. [D 20:42:45.440199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14483. [D 20:42:45.440215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14484. [D 20:42:45.440230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14485. [D 20:42:45.440251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14486. [D 20:42:45.440290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14487. [D 20:42:45.440305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14488. [D 20:42:45.440343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14489. [D 20:42:45.440359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14490. [D 20:42:45.440373] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14491. [D 20:42:45.445716] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14491. [D 20:42:45.445736] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 43/70. [D 20:42:45.445837] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.445888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.445901] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.514770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.514791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.514804] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.514842] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3781 [D 20:42:45.514857] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:45.514876] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 44/70. [D 20:42:45.518470] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3781 [D 20:42:45.518507] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 45/70. [D 20:42:45.518558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14491. [D 20:42:45.518575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14492. [D 20:42:45.518590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14493. [D 20:42:45.518604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14494. [D 20:42:45.518620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14495. [D 20:42:45.518635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14496. [D 20:42:45.518650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14497. [D 20:42:45.518669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14498. [D 20:42:45.518684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14499. [D 20:42:45.518699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14500. [D 20:42:45.518713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14501. [D 20:42:45.518728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14502. [D 20:42:45.518743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14503. [D 20:42:45.518758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14504. [D 20:42:45.518772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14505. [D 20:42:45.518819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14506. [D 20:42:45.518834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14507. [D 20:42:45.518854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14508. [D 20:42:45.518868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14509. [D 20:42:45.518883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14510. [D 20:42:45.518898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14511. [D 20:42:45.518912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14512. [D 20:42:45.518927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14513. [D 20:42:45.518942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14514. [D 20:42:45.518956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14515. [D 20:42:45.518971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14516. [D 20:42:45.518988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14517. [D 20:42:45.519002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14518. [D 20:42:45.519017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14519. [D 20:42:45.519032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14520. [D 20:42:45.519078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14521. [D 20:42:45.519100] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14522. [D 20:42:45.524521] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14522. [D 20:42:45.524543] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 46/70. [D 20:42:45.524647] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.524698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.524712] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.568556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.568576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.568590] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.568628] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3785 [D 20:42:45.568643] element 0: offset: 0x2aaaab611060, size: 24 [D 20:42:45.568663] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 47/70. [D 20:42:45.572291] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3785 [D 20:42:45.572328] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 48/70. [D 20:42:45.572379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 14522. [D 20:42:45.572396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 14523. [D 20:42:45.572411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 14524. [D 20:42:45.572426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 14525. [D 20:42:45.572443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 14526. [D 20:42:45.572457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 14527. [D 20:42:45.572472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14528. [D 20:42:45.572502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14529. [D 20:42:45.572518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14530. [D 20:42:45.572533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 14531. [D 20:42:45.572548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 14532. [D 20:42:45.572563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 14533. [D 20:42:45.572578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 14534. [D 20:42:45.572592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 14535. [D 20:42:45.572607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14536. [D 20:42:45.572654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14537. [D 20:42:45.572674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14538. [D 20:42:45.572689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 14539. [D 20:42:45.572704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 14540. [D 20:42:45.572718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 14541. [D 20:42:45.572733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 14542. [D 20:42:45.572748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 14543. [D 20:42:45.572762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14544. [D 20:42:45.572777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14545. [D 20:42:45.572792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14546. [D 20:42:45.572808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 14547. [D 20:42:45.572825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 14548. [D 20:42:45.572840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 14549. [D 20:42:45.572855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 14550. [D 20:42:45.572898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 14551. [D 20:42:45.572916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14552. [D 20:42:45.572946] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14553. [D 20:42:45.578311] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14553. [D 20:42:45.578330] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 49/70. [D 20:42:45.578432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.578484] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.578498] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.686723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.686745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.686758] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.686796] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3787 [D 20:42:45.686811] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:45.686830] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 50/70. [D 20:42:45.690505] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3787 [D 20:42:45.690542] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 51/70. [D 20:42:45.690591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14553. [D 20:42:45.690608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14554. [D 20:42:45.690623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14555. [D 20:42:45.690638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14556. [D 20:42:45.690654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14557. [D 20:42:45.690669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14558. [D 20:42:45.690684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14559. [D 20:42:45.690714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14560. [D 20:42:45.690730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14561. [D 20:42:45.690745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14562. [D 20:42:45.690759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14563. [D 20:42:45.690774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14564. [D 20:42:45.690789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14565. [D 20:42:45.690804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14566. [D 20:42:45.690819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14567. [D 20:42:45.690851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14568. [D 20:42:45.690865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14569. [D 20:42:45.690885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14570. [D 20:42:45.690900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14571. [D 20:42:45.690915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14572. [D 20:42:45.690930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14573. [D 20:42:45.690944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14574. [D 20:42:45.690959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14575. [D 20:42:45.690973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14576. [D 20:42:45.690992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14577. [D 20:42:45.691009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14578. [D 20:42:45.691023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14579. [D 20:42:45.691044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14580. [D 20:42:45.691085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14581. [D 20:42:45.691100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14582. [D 20:42:45.691122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14583. [D 20:42:45.691150] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14584. [D 20:42:45.696517] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14584. [D 20:42:45.696538] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 52/70. [D 20:42:45.696639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.696691] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.696705] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.742135] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.742156] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.742169] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.742206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3790 [D 20:42:45.742221] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:45.742240] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 53/70. [D 20:42:45.745834] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3790 [D 20:42:45.745870] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 54/70. [D 20:42:45.745924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14584. [D 20:42:45.745941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14585. [D 20:42:45.745956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14586. [D 20:42:45.745971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14587. [D 20:42:45.745986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14588. [D 20:42:45.746001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14589. [D 20:42:45.746015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14590. [D 20:42:45.746034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14591. [D 20:42:45.746050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14592. [D 20:42:45.746077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14593. [D 20:42:45.746092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14594. [D 20:42:45.746107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14595. [D 20:42:45.746122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14596. [D 20:42:45.746136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14597. [D 20:42:45.746181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14598. [D 20:42:45.746196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14599. [D 20:42:45.746216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14600. [D 20:42:45.746231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14601. [D 20:42:45.746245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14602. [D 20:42:45.746260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14603. [D 20:42:45.746275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14604. [D 20:42:45.746290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14605. [D 20:42:45.746304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14606. [D 20:42:45.746323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14607. [D 20:42:45.746340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14608. [D 20:42:45.746355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14609. [D 20:42:45.746369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14610. [D 20:42:45.746391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14611. [D 20:42:45.746433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14612. [D 20:42:45.746455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14613. [D 20:42:45.746471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14614. [D 20:42:45.746497] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14615. [D 20:42:45.751889] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14615. [D 20:42:45.751911] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 55/70. [D 20:42:45.752013] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.752065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.752079] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.858014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.858035] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.858048] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.858086] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3794 [D 20:42:45.858101] element 0: offset: 0x2aaaab6181e0, size: 24 [D 20:42:45.858120] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 56/70. [D 20:42:45.861704] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3794 [D 20:42:45.861738] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 57/70. [D 20:42:45.861794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 14615. [D 20:42:45.861811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 14616. [D 20:42:45.861840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 14617. [D 20:42:45.861857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 14618. [D 20:42:45.861871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 14619. [D 20:42:45.861886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 14620. [D 20:42:45.861901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14621. [D 20:42:45.861916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14622. [D 20:42:45.861931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14623. [D 20:42:45.861946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 14624. [D 20:42:45.861961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 14625. [D 20:42:45.861986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 14626. [D 20:42:45.862001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 14627. [D 20:42:45.862020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 14628. [D 20:42:45.862035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14629. [D 20:42:45.862050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14630. [D 20:42:45.862064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14631. [D 20:42:45.862079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 14632. [D 20:42:45.862098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 14633. [D 20:42:45.862114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 14634. [D 20:42:45.862129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 14635. [D 20:42:45.862144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 14636. [D 20:42:45.862181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14637. [D 20:42:45.862199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14638. [D 20:42:45.862218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14639. [D 20:42:45.862233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 14640. [D 20:42:45.862248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 14641. [D 20:42:45.862277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 14642. [D 20:42:45.862292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 14643. [D 20:42:45.862307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 14644. [D 20:42:45.862326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14645. [D 20:42:45.862341] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14646. [D 20:42:45.867751] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14646. [D 20:42:45.867770] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 58/70. [D 20:42:45.867894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.867946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.867960] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.920165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.920186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.920199] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.920237] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3796 [D 20:42:45.920252] element 0: offset: 0x2aaaab610f80, size: 24 [D 20:42:45.920271] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 59/70. [D 20:42:45.923777] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3796 [D 20:42:45.923803] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 60/70. [D 20:42:45.923853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14646. [D 20:42:45.923871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14647. [D 20:42:45.923886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14648. [D 20:42:45.923900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14649. [D 20:42:45.923923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14650. [D 20:42:45.923937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14651. [D 20:42:45.923952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14652. [D 20:42:45.923982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14653. [D 20:42:45.924011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14654. [D 20:42:45.924026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14655. [D 20:42:45.924040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14656. [D 20:42:45.924055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14657. [D 20:42:45.924072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14658. [D 20:42:45.924088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14659. [D 20:42:45.924103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14660. [D 20:42:45.924118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14661. [D 20:42:45.924148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14662. [D 20:42:45.924167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14663. [D 20:42:45.924182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14664. [D 20:42:45.924202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14665. [D 20:42:45.924217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14666. [D 20:42:45.924231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14667. [D 20:42:45.924248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14668. [D 20:42:45.924263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14669. [D 20:42:45.924278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14670. [D 20:42:45.924292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14671. [D 20:42:45.924311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14672. [D 20:42:45.924326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14673. [D 20:42:45.924353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14674. [D 20:42:45.924367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14675. [D 20:42:45.924382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14676. [D 20:42:45.924397] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14677. [D 20:42:45.929803] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14677. [D 20:42:45.929827] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 0/70. [D 20:42:45.929932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.929986] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.930000] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:45.957902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:45.957923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.957936] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:45.957973] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3799 [D 20:42:45.957988] element 0: offset: 0x2aaaab639090, size: 24 [D 20:42:45.958008] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 1/70. [D 20:42:45.961450] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3799 [D 20:42:45.961478] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 2/70. [D 20:42:45.961587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14677. [D 20:42:45.961611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14678. [D 20:42:45.961628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 14679. [D 20:42:45.961642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 14680. [D 20:42:45.961661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 14681. [D 20:42:45.961686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 14682. [D 20:42:45.961701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 14683. [D 20:42:45.961715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14684. [D 20:42:45.961730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14685. [D 20:42:45.961745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14686. [D 20:42:45.961774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 14687. [D 20:42:45.961788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 14688. [D 20:42:45.961803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 14689. [D 20:42:45.961817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 14690. [D 20:42:45.961832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 14691. [D 20:42:45.961847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14692. [D 20:42:45.961869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14693. [D 20:42:45.961883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14694. [D 20:42:45.961899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14695. [D 20:42:45.961919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14696. [D 20:42:45.961937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14697. [D 20:42:45.961955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14698. [D 20:42:45.961973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14699. [D 20:42:45.961991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14700. [D 20:42:45.962009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14701. [D 20:42:45.962027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14702. [D 20:42:45.962045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14703. [D 20:42:45.962062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14704. [D 20:42:45.962080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14705. [D 20:42:45.962098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14706. [D 20:42:45.962116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14707. [D 20:42:45.962134] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14708. [D 20:42:45.967523] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14708. [D 20:42:45.967545] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 3/70. [D 20:42:45.967644] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:45.967697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:45.967711] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.092800] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.092821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.092835] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.092873] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3802 [D 20:42:46.092888] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:46.092910] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 4/70. [D 20:42:46.096352] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3802 [D 20:42:46.096380] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 5/70. [D 20:42:46.096431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14708. [D 20:42:46.096448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14709. [D 20:42:46.096464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14710. [D 20:42:46.096478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14711. [D 20:42:46.096493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14712. [D 20:42:46.096508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14713. [D 20:42:46.096523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14714. [D 20:42:46.096542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14715. [D 20:42:46.096557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14716. [D 20:42:46.096572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14717. [D 20:42:46.096597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14718. [D 20:42:46.096627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14719. [D 20:42:46.096643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14720. [D 20:42:46.096662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14721. [D 20:42:46.096679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14722. [D 20:42:46.096697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14723. [D 20:42:46.096715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14724. [D 20:42:46.096733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14725. [D 20:42:46.096751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14726. [D 20:42:46.096769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14727. [D 20:42:46.096786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14728. [D 20:42:46.096804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14729. [D 20:42:46.096822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14730. [D 20:42:46.096840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14731. [D 20:42:46.096858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14732. [D 20:42:46.096876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14733. [D 20:42:46.096893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14734. [D 20:42:46.096911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14735. [D 20:42:46.096929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14736. [D 20:42:46.096947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14737. [D 20:42:46.096965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14738. [D 20:42:46.096982] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14739. [D 20:42:46.102363] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14739. [D 20:42:46.102385] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 6/70. [D 20:42:46.102484] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.102537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.102550] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.180002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.180023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.180036] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.180074] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3805 [D 20:42:46.180089] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:46.180108] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 7/70. [D 20:42:46.183620] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3805 [D 20:42:46.183651] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 8/70. [D 20:42:46.183703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14739. [D 20:42:46.183720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14740. [D 20:42:46.183735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14741. [D 20:42:46.183753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14742. [D 20:42:46.183767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14743. [D 20:42:46.183790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14744. [D 20:42:46.183805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14745. [D 20:42:46.183833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14746. [D 20:42:46.183865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14747. [D 20:42:46.183879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14748. [D 20:42:46.183894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14749. [D 20:42:46.183912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14750. [D 20:42:46.183927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14751. [D 20:42:46.183941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14752. [D 20:42:46.183956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14753. [D 20:42:46.183971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14754. [D 20:42:46.183985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14755. [D 20:42:46.184000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14756. [D 20:42:46.184015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14757. [D 20:42:46.184047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14758. [D 20:42:46.184064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14759. [D 20:42:46.184088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14760. [D 20:42:46.184116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14761. [D 20:42:46.184131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14762. [D 20:42:46.184146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14763. [D 20:42:46.184161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14764. [D 20:42:46.184176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14765. [D 20:42:46.184190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14766. [D 20:42:46.184205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14767. [D 20:42:46.184223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14768. [D 20:42:46.184238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14769. [D 20:42:46.184253] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14770. [D 20:42:46.189625] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14770. [D 20:42:46.189647] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 9/70. [D 20:42:46.189747] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.189798] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.189812] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.393556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.393580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.393593] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.393630] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3808 [D 20:42:46.393645] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:46.393665] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 10/70. [D 20:42:46.396800] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.396861] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.396874] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:46.396914] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3812 [D 20:42:46.396929] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:46.396947] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 11/70. [D 20:42:46.400950] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3808 [D 20:42:46.401005] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 12/70. [D 20:42:46.401029] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3812 [D 20:42:46.401049] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 13/70. [D 20:42:46.401084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 14770. [D 20:42:46.401103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 14771. [D 20:42:46.401138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14772. [D 20:42:46.401153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14773. [D 20:42:46.401168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14774. [D 20:42:46.401184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14775. [D 20:42:46.401198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14776. [D 20:42:46.401213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14777. [D 20:42:46.401247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14778. [D 20:42:46.401261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14779. [D 20:42:46.401276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14780. [D 20:42:46.401295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14781. [D 20:42:46.401310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14782. [D 20:42:46.401324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14783. [D 20:42:46.401339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14784. [D 20:42:46.401354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14785. [D 20:42:46.401368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14786. [D 20:42:46.401383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14787. [D 20:42:46.401398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14788. [D 20:42:46.401444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14789. [D 20:42:46.401464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14790. [D 20:42:46.401479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14791. [D 20:42:46.401494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14792. [D 20:42:46.401509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14793. [D 20:42:46.401526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14794. [D 20:42:46.401540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14795. [D 20:42:46.401555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14796. [D 20:42:46.401576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14797. [D 20:42:46.401591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14798. [D 20:42:46.401606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14799. [D 20:42:46.401621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14800. [D 20:42:46.401635] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14801. [D 20:42:46.401652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14802. [D 20:42:46.401667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 14803. [D 20:42:46.401682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 14804. [D 20:42:46.401734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 14805. [D 20:42:46.401750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 14806. [D 20:42:46.401786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14807. [D 20:42:46.401801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14808. [D 20:42:46.401816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14809. [D 20:42:46.401830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14810. [D 20:42:46.401845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14811. [D 20:42:46.401860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14812. [D 20:42:46.401874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14813. [D 20:42:46.401892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14814. [D 20:42:46.401909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 14815. [D 20:42:46.401923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14816. [D 20:42:46.401938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14817. [D 20:42:46.401953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14818. [D 20:42:46.401968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14819. [D 20:42:46.401982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14820. [D 20:42:46.402001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14821. [D 20:42:46.402017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14822. [D 20:42:46.402032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14823. [D 20:42:46.402046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14824. [D 20:42:46.402061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14825. [D 20:42:46.402076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14826. [D 20:42:46.402090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14827. [D 20:42:46.402104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14828. [D 20:42:46.402129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14829. [D 20:42:46.402144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14830. [D 20:42:46.402158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14831. [D 20:42:46.402173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14832. [D 20:42:46.402202] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14833. [D 20:42:46.406978] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14833. [D 20:42:46.407001] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 14/70. [D 20:42:46.412823] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 14832. [D 20:42:46.412844] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 15/70. [D 20:42:46.412945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.413002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.413016] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:46.413040] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.413054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.413066] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.477161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.477182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.477195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.477234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3814 [D 20:42:46.477249] element 0: offset: 0x2aaaab639090, size: 24 [D 20:42:46.477268] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 16/70. [D 20:42:46.480867] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3814 [D 20:42:46.480906] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 17/70. [D 20:42:46.480961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 14832. [D 20:42:46.480991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 14833. [D 20:42:46.481006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 14834. [D 20:42:46.481021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 14835. [D 20:42:46.481036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 14836. [D 20:42:46.481050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 14837. [D 20:42:46.481069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 14838. [D 20:42:46.481084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 14839. [D 20:42:46.481099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 14840. [D 20:42:46.481114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 14841. [D 20:42:46.481141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 14842. [D 20:42:46.481156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 14843. [D 20:42:46.481170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 14844. [D 20:42:46.481189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 14845. [D 20:42:46.481204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 14846. [D 20:42:46.481218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 14847. [D 20:42:46.481233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 14848. [D 20:42:46.481248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 14849. [D 20:42:46.481262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 14850. [D 20:42:46.481277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 14851. [D 20:42:46.481292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 14852. [D 20:42:46.481333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 14853. [D 20:42:46.481354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 14854. [D 20:42:46.481369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 14855. [D 20:42:46.481385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 14856. [D 20:42:46.481400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 14857. [D 20:42:46.481414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 14858. [D 20:42:46.481429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 14859. [D 20:42:46.481443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 14860. [D 20:42:46.481458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 14861. [D 20:42:46.481472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 14862. [D 20:42:46.481491] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 14863. [D 20:42:46.486595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.486650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.486665] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:46.486708] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3817 [D 20:42:46.486723] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:46.486744] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 18/70. [D 20:42:46.486897] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14863. [D 20:42:46.486920] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 19/70. [D 20:42:46.487030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.487052] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.487065] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:46.490609] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3817 [D 20:42:46.490638] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 20/70. [D 20:42:46.490695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 14863. [D 20:42:46.490712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 14864. [D 20:42:46.490726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 14865. [D 20:42:46.490741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 14866. [D 20:42:46.490757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 14867. [D 20:42:46.490771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 14868. [D 20:42:46.490786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 14869. [D 20:42:46.490801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 14870. [D 20:42:46.490820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 14871. [D 20:42:46.490835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 14872. [D 20:42:46.490849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 14873. [D 20:42:46.490864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 14874. [D 20:42:46.490878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 14875. [D 20:42:46.490893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 14876. [D 20:42:46.490908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 14877. [D 20:42:46.490955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 14878. [D 20:42:46.490969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 14879. [D 20:42:46.490989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 14880. [D 20:42:46.491004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 14881. [D 20:42:46.491038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 14882. [D 20:42:46.491052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 14883. [D 20:42:46.491067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 14884. [D 20:42:46.491082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 14885. [D 20:42:46.491096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 14886. [D 20:42:46.491111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 14887. [D 20:42:46.491126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 14888. [D 20:42:46.491140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 14889. [D 20:42:46.491155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 14890. [D 20:42:46.491170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 14891. [D 20:42:46.491211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 14892. [D 20:42:46.491233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 14893. [D 20:42:46.491249] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 14894. [D 20:42:46.496573] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14894. [D 20:42:46.496594] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 21/70. [D 20:42:46.496692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.496737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.496751] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.557667] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.557689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.557702] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.557741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3820 [D 20:42:46.557756] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:46.557776] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 22/70. [D 20:42:46.561320] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3820 [D 20:42:46.561351] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 23/70. [D 20:42:46.561405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 14894. [D 20:42:46.561427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 14895. [D 20:42:46.561442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14896. [D 20:42:46.561456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14897. [D 20:42:46.561472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14898. [D 20:42:46.561491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14899. [D 20:42:46.561506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14900. [D 20:42:46.561548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14901. [D 20:42:46.561563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14902. [D 20:42:46.561580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14903. [D 20:42:46.561599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14904. [D 20:42:46.561614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14905. [D 20:42:46.561629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14906. [D 20:42:46.561644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14907. [D 20:42:46.561658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14908. [D 20:42:46.561673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14909. [D 20:42:46.561688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14910. [D 20:42:46.561716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14911. [D 20:42:46.561734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14912. [D 20:42:46.561750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14913. [D 20:42:46.561769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14914. [D 20:42:46.561784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14915. [D 20:42:46.561798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14916. [D 20:42:46.561815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14917. [D 20:42:46.561845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14918. [D 20:42:46.561860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14919. [D 20:42:46.561875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14920. [D 20:42:46.561889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14921. [D 20:42:46.561904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14922. [D 20:42:46.561919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14923. [D 20:42:46.561933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14924. [D 20:42:46.561950] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14925. [D 20:42:46.567353] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14925. [D 20:42:46.567373] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 24/70. [D 20:42:46.567476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.567530] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.567544] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.594012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.594033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.594046] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.594084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3824 [D 20:42:46.594099] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:46.594118] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 25/70. [D 20:42:46.597687] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3824 [D 20:42:46.597713] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 26/70. [D 20:42:46.597768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14925. [D 20:42:46.597785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 14926. [D 20:42:46.597800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 14927. [D 20:42:46.597814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 14928. [D 20:42:46.597829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 14929. [D 20:42:46.597844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14930. [D 20:42:46.597863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14931. [D 20:42:46.597892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14932. [D 20:42:46.597914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14933. [D 20:42:46.597928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14934. [D 20:42:46.597943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14935. [D 20:42:46.597958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14936. [D 20:42:46.597972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14937. [D 20:42:46.597987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 14938. [D 20:42:46.598004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14939. [D 20:42:46.598020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14940. [D 20:42:46.598034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14941. [D 20:42:46.598056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14942. [D 20:42:46.598090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14943. [D 20:42:46.598107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14944. [D 20:42:46.598127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14945. [D 20:42:46.598146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14946. [D 20:42:46.598161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14947. [D 20:42:46.598176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14948. [D 20:42:46.598190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14949. [D 20:42:46.598205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14950. [D 20:42:46.598220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14951. [D 20:42:46.598234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14952. [D 20:42:46.598249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14953. [D 20:42:46.598268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14954. [D 20:42:46.598282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14955. [D 20:42:46.598297] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14956. [D 20:42:46.603701] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14956. [D 20:42:46.603721] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 27/70. [D 20:42:46.603874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.603924] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.603938] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.649317] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.649338] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.649351] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.649388] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3826 [D 20:42:46.649403] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:46.649422] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 28/70. [D 20:42:46.653088] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3826 [D 20:42:46.653124] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 29/70. [D 20:42:46.653181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 14956. [D 20:42:46.653198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 14957. [D 20:42:46.653213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 14958. [D 20:42:46.653243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 14959. [D 20:42:46.653258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 14960. [D 20:42:46.653273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 14961. [D 20:42:46.653291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 14962. [D 20:42:46.653308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14963. [D 20:42:46.653323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14964. [D 20:42:46.653337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14965. [D 20:42:46.653352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 14966. [D 20:42:46.653367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 14967. [D 20:42:46.653382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 14968. [D 20:42:46.653397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 14969. [D 20:42:46.653433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 14970. [D 20:42:46.653448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14971. [D 20:42:46.653467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14972. [D 20:42:46.653482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14973. [D 20:42:46.653496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 14974. [D 20:42:46.653511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 14975. [D 20:42:46.653526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 14976. [D 20:42:46.653540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 14977. [D 20:42:46.653566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 14978. [D 20:42:46.653584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14979. [D 20:42:46.653599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14980. [D 20:42:46.653614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14981. [D 20:42:46.653629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 14982. [D 20:42:46.653669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 14983. [D 20:42:46.653690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 14984. [D 20:42:46.653705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 14985. [D 20:42:46.653720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 14986. [D 20:42:46.653734] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14987. [D 20:42:46.659118] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 14987. [D 20:42:46.659139] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 30/70. [D 20:42:46.659241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.659294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.659307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.772087] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.772108] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.772121] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.772158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3830 [D 20:42:46.772173] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:46.772192] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 31/70. [D 20:42:46.775788] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3830 [D 20:42:46.775819] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 32/70. [D 20:42:46.775874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14987. [D 20:42:46.775903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 14988. [D 20:42:46.775919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 14989. [D 20:42:46.775933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 14990. [D 20:42:46.775948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 14991. [D 20:42:46.775973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 14992. [D 20:42:46.775988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14993. [D 20:42:46.776002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14994. [D 20:42:46.776021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14995. [D 20:42:46.776036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 14996. [D 20:42:46.776051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 14997. [D 20:42:46.776066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 14998. [D 20:42:46.776080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 14999. [D 20:42:46.776119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 15000. [D 20:42:46.776136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 15001. [D 20:42:46.776151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 15002. [D 20:42:46.776169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 15003. [D 20:42:46.776195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 15004. [D 20:42:46.776211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 15005. [D 20:42:46.776225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 15006. [D 20:42:46.776239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 15007. [D 20:42:46.776254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 15008. [D 20:42:46.776268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 15009. [D 20:42:46.776284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 15010. [D 20:42:46.776314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 15011. [D 20:42:46.776333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 15012. [D 20:42:46.776348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 15013. [D 20:42:46.776367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 15014. [D 20:42:46.776382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 15015. [D 20:42:46.776396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 15016. [D 20:42:46.776411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 15017. [D 20:42:46.776426] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 15018. [D 20:42:46.781826] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15018. [D 20:42:46.781845] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 33/70. [D 20:42:46.781947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.781998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.782012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.826063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.826084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.826097] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.826135] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3832 [D 20:42:46.826150] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:46.826169] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 34/70. [D 20:42:46.829867] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3832 [D 20:42:46.829898] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 35/70. [D 20:42:46.829953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15018. [D 20:42:46.829970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15019. [D 20:42:46.829984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 15020. [D 20:42:46.830005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 15021. [D 20:42:46.830021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 15022. [D 20:42:46.830036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 15023. [D 20:42:46.830066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 15024. [D 20:42:46.830081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15025. [D 20:42:46.830095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15026. [D 20:42:46.830110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15027. [D 20:42:46.830125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 15028. [D 20:42:46.830139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 15029. [D 20:42:46.830154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 15030. [D 20:42:46.830169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 15031. [D 20:42:46.830184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 15032. [D 20:42:46.830219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15033. [D 20:42:46.830234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15034. [D 20:42:46.830254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15035. [D 20:42:46.830269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 15036. [D 20:42:46.830283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 15037. [D 20:42:46.830298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 15038. [D 20:42:46.830312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 15039. [D 20:42:46.830327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 15040. [D 20:42:46.830341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15041. [D 20:42:46.830360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15042. [D 20:42:46.830376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15043. [D 20:42:46.830391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 15044. [D 20:42:46.830412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 15045. [D 20:42:46.830453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 15046. [D 20:42:46.830468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 15047. [D 20:42:46.830506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 15048. [D 20:42:46.830521] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15049. [D 20:42:46.835873] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15049. [D 20:42:46.835894] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 36/70. [D 20:42:46.835997] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.836049] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.836063] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.862134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.862155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.862168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.862206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3835 [D 20:42:46.862221] element 0: offset: 0x2aaaab639090, size: 24 [D 20:42:46.862241] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 37/70. [D 20:42:46.865892] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3835 [D 20:42:46.865928] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 38/70. [D 20:42:46.865980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15049. [D 20:42:46.865997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15050. [D 20:42:46.866012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15051. [D 20:42:46.866027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15052. [D 20:42:46.866042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15053. [D 20:42:46.866057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15054. [D 20:42:46.866071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15055. [D 20:42:46.866105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15056. [D 20:42:46.866120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15057. [D 20:42:46.866135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15058. [D 20:42:46.866152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15059. [D 20:42:46.866168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15060. [D 20:42:46.866183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15061. [D 20:42:46.866198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15062. [D 20:42:46.866241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15063. [D 20:42:46.866256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15064. [D 20:42:46.866276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15065. [D 20:42:46.866291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15066. [D 20:42:46.866305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15067. [D 20:42:46.866320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15068. [D 20:42:46.866334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15069. [D 20:42:46.866349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15070. [D 20:42:46.866363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15071. [D 20:42:46.866382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15072. [D 20:42:46.866398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15073. [D 20:42:46.866413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15074. [D 20:42:46.866428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15075. [D 20:42:46.866443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15076. [D 20:42:46.866486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15077. [D 20:42:46.866508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15078. [D 20:42:46.866523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15079. [D 20:42:46.866538] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15080. [D 20:42:46.871947] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15080. [D 20:42:46.871968] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 39/70. [D 20:42:46.872071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.872123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.872137] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:46.947049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:46.947070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.947083] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:46.947121] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3839 [D 20:42:46.947136] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:46.947156] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 40/70. [D 20:42:46.950774] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3839 [D 20:42:46.950806] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 41/70. [D 20:42:46.950857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 15080. [D 20:42:46.950875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 15081. [D 20:42:46.950903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 15082. [D 20:42:46.950927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 15083. [D 20:42:46.950941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 15084. [D 20:42:46.950956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 15085. [D 20:42:46.950970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 15086. [D 20:42:46.950995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 15087. [D 20:42:46.951011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 15088. [D 20:42:46.951026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 15089. [D 20:42:46.951041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 15090. [D 20:42:46.951069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 15091. [D 20:42:46.951087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 15092. [D 20:42:46.951102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 15093. [D 20:42:46.951121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 15094. [D 20:42:46.951136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 15095. [D 20:42:46.951151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 15096. [D 20:42:46.951165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 15097. [D 20:42:46.951180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 15098. [D 20:42:46.951195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 15099. [D 20:42:46.951210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 15100. [D 20:42:46.951224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 15101. [D 20:42:46.951246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 15102. [D 20:42:46.951263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 15103. [D 20:42:46.951282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 15104. [D 20:42:46.951299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 15105. [D 20:42:46.951313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 15106. [D 20:42:46.951332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 15107. [D 20:42:46.951347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 15108. [D 20:42:46.951362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 15109. [D 20:42:46.951376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 15110. [D 20:42:46.951394] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 15111. [D 20:42:46.956799] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15111. [D 20:42:46.956821] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 42/70. [D 20:42:46.956921] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:46.956972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:46.956986] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.018799] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.018821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.018834] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.018871] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3841 [D 20:42:47.018886] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:47.018905] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 43/70. [D 20:42:47.022493] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3841 [D 20:42:47.022520] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 44/70. [D 20:42:47.022574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15111. [D 20:42:47.022591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15112. [D 20:42:47.022606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 15113. [D 20:42:47.022621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 15114. [D 20:42:47.022636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 15115. [D 20:42:47.022665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 15116. [D 20:42:47.022680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 15117. [D 20:42:47.022701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15118. [D 20:42:47.022725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15119. [D 20:42:47.022739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15120. [D 20:42:47.022754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 15121. [D 20:42:47.022773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 15122. [D 20:42:47.022787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 15123. [D 20:42:47.022802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 15124. [D 20:42:47.022817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 15125. [D 20:42:47.022832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15126. [D 20:42:47.022847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15127. [D 20:42:47.022862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15128. [D 20:42:47.022897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 15129. [D 20:42:47.022912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 15130. [D 20:42:47.022948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 15131. [D 20:42:47.022965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 15132. [D 20:42:47.022980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 15133. [D 20:42:47.022995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15134. [D 20:42:47.023010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15135. [D 20:42:47.023024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15136. [D 20:42:47.023039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 15137. [D 20:42:47.023054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 15138. [D 20:42:47.023072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 15139. [D 20:42:47.023087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 15140. [D 20:42:47.023101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 15141. [D 20:42:47.023117] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15142. [D 20:42:47.028497] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15142. [D 20:42:47.028516] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 45/70. [D 20:42:47.028619] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.028671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.028685] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.121476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.121497] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.121511] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.121549] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3844 [D 20:42:47.121564] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:47.121583] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 46/70. [D 20:42:47.125409] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3844 [D 20:42:47.125438] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 47/70. [D 20:42:47.125584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15142. [D 20:42:47.125606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15143. [D 20:42:47.125625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15144. [D 20:42:47.125645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15145. [D 20:42:47.125660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15146. [D 20:42:47.125675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15147. [D 20:42:47.125698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15148. [D 20:42:47.125713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15149. [D 20:42:47.125728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15150. [D 20:42:47.125743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15151. [D 20:42:47.125758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15152. [D 20:42:47.125772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15153. [D 20:42:47.125787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15154. [D 20:42:47.125828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15155. [D 20:42:47.125843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15156. [D 20:42:47.125862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15157. [D 20:42:47.125877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15158. [D 20:42:47.125891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15159. [D 20:42:47.125907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15160. [D 20:42:47.125921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15161. [D 20:42:47.125936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15162. [D 20:42:47.125951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15163. [D 20:42:47.125965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15164. [D 20:42:47.125995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15165. [D 20:42:47.126010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15166. [D 20:42:47.126026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15167. [D 20:42:47.126064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15168. [D 20:42:47.126086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15169. [D 20:42:47.126101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15170. [D 20:42:47.126116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15171. [D 20:42:47.126130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15172. [D 20:42:47.126145] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15173. [D 20:42:47.136434] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15173. [D 20:42:47.136459] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 48/70. [D 20:42:47.136560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.136612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.136626] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.142353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.142374] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.142387] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.142425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3847 [D 20:42:47.142440] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:47.142459] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 49/70. [D 20:42:47.146042] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3847 [D 20:42:47.146071] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 50/70. [D 20:42:47.146134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 15173. [D 20:42:47.146151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 15174. [D 20:42:47.146166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15175. [D 20:42:47.146180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15176. [D 20:42:47.146195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15177. [D 20:42:47.146210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15178. [D 20:42:47.146241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15179. [D 20:42:47.146270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15180. [D 20:42:47.146285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15181. [D 20:42:47.146299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15182. [D 20:42:47.146314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15183. [D 20:42:47.146331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15184. [D 20:42:47.146347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15185. [D 20:42:47.146362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15186. [D 20:42:47.146383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15187. [D 20:42:47.146412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15188. [D 20:42:47.146430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15189. [D 20:42:47.146450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15190. [D 20:42:47.146465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15191. [D 20:42:47.146480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15192. [D 20:42:47.146494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15193. [D 20:42:47.146509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 15194. [D 20:42:47.146537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 15195. [D 20:42:47.146551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 15196. [D 20:42:47.146566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 15197. [D 20:42:47.146581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 15198. [D 20:42:47.146595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 15199. [D 20:42:47.146610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 15200. [D 20:42:47.146625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 15201. [D 20:42:47.146641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 15202. [D 20:42:47.146655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 15203. [D 20:42:47.146671] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 15204. [D 20:42:47.152051] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15204. [D 20:42:47.152070] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 51/70. [D 20:42:47.152171] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.152231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.152244] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.317965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.317987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.318000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.318039] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3851 [D 20:42:47.318054] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:47.318073] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 52/70. [D 20:42:47.321660] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3851 [D 20:42:47.321692] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 53/70. [D 20:42:47.321748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15204. [D 20:42:47.321770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15205. [D 20:42:47.321785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15206. [D 20:42:47.321800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15207. [D 20:42:47.321814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15208. [D 20:42:47.321834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15209. [D 20:42:47.321860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15210. [D 20:42:47.321890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15211. [D 20:42:47.321905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15212. [D 20:42:47.321919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15213. [D 20:42:47.321938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15214. [D 20:42:47.321953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15215. [D 20:42:47.321967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15216. [D 20:42:47.321982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15217. [D 20:42:47.321997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15218. [D 20:42:47.322012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15219. [D 20:42:47.322027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15220. [D 20:42:47.322059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15221. [D 20:42:47.322076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15222. [D 20:42:47.322091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15223. [D 20:42:47.322112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15224. [D 20:42:47.322127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15225. [D 20:42:47.322142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15226. [D 20:42:47.322156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15227. [D 20:42:47.322184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15228. [D 20:42:47.322199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15229. [D 20:42:47.322214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15230. [D 20:42:47.322228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15231. [D 20:42:47.322243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15232. [D 20:42:47.322257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15233. [D 20:42:47.322272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15234. [D 20:42:47.322287] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15235. [D 20:42:47.327636] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15235. [D 20:42:47.327657] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 54/70. [D 20:42:47.327770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.327822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.327835] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.360533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.360554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.360567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.360605] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3853 [D 20:42:47.360620] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:47.360639] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 55/70. [D 20:42:47.364251] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3853 [D 20:42:47.364285] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 56/70. [D 20:42:47.364339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 15235. [D 20:42:47.364356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 15236. [D 20:42:47.364371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 15237. [D 20:42:47.364403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 15238. [D 20:42:47.364418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 15239. [D 20:42:47.364433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 15240. [D 20:42:47.364452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 15241. [D 20:42:47.364468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 15242. [D 20:42:47.364483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 15243. [D 20:42:47.364497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 15244. [D 20:42:47.364512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 15245. [D 20:42:47.364527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 15246. [D 20:42:47.364541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 15247. [D 20:42:47.364557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 15248. [D 20:42:47.364593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 15249. [D 20:42:47.364607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 15250. [D 20:42:47.364628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 15251. [D 20:42:47.364642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 15252. [D 20:42:47.364657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 15253. [D 20:42:47.364672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 15254. [D 20:42:47.364686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 15255. [D 20:42:47.364701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 15256. [D 20:42:47.364715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 15257. [D 20:42:47.364730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 15258. [D 20:42:47.364745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 15259. [D 20:42:47.364760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 15260. [D 20:42:47.364774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 15261. [D 20:42:47.364789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 15262. [D 20:42:47.364829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 15263. [D 20:42:47.364851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 15264. [D 20:42:47.364867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 15265. [D 20:42:47.364881] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 15266. [D 20:42:47.370213] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15266. [D 20:42:47.370233] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 57/70. [D 20:42:47.370335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.370386] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.370400] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.399161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.399182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.399195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.399232] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3856 [D 20:42:47.399247] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:47.399266] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 58/70. [D 20:42:47.402878] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3856 [D 20:42:47.402910] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 59/70. [D 20:42:47.402975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15266. [D 20:42:47.402992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15267. [D 20:42:47.403007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15268. [D 20:42:47.403031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15269. [D 20:42:47.403046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15270. [D 20:42:47.403061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15271. [D 20:42:47.403080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15272. [D 20:42:47.403095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15273. [D 20:42:47.403110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15274. [D 20:42:47.403124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15275. [D 20:42:47.403139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15276. [D 20:42:47.403154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15277. [D 20:42:47.403169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15278. [D 20:42:47.403183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15279. [D 20:42:47.403228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15280. [D 20:42:47.403242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15281. [D 20:42:47.403263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15282. [D 20:42:47.403277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15283. [D 20:42:47.403292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15284. [D 20:42:47.403307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15285. [D 20:42:47.403322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15286. [D 20:42:47.403336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15287. [D 20:42:47.403351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15288. [D 20:42:47.403370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15289. [D 20:42:47.403387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15290. [D 20:42:47.403401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15291. [D 20:42:47.403423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15292. [D 20:42:47.403462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15293. [D 20:42:47.403478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15294. [D 20:42:47.403499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15295. [D 20:42:47.403515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15296. [D 20:42:47.403529] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15297. [D 20:42:47.408941] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15297. [D 20:42:47.408963] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 60/70. [D 20:42:47.409063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.409115] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.409129] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.491427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.491448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.491461] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.491499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3859 [D 20:42:47.491514] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:47.491533] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 0/70. [D 20:42:47.495086] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3859 [D 20:42:47.495112] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 1/70. [D 20:42:47.495171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15297. [D 20:42:47.495193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15298. [D 20:42:47.495208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15299. [D 20:42:47.495223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15300. [D 20:42:47.495239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15301. [D 20:42:47.495268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15302. [D 20:42:47.495283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15303. [D 20:42:47.495314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15304. [D 20:42:47.495329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15305. [D 20:42:47.495344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15306. [D 20:42:47.495363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15307. [D 20:42:47.495377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15308. [D 20:42:47.495392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15309. [D 20:42:47.495407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15310. [D 20:42:47.495422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15311. [D 20:42:47.495437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15312. [D 20:42:47.495452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15313. [D 20:42:47.495485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15314. [D 20:42:47.495500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15315. [D 20:42:47.495515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15316. [D 20:42:47.495546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15317. [D 20:42:47.495561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15318. [D 20:42:47.495576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15319. [D 20:42:47.495591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15320. [D 20:42:47.495610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15321. [D 20:42:47.495625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15322. [D 20:42:47.495639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15323. [D 20:42:47.495654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15324. [D 20:42:47.495672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15325. [D 20:42:47.495687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15326. [D 20:42:47.495702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15327. [D 20:42:47.495717] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15328. [D 20:42:47.501113] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15328. [D 20:42:47.501132] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 2/70. [D 20:42:47.501216] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.501267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.501281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.556395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.556418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.556431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.556469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3862 [D 20:42:47.556484] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:47.556504] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 3/70. [D 20:42:47.559933] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3862 [D 20:42:47.559960] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 4/70. [D 20:42:47.560011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 15328. [D 20:42:47.560030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 15329. [D 20:42:47.560044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15330. [D 20:42:47.560059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15331. [D 20:42:47.560074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15332. [D 20:42:47.560089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15333. [D 20:42:47.560103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15334. [D 20:42:47.560118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15335. [D 20:42:47.560132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15336. [D 20:42:47.560147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15337. [D 20:42:47.560161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15338. [D 20:42:47.560176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15339. [D 20:42:47.560191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15340. [D 20:42:47.560205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15341. [D 20:42:47.560220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15342. [D 20:42:47.560234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15343. [D 20:42:47.560249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15344. [D 20:42:47.560263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15345. [D 20:42:47.560279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15346. [D 20:42:47.560293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15347. [D 20:42:47.560308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15348. [D 20:42:47.560337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 15349. [D 20:42:47.560351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 15350. [D 20:42:47.560366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 15351. [D 20:42:47.560380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 15352. [D 20:42:47.560395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 15353. [D 20:42:47.560410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 15354. [D 20:42:47.560424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 15355. [D 20:42:47.560439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 15356. [D 20:42:47.560454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 15357. [D 20:42:47.560469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 15358. [D 20:42:47.560484] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 15359. [D 20:42:47.565938] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15359. [D 20:42:47.565961] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 5/70. [D 20:42:47.566049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.566107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.566121] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.622030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.622051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.622064] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.622102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3865 [D 20:42:47.622117] element 0: offset: 0x2aaaab639090, size: 24 [D 20:42:47.622137] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 6/70. [D 20:42:47.625824] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3865 [D 20:42:47.625858] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 7/70. [D 20:42:47.625908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15359. [D 20:42:47.625926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15360. [D 20:42:47.625941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15361. [D 20:42:47.625956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15362. [D 20:42:47.625993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15363. [D 20:42:47.626007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15364. [D 20:42:47.626022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15365. [D 20:42:47.626036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15366. [D 20:42:47.626051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15367. [D 20:42:47.626066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15368. [D 20:42:47.626081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15369. [D 20:42:47.626095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15370. [D 20:42:47.626110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15371. [D 20:42:47.626124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15372. [D 20:42:47.626139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15373. [D 20:42:47.626161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15374. [D 20:42:47.626198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15375. [D 20:42:47.626213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15376. [D 20:42:47.626233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15377. [D 20:42:47.626248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15378. [D 20:42:47.626262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15379. [D 20:42:47.626277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15380. [D 20:42:47.626292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15381. [D 20:42:47.626306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15382. [D 20:42:47.626321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15383. [D 20:42:47.626339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15384. [D 20:42:47.626355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15385. [D 20:42:47.626370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15386. [D 20:42:47.626386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15387. [D 20:42:47.626428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15388. [D 20:42:47.626448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15389. [D 20:42:47.626479] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15390. [D 20:42:47.631844] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15390. [D 20:42:47.631864] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 8/70. [D 20:42:47.631967] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.632018] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.632032] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.724231] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.724252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.724266] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.724303] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3868 [D 20:42:47.724318] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:47.724337] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 9/70. [D 20:42:47.727796] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3868 [D 20:42:47.727819] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 10/70. [D 20:42:47.727889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 15390. [D 20:42:47.727907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 15391. [D 20:42:47.727922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15392. [D 20:42:47.727936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15393. [D 20:42:47.727956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15394. [D 20:42:47.727972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15395. [D 20:42:47.727987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15396. [D 20:42:47.728001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15397. [D 20:42:47.728016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15398. [D 20:42:47.728031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15399. [D 20:42:47.728045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15400. [D 20:42:47.728060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15401. [D 20:42:47.728075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15402. [D 20:42:47.728128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15403. [D 20:42:47.728143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15404. [D 20:42:47.728157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15405. [D 20:42:47.728172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15406. [D 20:42:47.728187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15407. [D 20:42:47.728201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15408. [D 20:42:47.728215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15409. [D 20:42:47.728231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15410. [D 20:42:47.728245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 15411. [D 20:42:47.728259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 15412. [D 20:42:47.728274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 15413. [D 20:42:47.728289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 15414. [D 20:42:47.728303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 15415. [D 20:42:47.728327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 15416. [D 20:42:47.728384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 15417. [D 20:42:47.728403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 15418. [D 20:42:47.728419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 15419. [D 20:42:47.728435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 15420. [D 20:42:47.728450] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 15421. [D 20:42:47.733810] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15421. [D 20:42:47.733832] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 11/70. [D 20:42:47.733937] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.733989] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.734002] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.762028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.762049] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.762061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.762098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3872 [D 20:42:47.762113] element 0: offset: 0x2aaaab62e5b0, size: 24 [D 20:42:47.762132] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 12/70. [D 20:42:47.765621] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3872 [D 20:42:47.765656] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 13/70. [D 20:42:47.765747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15421. [D 20:42:47.765816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15422. [D 20:42:47.765833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15423. [D 20:42:47.765848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15424. [D 20:42:47.765919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15425. [D 20:42:47.765936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15426. [D 20:42:47.766004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15427. [D 20:42:47.766131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15428. [D 20:42:47.766149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15429. [D 20:42:47.766164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15430. [D 20:42:47.766234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15431. [D 20:42:47.766252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15432. [D 20:42:47.766345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15433. [D 20:42:47.766455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15434. [D 20:42:47.766473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15435. [D 20:42:47.766488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15436. [D 20:42:47.766557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15437. [D 20:42:47.766706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15438. [D 20:42:47.766725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15439. [D 20:42:47.766740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15440. [D 20:42:47.766809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15441. [D 20:42:47.766906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15442. [D 20:42:47.766967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15443. [D 20:42:47.767030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15444. [D 20:42:47.767155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15445. [D 20:42:47.767172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15446. [D 20:42:47.767187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15447. [D 20:42:47.767257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15448. [D 20:42:47.767274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15449. [D 20:42:47.767342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15450. [D 20:42:47.767450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15451. [D 20:42:47.767468] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15452. [D 20:42:47.771762] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15452. [D 20:42:47.771784] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 14/70. [D 20:42:47.771888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.771940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.771953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.850826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.850847] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.850860] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.850898] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3874 [D 20:42:47.850913] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:47.850932] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 15/70. [D 20:42:47.854377] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3874 [D 20:42:47.854405] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 16/70. [D 20:42:47.854526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15452. [D 20:42:47.854550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15453. [D 20:42:47.854572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15454. [D 20:42:47.854602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15455. [D 20:42:47.854621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15456. [D 20:42:47.854639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15457. [D 20:42:47.854658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15458. [D 20:42:47.854677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15459. [D 20:42:47.854695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15460. [D 20:42:47.854713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15461. [D 20:42:47.854732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15462. [D 20:42:47.854750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15463. [D 20:42:47.854768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15464. [D 20:42:47.854787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15465. [D 20:42:47.854805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15466. [D 20:42:47.854824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15467. [D 20:42:47.854842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15468. [D 20:42:47.854860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15469. [D 20:42:47.854879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15470. [D 20:42:47.854897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15471. [D 20:42:47.854916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15472. [D 20:42:47.854934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15473. [D 20:42:47.854952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15474. [D 20:42:47.854971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15475. [D 20:42:47.854989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15476. [D 20:42:47.855008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15477. [D 20:42:47.855024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15478. [D 20:42:47.855039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15479. [D 20:42:47.855057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15480. [D 20:42:47.855075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15481. [D 20:42:47.855094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15482. [D 20:42:47.855109] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15483. [D 20:42:47.860495] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15483. [D 20:42:47.860514] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 17/70. [D 20:42:47.860616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.860666] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.860680] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:47.968953] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:47.968974] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.968987] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:47.969025] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3878 [D 20:42:47.969040] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:47.969059] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 18/70. [D 20:42:47.972686] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3878 [D 20:42:47.972723] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 19/70. [D 20:42:47.972772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15483. [D 20:42:47.972789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15484. [D 20:42:47.972804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15485. [D 20:42:47.972835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15486. [D 20:42:47.972850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15487. [D 20:42:47.972864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15488. [D 20:42:47.972879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15489. [D 20:42:47.972898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15490. [D 20:42:47.972912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15491. [D 20:42:47.972927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15492. [D 20:42:47.972942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15493. [D 20:42:47.972957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15494. [D 20:42:47.972971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15495. [D 20:42:47.972987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15496. [D 20:42:47.973002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15497. [D 20:42:47.973033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15498. [D 20:42:47.973048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15499. [D 20:42:47.973069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15500. [D 20:42:47.973083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15501. [D 20:42:47.973098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15502. [D 20:42:47.973113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15503. [D 20:42:47.973127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15504. [D 20:42:47.973142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15505. [D 20:42:47.973170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15506. [D 20:42:47.973184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15507. [D 20:42:47.973199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15508. [D 20:42:47.973214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15509. [D 20:42:47.973229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15510. [D 20:42:47.973266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15511. [D 20:42:47.973281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15512. [D 20:42:47.973305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15513. [D 20:42:47.973321] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15514. [D 20:42:47.978709] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15514. [D 20:42:47.978728] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 20/70. [D 20:42:47.978831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:47.978882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:47.978896] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.079076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.079098] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.079111] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.079149] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3880 [D 20:42:48.079164] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:48.079183] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 21/70. [D 20:42:48.082894] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3880 [D 20:42:48.082930] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 22/70. [D 20:42:48.082979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 15514. [D 20:42:48.082996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 15515. [D 20:42:48.083011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15516. [D 20:42:48.083026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15517. [D 20:42:48.083043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15518. [D 20:42:48.083057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15519. [D 20:42:48.083072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15520. [D 20:42:48.083087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15521. [D 20:42:48.083118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15522. [D 20:42:48.083133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15523. [D 20:42:48.083147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15524. [D 20:42:48.083162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15525. [D 20:42:48.083177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15526. [D 20:42:48.083192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15527. [D 20:42:48.083207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15528. [D 20:42:48.083242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15529. [D 20:42:48.083256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15530. [D 20:42:48.083276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15531. [D 20:42:48.083291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15532. [D 20:42:48.083306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15533. [D 20:42:48.083321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15534. [D 20:42:48.083335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 15535. [D 20:42:48.083350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 15536. [D 20:42:48.083364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 15537. [D 20:42:48.083383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 15538. [D 20:42:48.083400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 15539. [D 20:42:48.083414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 15540. [D 20:42:48.083429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 15541. [D 20:42:48.083445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 15542. [D 20:42:48.083490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 15543. [D 20:42:48.083512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 15544. [D 20:42:48.083527] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 15545. [D 20:42:48.088856] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15545. [D 20:42:48.088875] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 23/70. [D 20:42:48.088977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.089028] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.089042] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.160244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.160264] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.160278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.160316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3883 [D 20:42:48.160331] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.160352] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 24/70. [D 20:42:48.163674] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3883 [D 20:42:48.163702] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 25/70. [D 20:42:48.163758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 15545. [D 20:42:48.163777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 15546. [D 20:42:48.163792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 15547. [D 20:42:48.163807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 15548. [D 20:42:48.163822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 15549. [D 20:42:48.163837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 15550. [D 20:42:48.163851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 15551. [D 20:42:48.163866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 15552. [D 20:42:48.163881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 15553. [D 20:42:48.163895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 15554. [D 20:42:48.163910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 15555. [D 20:42:48.163926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 15556. [D 20:42:48.163940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 15557. [D 20:42:48.163955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 15558. [D 20:42:48.163970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 15559. [D 20:42:48.163985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 15560. [D 20:42:48.163999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 15561. [D 20:42:48.164014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 15562. [D 20:42:48.164028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 15563. [D 20:42:48.164043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 15564. [D 20:42:48.164058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 15565. [D 20:42:48.164076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 15566. [D 20:42:48.164093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 15567. [D 20:42:48.164107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 15568. [D 20:42:48.164129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 15569. [D 20:42:48.164177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 15570. [D 20:42:48.164197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 15571. [D 20:42:48.164212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 15572. [D 20:42:48.164226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 15573. [D 20:42:48.164241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 15574. [D 20:42:48.164256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 15575. [D 20:42:48.164271] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 15576. [D 20:42:48.169679] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15576. [D 20:42:48.169699] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 26/70. [D 20:42:48.169801] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.169851] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.169865] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.182979] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.182999] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.183012] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.183048] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3887 [D 20:42:48.183063] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:48.183082] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 27/70. [D 20:42:48.186731] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3887 [D 20:42:48.186768] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 28/70. [D 20:42:48.186819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15576. [D 20:42:48.186836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15577. [D 20:42:48.186851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15578. [D 20:42:48.186866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15579. [D 20:42:48.186881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15580. [D 20:42:48.186896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15581. [D 20:42:48.186910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15582. [D 20:42:48.186929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15583. [D 20:42:48.186944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15584. [D 20:42:48.186959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15585. [D 20:42:48.186973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15586. [D 20:42:48.186991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15587. [D 20:42:48.187023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15588. [D 20:42:48.187044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15589. [D 20:42:48.187078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15590. [D 20:42:48.187093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15591. [D 20:42:48.187112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15592. [D 20:42:48.187126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15593. [D 20:42:48.187141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15594. [D 20:42:48.187156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15595. [D 20:42:48.187171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15596. [D 20:42:48.187185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15597. [D 20:42:48.187200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15598. [D 20:42:48.187215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15599. [D 20:42:48.187230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15600. [D 20:42:48.187244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15601. [D 20:42:48.187260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15602. [D 20:42:48.187300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15603. [D 20:42:48.187315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15604. [D 20:42:48.187339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15605. [D 20:42:48.187353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15606. [D 20:42:48.187368] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15607. [D 20:42:48.192778] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15607. [D 20:42:48.192798] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 29/70. [D 20:42:48.192902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.192954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.192968] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.234641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.234662] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.234675] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.234713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3889 [D 20:42:48.234728] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:48.234747] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 30/70. [D 20:42:48.238393] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3889 [D 20:42:48.238429] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 31/70. [D 20:42:48.238481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15607. [D 20:42:48.238498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15608. [D 20:42:48.238513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15609. [D 20:42:48.238546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15610. [D 20:42:48.238561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15611. [D 20:42:48.238576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15612. [D 20:42:48.238590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15613. [D 20:42:48.238606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15614. [D 20:42:48.238620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15615. [D 20:42:48.238635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15616. [D 20:42:48.238650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15617. [D 20:42:48.238664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15618. [D 20:42:48.238679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15619. [D 20:42:48.238694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15620. [D 20:42:48.238739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15621. [D 20:42:48.238753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15622. [D 20:42:48.238773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15623. [D 20:42:48.238788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15624. [D 20:42:48.238802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15625. [D 20:42:48.238817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15626. [D 20:42:48.238832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15627. [D 20:42:48.238858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15628. [D 20:42:48.238873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15629. [D 20:42:48.238888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15630. [D 20:42:48.238903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15631. [D 20:42:48.238918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15632. [D 20:42:48.238932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15633. [D 20:42:48.238947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15634. [D 20:42:48.238985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15635. [D 20:42:48.239007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15636. [D 20:42:48.239023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15637. [D 20:42:48.239037] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15638. [D 20:42:48.244412] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15638. [D 20:42:48.244432] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 32/70. [D 20:42:48.244534] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.244586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.244600] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.401772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.401793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.401806] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.401843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3893 [D 20:42:48.401858] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:48.401878] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 33/70. [D 20:42:48.405492] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3893 [D 20:42:48.405525] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 34/70. [D 20:42:48.405578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15638. [D 20:42:48.405600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15639. [D 20:42:48.405614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15640. [D 20:42:48.405629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15641. [D 20:42:48.405645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15642. [D 20:42:48.405664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15643. [D 20:42:48.405679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15644. [D 20:42:48.405712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15645. [D 20:42:48.405728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15646. [D 20:42:48.405742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15647. [D 20:42:48.405757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15648. [D 20:42:48.405771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15649. [D 20:42:48.405785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15650. [D 20:42:48.405800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15651. [D 20:42:48.405814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15652. [D 20:42:48.405829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15653. [D 20:42:48.405843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15654. [D 20:42:48.405859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15655. [D 20:42:48.405894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15656. [D 20:42:48.405912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15657. [D 20:42:48.405932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15658. [D 20:42:48.405947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15659. [D 20:42:48.405961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15660. [D 20:42:48.405976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15661. [D 20:42:48.405990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15662. [D 20:42:48.406005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15663. [D 20:42:48.406019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15664. [D 20:42:48.406047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15665. [D 20:42:48.406062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15666. [D 20:42:48.406076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15667. [D 20:42:48.406091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15668. [D 20:42:48.406105] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15669. [D 20:42:48.414218] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15669. [D 20:42:48.414243] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 35/70. [D 20:42:48.414384] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.414435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.414449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.422989] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.423010] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.423023] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.423062] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3896 [D 20:42:48.423077] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.423095] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 36/70. [D 20:42:48.426793] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3896 [D 20:42:48.426827] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 37/70. [D 20:42:48.426880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15669. [D 20:42:48.426897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15670. [D 20:42:48.426912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15671. [D 20:42:48.426927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15672. [D 20:42:48.426941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15673. [D 20:42:48.426956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15674. [D 20:42:48.426985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15675. [D 20:42:48.427000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15676. [D 20:42:48.427014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15677. [D 20:42:48.427029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15678. [D 20:42:48.427043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15679. [D 20:42:48.427058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15680. [D 20:42:48.427072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15681. [D 20:42:48.427086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15682. [D 20:42:48.427101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15683. [D 20:42:48.427137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15684. [D 20:42:48.427152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15685. [D 20:42:48.427172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15686. [D 20:42:48.427186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15687. [D 20:42:48.427201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15688. [D 20:42:48.427215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15689. [D 20:42:48.427229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15690. [D 20:42:48.427244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15691. [D 20:42:48.427258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15692. [D 20:42:48.427272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15693. [D 20:42:48.427287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15694. [D 20:42:48.427302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15695. [D 20:42:48.427316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15696. [D 20:42:48.427331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15697. [D 20:42:48.427373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15698. [D 20:42:48.427388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15699. [D 20:42:48.427410] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15700. [D 20:42:48.435515] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15700. [D 20:42:48.435539] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 38/70. [D 20:42:48.435684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.435734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.435748] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.444556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.444577] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.444590] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.444627] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3899 [D 20:42:48.444642] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:48.444662] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 39/70. [D 20:42:48.448388] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3899 [D 20:42:48.448415] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 40/70. [D 20:42:48.448563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15700. [D 20:42:48.448584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15701. [D 20:42:48.448599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15702. [D 20:42:48.448621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15703. [D 20:42:48.448649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15704. [D 20:42:48.448664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15705. [D 20:42:48.448678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15706. [D 20:42:48.448693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15707. [D 20:42:48.448707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15708. [D 20:42:48.448722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15709. [D 20:42:48.448736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15710. [D 20:42:48.448751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15711. [D 20:42:48.448765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15712. [D 20:42:48.448807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15713. [D 20:42:48.448821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15714. [D 20:42:48.448841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15715. [D 20:42:48.448856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15716. [D 20:42:48.448870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15717. [D 20:42:48.448885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15718. [D 20:42:48.448899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15719. [D 20:42:48.448914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15720. [D 20:42:48.448940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15721. [D 20:42:48.448956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15722. [D 20:42:48.448971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15723. [D 20:42:48.448985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15724. [D 20:42:48.449000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15725. [D 20:42:48.449040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15726. [D 20:42:48.449062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15727. [D 20:42:48.449076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15728. [D 20:42:48.449091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15729. [D 20:42:48.449105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15730. [D 20:42:48.449120] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15731. [D 20:42:48.460181] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15731. [D 20:42:48.460205] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 41/70. [D 20:42:48.460347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.460396] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.460410] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.464037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.464058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.464071] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.464108] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3901 [D 20:42:48.464123] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:48.464143] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 42/70. [D 20:42:48.467705] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3901 [D 20:42:48.467736] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 43/70. [D 20:42:48.470208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 15731. [D 20:42:48.470229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 15732. [D 20:42:48.470246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15733. [D 20:42:48.470260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15734. [D 20:42:48.470275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15735. [D 20:42:48.470289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15736. [D 20:42:48.470304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15737. [D 20:42:48.470319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15738. [D 20:42:48.470333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15739. [D 20:42:48.470359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15740. [D 20:42:48.470373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15741. [D 20:42:48.470388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15742. [D 20:42:48.470407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15743. [D 20:42:48.470421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15744. [D 20:42:48.470436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15745. [D 20:42:48.470450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15746. [D 20:42:48.470465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15747. [D 20:42:48.470479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15748. [D 20:42:48.470493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15749. [D 20:42:48.470508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15750. [D 20:42:48.470548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15751. [D 20:42:48.470565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 15752. [D 20:42:48.470580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 15753. [D 20:42:48.470595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 15754. [D 20:42:48.470609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 15755. [D 20:42:48.470623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 15756. [D 20:42:48.470638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 15757. [D 20:42:48.470652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 15758. [D 20:42:48.470667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 15759. [D 20:42:48.470681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 15760. [D 20:42:48.470700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 15761. [D 20:42:48.470714] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 15762. [D 20:42:48.473938] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.473959] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.473976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:48.474020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3905 [D 20:42:48.474036] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.474051] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 44/70. [D 20:42:48.476109] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15762. [D 20:42:48.476132] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 45/70. [D 20:42:48.479283] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.479303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.479317] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:48.482351] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3905 [D 20:42:48.482376] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 46/70. [D 20:42:48.482526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15762. [D 20:42:48.482547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15763. [D 20:42:48.482562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15764. [D 20:42:48.482576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15765. [D 20:42:48.482590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15766. [D 20:42:48.482605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15767. [D 20:42:48.482619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15768. [D 20:42:48.482634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15769. [D 20:42:48.482648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15770. [D 20:42:48.482662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15771. [D 20:42:48.482677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15772. [D 20:42:48.482691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15773. [D 20:42:48.482705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15774. [D 20:42:48.482720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15775. [D 20:42:48.482734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15776. [D 20:42:48.482748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15777. [D 20:42:48.482763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15778. [D 20:42:48.482777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15779. [D 20:42:48.482791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15780. [D 20:42:48.482806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15781. [D 20:42:48.482820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15782. [D 20:42:48.482834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15783. [D 20:42:48.482848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15784. [D 20:42:48.482863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15785. [D 20:42:48.482877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15786. [D 20:42:48.482891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15787. [D 20:42:48.482906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15788. [D 20:42:48.482920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15789. [D 20:42:48.482934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15790. [D 20:42:48.482948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15791. [D 20:42:48.482963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15792. [D 20:42:48.482978] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15793. [D 20:42:48.489355] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15793. [D 20:42:48.489378] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 47/70. [D 20:42:48.491947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.492011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.492025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.495266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.495287] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.495301] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.495342] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3908 [D 20:42:48.495357] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:48.495377] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 48/70. [D 20:42:48.498729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.498803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.498817] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:48.498862] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3910 [D 20:42:48.498878] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:48.498898] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 49/70. [D 20:42:48.499311] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3908 [D 20:42:48.499343] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 50/70. [D 20:42:48.499392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15793. [D 20:42:48.499408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15794. [D 20:42:48.499422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15795. [D 20:42:48.499437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15796. [D 20:42:48.499451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15797. [D 20:42:48.499465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15798. [D 20:42:48.499480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15799. [D 20:42:48.499494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15800. [D 20:42:48.499508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15801. [D 20:42:48.499523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15802. [D 20:42:48.499537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15803. [D 20:42:48.499551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15804. [D 20:42:48.499566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15805. [D 20:42:48.499580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15806. [D 20:42:48.499594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15807. [D 20:42:48.499609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15808. [D 20:42:48.499623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15809. [D 20:42:48.499637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15810. [D 20:42:48.499652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15811. [D 20:42:48.499666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15812. [D 20:42:48.499680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15813. [D 20:42:48.499695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15814. [D 20:42:48.499709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15815. [D 20:42:48.499723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15816. [D 20:42:48.499737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15817. [D 20:42:48.499753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15818. [D 20:42:48.499772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15819. [D 20:42:48.499786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15820. [D 20:42:48.499801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15821. [D 20:42:48.499816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15822. [D 20:42:48.499831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15823. [D 20:42:48.499845] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15824. [D 20:42:48.503821] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3910 [D 20:42:48.503846] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 51/70. [D 20:42:48.507103] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15824. [D 20:42:48.507129] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 52/70. [D 20:42:48.507146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15824. [D 20:42:48.507161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15825. [D 20:42:48.507178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15826. [D 20:42:48.507194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15827. [D 20:42:48.507209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15828. [D 20:42:48.507223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15829. [D 20:42:48.507252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15830. [D 20:42:48.507266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15831. [D 20:42:48.507280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15832. [D 20:42:48.507298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15833. [D 20:42:48.507313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15834. [D 20:42:48.507327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15835. [D 20:42:48.507341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15836. [D 20:42:48.507356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15837. [D 20:42:48.507370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15838. [D 20:42:48.507385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15839. [D 20:42:48.507417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15840. [D 20:42:48.507435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15841. [D 20:42:48.507450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15842. [D 20:42:48.507468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15843. [D 20:42:48.507483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15844. [D 20:42:48.507497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15845. [D 20:42:48.507511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15846. [D 20:42:48.507525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15847. [D 20:42:48.507540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15848. [D 20:42:48.507553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15849. [D 20:42:48.507572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 15850. [D 20:42:48.507586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 15851. [D 20:42:48.507619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 15852. [D 20:42:48.507633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 15853. [D 20:42:48.507649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 15854. [D 20:42:48.507663] openib_post_sr_rdmaw: ibv_post_send wr_id 61f990 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 15855. [D 20:42:48.510767] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.510787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.510805] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:48.518752] openib_check_cq: completed rdma wr_id 61f990, nic_wr_credit 15855. [D 20:42:48.518777] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 53/70. [D 20:42:48.523958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.523977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.523991] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.524014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.524028] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.524041] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.524070] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3914 [D 20:42:48.524086] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.524101] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 54/70. [D 20:42:48.527791] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3914 [D 20:42:48.527814] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 55/70. [D 20:42:48.528953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15855. [D 20:42:48.528973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15856. [D 20:42:48.528989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15857. [D 20:42:48.529004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15858. [D 20:42:48.529019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15859. [D 20:42:48.529033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15860. [D 20:42:48.529047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15861. [D 20:42:48.529062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15862. [D 20:42:48.529077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15863. [D 20:42:48.529101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15864. [D 20:42:48.529115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15865. [D 20:42:48.529130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15866. [D 20:42:48.529148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15867. [D 20:42:48.529162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15868. [D 20:42:48.529177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15869. [D 20:42:48.529191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15870. [D 20:42:48.529205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15871. [D 20:42:48.529220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15872. [D 20:42:48.529235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15873. [D 20:42:48.529250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15874. [D 20:42:48.529286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15875. [D 20:42:48.529300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15876. [D 20:42:48.529324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15877. [D 20:42:48.529339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15878. [D 20:42:48.529353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15879. [D 20:42:48.529368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15880. [D 20:42:48.529382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15881. [D 20:42:48.529397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15882. [D 20:42:48.529411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15883. [D 20:42:48.529426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15884. [D 20:42:48.529440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15885. [D 20:42:48.529458] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15886. [D 20:42:48.529501] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.529516] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.529529] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:48.529552] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3916 [D 20:42:48.529566] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:48.529581] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 56/70. [D 20:42:48.534930] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15886. [D 20:42:48.534950] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 57/70. [D 20:42:48.535943] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.536005] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.536019] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:48.539467] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3916 [D 20:42:48.539492] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 58/70. [D 20:42:48.539633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 15886. [D 20:42:48.539652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 15887. [D 20:42:48.539667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 15888. [D 20:42:48.539682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 15889. [D 20:42:48.539697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 15890. [D 20:42:48.539711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 15891. [D 20:42:48.539726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 15892. [D 20:42:48.539740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 15893. [D 20:42:48.539754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 15894. [D 20:42:48.539772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 15895. [D 20:42:48.539792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 15896. [D 20:42:48.539806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 15897. [D 20:42:48.539821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 15898. [D 20:42:48.539836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 15899. [D 20:42:48.539850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 15900. [D 20:42:48.539865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 15901. [D 20:42:48.539879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 15902. [D 20:42:48.539893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 15903. [D 20:42:48.539908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 15904. [D 20:42:48.539922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 15905. [D 20:42:48.539936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 15906. [D 20:42:48.539951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 15907. [D 20:42:48.539965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 15908. [D 20:42:48.539979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 15909. [D 20:42:48.539994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 15910. [D 20:42:48.540008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 15911. [D 20:42:48.540022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 15912. [D 20:42:48.540036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 15913. [D 20:42:48.540051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 15914. [D 20:42:48.540065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 15915. [D 20:42:48.540081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 15916. [D 20:42:48.540095] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 15917. [D 20:42:48.546810] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15917. [D 20:42:48.546833] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 59/70. [D 20:42:48.546922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.546980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.546994] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.547915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.547931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.547943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.547984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3920 [D 20:42:48.548000] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:48.548020] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 60/70. [D 20:42:48.551798] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3920 [D 20:42:48.551823] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 0/70. [D 20:42:48.551877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15917. [D 20:42:48.551894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15918. [D 20:42:48.551909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15919. [D 20:42:48.551923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15920. [D 20:42:48.551937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15921. [D 20:42:48.551952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15922. [D 20:42:48.551966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15923. [D 20:42:48.551980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15924. [D 20:42:48.551994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15925. [D 20:42:48.552008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15926. [D 20:42:48.552023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15927. [D 20:42:48.552037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15928. [D 20:42:48.552051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15929. [D 20:42:48.552065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15930. [D 20:42:48.552079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15931. [D 20:42:48.552093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15932. [D 20:42:48.552108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15933. [D 20:42:48.552122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15934. [D 20:42:48.552136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15935. [D 20:42:48.552150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15936. [D 20:42:48.552165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15937. [D 20:42:48.552179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15938. [D 20:42:48.552193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15939. [D 20:42:48.552207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15940. [D 20:42:48.552221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15941. [D 20:42:48.552235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15942. [D 20:42:48.552249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15943. [D 20:42:48.552264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15944. [D 20:42:48.552278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15945. [D 20:42:48.552293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15946. [D 20:42:48.552308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15947. [D 20:42:48.552322] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15948. [D 20:42:48.560559] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15948. [D 20:42:48.560581] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 1/70. [D 20:42:48.560718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.560779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.560793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.569306] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.569329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.569342] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.569382] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3923 [D 20:42:48.569397] element 0: offset: 0x2aaaab639150, size: 24 [D 20:42:48.569418] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 2/70. [D 20:42:48.573195] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3923 [D 20:42:48.573226] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 3/70. [D 20:42:48.573278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15948. [D 20:42:48.573297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 15949. [D 20:42:48.573311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 15950. [D 20:42:48.573325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 15951. [D 20:42:48.573340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 15952. [D 20:42:48.573355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 15953. [D 20:42:48.573371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15954. [D 20:42:48.573385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15955. [D 20:42:48.573400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15956. [D 20:42:48.573414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 15957. [D 20:42:48.573428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 15958. [D 20:42:48.573442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 15959. [D 20:42:48.573456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 15960. [D 20:42:48.573475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 15961. [D 20:42:48.573489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15962. [D 20:42:48.573503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15963. [D 20:42:48.573517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15964. [D 20:42:48.573531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 15965. [D 20:42:48.573545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 15966. [D 20:42:48.573559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 15967. [D 20:42:48.573574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 15968. [D 20:42:48.573588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 15969. [D 20:42:48.573602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15970. [D 20:42:48.573616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15971. [D 20:42:48.573630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15972. [D 20:42:48.573644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 15973. [D 20:42:48.573658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 15974. [D 20:42:48.573672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 15975. [D 20:42:48.573687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 15976. [D 20:42:48.573704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 15977. [D 20:42:48.573719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15978. [D 20:42:48.573734] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15979. [D 20:42:48.582383] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 15979. [D 20:42:48.582409] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 4/70. [D 20:42:48.582552] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.582611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.582625] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.597996] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.598017] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.598030] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.598070] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3925 [D 20:42:48.598086] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:48.598107] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 5/70. [D 20:42:48.601503] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3925 [D 20:42:48.601535] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 6/70. [D 20:42:48.601596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 15979. [D 20:42:48.601615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 15980. [D 20:42:48.601773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 15981. [D 20:42:48.601799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 15982. [D 20:42:48.601936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 15983. [D 20:42:48.602087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 15984. [D 20:42:48.602111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 15985. [D 20:42:48.602215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 15986. [D 20:42:48.602317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 15987. [D 20:42:48.602418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 15988. [D 20:42:48.602435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 15989. [D 20:42:48.602567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 15990. [D 20:42:48.602671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 15991. [D 20:42:48.602775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 15992. [D 20:42:48.602898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 15993. [D 20:42:48.603008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 15994. [D 20:42:48.603108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 15995. [D 20:42:48.603216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 15996. [D 20:42:48.603316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 15997. [D 20:42:48.603424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 15998. [D 20:42:48.603525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 15999. [D 20:42:48.603631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16000. [D 20:42:48.603751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16001. [D 20:42:48.603864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16002. [D 20:42:48.603882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16003. [D 20:42:48.604024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16004. [D 20:42:48.604138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16005. [D 20:42:48.604172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16006. [D 20:42:48.604275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16007. [D 20:42:48.604382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16008. [D 20:42:48.604483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16009. [D 20:42:48.604600] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16010. [D 20:42:48.607473] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16010. [D 20:42:48.607497] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 7/70. [D 20:42:48.607734] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.607792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.607806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.627833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.627852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.627865] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.627904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3928 [D 20:42:48.627919] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:48.627939] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 8/70. [D 20:42:48.631359] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3928 [D 20:42:48.631387] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 9/70. [D 20:42:48.631580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16010. [D 20:42:48.631604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16011. [D 20:42:48.631628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16012. [D 20:42:48.631646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16013. [D 20:42:48.631670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16014. [D 20:42:48.631688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16015. [D 20:42:48.631707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16016. [D 20:42:48.631725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16017. [D 20:42:48.631743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16018. [D 20:42:48.631761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16019. [D 20:42:48.631780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16020. [D 20:42:48.631795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16021. [D 20:42:48.631811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16022. [D 20:42:48.631833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16023. [D 20:42:48.631852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16024. [D 20:42:48.631870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16025. [D 20:42:48.631888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16026. [D 20:42:48.631907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16027. [D 20:42:48.631925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16028. [D 20:42:48.631943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16029. [D 20:42:48.631961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16030. [D 20:42:48.631980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16031. [D 20:42:48.631998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16032. [D 20:42:48.632014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16033. [D 20:42:48.632029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16034. [D 20:42:48.632048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16035. [D 20:42:48.632066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16036. [D 20:42:48.632085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16037. [D 20:42:48.632103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16038. [D 20:42:48.632122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16039. [D 20:42:48.632140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16040. [D 20:42:48.632156] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16041. [D 20:42:48.637476] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16041. [D 20:42:48.637500] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 10/70. [D 20:42:48.637595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.637648] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.637662] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.682870] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.682890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.682903] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.682941] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3931 [D 20:42:48.682956] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:48.682976] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 11/70. [D 20:42:48.686357] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3931 [D 20:42:48.686438] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 12/70. [D 20:42:48.686511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16041. [D 20:42:48.686539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16042. [D 20:42:48.686554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16043. [D 20:42:48.686576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16044. [D 20:42:48.686781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16045. [D 20:42:48.686803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16046. [D 20:42:48.686950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16047. [D 20:42:48.687062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16048. [D 20:42:48.687164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16049. [D 20:42:48.687284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16050. [D 20:42:48.687394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16051. [D 20:42:48.687496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16052. [D 20:42:48.687601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16053. [D 20:42:48.687706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16054. [D 20:42:48.687810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16055. [D 20:42:48.687920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16056. [D 20:42:48.688021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16057. [D 20:42:48.688144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16058. [D 20:42:48.688253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16059. [D 20:42:48.688354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16060. [D 20:42:48.688460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16061. [D 20:42:48.688561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16062. [D 20:42:48.688666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16063. [D 20:42:48.688768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16064. [D 20:42:48.688871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16065. [D 20:42:48.688977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16066. [D 20:42:48.689090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16067. [D 20:42:48.689198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16068. [D 20:42:48.689303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16069. [D 20:42:48.689410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16070. [D 20:42:48.689511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16071. [D 20:42:48.689618] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16072. [D 20:42:48.692450] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16072. [D 20:42:48.692474] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 13/70. [D 20:42:48.692649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.692673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.692686] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.718676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.718696] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.718709] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.718747] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3935 [D 20:42:48.718762] element 0: offset: 0x2aaaab611120, size: 24 [D 20:42:48.718779] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 14/70. [D 20:42:48.722344] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3935 [D 20:42:48.722423] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 15/70. [D 20:42:48.722483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16072. [D 20:42:48.722508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16073. [D 20:42:48.722523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16074. [D 20:42:48.722538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16075. [D 20:42:48.722553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16076. [D 20:42:48.722568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16077. [D 20:42:48.722582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16078. [D 20:42:48.722597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16079. [D 20:42:48.722612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16080. [D 20:42:48.722627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16081. [D 20:42:48.722642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16082. [D 20:42:48.722657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16083. [D 20:42:48.722672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16084. [D 20:42:48.722719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16085. [D 20:42:48.722738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16086. [D 20:42:48.722753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16087. [D 20:42:48.722768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16088. [D 20:42:48.722783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16089. [D 20:42:48.722798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16090. [D 20:42:48.722813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16091. [D 20:42:48.722827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16092. [D 20:42:48.722842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16093. [D 20:42:48.722857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16094. [D 20:42:48.722874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16095. [D 20:42:48.722891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16096. [D 20:42:48.722906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16097. [D 20:42:48.722921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16098. [D 20:42:48.722936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16099. [D 20:42:48.722997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16100. [D 20:42:48.723012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16101. [D 20:42:48.723027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16102. [D 20:42:48.723042] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16103. [D 20:42:48.730999] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16103. [D 20:42:48.731025] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 16/70. [D 20:42:48.731166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.731190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.731204] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.739342] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.739363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.739376] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.739415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3938 [D 20:42:48.739431] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.739448] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 17/70. [D 20:42:48.743067] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3938 [D 20:42:48.743147] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 18/70. [D 20:42:48.743207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16103. [D 20:42:48.743233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16104. [D 20:42:48.743248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16105. [D 20:42:48.743263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16106. [D 20:42:48.743278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16107. [D 20:42:48.743292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16108. [D 20:42:48.743307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16109. [D 20:42:48.743322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16110. [D 20:42:48.743337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16111. [D 20:42:48.743352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16112. [D 20:42:48.743366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16113. [D 20:42:48.743381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16114. [D 20:42:48.743396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16115. [D 20:42:48.743444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16116. [D 20:42:48.743458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16117. [D 20:42:48.743477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16118. [D 20:42:48.743492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16119. [D 20:42:48.743507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16120. [D 20:42:48.743521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16121. [D 20:42:48.743536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16122. [D 20:42:48.743551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16123. [D 20:42:48.743565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16124. [D 20:42:48.743580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16125. [D 20:42:48.743599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16126. [D 20:42:48.743615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16127. [D 20:42:48.743630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16128. [D 20:42:48.743645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16129. [D 20:42:48.743695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16130. [D 20:42:48.743710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16131. [D 20:42:48.743731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16132. [D 20:42:48.743747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16133. [D 20:42:48.743761] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16134. [D 20:42:48.752285] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16134. [D 20:42:48.752310] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 19/70. [D 20:42:48.752453] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.752477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.752490] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.760240] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.760260] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.760273] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.760312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3941 [D 20:42:48.760327] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:48.760345] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 20/70. [D 20:42:48.763809] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3941 [D 20:42:48.763837] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 21/70. [D 20:42:48.763891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16134. [D 20:42:48.763908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16135. [D 20:42:48.763929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16136. [D 20:42:48.763948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16137. [D 20:42:48.763963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16138. [D 20:42:48.763978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16139. [D 20:42:48.763993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16140. [D 20:42:48.764007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16141. [D 20:42:48.764022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16142. [D 20:42:48.764037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16143. [D 20:42:48.764052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16144. [D 20:42:48.764066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16145. [D 20:42:48.764082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16146. [D 20:42:48.764125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16147. [D 20:42:48.764140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16148. [D 20:42:48.764161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16149. [D 20:42:48.764176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16150. [D 20:42:48.764190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16151. [D 20:42:48.764205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16152. [D 20:42:48.764220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16153. [D 20:42:48.764234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16154. [D 20:42:48.764249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16155. [D 20:42:48.764264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16156. [D 20:42:48.764294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16157. [D 20:42:48.764314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16158. [D 20:42:48.764331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16159. [D 20:42:48.764346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16160. [D 20:42:48.764370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16161. [D 20:42:48.764410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16162. [D 20:42:48.764428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16163. [D 20:42:48.764447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16164. [D 20:42:48.764462] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16165. [D 20:42:48.774912] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16165. [D 20:42:48.774936] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 22/70. [D 20:42:48.775081] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.775140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.775154] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.780985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.781006] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.781019] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.781060] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3944 [D 20:42:48.781075] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:48.781094] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 23/70. [D 20:42:48.784644] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3944 [D 20:42:48.784674] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 24/70. [D 20:42:48.787135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16165. [D 20:42:48.787155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16166. [D 20:42:48.787172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16167. [D 20:42:48.787187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16168. [D 20:42:48.787202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16169. [D 20:42:48.787216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16170. [D 20:42:48.787231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16171. [D 20:42:48.787246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16172. [D 20:42:48.787261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16173. [D 20:42:48.787294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16174. [D 20:42:48.787318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16175. [D 20:42:48.787332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16176. [D 20:42:48.787358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16177. [D 20:42:48.787374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16178. [D 20:42:48.787399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16179. [D 20:42:48.787426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16180. [D 20:42:48.787495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16181. [D 20:42:48.787511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16182. [D 20:42:48.787537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16183. [D 20:42:48.787563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16184. [D 20:42:48.787579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16185. [D 20:42:48.787601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16186. [D 20:42:48.787617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16187. [D 20:42:48.787643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16188. [D 20:42:48.787658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16189. [D 20:42:48.787682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16190. [D 20:42:48.787716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16191. [D 20:42:48.787741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16192. [D 20:42:48.787757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16193. [D 20:42:48.787775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16194. [D 20:42:48.787790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16195. [D 20:42:48.787805] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16196. [D 20:42:48.791202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.791225] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.791240] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:48.791271] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3946 [D 20:42:48.791287] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.791303] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 25/70. [D 20:42:48.798950] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16196. [D 20:42:48.798975] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 26/70. [D 20:42:48.802004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.802025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.802039] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:48.807170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.807191] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.807205] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:48.807228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3950 [D 20:42:48.807244] element 0: offset: 0x2aaaab610300, size: 24 [D 20:42:48.807259] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 27/70. [D 20:42:48.807342] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 3946 [D 20:42:48.807364] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 28/70. [D 20:42:48.807649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16196. [D 20:42:48.807673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16197. [D 20:42:48.807688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16198. [D 20:42:48.807703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16199. [D 20:42:48.807718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16200. [D 20:42:48.807732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16201. [D 20:42:48.807747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16202. [D 20:42:48.807762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16203. [D 20:42:48.807783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16204. [D 20:42:48.807802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16205. [D 20:42:48.807817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16206. [D 20:42:48.807832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16207. [D 20:42:48.807846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16208. [D 20:42:48.807861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16209. [D 20:42:48.807876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16210. [D 20:42:48.807890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16211. [D 20:42:48.807905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16212. [D 20:42:48.807919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16213. [D 20:42:48.807934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16214. [D 20:42:48.807949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16215. [D 20:42:48.807963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16216. [D 20:42:48.807978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16217. [D 20:42:48.807993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16218. [D 20:42:48.808007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16219. [D 20:42:48.808022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16220. [D 20:42:48.808036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16221. [D 20:42:48.808051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16222. [D 20:42:48.808066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16223. [D 20:42:48.808080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16224. [D 20:42:48.808095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16225. [D 20:42:48.808110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16226. [D 20:42:48.808125] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16227. [D 20:42:48.816160] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3950 [D 20:42:48.816185] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 29/70. [D 20:42:48.818495] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16227. [D 20:42:48.818515] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 30/70. [D 20:42:48.818547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16227. [D 20:42:48.818563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16228. [D 20:42:48.818577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16229. [D 20:42:48.818592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16230. [D 20:42:48.818607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16231. [D 20:42:48.818621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16232. [D 20:42:48.818636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16233. [D 20:42:48.818650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16234. [D 20:42:48.818665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16235. [D 20:42:48.818679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16236. [D 20:42:48.818694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16237. [D 20:42:48.818709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16238. [D 20:42:48.818723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16239. [D 20:42:48.818738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16240. [D 20:42:48.818752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16241. [D 20:42:48.818767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16242. [D 20:42:48.818781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16243. [D 20:42:48.818796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16244. [D 20:42:48.818811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16245. [D 20:42:48.818825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16246. [D 20:42:48.818840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16247. [D 20:42:48.818855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16248. [D 20:42:48.818869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16249. [D 20:42:48.818884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16250. [D 20:42:48.818898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16251. [D 20:42:48.818913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16252. [D 20:42:48.818928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16253. [D 20:42:48.818942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16254. [D 20:42:48.818957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16255. [D 20:42:48.818972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16256. [D 20:42:48.818987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16257. [D 20:42:48.819002] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16258. [D 20:42:48.819783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.819800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.819814] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:48.825354] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 16258. [D 20:42:48.825374] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 31/70. [D 20:42:48.827876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.827936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.827950] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.830411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.830431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.830444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.830485] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3953 [D 20:42:48.830500] element 0: offset: 0x2aaaab639180, size: 24 [D 20:42:48.830520] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 32/70. [D 20:42:48.834105] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3953 [D 20:42:48.834133] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 33/70. [D 20:42:48.834183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16258. [D 20:42:48.834200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16259. [D 20:42:48.834215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16260. [D 20:42:48.834229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16261. [D 20:42:48.834244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16262. [D 20:42:48.834259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16263. [D 20:42:48.834274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16264. [D 20:42:48.834288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16265. [D 20:42:48.834303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16266. [D 20:42:48.834318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16267. [D 20:42:48.834333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16268. [D 20:42:48.834347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16269. [D 20:42:48.834394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16270. [D 20:42:48.834413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16271. [D 20:42:48.834428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16272. [D 20:42:48.834442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16273. [D 20:42:48.834457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16274. [D 20:42:48.834471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16275. [D 20:42:48.834486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16276. [D 20:42:48.834500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16277. [D 20:42:48.834515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16278. [D 20:42:48.834530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16279. [D 20:42:48.834544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16280. [D 20:42:48.834561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16281. [D 20:42:48.834576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16282. [D 20:42:48.834590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16283. [D 20:42:48.834631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16284. [D 20:42:48.834660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16285. [D 20:42:48.834675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16286. [D 20:42:48.834689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16287. [D 20:42:48.834707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16288. [D 20:42:48.834722] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16289. [D 20:42:48.845389] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16289. [D 20:42:48.845409] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 34/70. [D 20:42:48.845554] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.845613] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.845627] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.851345] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.851367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.851380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.851421] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3956 [D 20:42:48.851436] element 0: offset: 0x2aaaab63aac0, size: 24 [D 20:42:48.851456] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 35/70. [D 20:42:48.855436] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3956 [D 20:42:48.855462] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 36/70. [D 20:42:48.855605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16289. [D 20:42:48.855622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16290. [D 20:42:48.855638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16291. [D 20:42:48.855652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16292. [D 20:42:48.855667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16293. [D 20:42:48.855693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16294. [D 20:42:48.855708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16295. [D 20:42:48.855723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16296. [D 20:42:48.855742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16297. [D 20:42:48.855757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16298. [D 20:42:48.855792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16299. [D 20:42:48.855807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16300. [D 20:42:48.855822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16301. [D 20:42:48.855859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16302. [D 20:42:48.855875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16303. [D 20:42:48.855889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16304. [D 20:42:48.855909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16305. [D 20:42:48.855923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16306. [D 20:42:48.855938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16307. [D 20:42:48.855952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16308. [D 20:42:48.855967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16309. [D 20:42:48.855982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16310. [D 20:42:48.855997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16311. [D 20:42:48.856012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16312. [D 20:42:48.856054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16313. [D 20:42:48.856070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16314. [D 20:42:48.856092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16315. [D 20:42:48.856107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16316. [D 20:42:48.856122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16317. [D 20:42:48.856136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16318. [D 20:42:48.856151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16319. [D 20:42:48.856166] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16320. [D 20:42:48.862746] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16320. [D 20:42:48.862770] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 37/70. [D 20:42:48.862874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.862931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.862945] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.864833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.864854] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.864867] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.864908] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3958 [D 20:42:48.864923] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:48.864942] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 38/70. [D 20:42:48.868712] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3958 [D 20:42:48.868742] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 39/70. [D 20:42:48.868876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 16320. [D 20:42:48.868893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 16321. [D 20:42:48.868908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16322. [D 20:42:48.868922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16323. [D 20:42:48.868937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16324. [D 20:42:48.868952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16325. [D 20:42:48.868966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16326. [D 20:42:48.868981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16327. [D 20:42:48.869005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16328. [D 20:42:48.869019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16329. [D 20:42:48.869039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16330. [D 20:42:48.869054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16331. [D 20:42:48.869069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16332. [D 20:42:48.869084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16333. [D 20:42:48.869103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16334. [D 20:42:48.869120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16335. [D 20:42:48.869135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16336. [D 20:42:48.869157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16337. [D 20:42:48.869190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16338. [D 20:42:48.869206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16339. [D 20:42:48.869229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16340. [D 20:42:48.869244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16341. [D 20:42:48.869259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16342. [D 20:42:48.869273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16343. [D 20:42:48.869288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16344. [D 20:42:48.869303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16345. [D 20:42:48.869318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16346. [D 20:42:48.869332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16347. [D 20:42:48.869347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16348. [D 20:42:48.869366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16349. [D 20:42:48.869380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16350. [D 20:42:48.869395] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16351. [D 20:42:48.876185] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16351. [D 20:42:48.876209] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 40/70. [D 20:42:48.876317] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.876376] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.876390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.877043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.877064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.877077] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.877117] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3962 [D 20:42:48.877132] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:48.877152] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 41/70. [D 20:42:48.880715] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3962 [D 20:42:48.880746] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 42/70. [D 20:42:48.880798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16351. [D 20:42:48.880815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16352. [D 20:42:48.880830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16353. [D 20:42:48.880848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16354. [D 20:42:48.880863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16355. [D 20:42:48.880878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16356. [D 20:42:48.880893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16357. [D 20:42:48.880908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16358. [D 20:42:48.880923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16359. [D 20:42:48.880939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16360. [D 20:42:48.880953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 16361. [D 20:42:48.880969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 16362. [D 20:42:48.881007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 16363. [D 20:42:48.881026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 16364. [D 20:42:48.881041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 16365. [D 20:42:48.881056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 16366. [D 20:42:48.881071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 16367. [D 20:42:48.881086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 16368. [D 20:42:48.881101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 16369. [D 20:42:48.881117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 16370. [D 20:42:48.881132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 16371. [D 20:42:48.881147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 16372. [D 20:42:48.881163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 16373. [D 20:42:48.881178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 16374. [D 20:42:48.881193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 16375. [D 20:42:48.881209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 16376. [D 20:42:48.881253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 16377. [D 20:42:48.881275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 16378. [D 20:42:48.881290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 16379. [D 20:42:48.881305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 16380. [D 20:42:48.881320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 16381. [D 20:42:48.881335] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 16382. [D 20:42:48.891870] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16382. [D 20:42:48.891890] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 43/70. [D 20:42:48.892039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.892097] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.892111] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.909209] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.909230] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.909243] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.909283] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3964 [D 20:42:48.909298] element 0: offset: 0x2aaaab610860, size: 24 [D 20:42:48.909318] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 44/70. [D 20:42:48.912908] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3964 [D 20:42:48.912935] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 45/70. [D 20:42:48.912991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16382. [D 20:42:48.913008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16383. [D 20:42:48.913026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16384. [D 20:42:48.913043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16385. [D 20:42:48.913058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16386. [D 20:42:48.913073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16387. [D 20:42:48.913104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16388. [D 20:42:48.913118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16389. [D 20:42:48.913133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16390. [D 20:42:48.913152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16391. [D 20:42:48.913168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16392. [D 20:42:48.913183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16393. [D 20:42:48.913201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16394. [D 20:42:48.913218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16395. [D 20:42:48.913233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16396. [D 20:42:48.913249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16397. [D 20:42:48.913282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16398. [D 20:42:48.913300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16399. [D 20:42:48.913315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16400. [D 20:42:48.913334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16401. [D 20:42:48.913349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16402. [D 20:42:48.913364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16403. [D 20:42:48.913382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16404. [D 20:42:48.913418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16405. [D 20:42:48.913432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16406. [D 20:42:48.913447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16407. [D 20:42:48.913462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16408. [D 20:42:48.913476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16409. [D 20:42:48.913491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16410. [D 20:42:48.913506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16411. [D 20:42:48.913520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16412. [D 20:42:48.913537] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16413. [D 20:42:48.918930] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16413. [D 20:42:48.918950] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 46/70. [D 20:42:48.919055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.919114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.919128] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:48.988423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:48.988444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.988457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:48.988497] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3967 [D 20:42:48.988512] element 0: offset: 0x2aaaab639180, size: 24 [D 20:42:48.988532] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 47/70. [D 20:42:48.992093] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3967 [D 20:42:48.992125] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 48/70. [D 20:42:48.992177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16413. [D 20:42:48.992194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16414. [D 20:42:48.992211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16415. [D 20:42:48.992226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16416. [D 20:42:48.992244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16417. [D 20:42:48.992264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16418. [D 20:42:48.992279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16419. [D 20:42:48.992322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16420. [D 20:42:48.992337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16421. [D 20:42:48.992352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16422. [D 20:42:48.992367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16423. [D 20:42:48.992382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16424. [D 20:42:48.992396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16425. [D 20:42:48.992411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16426. [D 20:42:48.992428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16427. [D 20:42:48.992443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16428. [D 20:42:48.992458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16429. [D 20:42:48.992490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16430. [D 20:42:48.992506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16431. [D 20:42:48.992521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16432. [D 20:42:48.992543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16433. [D 20:42:48.992558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16434. [D 20:42:48.992572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16435. [D 20:42:48.992587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16436. [D 20:42:48.992615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16437. [D 20:42:48.992630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16438. [D 20:42:48.992645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16439. [D 20:42:48.992659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16440. [D 20:42:48.992678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16441. [D 20:42:48.992693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16442. [D 20:42:48.992707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16443. [D 20:42:48.992722] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16444. [D 20:42:48.998117] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16444. [D 20:42:48.998137] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 49/70. [D 20:42:48.998241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:48.998292] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:48.998306] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.028394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.028415] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.028428] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.028466] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3971 [D 20:42:49.028481] element 0: offset: 0x2aaaab617f40, size: 24 [D 20:42:49.028501] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 50/70. [D 20:42:49.031789] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 655360, tag: 3971 [D 20:42:49.031819] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 51/70. [D 20:42:49.031950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 16444. [D 20:42:49.031970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 16445. [D 20:42:49.031985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 16446. [D 20:42:49.032000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 16447. [D 20:42:49.032015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 16448. [D 20:42:49.032036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 16449. [D 20:42:49.032056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 16450. [D 20:42:49.032071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 16451. [D 20:42:49.032090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 16452. [D 20:42:49.032105] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 16453. [D 20:42:49.035565] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16453. [D 20:42:49.035585] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 52/70. [D 20:42:49.035732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.035837] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.035852] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.039546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.039568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.039581] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.039617] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3974 [D 20:42:49.039632] element 0: offset: 0x2aaaab6182a0, size: 24 [D 20:42:49.039651] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 53/70. [D 20:42:49.039842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.039861] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.039874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.050205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.050225] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.050238] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.050261] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3976 [D 20:42:49.050275] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:49.050293] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 54/70. [D 20:42:49.053974] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3976 [D 20:42:49.054008] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 55/70. [D 20:42:49.054059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16453. [D 20:42:49.054076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16454. [D 20:42:49.054091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16455. [D 20:42:49.054106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16456. [D 20:42:49.054122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16457. [D 20:42:49.054137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16458. [D 20:42:49.054151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16459. [D 20:42:49.054166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16460. [D 20:42:49.054185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16461. [D 20:42:49.054200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16462. [D 20:42:49.054216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16463. [D 20:42:49.054231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16464. [D 20:42:49.054246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16465. [D 20:42:49.054261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16466. [D 20:42:49.054276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16467. [D 20:42:49.054325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16468. [D 20:42:49.054340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16469. [D 20:42:49.054356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16470. [D 20:42:49.054371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16471. [D 20:42:49.054385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16472. [D 20:42:49.054400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16473. [D 20:42:49.054415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16474. [D 20:42:49.054430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16475. [D 20:42:49.054445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16476. [D 20:42:49.054460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16477. [D 20:42:49.054475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16478. [D 20:42:49.054492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16479. [D 20:42:49.054507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16480. [D 20:42:49.054522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16481. [D 20:42:49.054537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16482. [D 20:42:49.054582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16483. [D 20:42:49.054604] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16484. [D 20:42:49.059990] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16484. [D 20:42:49.060010] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 56/70. [D 20:42:49.060112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.060163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.060177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.104298] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.104319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.104332] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.104371] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3979 [D 20:42:49.104385] element 0: offset: 0x2aaaab610860, size: 24 [D 20:42:49.104405] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 57/70. [D 20:42:49.107806] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3979 [D 20:42:49.107832] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 58/70. [D 20:42:49.107887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16484. [D 20:42:49.107905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16485. [D 20:42:49.107920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16486. [D 20:42:49.107935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16487. [D 20:42:49.107950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16488. [D 20:42:49.107965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16489. [D 20:42:49.107980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16490. [D 20:42:49.107995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16491. [D 20:42:49.108010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16492. [D 20:42:49.108024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16493. [D 20:42:49.108039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16494. [D 20:42:49.108054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16495. [D 20:42:49.108068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16496. [D 20:42:49.108083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16497. [D 20:42:49.108105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16498. [D 20:42:49.108155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16499. [D 20:42:49.108170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16500. [D 20:42:49.108184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16501. [D 20:42:49.108199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16502. [D 20:42:49.108214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16503. [D 20:42:49.108229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16504. [D 20:42:49.108255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16505. [D 20:42:49.108270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16506. [D 20:42:49.108285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16507. [D 20:42:49.108300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16508. [D 20:42:49.108315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16509. [D 20:42:49.108330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16510. [D 20:42:49.108345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16511. [D 20:42:49.108360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16512. [D 20:42:49.108375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16513. [D 20:42:49.108390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16514. [D 20:42:49.108406] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16515. [D 20:42:49.113807] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16515. [D 20:42:49.113827] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 59/70. [D 20:42:49.113930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.113982] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.113996] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.170772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.170793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.170806] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.170843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3982 [D 20:42:49.170858] element 0: offset: 0x2aaaab639180, size: 24 [D 20:42:49.170877] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:42:49.174644] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3982 [D 20:42:49.174670] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 0/70. [D 20:42:49.174727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 16515. [D 20:42:49.174744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 16516. [D 20:42:49.174760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 16517. [D 20:42:49.174775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 16518. [D 20:42:49.174791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 16519. [D 20:42:49.174806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 16520. [D 20:42:49.174821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 16521. [D 20:42:49.174840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 16522. [D 20:42:49.174855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 16523. [D 20:42:49.174883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 16524. [D 20:42:49.174898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 16525. [D 20:42:49.174913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 16526. [D 20:42:49.174928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 16527. [D 20:42:49.174943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 16528. [D 20:42:49.174987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 16529. [D 20:42:49.175003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 16530. [D 20:42:49.175023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 16531. [D 20:42:49.175037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 16532. [D 20:42:49.175052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 16533. [D 20:42:49.175067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 16534. [D 20:42:49.175082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 16535. [D 20:42:49.175097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 16536. [D 20:42:49.175111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 16537. [D 20:42:49.175129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 16538. [D 20:42:49.175145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 16539. [D 20:42:49.175160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 16540. [D 20:42:49.175181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 16541. [D 20:42:49.175220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 16542. [D 20:42:49.175235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 16543. [D 20:42:49.175258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 16544. [D 20:42:49.175274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 16545. [D 20:42:49.175301] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 16546. [D 20:42:49.180649] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16546. [D 20:42:49.180668] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 1/70. [D 20:42:49.180771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.180823] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.180837] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.246930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.246952] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.246965] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.247003] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3985 [D 20:42:49.247019] element 0: offset: 0x2aaaab637800, size: 24 [D 20:42:49.247038] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 2/70. [D 20:42:49.250702] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3985 [D 20:42:49.250736] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 3/70. [D 20:42:49.250790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16546. [D 20:42:49.250807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16547. [D 20:42:49.250831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16548. [D 20:42:49.250850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16549. [D 20:42:49.250875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16550. [D 20:42:49.250890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16551. [D 20:42:49.250908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16552. [D 20:42:49.250923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16553. [D 20:42:49.250942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16554. [D 20:42:49.250958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16555. [D 20:42:49.250973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16556. [D 20:42:49.250987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16557. [D 20:42:49.251002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16558. [D 20:42:49.251017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16559. [D 20:42:49.251032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16560. [D 20:42:49.251047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16561. [D 20:42:49.251093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16562. [D 20:42:49.251108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16563. [D 20:42:49.251128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16564. [D 20:42:49.251143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16565. [D 20:42:49.251158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16566. [D 20:42:49.251172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16567. [D 20:42:49.251201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16568. [D 20:42:49.251217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16569. [D 20:42:49.251232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16570. [D 20:42:49.251247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16571. [D 20:42:49.251262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16572. [D 20:42:49.251277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16573. [D 20:42:49.251293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16574. [D 20:42:49.251308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16575. [D 20:42:49.251349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16576. [D 20:42:49.251371] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16577. [D 20:42:49.256709] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16577. [D 20:42:49.256728] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 4/70. [D 20:42:49.256829] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.256881] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.256895] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.314181] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.314202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.314215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.314254] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3988 [D 20:42:49.314269] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:49.314289] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 5/70. [D 20:42:49.317872] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3988 [D 20:42:49.317902] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 6/70. [D 20:42:49.317952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16577. [D 20:42:49.317972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16578. [D 20:42:49.317992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16579. [D 20:42:49.318007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16580. [D 20:42:49.318021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16581. [D 20:42:49.318036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16582. [D 20:42:49.318061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16583. [D 20:42:49.318089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16584. [D 20:42:49.318104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16585. [D 20:42:49.318119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16586. [D 20:42:49.318144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16587. [D 20:42:49.318159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16588. [D 20:42:49.318178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16589. [D 20:42:49.318196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16590. [D 20:42:49.318214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16591. [D 20:42:49.318232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16592. [D 20:42:49.318250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16593. [D 20:42:49.318267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16594. [D 20:42:49.318285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16595. [D 20:42:49.318303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16596. [D 20:42:49.318330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16597. [D 20:42:49.318348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16598. [D 20:42:49.318366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16599. [D 20:42:49.318384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16600. [D 20:42:49.318402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16601. [D 20:42:49.318420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16602. [D 20:42:49.318438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16603. [D 20:42:49.318456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16604. [D 20:42:49.318473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16605. [D 20:42:49.318491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16606. [D 20:42:49.318509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16607. [D 20:42:49.318527] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16608. [D 20:42:49.323903] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16608. [D 20:42:49.323926] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 7/70. [D 20:42:49.324028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.324080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.324093] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.425831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.425852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.425865] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.425904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3991 [D 20:42:49.425919] element 0: offset: 0x2aaaab6183d0, size: 24 [D 20:42:49.425938] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 8/70. [D 20:42:49.429544] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3991 [D 20:42:49.429573] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 9/70. [D 20:42:49.429625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 16608. [D 20:42:49.429645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 16609. [D 20:42:49.429660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 16610. [D 20:42:49.429675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 16611. [D 20:42:49.429699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 16612. [D 20:42:49.429714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 16613. [D 20:42:49.429728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 16614. [D 20:42:49.429747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 16615. [D 20:42:49.429836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 16616. [D 20:42:49.430003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 16617. [D 20:42:49.430072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 16618. [D 20:42:49.430090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 16619. [D 20:42:49.430162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 16620. [D 20:42:49.430182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 16621. [D 20:42:49.430197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 16622. [D 20:42:49.430290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 16623. [D 20:42:49.430409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 16624. [D 20:42:49.430427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 16625. [D 20:42:49.430442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 16626. [D 20:42:49.430510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 16627. [D 20:42:49.430528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 16628. [D 20:42:49.430542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 16629. [D 20:42:49.430611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 16630. [D 20:42:49.430628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 16631. [D 20:42:49.430725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 16632. [D 20:42:49.430820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 16633. [D 20:42:49.430882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 16634. [D 20:42:49.430993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 16635. [D 20:42:49.431011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 16636. [D 20:42:49.431026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 16637. [D 20:42:49.431094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 16638. [D 20:42:49.431111] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 16639. [D 20:42:49.435580] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16639. [D 20:42:49.435602] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 10/70. [D 20:42:49.435704] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.435756] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.435775] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.524451] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.524472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.524485] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.524523] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3994 [D 20:42:49.524538] element 0: offset: 0x2aaaab639180, size: 24 [D 20:42:49.524558] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 11/70. [D 20:42:49.528073] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3994 [D 20:42:49.528159] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 12/70. [D 20:42:49.528348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16639. [D 20:42:49.528374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16640. [D 20:42:49.528395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16641. [D 20:42:49.528414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16642. [D 20:42:49.528432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16643. [D 20:42:49.528450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16644. [D 20:42:49.528469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16645. [D 20:42:49.528485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16646. [D 20:42:49.528500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16647. [D 20:42:49.528518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16648. [D 20:42:49.528536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16649. [D 20:42:49.528555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16650. [D 20:42:49.528574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16651. [D 20:42:49.528592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16652. [D 20:42:49.528611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16653. [D 20:42:49.528629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16654. [D 20:42:49.528647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16655. [D 20:42:49.528666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16656. [D 20:42:49.528684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16657. [D 20:42:49.528702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16658. [D 20:42:49.528721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16659. [D 20:42:49.528739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16660. [D 20:42:49.528757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16661. [D 20:42:49.528776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16662. [D 20:42:49.528794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16663. [D 20:42:49.528813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16664. [D 20:42:49.528831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16665. [D 20:42:49.528850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16666. [D 20:42:49.528868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16667. [D 20:42:49.528887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16668. [D 20:42:49.528905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16669. [D 20:42:49.528920] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16670. [D 20:42:49.534278] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16670. [D 20:42:49.534303] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 13/70. [D 20:42:49.534431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.534482] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.534496] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.573133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.573154] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.573167] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.573204] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 3997 [D 20:42:49.573219] element 0: offset: 0x2aaaab637800, size: 24 [D 20:42:49.573239] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 14/70. [D 20:42:49.576939] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 3997 [D 20:42:49.576971] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 15/70. [D 20:42:49.577023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 16670. [D 20:42:49.577053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 16671. [D 20:42:49.577069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 16672. [D 20:42:49.577092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 16673. [D 20:42:49.577107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 16674. [D 20:42:49.577122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 16675. [D 20:42:49.577141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 16676. [D 20:42:49.577156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 16677. [D 20:42:49.577171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 16678. [D 20:42:49.577185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 16679. [D 20:42:49.577201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 16680. [D 20:42:49.577215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 16681. [D 20:42:49.577230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 16682. [D 20:42:49.577245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 16683. [D 20:42:49.577289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 16684. [D 20:42:49.577304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 16685. [D 20:42:49.577325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 16686. [D 20:42:49.577340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 16687. [D 20:42:49.577367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 16688. [D 20:42:49.577382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 16689. [D 20:42:49.577397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 16690. [D 20:42:49.577412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 16691. [D 20:42:49.577430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 16692. [D 20:42:49.577447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 16693. [D 20:42:49.577462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 16694. [D 20:42:49.577483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 16695. [D 20:42:49.577520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 16696. [D 20:42:49.577538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 16697. [D 20:42:49.577559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 16698. [D 20:42:49.577574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 16699. [D 20:42:49.577589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 16700. [D 20:42:49.577604] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 16701. [D 20:42:49.582983] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16701. [D 20:42:49.583003] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 16/70. [D 20:42:49.583105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.583158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.583172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.672442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.672463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.672475] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.672513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4000 [D 20:42:49.672528] element 0: offset: 0x2aaaab605a40, size: 24 [D 20:42:49.672547] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 17/70. [D 20:42:49.676219] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4000 [D 20:42:49.676285] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 18/70. [D 20:42:49.676343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16701. [D 20:42:49.676362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16702. [D 20:42:49.676377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16703. [D 20:42:49.676400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16704. [D 20:42:49.676415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16705. [D 20:42:49.676429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16706. [D 20:42:49.676464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16707. [D 20:42:49.676479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16708. [D 20:42:49.676494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16709. [D 20:42:49.676509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16710. [D 20:42:49.676524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16711. [D 20:42:49.676539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16712. [D 20:42:49.676554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16713. [D 20:42:49.676569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16714. [D 20:42:49.676601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16715. [D 20:42:49.676616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16716. [D 20:42:49.676636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16717. [D 20:42:49.676651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16718. [D 20:42:49.676666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16719. [D 20:42:49.676681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16720. [D 20:42:49.676695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16721. [D 20:42:49.676710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16722. [D 20:42:49.676725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16723. [D 20:42:49.676740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16724. [D 20:42:49.676754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16725. [D 20:42:49.676769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16726. [D 20:42:49.676784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16727. [D 20:42:49.676799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16728. [D 20:42:49.676841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16729. [D 20:42:49.676870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16730. [D 20:42:49.676892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16731. [D 20:42:49.676907] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16732. [D 20:42:49.682233] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16732. [D 20:42:49.682253] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 19/70. [D 20:42:49.682343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.682393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.682407] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.740550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.740572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.740584] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.740622] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4003 [D 20:42:49.740636] element 0: offset: 0x2aaaab6183d0, size: 24 [D 20:42:49.740657] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 20/70. [D 20:42:49.745950] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4003 [D 20:42:49.746019] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 21/70. [D 20:42:49.746084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16732. [D 20:42:49.746105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16733. [D 20:42:49.746121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16734. [D 20:42:49.746136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16735. [D 20:42:49.746152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16736. [D 20:42:49.746178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16737. [D 20:42:49.746193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16738. [D 20:42:49.746208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16739. [D 20:42:49.746228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16740. [D 20:42:49.746243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16741. [D 20:42:49.746258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16742. [D 20:42:49.746273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16743. [D 20:42:49.746288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16744. [D 20:42:49.746303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16745. [D 20:42:49.746332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16746. [D 20:42:49.746347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16747. [D 20:42:49.746381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16748. [D 20:42:49.746397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16749. [D 20:42:49.746412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16750. [D 20:42:49.746427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16751. [D 20:42:49.746442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16752. [D 20:42:49.746457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16753. [D 20:42:49.746472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16754. [D 20:42:49.746487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16755. [D 20:42:49.746502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16756. [D 20:42:49.746517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16757. [D 20:42:49.746532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16758. [D 20:42:49.746547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16759. [D 20:42:49.746562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16760. [D 20:42:49.746610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16761. [D 20:42:49.746625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16762. [D 20:42:49.746642] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16763. [D 20:42:49.751974] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16763. [D 20:42:49.751995] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 22/70. [D 20:42:49.752100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.752158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.752172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.756422] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.756443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.756457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.756496] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4006 [D 20:42:49.756511] element 0: offset: 0x2aaaab6108c0, size: 24 [D 20:42:49.756531] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 23/70. [D 20:42:49.759828] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4006 [D 20:42:49.759852] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 24/70. [D 20:42:49.759931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16763. [D 20:42:49.759949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16764. [D 20:42:49.759964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16765. [D 20:42:49.759980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16766. [D 20:42:49.759995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16767. [D 20:42:49.760011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16768. [D 20:42:49.760025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16769. [D 20:42:49.760040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16770. [D 20:42:49.760055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16771. [D 20:42:49.760070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16772. [D 20:42:49.760085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16773. [D 20:42:49.760100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16774. [D 20:42:49.760118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16775. [D 20:42:49.760133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16776. [D 20:42:49.760147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16777. [D 20:42:49.760162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16778. [D 20:42:49.760178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16779. [D 20:42:49.760224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16780. [D 20:42:49.760245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16781. [D 20:42:49.760260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16782. [D 20:42:49.760274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16783. [D 20:42:49.760289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16784. [D 20:42:49.760304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16785. [D 20:42:49.760318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16786. [D 20:42:49.760333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16787. [D 20:42:49.760348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16788. [D 20:42:49.760362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16789. [D 20:42:49.760377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16790. [D 20:42:49.760392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16791. [D 20:42:49.760406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16792. [D 20:42:49.760421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16793. [D 20:42:49.760436] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16794. [D 20:42:49.767572] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16794. [D 20:42:49.767597] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 25/70. [D 20:42:49.767741] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.767801] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.767814] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.778755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.778777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.778790] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.778829] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4010 [D 20:42:49.778844] element 0: offset: 0x2aaaab63aac0, size: 24 [D 20:42:49.778864] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 26/70. [D 20:42:49.778909] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.778923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.778936] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:49.778957] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4012 [D 20:42:49.778971] element 0: offset: 0x2aaaab637800, size: 24 [D 20:42:49.778987] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 27/70. [D 20:42:49.783947] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4010 [D 20:42:49.783973] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 28/70. [D 20:42:49.784023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16794. [D 20:42:49.784041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16795. [D 20:42:49.784056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16796. [D 20:42:49.784071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16797. [D 20:42:49.784086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16798. [D 20:42:49.784100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16799. [D 20:42:49.784115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16800. [D 20:42:49.784130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16801. [D 20:42:49.784145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16802. [D 20:42:49.784160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16803. [D 20:42:49.784174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16804. [D 20:42:49.784189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16805. [D 20:42:49.784204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16806. [D 20:42:49.784218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16807. [D 20:42:49.784233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16808. [D 20:42:49.784248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16809. [D 20:42:49.784263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16810. [D 20:42:49.784278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16811. [D 20:42:49.784293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16812. [D 20:42:49.784308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16813. [D 20:42:49.784322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16814. [D 20:42:49.784337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16815. [D 20:42:49.784353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16816. [D 20:42:49.784368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16817. [D 20:42:49.784382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16818. [D 20:42:49.784397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16819. [D 20:42:49.784412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16820. [D 20:42:49.784426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16821. [D 20:42:49.784441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16822. [D 20:42:49.784455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16823. [D 20:42:49.784470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16824. [D 20:42:49.784485] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16825. [D 20:42:49.787896] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4012 [D 20:42:49.787924] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 29/70. [D 20:42:49.789959] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16825. [D 20:42:49.789983] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 30/70. [D 20:42:49.790006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 16825. [D 20:42:49.790025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 16826. [D 20:42:49.790044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 16827. [D 20:42:49.790062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 16828. [D 20:42:49.790081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 16829. [D 20:42:49.790099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 16830. [D 20:42:49.790117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 16831. [D 20:42:49.790136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 16832. [D 20:42:49.790152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 16833. [D 20:42:49.790170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 16834. [D 20:42:49.790188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 16835. [D 20:42:49.790207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 16836. [D 20:42:49.790225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 16837. [D 20:42:49.790243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 16838. [D 20:42:49.790262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 16839. [D 20:42:49.790280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 16840. [D 20:42:49.790299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 16841. [D 20:42:49.790317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 16842. [D 20:42:49.790335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 16843. [D 20:42:49.790354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 16844. [D 20:42:49.790373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 16845. [D 20:42:49.790391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 16846. [D 20:42:49.790409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 16847. [D 20:42:49.790427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 16848. [D 20:42:49.790446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 16849. [D 20:42:49.790464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 16850. [D 20:42:49.790483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 16851. [D 20:42:49.790501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 16852. [D 20:42:49.790520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 16853. [D 20:42:49.790538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 16854. [D 20:42:49.790553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 16855. [D 20:42:49.790568] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 16856. [D 20:42:49.790651] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.790710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.790724] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:49.795885] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 16856. [D 20:42:49.795910] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 31/70. [D 20:42:49.795987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.796009] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.796022] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.884865] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.884886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.884900] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.884938] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4015 [D 20:42:49.884953] element 0: offset: 0x2aaaab014740, size: 24 [D 20:42:49.884973] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 32/70. [D 20:42:49.888665] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4015 [D 20:42:49.888707] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 33/70. [D 20:42:49.888760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16856. [D 20:42:49.888778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16857. [D 20:42:49.888796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16858. [D 20:42:49.888812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16859. [D 20:42:49.888826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16860. [D 20:42:49.888842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16861. [D 20:42:49.888863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16862. [D 20:42:49.888882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16863. [D 20:42:49.888897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16864. [D 20:42:49.888916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16865. [D 20:42:49.888931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16866. [D 20:42:49.888946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16867. [D 20:42:49.888960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16868. [D 20:42:49.888975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16869. [D 20:42:49.888991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16870. [D 20:42:49.889008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16871. [D 20:42:49.889023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16872. [D 20:42:49.889038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16873. [D 20:42:49.889072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16874. [D 20:42:49.889091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16875. [D 20:42:49.889111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16876. [D 20:42:49.889126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16877. [D 20:42:49.889141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16878. [D 20:42:49.889156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16879. [D 20:42:49.889173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16880. [D 20:42:49.889188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16881. [D 20:42:49.889203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16882. [D 20:42:49.889222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16883. [D 20:42:49.889237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16884. [D 20:42:49.889252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16885. [D 20:42:49.889266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16886. [D 20:42:49.889281] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16887. [D 20:42:49.900555] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16887. [D 20:42:49.900578] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 34/70. [D 20:42:49.900723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.900782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.900796] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:49.942546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.942567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.942581] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:49.942621] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4018 [D 20:42:49.942636] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:49.942656] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 35/70. [D 20:42:49.946297] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4018 [D 20:42:49.946354] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 36/70. [D 20:42:49.946408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 16887. [D 20:42:49.946426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 16888. [D 20:42:49.946445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 16889. [D 20:42:49.946465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 16890. [D 20:42:49.946481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 16891. [D 20:42:49.946516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 16892. [D 20:42:49.946530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 16893. [D 20:42:49.946545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 16894. [D 20:42:49.946560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 16895. [D 20:42:49.946575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 16896. [D 20:42:49.946590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 16897. [D 20:42:49.946605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 16898. [D 20:42:49.946619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 16899. [D 20:42:49.946635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 16900. [D 20:42:49.946650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 16901. [D 20:42:49.946664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 16902. [D 20:42:49.946679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 16903. [D 20:42:49.946695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 16904. [D 20:42:49.946711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 16905. [D 20:42:49.946726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 16906. [D 20:42:49.946742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 16907. [D 20:42:49.946788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 16908. [D 20:42:49.946809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 16909. [D 20:42:49.946824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 16910. [D 20:42:49.946839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 16911. [D 20:42:49.946854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 16912. [D 20:42:49.946868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 16913. [D 20:42:49.946883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 16914. [D 20:42:49.946898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 16915. [D 20:42:49.946912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 16916. [D 20:42:49.946927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 16917. [D 20:42:49.946942] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 16918. [D 20:42:49.948063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:49.948119] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.948134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:49.948175] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4021 [D 20:42:49.948190] element 0: offset: 0x2aaaab01d8c0, size: 24 [D 20:42:49.948210] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 37/70. [D 20:42:49.952336] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16918. [D 20:42:49.952362] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 38/70. [D 20:42:49.952491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.952513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.952526] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:49.955925] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4021 [D 20:42:49.955952] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 39/70. [D 20:42:49.956003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 16918. [D 20:42:49.956021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 16919. [D 20:42:49.956036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 16920. [D 20:42:49.956051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 16921. [D 20:42:49.956071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 16922. [D 20:42:49.956108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 16923. [D 20:42:49.956123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 16924. [D 20:42:49.956137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 16925. [D 20:42:49.956152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 16926. [D 20:42:49.956171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 16927. [D 20:42:49.956186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 16928. [D 20:42:49.956218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 16929. [D 20:42:49.956233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 16930. [D 20:42:49.956251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 16931. [D 20:42:49.956268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 16932. [D 20:42:49.956286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 16933. [D 20:42:49.956304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 16934. [D 20:42:49.956321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 16935. [D 20:42:49.956339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 16936. [D 20:42:49.956365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 16937. [D 20:42:49.956384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 16938. [D 20:42:49.956401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 16939. [D 20:42:49.956419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 16940. [D 20:42:49.956437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 16941. [D 20:42:49.956455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 16942. [D 20:42:49.956472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 16943. [D 20:42:49.956490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 16944. [D 20:42:49.956508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 16945. [D 20:42:49.956525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 16946. [D 20:42:49.956543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 16947. [D 20:42:49.956560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 16948. [D 20:42:49.956578] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 16949. [D 20:42:49.961883] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16949. [D 20:42:49.961916] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 40/70. [D 20:42:49.962008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:49.962062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:49.962076] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.029680] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.029702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.029715] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.029755] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4024 [D 20:42:50.029771] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.029791] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 41/70. [D 20:42:50.033236] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4024 [D 20:42:50.033266] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 42/70. [D 20:42:50.033379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16949. [D 20:42:50.033403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16950. [D 20:42:50.033419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16951. [D 20:42:50.033434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16952. [D 20:42:50.033454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16953. [D 20:42:50.033477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16954. [D 20:42:50.033492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16955. [D 20:42:50.033518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16956. [D 20:42:50.033536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16957. [D 20:42:50.033563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16958. [D 20:42:50.033578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16959. [D 20:42:50.033593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16960. [D 20:42:50.033607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16961. [D 20:42:50.033630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16962. [D 20:42:50.033659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16963. [D 20:42:50.033674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16964. [D 20:42:50.033692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16965. [D 20:42:50.033710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16966. [D 20:42:50.033728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16967. [D 20:42:50.033746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16968. [D 20:42:50.033774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 16969. [D 20:42:50.033796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 16970. [D 20:42:50.033814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 16971. [D 20:42:50.033832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 16972. [D 20:42:50.033850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 16973. [D 20:42:50.033865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 16974. [D 20:42:50.033880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 16975. [D 20:42:50.033898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 16976. [D 20:42:50.033916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 16977. [D 20:42:50.033933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 16978. [D 20:42:50.033952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 16979. [D 20:42:50.033970] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 16980. [D 20:42:50.039309] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 16980. [D 20:42:50.039331] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 43/70. [D 20:42:50.039432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.039486] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.039500] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.098248] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.098270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.098283] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.098321] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4027 [D 20:42:50.098336] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.098356] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 44/70. [D 20:42:50.101852] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4027 [D 20:42:50.101881] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 45/70. [D 20:42:50.101932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 16980. [D 20:42:50.101949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 16981. [D 20:42:50.101964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 16982. [D 20:42:50.101981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 16983. [D 20:42:50.101996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 16984. [D 20:42:50.102011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 16985. [D 20:42:50.102027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 16986. [D 20:42:50.102042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 16987. [D 20:42:50.102056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 16988. [D 20:42:50.102072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 16989. [D 20:42:50.102087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 16990. [D 20:42:50.102102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 16991. [D 20:42:50.102141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 16992. [D 20:42:50.102160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 16993. [D 20:42:50.102175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 16994. [D 20:42:50.102189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 16995. [D 20:42:50.102204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 16996. [D 20:42:50.102219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 16997. [D 20:42:50.102234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 16998. [D 20:42:50.102248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 16999. [D 20:42:50.102275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17000. [D 20:42:50.102290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17001. [D 20:42:50.102305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17002. [D 20:42:50.102320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17003. [D 20:42:50.102335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17004. [D 20:42:50.102350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17005. [D 20:42:50.102393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17006. [D 20:42:50.102408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17007. [D 20:42:50.102430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17008. [D 20:42:50.102445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17009. [D 20:42:50.102460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17010. [D 20:42:50.102476] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17011. [D 20:42:50.107863] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17011. [D 20:42:50.107885] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 46/70. [D 20:42:50.107987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.108047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.108061] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.151285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.151306] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.151319] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.151357] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4030 [D 20:42:50.151373] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.151392] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 47/70. [D 20:42:50.154926] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4030 [D 20:42:50.154957] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 48/70. [D 20:42:50.155010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17011. [D 20:42:50.155027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17012. [D 20:42:50.155042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17013. [D 20:42:50.155057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17014. [D 20:42:50.155072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17015. [D 20:42:50.155097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17016. [D 20:42:50.155111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17017. [D 20:42:50.155127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17018. [D 20:42:50.155152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17019. [D 20:42:50.155171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17020. [D 20:42:50.155186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17021. [D 20:42:50.155201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17022. [D 20:42:50.155216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17023. [D 20:42:50.155231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17024. [D 20:42:50.155250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17025. [D 20:42:50.155266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17026. [D 20:42:50.155281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17027. [D 20:42:50.155296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17028. [D 20:42:50.155312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17029. [D 20:42:50.155348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17030. [D 20:42:50.155385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17031. [D 20:42:50.155399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17032. [D 20:42:50.155414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17033. [D 20:42:50.155429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17034. [D 20:42:50.155444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17035. [D 20:42:50.155459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17036. [D 20:42:50.155474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17037. [D 20:42:50.155489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17038. [D 20:42:50.155508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17039. [D 20:42:50.155523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17040. [D 20:42:50.155537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17041. [D 20:42:50.155552] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17042. [D 20:42:50.160964] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17042. [D 20:42:50.160986] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 49/70. [D 20:42:50.161088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.161147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.161160] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.234650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.234672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.234685] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.234724] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4033 [D 20:42:50.234739] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.234759] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 50/70. [D 20:42:50.238313] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4033 [D 20:42:50.238343] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 51/70. [D 20:42:50.238406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17042. [D 20:42:50.238423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17043. [D 20:42:50.238438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17044. [D 20:42:50.238454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17045. [D 20:42:50.238469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17046. [D 20:42:50.238483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17047. [D 20:42:50.238516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17048. [D 20:42:50.238531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17049. [D 20:42:50.238546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17050. [D 20:42:50.238560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17051. [D 20:42:50.238575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17052. [D 20:42:50.238590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17053. [D 20:42:50.238604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17054. [D 20:42:50.238620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17055. [D 20:42:50.238634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17056. [D 20:42:50.238649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17057. [D 20:42:50.238665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17058. [D 20:42:50.238697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17059. [D 20:42:50.238716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17060. [D 20:42:50.238736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17061. [D 20:42:50.238751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17062. [D 20:42:50.238765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17063. [D 20:42:50.238780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17064. [D 20:42:50.238798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17065. [D 20:42:50.238812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17066. [D 20:42:50.238827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17067. [D 20:42:50.238842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17068. [D 20:42:50.238871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17069. [D 20:42:50.238885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17070. [D 20:42:50.238900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17071. [D 20:42:50.238915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17072. [D 20:42:50.238929] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17073. [D 20:42:50.244360] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17073. [D 20:42:50.244383] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 52/70. [D 20:42:50.244486] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.244545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.244558] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.321303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.321325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.321338] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.321377] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4036 [D 20:42:50.321392] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.321412] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 53/70. [D 20:42:50.325024] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4036 [D 20:42:50.325100] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 54/70. [D 20:42:50.325171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17073. [D 20:42:50.325190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17074. [D 20:42:50.325211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17075. [D 20:42:50.325226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17076. [D 20:42:50.325241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17077. [D 20:42:50.325256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17078. [D 20:42:50.325276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17079. [D 20:42:50.325291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17080. [D 20:42:50.325306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17081. [D 20:42:50.325331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17082. [D 20:42:50.325346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17083. [D 20:42:50.325361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17084. [D 20:42:50.325380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17085. [D 20:42:50.325395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17086. [D 20:42:50.325410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17087. [D 20:42:50.325425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17088. [D 20:42:50.325440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17089. [D 20:42:50.325455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17090. [D 20:42:50.325470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17091. [D 20:42:50.325503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17092. [D 20:42:50.325519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17093. [D 20:42:50.325537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17094. [D 20:42:50.325553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17095. [D 20:42:50.325567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17096. [D 20:42:50.325582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17097. [D 20:42:50.325597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17098. [D 20:42:50.325612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17099. [D 20:42:50.325627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17100. [D 20:42:50.325642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17101. [D 20:42:50.325656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17102. [D 20:42:50.325676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17103. [D 20:42:50.325691] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17104. [D 20:42:50.331120] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17104. [D 20:42:50.331140] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 55/70. [D 20:42:50.331242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.331294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.331308] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.350663] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.350684] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.350698] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.350736] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4039 [D 20:42:50.350751] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.350770] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 56/70. [D 20:42:50.354317] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4039 [D 20:42:50.354346] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 57/70. [D 20:42:50.354402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17104. [D 20:42:50.354419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17105. [D 20:42:50.354434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17106. [D 20:42:50.354449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17107. [D 20:42:50.354463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17108. [D 20:42:50.354478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17109. [D 20:42:50.354499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17110. [D 20:42:50.354523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17111. [D 20:42:50.354538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17112. [D 20:42:50.354568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17113. [D 20:42:50.354583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17114. [D 20:42:50.354598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17115. [D 20:42:50.354612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17116. [D 20:42:50.354627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17117. [D 20:42:50.354641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17118. [D 20:42:50.354656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17119. [D 20:42:50.354670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17120. [D 20:42:50.354686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17121. [D 20:42:50.354721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17122. [D 20:42:50.354744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17123. [D 20:42:50.354759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17124. [D 20:42:50.354774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17125. [D 20:42:50.354789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17126. [D 20:42:50.354804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17127. [D 20:42:50.354822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17128. [D 20:42:50.354837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17129. [D 20:42:50.354851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17130. [D 20:42:50.354866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17131. [D 20:42:50.354881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17132. [D 20:42:50.354896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17133. [D 20:42:50.354911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17134. [D 20:42:50.354926] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17135. [D 20:42:50.360326] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17135. [D 20:42:50.360348] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 58/70. [D 20:42:50.360449] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.360508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.360522] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.435299] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.435320] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.435334] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.435373] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4042 [D 20:42:50.435388] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.435408] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 59/70. [D 20:42:50.438979] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4042 [D 20:42:50.439010] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 60/70. [D 20:42:50.439063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17135. [D 20:42:50.439085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17136. [D 20:42:50.439101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17137. [D 20:42:50.439116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17138. [D 20:42:50.439132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17139. [D 20:42:50.439152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17140. [D 20:42:50.439167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17141. [D 20:42:50.439208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17142. [D 20:42:50.439223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17143. [D 20:42:50.439238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17144. [D 20:42:50.439256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17145. [D 20:42:50.439271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17146. [D 20:42:50.439286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17147. [D 20:42:50.439301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17148. [D 20:42:50.439316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17149. [D 20:42:50.439331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17150. [D 20:42:50.439346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17151. [D 20:42:50.439377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17152. [D 20:42:50.439396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17153. [D 20:42:50.439424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17154. [D 20:42:50.439441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17155. [D 20:42:50.439455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17156. [D 20:42:50.439470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17157. [D 20:42:50.439485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17158. [D 20:42:50.439500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17159. [D 20:42:50.439515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17160. [D 20:42:50.439534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17161. [D 20:42:50.439549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17162. [D 20:42:50.439564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17163. [D 20:42:50.439579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17164. [D 20:42:50.439594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17165. [D 20:42:50.439609] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17166. [D 20:42:50.444992] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17166. [D 20:42:50.445011] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 0/70. [D 20:42:50.445114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.445165] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.445179] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.508509] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.508530] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.508543] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.508582] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4045 [D 20:42:50.508597] element 0: offset: 0x2aaaab038b40, size: 24 [D 20:42:50.508617] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 1/70. [D 20:42:50.512242] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4045 [D 20:42:50.512302] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 2/70. [D 20:42:50.512358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17166. [D 20:42:50.512377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17167. [D 20:42:50.512396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17168. [D 20:42:50.512411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17169. [D 20:42:50.512427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17170. [D 20:42:50.512442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17171. [D 20:42:50.512457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17172. [D 20:42:50.512472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17173. [D 20:42:50.512487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17174. [D 20:42:50.512502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17175. [D 20:42:50.512518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17176. [D 20:42:50.512549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17177. [D 20:42:50.512564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17178. [D 20:42:50.512583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17179. [D 20:42:50.512598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17180. [D 20:42:50.512613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17181. [D 20:42:50.512628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17182. [D 20:42:50.512643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17183. [D 20:42:50.512658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17184. [D 20:42:50.512673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17185. [D 20:42:50.512692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17186. [D 20:42:50.512710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17187. [D 20:42:50.512725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17188. [D 20:42:50.512754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17189. [D 20:42:50.512787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17190. [D 20:42:50.512802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17191. [D 20:42:50.512827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17192. [D 20:42:50.512842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17193. [D 20:42:50.512856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17194. [D 20:42:50.512871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17195. [D 20:42:50.512886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17196. [D 20:42:50.512901] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17197. [D 20:42:50.523946] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17197. [D 20:42:50.523970] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 3/70. [D 20:42:50.524075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.524136] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.524150] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.572245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.572267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.572281] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.572320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4048 [D 20:42:50.572335] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.572355] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 4/70. [D 20:42:50.575896] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4048 [D 20:42:50.575930] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 5/70. [D 20:42:50.575998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17197. [D 20:42:50.576022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17198. [D 20:42:50.576037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17199. [D 20:42:50.576052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17200. [D 20:42:50.576067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17201. [D 20:42:50.576082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17202. [D 20:42:50.576097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17203. [D 20:42:50.576112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17204. [D 20:42:50.576131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17205. [D 20:42:50.576146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17206. [D 20:42:50.576161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17207. [D 20:42:50.576175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17208. [D 20:42:50.576207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17209. [D 20:42:50.576222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17210. [D 20:42:50.576237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17211. [D 20:42:50.576252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17212. [D 20:42:50.576299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17213. [D 20:42:50.576318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17214. [D 20:42:50.576333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17215. [D 20:42:50.576347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17216. [D 20:42:50.576362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17217. [D 20:42:50.576377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17218. [D 20:42:50.576392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17219. [D 20:42:50.576406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17220. [D 20:42:50.576421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17221. [D 20:42:50.576436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17222. [D 20:42:50.576453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17223. [D 20:42:50.576469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17224. [D 20:42:50.576484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17225. [D 20:42:50.576499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17226. [D 20:42:50.576542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17227. [D 20:42:50.576560] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17228. [D 20:42:50.581946] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17228. [D 20:42:50.581966] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 6/70. [D 20:42:50.582070] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.582124] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.582137] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.673928] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.673950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.673963] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.674000] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4051 [D 20:42:50.674015] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:50.674035] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 7/70. [D 20:42:50.677577] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4051 [D 20:42:50.677609] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 8/70. [D 20:42:50.677662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17228. [D 20:42:50.677680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17229. [D 20:42:50.677694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17230. [D 20:42:50.677709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17231. [D 20:42:50.677724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17232. [D 20:42:50.677739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17233. [D 20:42:50.677764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17234. [D 20:42:50.677779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17235. [D 20:42:50.677794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17236. [D 20:42:50.677809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17237. [D 20:42:50.677828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17238. [D 20:42:50.677863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17239. [D 20:42:50.677878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17240. [D 20:42:50.677897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17241. [D 20:42:50.677911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17242. [D 20:42:50.677926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17243. [D 20:42:50.677940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17244. [D 20:42:50.677955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17245. [D 20:42:50.677969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17246. [D 20:42:50.677983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17247. [D 20:42:50.677998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17248. [D 20:42:50.678013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17249. [D 20:42:50.678040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17250. [D 20:42:50.678055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17251. [D 20:42:50.678107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17252. [D 20:42:50.678122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17253. [D 20:42:50.678143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17254. [D 20:42:50.678158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17255. [D 20:42:50.678173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17256. [D 20:42:50.678188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17257. [D 20:42:50.678203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17258. [D 20:42:50.678218] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17259. [D 20:42:50.685683] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17259. [D 20:42:50.685705] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 9/70. [D 20:42:50.685810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.685871] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.685884] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.772755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.772776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.772789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.772828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4054 [D 20:42:50.772843] element 0: offset: 0x2aaaab038b40, size: 24 [D 20:42:50.772863] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:42:50.776394] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4054 [D 20:42:50.776428] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 11/70. [D 20:42:50.776482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17259. [D 20:42:50.776499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17260. [D 20:42:50.776514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17261. [D 20:42:50.776529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17262. [D 20:42:50.776544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17263. [D 20:42:50.776558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17264. [D 20:42:50.776573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17265. [D 20:42:50.776588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17266. [D 20:42:50.776603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17267. [D 20:42:50.776617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17268. [D 20:42:50.776632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17269. [D 20:42:50.776647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17270. [D 20:42:50.776680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17271. [D 20:42:50.776695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17272. [D 20:42:50.776714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17273. [D 20:42:50.776729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17274. [D 20:42:50.776743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17275. [D 20:42:50.776758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17276. [D 20:42:50.776773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17277. [D 20:42:50.776788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17278. [D 20:42:50.776803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17279. [D 20:42:50.776818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17280. [D 20:42:50.776838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17281. [D 20:42:50.776855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17282. [D 20:42:50.776869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17283. [D 20:42:50.776891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17284. [D 20:42:50.776936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17285. [D 20:42:50.776951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17286. [D 20:42:50.776970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17287. [D 20:42:50.776986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17288. [D 20:42:50.777002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17289. [D 20:42:50.777017] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17290. [D 20:42:50.782403] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17290. [D 20:42:50.782423] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 12/70. [D 20:42:50.782526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.782585] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.782599] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.858851] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.858873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.858886] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.858925] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4057 [D 20:42:50.858941] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:50.858960] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 13/70. [D 20:42:50.862478] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4057 [D 20:42:50.862563] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 14/70. [D 20:42:50.862851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17290. [D 20:42:50.862882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17291. [D 20:42:50.862899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17292. [D 20:42:50.862916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17293. [D 20:42:50.862931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17294. [D 20:42:50.862945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17295. [D 20:42:50.862961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17296. [D 20:42:50.862976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17297. [D 20:42:50.862991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17298. [D 20:42:50.863006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17299. [D 20:42:50.863021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17300. [D 20:42:50.863036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17301. [D 20:42:50.863080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17302. [D 20:42:50.863096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17303. [D 20:42:50.863117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17304. [D 20:42:50.863133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17305. [D 20:42:50.863147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17306. [D 20:42:50.863162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17307. [D 20:42:50.863177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17308. [D 20:42:50.863192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17309. [D 20:42:50.863206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17310. [D 20:42:50.863221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17311. [D 20:42:50.863236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17312. [D 20:42:50.863251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17313. [D 20:42:50.863266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17314. [D 20:42:50.863281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17315. [D 20:42:50.863296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17316. [D 20:42:50.863311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17317. [D 20:42:50.863327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17318. [D 20:42:50.863371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17319. [D 20:42:50.863389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17320. [D 20:42:50.863421] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17321. [D 20:42:50.875081] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17321. [D 20:42:50.875107] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 15/70. [D 20:42:50.875206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.875230] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.875243] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.877586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.877606] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.877619] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.877657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4060 [D 20:42:50.877672] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:50.877689] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 16/70. [D 20:42:50.881398] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4060 [D 20:42:50.881485] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 17/70. [D 20:42:50.881837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 17321. [D 20:42:50.881906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 17322. [D 20:42:50.881923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17323. [D 20:42:50.881938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17324. [D 20:42:50.881953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17325. [D 20:42:50.881968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17326. [D 20:42:50.881983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17327. [D 20:42:50.881998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17328. [D 20:42:50.882013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17329. [D 20:42:50.882033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17330. [D 20:42:50.882048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17331. [D 20:42:50.882081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17332. [D 20:42:50.882096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17333. [D 20:42:50.882111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17334. [D 20:42:50.882126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17335. [D 20:42:50.882142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17336. [D 20:42:50.882156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17337. [D 20:42:50.882172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17338. [D 20:42:50.882205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17339. [D 20:42:50.882224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17340. [D 20:42:50.882243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17341. [D 20:42:50.882258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17342. [D 20:42:50.882273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17343. [D 20:42:50.882288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17344. [D 20:42:50.882317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17345. [D 20:42:50.882332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17346. [D 20:42:50.882346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17347. [D 20:42:50.882361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17348. [D 20:42:50.882376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17349. [D 20:42:50.882390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17350. [D 20:42:50.882405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17351. [D 20:42:50.882420] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17352. [D 20:42:50.891978] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17352. [D 20:42:50.892003] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 18/70. [D 20:42:50.892101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.892125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.892138] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.909095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.909116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.909129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.909168] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4063 [D 20:42:50.909183] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:50.909200] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 19/70. [D 20:42:50.912733] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4063 [D 20:42:50.912811] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 20/70. [D 20:42:50.912871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17352. [D 20:42:50.912897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17353. [D 20:42:50.912912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17354. [D 20:42:50.912927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17355. [D 20:42:50.912942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17356. [D 20:42:50.912957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17357. [D 20:42:50.912972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17358. [D 20:42:50.912987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17359. [D 20:42:50.913002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17360. [D 20:42:50.913017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17361. [D 20:42:50.913032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17362. [D 20:42:50.913047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17363. [D 20:42:50.913062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17364. [D 20:42:50.913078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17365. [D 20:42:50.913114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17366. [D 20:42:50.913134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17367. [D 20:42:50.913149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17368. [D 20:42:50.913164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17369. [D 20:42:50.913179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17370. [D 20:42:50.913194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17371. [D 20:42:50.913209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17372. [D 20:42:50.913223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17373. [D 20:42:50.913238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17374. [D 20:42:50.913264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17375. [D 20:42:50.913282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17376. [D 20:42:50.913297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17377. [D 20:42:50.913312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17378. [D 20:42:50.913334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17379. [D 20:42:50.913378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17380. [D 20:42:50.913400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17381. [D 20:42:50.913415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17382. [D 20:42:50.913430] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17383. [D 20:42:50.918808] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17383. [D 20:42:50.918830] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 21/70. [D 20:42:50.918924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.918948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.918961] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:50.969388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:50.969409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.969422] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:50.969461] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4066 [D 20:42:50.969476] element 0: offset: 0x2aaaab038b40, size: 24 [D 20:42:50.969494] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 22/70. [D 20:42:50.973175] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4066 [D 20:42:50.973259] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 23/70. [D 20:42:50.973330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17383. [D 20:42:50.973388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17384. [D 20:42:50.973404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17385. [D 20:42:50.973419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17386. [D 20:42:50.973434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17387. [D 20:42:50.973449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17388. [D 20:42:50.973465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17389. [D 20:42:50.973480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17390. [D 20:42:50.973495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17391. [D 20:42:50.973509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17392. [D 20:42:50.973524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17393. [D 20:42:50.973540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17394. [D 20:42:50.973563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17395. [D 20:42:50.973601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17396. [D 20:42:50.973620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17397. [D 20:42:50.973635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17398. [D 20:42:50.973650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17399. [D 20:42:50.973665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17400. [D 20:42:50.973680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17401. [D 20:42:50.973695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17402. [D 20:42:50.973709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17403. [D 20:42:50.973725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17404. [D 20:42:50.973756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17405. [D 20:42:50.973771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17406. [D 20:42:50.973786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17407. [D 20:42:50.973801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17408. [D 20:42:50.973817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17409. [D 20:42:50.973873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17410. [D 20:42:50.973888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17411. [D 20:42:50.973903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17412. [D 20:42:50.973918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17413. [D 20:42:50.973937] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17414. [D 20:42:50.984794] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17414. [D 20:42:50.984821] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 24/70. [D 20:42:50.984953] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:50.984976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:50.984989] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.047228] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.047248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.047262] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.047300] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4069 [D 20:42:51.047316] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:51.047336] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 25/70. [D 20:42:51.050837] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4069 [D 20:42:51.050915] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 26/70. [D 20:42:51.050979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17414. [D 20:42:51.051021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17415. [D 20:42:51.051038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17416. [D 20:42:51.051054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17417. [D 20:42:51.051069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17418. [D 20:42:51.051084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17419. [D 20:42:51.051099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17420. [D 20:42:51.051114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17421. [D 20:42:51.051129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17422. [D 20:42:51.051144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17423. [D 20:42:51.051166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17424. [D 20:42:51.051198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17425. [D 20:42:51.051213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17426. [D 20:42:51.051232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17427. [D 20:42:51.051246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17428. [D 20:42:51.051261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17429. [D 20:42:51.051276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17430. [D 20:42:51.051291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17431. [D 20:42:51.051305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17432. [D 20:42:51.051321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17433. [D 20:42:51.051336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17434. [D 20:42:51.051351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17435. [D 20:42:51.051367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17436. [D 20:42:51.051414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17437. [D 20:42:51.051434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17438. [D 20:42:51.051450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17439. [D 20:42:51.051466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17440. [D 20:42:51.051481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17441. [D 20:42:51.051495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17442. [D 20:42:51.051510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17443. [D 20:42:51.051525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17444. [D 20:42:51.051540] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17445. [D 20:42:51.056930] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17445. [D 20:42:51.056951] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 27/70. [D 20:42:51.057049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.057073] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.057087] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.096648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.096669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.096682] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.096720] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4072 [D 20:42:51.096735] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:51.096752] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 28/70. [D 20:42:51.100391] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4072 [D 20:42:51.100466] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 29/70. [D 20:42:51.100527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17445. [D 20:42:51.100553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17446. [D 20:42:51.100568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17447. [D 20:42:51.100582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17448. [D 20:42:51.100597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17449. [D 20:42:51.100625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17450. [D 20:42:51.100641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17451. [D 20:42:51.100656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17452. [D 20:42:51.100678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17453. [D 20:42:51.100693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17454. [D 20:42:51.100708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17455. [D 20:42:51.100727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17456. [D 20:42:51.100742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17457. [D 20:42:51.100757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17458. [D 20:42:51.100772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17459. [D 20:42:51.100787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17460. [D 20:42:51.100801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17461. [D 20:42:51.100817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17462. [D 20:42:51.100852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17463. [D 20:42:51.100868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17464. [D 20:42:51.100900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17465. [D 20:42:51.100917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17466. [D 20:42:51.100932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17467. [D 20:42:51.100946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17468. [D 20:42:51.100961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17469. [D 20:42:51.100975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17470. [D 20:42:51.100990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17471. [D 20:42:51.101005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17472. [D 20:42:51.101023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17473. [D 20:42:51.101038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17474. [D 20:42:51.101053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17475. [D 20:42:51.101068] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17476. [D 20:42:51.111439] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17476. [D 20:42:51.111464] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 30/70. [D 20:42:51.111601] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.111623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.111637] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.118308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.118329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.118341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.118379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4075 [D 20:42:51.118394] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:51.118412] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 31/70. [D 20:42:51.121922] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4075 [D 20:42:51.121999] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 32/70. [D 20:42:51.122056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17476. [D 20:42:51.122082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17477. [D 20:42:51.122097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17478. [D 20:42:51.122113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17479. [D 20:42:51.122128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17480. [D 20:42:51.122142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17481. [D 20:42:51.122158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17482. [D 20:42:51.122172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17483. [D 20:42:51.122187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17484. [D 20:42:51.122202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17485. [D 20:42:51.122217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17486. [D 20:42:51.122232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17487. [D 20:42:51.122247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17488. [D 20:42:51.122286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17489. [D 20:42:51.122304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17490. [D 20:42:51.122319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17491. [D 20:42:51.122334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17492. [D 20:42:51.122349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17493. [D 20:42:51.122364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17494. [D 20:42:51.122379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17495. [D 20:42:51.122393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17496. [D 20:42:51.122408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17497. [D 20:42:51.122427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17498. [D 20:42:51.122444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17499. [D 20:42:51.122459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17500. [D 20:42:51.122494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17501. [D 20:42:51.122536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17502. [D 20:42:51.122557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17503. [D 20:42:51.122572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17504. [D 20:42:51.122586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17505. [D 20:42:51.122601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17506. [D 20:42:51.122615] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17507. [D 20:42:51.133093] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17507. [D 20:42:51.133118] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 33/70. [D 20:42:51.133256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.133279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.133292] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.207866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.207887] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.207900] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.207939] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4078 [D 20:42:51.207954] element 0: offset: 0x2aaaab038b40, size: 24 [D 20:42:51.207972] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 34/70. [D 20:42:51.211630] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4078 [D 20:42:51.211710] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 35/70. [D 20:42:51.211779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17507. [D 20:42:51.211864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17508. [D 20:42:51.211880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17509. [D 20:42:51.211895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17510. [D 20:42:51.211910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17511. [D 20:42:51.211925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17512. [D 20:42:51.211940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17513. [D 20:42:51.211955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17514. [D 20:42:51.211970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17515. [D 20:42:51.211985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17516. [D 20:42:51.212000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17517. [D 20:42:51.212015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17518. [D 20:42:51.212030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17519. [D 20:42:51.212046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17520. [D 20:42:51.212084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17521. [D 20:42:51.212103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17522. [D 20:42:51.212118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17523. [D 20:42:51.212132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17524. [D 20:42:51.212147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17525. [D 20:42:51.212162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17526. [D 20:42:51.212176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17527. [D 20:42:51.212191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17528. [D 20:42:51.212205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17529. [D 20:42:51.212220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17530. [D 20:42:51.212247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17531. [D 20:42:51.212262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17532. [D 20:42:51.212277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17533. [D 20:42:51.212292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17534. [D 20:42:51.212307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17535. [D 20:42:51.212357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17536. [D 20:42:51.212377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17537. [D 20:42:51.212395] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17538. [D 20:42:51.222147] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17538. [D 20:42:51.222171] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 36/70. [D 20:42:51.222261] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.222283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.222297] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.279691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.279713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.279726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.279765] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4081 [D 20:42:51.279780] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:51.279803] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 37/70. [D 20:42:51.283170] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4081 [D 20:42:51.283249] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 38/70. [D 20:42:51.283411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17538. [D 20:42:51.283491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17539. [D 20:42:51.283508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17540. [D 20:42:51.283523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17541. [D 20:42:51.283538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17542. [D 20:42:51.283553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17543. [D 20:42:51.283568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17544. [D 20:42:51.283583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17545. [D 20:42:51.283598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17546. [D 20:42:51.283613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17547. [D 20:42:51.283630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17548. [D 20:42:51.283645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17549. [D 20:42:51.283660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17550. [D 20:42:51.283675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17551. [D 20:42:51.283690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17552. [D 20:42:51.283705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17553. [D 20:42:51.283720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17554. [D 20:42:51.283734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17555. [D 20:42:51.283750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17556. [D 20:42:51.283765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17557. [D 20:42:51.283780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17558. [D 20:42:51.283934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17559. [D 20:42:51.283951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17560. [D 20:42:51.283965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17561. [D 20:42:51.283980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17562. [D 20:42:51.283995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17563. [D 20:42:51.284009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17564. [D 20:42:51.284024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17565. [D 20:42:51.284039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17566. [D 20:42:51.284054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17567. [D 20:42:51.284069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17568. [D 20:42:51.284083] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17569. [D 20:42:51.291421] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17569. [D 20:42:51.291444] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 39/70. [D 20:42:51.291532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.291555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.291569] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.296485] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.296508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.296521] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.296559] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4084 [D 20:42:51.296574] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:51.296593] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 40/70. [D 20:42:51.299917] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4084 [D 20:42:51.299992] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 41/70. [D 20:42:51.300134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17569. [D 20:42:51.300159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17570. [D 20:42:51.300187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17571. [D 20:42:51.300203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17572. [D 20:42:51.300223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17573. [D 20:42:51.300238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17574. [D 20:42:51.300253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17575. [D 20:42:51.300268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17576. [D 20:42:51.300283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17577. [D 20:42:51.300297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17578. [D 20:42:51.300313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17579. [D 20:42:51.300327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17580. [D 20:42:51.300342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17581. [D 20:42:51.300357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17582. [D 20:42:51.300372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17583. [D 20:42:51.300387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17584. [D 20:42:51.300402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17585. [D 20:42:51.300416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17586. [D 20:42:51.300431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17587. [D 20:42:51.300446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17588. [D 20:42:51.300461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17589. [D 20:42:51.300476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17590. [D 20:42:51.300491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17591. [D 20:42:51.300506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17592. [D 20:42:51.300528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17593. [D 20:42:51.300542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17594. [D 20:42:51.300557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17595. [D 20:42:51.300571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17596. [D 20:42:51.300598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17597. [D 20:42:51.300613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17598. [D 20:42:51.300629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17599. [D 20:42:51.300643] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17600. [D 20:42:51.307663] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17600. [D 20:42:51.307687] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 42/70. [D 20:42:51.311833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.311854] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.311868] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.311896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.311911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.311925] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.311966] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4087 [D 20:42:51.311981] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:51.311999] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 43/70. [D 20:42:51.318438] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4087 [D 20:42:51.318520] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 44/70. [D 20:42:51.318670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17600. [D 20:42:51.318693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17601. [D 20:42:51.318709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17602. [D 20:42:51.318724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17603. [D 20:42:51.318739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17604. [D 20:42:51.318754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17605. [D 20:42:51.318769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17606. [D 20:42:51.318784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17607. [D 20:42:51.318799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17608. [D 20:42:51.318814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17609. [D 20:42:51.318838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17610. [D 20:42:51.318869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17611. [D 20:42:51.318889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17612. [D 20:42:51.318904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17613. [D 20:42:51.318919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17614. [D 20:42:51.318934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17615. [D 20:42:51.318948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17616. [D 20:42:51.318964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17617. [D 20:42:51.318978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17618. [D 20:42:51.318993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17619. [D 20:42:51.319008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17620. [D 20:42:51.319023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17621. [D 20:42:51.319039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17622. [D 20:42:51.319095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17623. [D 20:42:51.319115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17624. [D 20:42:51.319131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17625. [D 20:42:51.319147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17626. [D 20:42:51.319162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17627. [D 20:42:51.319177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17628. [D 20:42:51.319192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17629. [D 20:42:51.319207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17630. [D 20:42:51.319221] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17631. [D 20:42:51.325862] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17631. [D 20:42:51.325882] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 45/70. [D 20:42:51.328947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.328965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.328980] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.331908] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.331933] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.331946] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.331990] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4090 [D 20:42:51.332006] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:51.332022] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 46/70. [D 20:42:51.335717] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4090 [D 20:42:51.335815] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 47/70. [D 20:42:51.335954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17631. [D 20:42:51.335981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17632. [D 20:42:51.335996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17633. [D 20:42:51.336011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17634. [D 20:42:51.336026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17635. [D 20:42:51.336041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17636. [D 20:42:51.336056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17637. [D 20:42:51.336071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17638. [D 20:42:51.336086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17639. [D 20:42:51.336101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17640. [D 20:42:51.336121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17641. [D 20:42:51.336136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17642. [D 20:42:51.336150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17643. [D 20:42:51.336165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17644. [D 20:42:51.336180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17645. [D 20:42:51.336195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17646. [D 20:42:51.336210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17647. [D 20:42:51.336225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17648. [D 20:42:51.336240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17649. [D 20:42:51.336255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17650. [D 20:42:51.336270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17651. [D 20:42:51.336285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17652. [D 20:42:51.336300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17653. [D 20:42:51.336315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17654. [D 20:42:51.336330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17655. [D 20:42:51.336345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17656. [D 20:42:51.336359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17657. [D 20:42:51.336374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17658. [D 20:42:51.336389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17659. [D 20:42:51.336405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17660. [D 20:42:51.336420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17661. [D 20:42:51.336435] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17662. [D 20:42:51.347319] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17662. [D 20:42:51.347343] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 48/70. [D 20:42:51.347483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.347507] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.347520] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.354006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.354027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.354040] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.354079] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4093 [D 20:42:51.354093] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:51.354110] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 49/70. [D 20:42:51.357934] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4093 [D 20:42:51.358012] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 50/70. [D 20:42:51.359961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 17662. [D 20:42:51.359990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 17663. [D 20:42:51.360008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17664. [D 20:42:51.360023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17665. [D 20:42:51.360037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17666. [D 20:42:51.360052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17667. [D 20:42:51.360067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17668. [D 20:42:51.360081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17669. [D 20:42:51.360096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17670. [D 20:42:51.360129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17671. [D 20:42:51.360144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17672. [D 20:42:51.360158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17673. [D 20:42:51.360187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17674. [D 20:42:51.360202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17675. [D 20:42:51.360225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17676. [D 20:42:51.360240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17677. [D 20:42:51.360255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17678. [D 20:42:51.360281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17679. [D 20:42:51.360304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17680. [D 20:42:51.360319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17681. [D 20:42:51.360333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17682. [D 20:42:51.360362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17683. [D 20:42:51.360385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17684. [D 20:42:51.360400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17685. [D 20:42:51.360432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17686. [D 20:42:51.360456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17687. [D 20:42:51.360471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17688. [D 20:42:51.360494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17689. [D 20:42:51.360509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17690. [D 20:42:51.360532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17691. [D 20:42:51.360555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17692. [D 20:42:51.360571] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17693. [D 20:42:51.360765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.360789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.360802] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.360845] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4096 [D 20:42:51.360860] element 0: offset: 0x2aaaab01d8c0, size: 24 [D 20:42:51.360877] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:42:51.371572] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17693. [D 20:42:51.371596] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 52/70. [D 20:42:51.371746] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.371768] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.371781] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.375270] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4096 [D 20:42:51.375346] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 53/70. [D 20:42:51.377347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17693. [D 20:42:51.377375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17694. [D 20:42:51.377393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17695. [D 20:42:51.377408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17696. [D 20:42:51.377423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17697. [D 20:42:51.377438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17698. [D 20:42:51.377453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17699. [D 20:42:51.377468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17700. [D 20:42:51.377483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17701. [D 20:42:51.377505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17702. [D 20:42:51.377520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17703. [D 20:42:51.377535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17704. [D 20:42:51.377554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17705. [D 20:42:51.377569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17706. [D 20:42:51.377584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17707. [D 20:42:51.377599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17708. [D 20:42:51.377614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17709. [D 20:42:51.377629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17710. [D 20:42:51.377644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17711. [D 20:42:51.377678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17712. [D 20:42:51.377696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17713. [D 20:42:51.377716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17714. [D 20:42:51.377731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17715. [D 20:42:51.377745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17716. [D 20:42:51.377764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17717. [D 20:42:51.377779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17718. [D 20:42:51.377794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17719. [D 20:42:51.377809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17720. [D 20:42:51.377828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17721. [D 20:42:51.377843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17722. [D 20:42:51.377861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17723. [D 20:42:51.377876] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17724. [D 20:42:51.377982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.378006] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.378019] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.378062] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4099 [D 20:42:51.378077] element 0: offset: 0x2aaaab038b40, size: 24 [D 20:42:51.378094] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 54/70. [D 20:42:51.383980] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17724. [D 20:42:51.384025] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 55/70. [D 20:42:51.384174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.384196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.384210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.387633] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4099 [D 20:42:51.387710] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 56/70. [D 20:42:51.387856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17724. [D 20:42:51.387878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17725. [D 20:42:51.387894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17726. [D 20:42:51.387914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17727. [D 20:42:51.387929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17728. [D 20:42:51.387944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17729. [D 20:42:51.387959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17730. [D 20:42:51.387974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17731. [D 20:42:51.387989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17732. [D 20:42:51.388005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17733. [D 20:42:51.388030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17734. [D 20:42:51.388045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17735. [D 20:42:51.388060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17736. [D 20:42:51.388084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17737. [D 20:42:51.388125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17738. [D 20:42:51.388144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17739. [D 20:42:51.388158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17740. [D 20:42:51.388173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17741. [D 20:42:51.388188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17742. [D 20:42:51.388203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17743. [D 20:42:51.388218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17744. [D 20:42:51.388233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17745. [D 20:42:51.388248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17746. [D 20:42:51.388262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17747. [D 20:42:51.388277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17748. [D 20:42:51.388292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17749. [D 20:42:51.388307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17750. [D 20:42:51.388322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17751. [D 20:42:51.388337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17752. [D 20:42:51.388352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17753. [D 20:42:51.388368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17754. [D 20:42:51.388429] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17755. [D 20:42:51.401438] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17755. [D 20:42:51.401492] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 57/70. [D 20:42:51.401586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.401609] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.401622] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.407493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.407514] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.407527] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.407567] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4102 [D 20:42:51.407582] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:51.407600] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 58/70. [D 20:42:51.411454] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4102 [D 20:42:51.411534] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 59/70. [D 20:42:51.411600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17755. [D 20:42:51.411649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17756. [D 20:42:51.411664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17757. [D 20:42:51.411679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17758. [D 20:42:51.411694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17759. [D 20:42:51.411710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17760. [D 20:42:51.411725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17761. [D 20:42:51.411740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17762. [D 20:42:51.411755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17763. [D 20:42:51.411780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17764. [D 20:42:51.411802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17765. [D 20:42:51.411817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17766. [D 20:42:51.411832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17767. [D 20:42:51.411847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17768. [D 20:42:51.411862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17769. [D 20:42:51.411887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17770. [D 20:42:51.411901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17771. [D 20:42:51.411916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17772. [D 20:42:51.411931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17773. [D 20:42:51.411946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17774. [D 20:42:51.411961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17775. [D 20:42:51.411977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17776. [D 20:42:51.411991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17777. [D 20:42:51.412007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17778. [D 20:42:51.412026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17779. [D 20:42:51.412043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17780. [D 20:42:51.412057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17781. [D 20:42:51.412072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17782. [D 20:42:51.412087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17783. [D 20:42:51.412102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17784. [D 20:42:51.412117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17785. [D 20:42:51.412136] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17786. [D 20:42:51.417302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.417326] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.417340] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.417383] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4105 [D 20:42:51.417398] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:51.417416] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 60/70. [D 20:42:51.423583] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17786. [D 20:42:51.423651] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 0/70. [D 20:42:51.423805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.423826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.423840] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.427263] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4105 [D 20:42:51.427338] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 1/70. [D 20:42:51.429590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 17786. [D 20:42:51.429618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 17787. [D 20:42:51.429636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 17788. [D 20:42:51.429651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 17789. [D 20:42:51.429666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 17790. [D 20:42:51.429681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 17791. [D 20:42:51.429696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 17792. [D 20:42:51.429711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 17793. [D 20:42:51.429727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 17794. [D 20:42:51.429751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 17795. [D 20:42:51.429766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 17796. [D 20:42:51.429781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 17797. [D 20:42:51.429800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 17798. [D 20:42:51.429814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 17799. [D 20:42:51.429829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 17800. [D 20:42:51.429844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 17801. [D 20:42:51.429858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 17802. [D 20:42:51.429877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 17803. [D 20:42:51.429892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 17804. [D 20:42:51.429924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 17805. [D 20:42:51.429940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 17806. [D 20:42:51.429962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 17807. [D 20:42:51.429980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 17808. [D 20:42:51.429995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 17809. [D 20:42:51.430010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 17810. [D 20:42:51.430025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 17811. [D 20:42:51.430040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 17812. [D 20:42:51.430055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 17813. [D 20:42:51.430070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 17814. [D 20:42:51.430084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 17815. [D 20:42:51.430103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 17816. [D 20:42:51.430118] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 17817. [D 20:42:51.430259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.430284] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.430297] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.430340] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4108 [D 20:42:51.430355] element 0: offset: 0x2aaaab014720, size: 24 [D 20:42:51.430371] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 2/70. [D 20:42:51.438168] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17817. [D 20:42:51.438197] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 3/70. [D 20:42:51.438344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.438366] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.438379] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.442252] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4108 [D 20:42:51.442328] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 4/70. [D 20:42:51.447555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 17817. [D 20:42:51.447583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 17818. [D 20:42:51.447602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17819. [D 20:42:51.447616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17820. [D 20:42:51.447631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17821. [D 20:42:51.447646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17822. [D 20:42:51.447661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17823. [D 20:42:51.447676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17824. [D 20:42:51.447691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17825. [D 20:42:51.447712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17826. [D 20:42:51.447727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17827. [D 20:42:51.447742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17828. [D 20:42:51.447760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17829. [D 20:42:51.447775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17830. [D 20:42:51.447790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17831. [D 20:42:51.447808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17832. [D 20:42:51.447823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17833. [D 20:42:51.447838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17834. [D 20:42:51.447853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17835. [D 20:42:51.447888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17836. [D 20:42:51.447903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17837. [D 20:42:51.447926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17838. [D 20:42:51.447942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17839. [D 20:42:51.447956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17840. [D 20:42:51.447971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17841. [D 20:42:51.447986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17842. [D 20:42:51.448004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17843. [D 20:42:51.448018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17844. [D 20:42:51.448033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17845. [D 20:42:51.448048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17846. [D 20:42:51.448067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17847. [D 20:42:51.448082] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17848. [D 20:42:51.448217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.448241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.448255] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.448298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4111 [D 20:42:51.448313] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:51.448330] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 5/70. [D 20:42:51.454072] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17848. [D 20:42:51.454100] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 6/70. [D 20:42:51.454245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.454267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.454280] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.457755] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4111 [D 20:42:51.457833] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 7/70. [D 20:42:51.459658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17848. [D 20:42:51.459685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17849. [D 20:42:51.459704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17850. [D 20:42:51.459718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17851. [D 20:42:51.459734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17852. [D 20:42:51.459749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17853. [D 20:42:51.459764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17854. [D 20:42:51.459779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17855. [D 20:42:51.459798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17856. [D 20:42:51.459813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17857. [D 20:42:51.459829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17858. [D 20:42:51.459844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17859. [D 20:42:51.459863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17860. [D 20:42:51.459897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17861. [D 20:42:51.459912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17862. [D 20:42:51.459927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17863. [D 20:42:51.459942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17864. [D 20:42:51.459968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17865. [D 20:42:51.459984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17866. [D 20:42:51.460020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17867. [D 20:42:51.460037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17868. [D 20:42:51.460052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17869. [D 20:42:51.460093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17870. [D 20:42:51.460111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17871. [D 20:42:51.460130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17872. [D 20:42:51.460145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17873. [D 20:42:51.460160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17874. [D 20:42:51.460175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17875. [D 20:42:51.460193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17876. [D 20:42:51.460207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17877. [D 20:42:51.460222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17878. [D 20:42:51.460241] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17879. [D 20:42:51.460414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.460442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.460455] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:51.460499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4114 [D 20:42:51.460514] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:51.460531] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 8/70. [D 20:42:51.468572] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17879. [D 20:42:51.468601] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 9/70. [D 20:42:51.468744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.468767] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.468780] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:51.470133] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 686016, tag: 4114 [D 20:42:51.470206] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 10/70. [D 20:42:51.470264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 17879. [D 20:42:51.470285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 17880. [D 20:42:51.470301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17881. [D 20:42:51.470316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17882. [D 20:42:51.470331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17883. [D 20:42:51.470346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17884. [D 20:42:51.470361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17885. [D 20:42:51.470375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17886. [D 20:42:51.470390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17887. [D 20:42:51.470405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17888. [D 20:42:51.470420] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17889. [D 20:42:51.473571] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17889. [D 20:42:51.473597] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 11/70. [D 20:42:51.473734] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.473757] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.473770] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.477011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.477032] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.477045] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.477084] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4117 [D 20:42:51.477099] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:51.477117] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 12/70. [D 20:42:51.477309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.477327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.477340] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.486666] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.486686] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.486699] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.486722] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4120 [D 20:42:51.486737] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:51.486753] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 13/70. [D 20:42:51.490720] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4120 [D 20:42:51.490803] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 14/70. [D 20:42:51.490864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 17889. [D 20:42:51.490892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 17890. [D 20:42:51.490907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 17891. [D 20:42:51.490922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 17892. [D 20:42:51.490937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 17893. [D 20:42:51.490952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 17894. [D 20:42:51.490968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 17895. [D 20:42:51.490983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 17896. [D 20:42:51.492950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 17897. [D 20:42:51.492969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 17898. [D 20:42:51.492984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 17899. [D 20:42:51.492998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 17900. [D 20:42:51.493013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 17901. [D 20:42:51.493028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 17902. [D 20:42:51.493042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 17903. [D 20:42:51.493057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 17904. [D 20:42:51.493081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 17905. [D 20:42:51.493096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 17906. [D 20:42:51.493110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 17907. [D 20:42:51.493129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 17908. [D 20:42:51.493144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 17909. [D 20:42:51.493159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 17910. [D 20:42:51.493174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 17911. [D 20:42:51.493189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 17912. [D 20:42:51.493204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 17913. [D 20:42:51.493219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 17914. [D 20:42:51.493253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 17915. [D 20:42:51.493272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 17916. [D 20:42:51.493296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 17917. [D 20:42:51.493311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 17918. [D 20:42:51.493326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 17919. [D 20:42:51.493341] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 17920. [D 20:42:51.501117] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17920. [D 20:42:51.501141] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 15/70. [D 20:42:51.501272] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.501295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.501308] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.514701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.514722] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.514735] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.514774] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4123 [D 20:42:51.514789] element 0: offset: 0x2aaaab01d8c0, size: 24 [D 20:42:51.514806] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 16/70. [D 20:42:51.518518] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4123 [D 20:42:51.518599] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 17/70. [D 20:42:51.518659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17920. [D 20:42:51.518685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17921. [D 20:42:51.518701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17922. [D 20:42:51.518716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17923. [D 20:42:51.518731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17924. [D 20:42:51.518746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17925. [D 20:42:51.518761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17926. [D 20:42:51.518776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17927. [D 20:42:51.518791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17928. [D 20:42:51.518806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17929. [D 20:42:51.518822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17930. [D 20:42:51.518837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17931. [D 20:42:51.518852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17932. [D 20:42:51.518867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17933. [D 20:42:51.518882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17934. [D 20:42:51.518898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17935. [D 20:42:51.518941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17936. [D 20:42:51.518960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17937. [D 20:42:51.518975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17938. [D 20:42:51.518990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17939. [D 20:42:51.519005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17940. [D 20:42:51.519020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17941. [D 20:42:51.519035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17942. [D 20:42:51.519050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17943. [D 20:42:51.519065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17944. [D 20:42:51.519080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17945. [D 20:42:51.519095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17946. [D 20:42:51.519114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17947. [D 20:42:51.519130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17948. [D 20:42:51.519145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17949. [D 20:42:51.519169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17950. [D 20:42:51.519216] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17951. [D 20:42:51.524553] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17951. [D 20:42:51.524573] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 18/70. [D 20:42:51.524673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.524698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.524711] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.578121] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.578142] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.578155] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.578194] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4126 [D 20:42:51.578209] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:51.578226] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 19/70. [D 20:42:51.581988] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4126 [D 20:42:51.582068] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 20/70. [D 20:42:51.582128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17951. [D 20:42:51.582157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17952. [D 20:42:51.582172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17953. [D 20:42:51.582188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17954. [D 20:42:51.582203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17955. [D 20:42:51.582222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17956. [D 20:42:51.582237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17957. [D 20:42:51.582253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17958. [D 20:42:51.582268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17959. [D 20:42:51.582283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17960. [D 20:42:51.582298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17961. [D 20:42:51.582313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17962. [D 20:42:51.582328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17963. [D 20:42:51.582350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17964. [D 20:42:51.582390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17965. [D 20:42:51.582410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17966. [D 20:42:51.582424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17967. [D 20:42:51.582440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17968. [D 20:42:51.582454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 17969. [D 20:42:51.582469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 17970. [D 20:42:51.582484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 17971. [D 20:42:51.582499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 17972. [D 20:42:51.582514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 17973. [D 20:42:51.582529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 17974. [D 20:42:51.582543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 17975. [D 20:42:51.582560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 17976. [D 20:42:51.582575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 17977. [D 20:42:51.582590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 17978. [D 20:42:51.582619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 17979. [D 20:42:51.582654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 17980. [D 20:42:51.582671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 17981. [D 20:42:51.582688] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 17982. [D 20:42:51.588075] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17982. [D 20:42:51.588095] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 21/70. [D 20:42:51.588194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.588218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.588231] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.642333] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.642353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.642367] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.642406] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4129 [D 20:42:51.642421] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:51.642438] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 22/70. [D 20:42:51.646171] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4129 [D 20:42:51.646253] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 23/70. [D 20:42:51.646311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 17982. [D 20:42:51.646338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 17983. [D 20:42:51.646354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 17984. [D 20:42:51.646369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 17985. [D 20:42:51.646384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 17986. [D 20:42:51.646399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 17987. [D 20:42:51.646414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 17988. [D 20:42:51.646429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 17989. [D 20:42:51.646444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 17990. [D 20:42:51.646459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 17991. [D 20:42:51.646474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 17992. [D 20:42:51.646489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 17993. [D 20:42:51.646504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 17994. [D 20:42:51.646520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 17995. [D 20:42:51.646535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 17996. [D 20:42:51.646550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 17997. [D 20:42:51.646595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 17998. [D 20:42:51.646615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 17999. [D 20:42:51.646630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18000. [D 20:42:51.646645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18001. [D 20:42:51.646660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18002. [D 20:42:51.646675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18003. [D 20:42:51.646690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18004. [D 20:42:51.646704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18005. [D 20:42:51.646720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18006. [D 20:42:51.646735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18007. [D 20:42:51.646749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18008. [D 20:42:51.646768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18009. [D 20:42:51.646785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18010. [D 20:42:51.646800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18011. [D 20:42:51.646835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18012. [D 20:42:51.646870] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18013. [D 20:42:51.654987] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18013. [D 20:42:51.655009] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 24/70. [D 20:42:51.655111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.655135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.655149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.683435] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.683456] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.683469] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.683508] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4132 [D 20:42:51.683523] element 0: offset: 0x2aaaab014720, size: 24 [D 20:42:51.683541] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 25/70. [D 20:42:51.687399] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4132 [D 20:42:51.687476] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 26/70. [D 20:42:51.687543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18013. [D 20:42:51.687615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18014. [D 20:42:51.687633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18015. [D 20:42:51.687648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18016. [D 20:42:51.687663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18017. [D 20:42:51.687678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18018. [D 20:42:51.687694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18019. [D 20:42:51.687709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18020. [D 20:42:51.687724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18021. [D 20:42:51.687744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18022. [D 20:42:51.687763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18023. [D 20:42:51.687779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18024. [D 20:42:51.687794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18025. [D 20:42:51.687813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18026. [D 20:42:51.687828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18027. [D 20:42:51.687859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18028. [D 20:42:51.687874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18029. [D 20:42:51.687899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18030. [D 20:42:51.687914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18031. [D 20:42:51.687928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18032. [D 20:42:51.687943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18033. [D 20:42:51.687958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18034. [D 20:42:51.687973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18035. [D 20:42:51.687987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18036. [D 20:42:51.688002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18037. [D 20:42:51.688017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18038. [D 20:42:51.688032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18039. [D 20:42:51.688047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18040. [D 20:42:51.688064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18041. [D 20:42:51.688079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18042. [D 20:42:51.688094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18043. [D 20:42:51.688110] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18044. [D 20:42:51.693511] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18044. [D 20:42:51.693533] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 27/70. [D 20:42:51.693621] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.693643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.693657] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.744514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.744537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.744550] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.744590] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4135 [D 20:42:51.744605] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:51.744622] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 28/70. [D 20:42:51.748311] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4135 [D 20:42:51.748392] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 29/70. [D 20:42:51.748533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18044. [D 20:42:51.748559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18045. [D 20:42:51.748575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18046. [D 20:42:51.748590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18047. [D 20:42:51.748605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18048. [D 20:42:51.748620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18049. [D 20:42:51.748635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18050. [D 20:42:51.748649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18051. [D 20:42:51.748664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18052. [D 20:42:51.748679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18053. [D 20:42:51.748694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18054. [D 20:42:51.748709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18055. [D 20:42:51.748724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18056. [D 20:42:51.748739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18057. [D 20:42:51.748758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18058. [D 20:42:51.748772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18059. [D 20:42:51.748787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18060. [D 20:42:51.748801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18061. [D 20:42:51.748816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18062. [D 20:42:51.748831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18063. [D 20:42:51.748846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18064. [D 20:42:51.748861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18065. [D 20:42:51.748876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18066. [D 20:42:51.748891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18067. [D 20:42:51.748906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18068. [D 20:42:51.748921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18069. [D 20:42:51.748936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18070. [D 20:42:51.748951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18071. [D 20:42:51.748966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18072. [D 20:42:51.748980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18073. [D 20:42:51.749012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18074. [D 20:42:51.749027] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18075. [D 20:42:51.759021] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18075. [D 20:42:51.759047] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 30/70. [D 20:42:51.759141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.759166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.759179] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.764533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.764553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.764566] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.764604] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4138 [D 20:42:51.764619] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:51.764636] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:42:51.768320] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4138 [D 20:42:51.768399] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 32/70. [D 20:42:51.768459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 18075. [D 20:42:51.768485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 18076. [D 20:42:51.768501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18077. [D 20:42:51.768516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18078. [D 20:42:51.768531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18079. [D 20:42:51.768546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18080. [D 20:42:51.768561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18081. [D 20:42:51.768576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18082. [D 20:42:51.768591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18083. [D 20:42:51.768605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18084. [D 20:42:51.768620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18085. [D 20:42:51.768635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18086. [D 20:42:51.768651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18087. [D 20:42:51.768666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18088. [D 20:42:51.768704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18089. [D 20:42:51.768724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18090. [D 20:42:51.768739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18091. [D 20:42:51.768753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18092. [D 20:42:51.768768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18093. [D 20:42:51.768783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18094. [D 20:42:51.768798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18095. [D 20:42:51.768812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18096. [D 20:42:51.768827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18097. [D 20:42:51.768842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18098. [D 20:42:51.768857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18099. [D 20:42:51.768874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18100. [D 20:42:51.768889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18101. [D 20:42:51.768952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18102. [D 20:42:51.768975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18103. [D 20:42:51.768992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18104. [D 20:42:51.769008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18105. [D 20:42:51.769022] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18106. [D 20:42:51.774412] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18106. [D 20:42:51.774433] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 33/70. [D 20:42:51.774517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.774540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.774554] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.791206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.791226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.791240] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.791278] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4141 [D 20:42:51.791293] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:51.791311] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 34/70. [D 20:42:51.794946] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4141 [D 20:42:51.795025] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 35/70. [D 20:42:51.795085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18106. [D 20:42:51.795111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18107. [D 20:42:51.795126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18108. [D 20:42:51.795141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18109. [D 20:42:51.795156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18110. [D 20:42:51.795171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18111. [D 20:42:51.795186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18112. [D 20:42:51.795201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18113. [D 20:42:51.795216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18114. [D 20:42:51.795231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18115. [D 20:42:51.795246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18116. [D 20:42:51.795261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18117. [D 20:42:51.795277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18118. [D 20:42:51.795292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18119. [D 20:42:51.795329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18120. [D 20:42:51.795348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18121. [D 20:42:51.795363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18122. [D 20:42:51.795378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18123. [D 20:42:51.795393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18124. [D 20:42:51.795408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18125. [D 20:42:51.795422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18126. [D 20:42:51.795438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18127. [D 20:42:51.795452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18128. [D 20:42:51.795467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18129. [D 20:42:51.795482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18130. [D 20:42:51.795498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18131. [D 20:42:51.795513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18132. [D 20:42:51.795535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18133. [D 20:42:51.795581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18134. [D 20:42:51.795604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18135. [D 20:42:51.795622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18136. [D 20:42:51.795638] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18137. [D 20:42:51.801008] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18137. [D 20:42:51.801030] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 36/70. [D 20:42:51.801127] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.801151] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.801165] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.839512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.839533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.839546] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.839585] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4144 [D 20:42:51.839600] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:51.839618] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 37/70. [D 20:42:51.843444] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4144 [D 20:42:51.843525] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 38/70. [D 20:42:51.843595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18137. [D 20:42:51.843667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18138. [D 20:42:51.843683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18139. [D 20:42:51.843699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18140. [D 20:42:51.843714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18141. [D 20:42:51.843729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18142. [D 20:42:51.843744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18143. [D 20:42:51.843759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18144. [D 20:42:51.843774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18145. [D 20:42:51.843838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18146. [D 20:42:51.843861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18147. [D 20:42:51.843876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18148. [D 20:42:51.843890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18149. [D 20:42:51.843905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18150. [D 20:42:51.843920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18151. [D 20:42:51.843935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18152. [D 20:42:51.843950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18153. [D 20:42:51.843966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18154. [D 20:42:51.843980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18155. [D 20:42:51.843995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18156. [D 20:42:51.844011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18157. [D 20:42:51.844065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18158. [D 20:42:51.844080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18159. [D 20:42:51.844095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18160. [D 20:42:51.844110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18161. [D 20:42:51.844125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18162. [D 20:42:51.844140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18163. [D 20:42:51.844155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18164. [D 20:42:51.844170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18165. [D 20:42:51.844186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18166. [D 20:42:51.844201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18167. [D 20:42:51.844216] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18168. [D 20:42:51.853829] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18168. [D 20:42:51.853855] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 39/70. [D 20:42:51.853948] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.853971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.853984] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.885878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.885901] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.885915] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.885954] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4147 [D 20:42:51.885969] element 0: offset: 0x2aaaab01d8c0, size: 24 [D 20:42:51.885987] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 40/70. [D 20:42:51.889971] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4147 [D 20:42:51.890091] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 41/70. [D 20:42:51.890165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18168. [D 20:42:51.890225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18169. [D 20:42:51.890241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18170. [D 20:42:51.890256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18171. [D 20:42:51.890272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18172. [D 20:42:51.890287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18173. [D 20:42:51.890302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18174. [D 20:42:51.890317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18175. [D 20:42:51.890336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18176. [D 20:42:51.890351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18177. [D 20:42:51.890366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18178. [D 20:42:51.890394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18179. [D 20:42:51.890408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18180. [D 20:42:51.890423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18181. [D 20:42:51.890438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18182. [D 20:42:51.890453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18183. [D 20:42:51.890468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18184. [D 20:42:51.890483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18185. [D 20:42:51.890519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18186. [D 20:42:51.890543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18187. [D 20:42:51.890558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18188. [D 20:42:51.890587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18189. [D 20:42:51.890616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18190. [D 20:42:51.890632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18191. [D 20:42:51.890657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18192. [D 20:42:51.890680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18193. [D 20:42:51.890695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18194. [D 20:42:51.890710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18195. [D 20:42:51.890739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18196. [D 20:42:51.890761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18197. [D 20:42:51.890780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18198. [D 20:42:51.890806] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18199. [D 20:42:51.902208] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18199. [D 20:42:51.902236] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 42/70. [D 20:42:51.902370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:51.902403] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.902417] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:51.990416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:51.990436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:51.990449] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:51.990489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4150 [D 20:42:51.990504] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:51.990522] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 43/70. [D 20:42:51.994226] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4150 [D 20:42:51.994302] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 44/70. [D 20:42:51.994371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18199. [D 20:42:51.994434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18200. [D 20:42:51.994450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18201. [D 20:42:51.994470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18202. [D 20:42:51.994485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18203. [D 20:42:51.994500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18204. [D 20:42:51.994515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18205. [D 20:42:51.994530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18206. [D 20:42:51.994545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18207. [D 20:42:51.994560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18208. [D 20:42:51.994575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18209. [D 20:42:51.994616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18210. [D 20:42:51.994631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18211. [D 20:42:51.994650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18212. [D 20:42:51.994665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18213. [D 20:42:51.994680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18214. [D 20:42:51.994694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18215. [D 20:42:51.994709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18216. [D 20:42:51.994724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18217. [D 20:42:51.994739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18218. [D 20:42:51.994754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18219. [D 20:42:51.994768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18220. [D 20:42:51.994783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18221. [D 20:42:51.994838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18222. [D 20:42:51.994853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18223. [D 20:42:51.994875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18224. [D 20:42:51.994890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18225. [D 20:42:51.994905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18226. [D 20:42:51.994920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18227. [D 20:42:51.994934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18228. [D 20:42:51.994949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18229. [D 20:42:51.994964] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18230. [D 20:42:52.000341] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18230. [D 20:42:52.000365] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 45/70. [D 20:42:52.000460] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.000485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.000498] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.037244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.037265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.037278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.037315] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4153 [D 20:42:52.037331] element 0: offset: 0x2aaaab026020, size: 24 [D 20:42:52.037348] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 46/70. [D 20:42:52.041031] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4153 [D 20:42:52.041105] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 47/70. [D 20:42:52.044343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18230. [D 20:42:52.044372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18231. [D 20:42:52.044390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18232. [D 20:42:52.044406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18233. [D 20:42:52.044421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18234. [D 20:42:52.044435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18235. [D 20:42:52.044450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18236. [D 20:42:52.044465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18237. [D 20:42:52.044963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18238. [D 20:42:52.045008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18239. [D 20:42:52.045024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18240. [D 20:42:52.045039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18241. [D 20:42:52.045054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18242. [D 20:42:52.045068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18243. [D 20:42:52.045083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18244. [D 20:42:52.045099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18245. [D 20:42:52.045183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18246. [D 20:42:52.045201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18247. [D 20:42:52.045216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18248. [D 20:42:52.045246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18249. [D 20:42:52.045263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18250. [D 20:42:52.045277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18251. [D 20:42:52.045306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18252. [D 20:42:52.045322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18253. [D 20:42:52.045339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18254. [D 20:42:52.045354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18255. [D 20:42:52.045369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18256. [D 20:42:52.045384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18257. [D 20:42:52.045399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18258. [D 20:42:52.045413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18259. [D 20:42:52.045429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18260. [D 20:42:52.045443] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18261. [D 20:42:52.045605] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.045629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.045643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:52.045683] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4156 [D 20:42:52.045699] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:52.045715] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 48/70. [D 20:42:52.055996] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18261. [D 20:42:52.056023] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 49/70. [D 20:42:52.056162] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.056184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.056197] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:52.059691] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4156 [D 20:42:52.059757] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 50/70. [D 20:42:52.061175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 18261. [D 20:42:52.061204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 18262. [D 20:42:52.061220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18263. [D 20:42:52.061235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18264. [D 20:42:52.061250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18265. [D 20:42:52.061265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18266. [D 20:42:52.061280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18267. [D 20:42:52.061295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18268. [D 20:42:52.061310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18269. [D 20:42:52.061331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18270. [D 20:42:52.061347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18271. [D 20:42:52.061361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18272. [D 20:42:52.061380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18273. [D 20:42:52.061395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18274. [D 20:42:52.061409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18275. [D 20:42:52.061424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18276. [D 20:42:52.061439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18277. [D 20:42:52.061454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18278. [D 20:42:52.061469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18279. [D 20:42:52.061505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18280. [D 20:42:52.061537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18281. [D 20:42:52.061554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18282. [D 20:42:52.061569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18283. [D 20:42:52.061583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18284. [D 20:42:52.061599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18285. [D 20:42:52.061614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18286. [D 20:42:52.061628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18287. [D 20:42:52.061643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18288. [D 20:42:52.061662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18289. [D 20:42:52.061677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18290. [D 20:42:52.061692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18291. [D 20:42:52.061707] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18292. [D 20:42:52.064123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.064147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.064161] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:52.064202] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4159 [D 20:42:52.064218] element 0: offset: 0x2aaaab014720, size: 24 [D 20:42:52.064235] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 51/70. [D 20:42:52.067396] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18292. [D 20:42:52.067420] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 52/70. [D 20:42:52.067565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.067586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.067599] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:52.071151] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4159 [D 20:42:52.071217] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 53/70. [D 20:42:52.071356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18292. [D 20:42:52.071379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18293. [D 20:42:52.071397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18294. [D 20:42:52.071412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18295. [D 20:42:52.071427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18296. [D 20:42:52.071446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18297. [D 20:42:52.071460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18298. [D 20:42:52.071475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18299. [D 20:42:52.071506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18300. [D 20:42:52.071520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18301. [D 20:42:52.071535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18302. [D 20:42:52.071550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18303. [D 20:42:52.071564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18304. [D 20:42:52.071579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18305. [D 20:42:52.071593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18306. [D 20:42:52.071607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18307. [D 20:42:52.071622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18308. [D 20:42:52.071636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18309. [D 20:42:52.071651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18310. [D 20:42:52.071667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18311. [D 20:42:52.071682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18312. [D 20:42:52.071705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18313. [D 20:42:52.071746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18314. [D 20:42:52.071761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18315. [D 20:42:52.071798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18316. [D 20:42:52.071852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18317. [D 20:42:52.071867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18318. [D 20:42:52.071883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18319. [D 20:42:52.071897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18320. [D 20:42:52.071912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18321. [D 20:42:52.071931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18322. [D 20:42:52.071946] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18323. [D 20:42:52.078890] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18323. [D 20:42:52.078911] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 54/70. [D 20:42:52.078997] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.079020] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.079033] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.084256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.084279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.084292] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.084331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4162 [D 20:42:52.084346] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.084363] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 55/70. [D 20:42:52.088182] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4162 [D 20:42:52.088262] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 56/70. [D 20:42:52.088324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18323. [D 20:42:52.088349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18324. [D 20:42:52.088364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18325. [D 20:42:52.088379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18326. [D 20:42:52.088394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18327. [D 20:42:52.088413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18328. [D 20:42:52.088428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18329. [D 20:42:52.088443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18330. [D 20:42:52.088458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18331. [D 20:42:52.088472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18332. [D 20:42:52.088488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18333. [D 20:42:52.088503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18334. [D 20:42:52.088518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18335. [D 20:42:52.088533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18336. [D 20:42:52.088548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18337. [D 20:42:52.088563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18338. [D 20:42:52.088578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18339. [D 20:42:52.088597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18340. [D 20:42:52.088612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18341. [D 20:42:52.088627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18342. [D 20:42:52.088642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18343. [D 20:42:52.088657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18344. [D 20:42:52.088672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18345. [D 20:42:52.088687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18346. [D 20:42:52.088713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18347. [D 20:42:52.088728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18348. [D 20:42:52.088743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18349. [D 20:42:52.088758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18350. [D 20:42:52.088773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18351. [D 20:42:52.088789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18352. [D 20:42:52.088820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18353. [D 20:42:52.088835] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18354. [D 20:42:52.099647] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18354. [D 20:42:52.099668] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 57/70. [D 20:42:52.099817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.099842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.099856] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.105777] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.105799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.105813] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.105851] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4165 [D 20:42:52.105867] element 0: offset: 0x2aaaab01d9a0, size: 24 [D 20:42:52.105884] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 58/70. [D 20:42:52.109725] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4165 [D 20:42:52.109809] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 59/70. [D 20:42:52.112465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18354. [D 20:42:52.112490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18355. [D 20:42:52.112505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18356. [D 20:42:52.112520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 18357. [D 20:42:52.112535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 18358. [D 20:42:52.112550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 18359. [D 20:42:52.112565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 18360. [D 20:42:52.112580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 18361. [D 20:42:52.112606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 18362. [D 20:42:52.112622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 18363. [D 20:42:52.112645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 18364. [D 20:42:52.112660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 18365. [D 20:42:52.112688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 18366. [D 20:42:52.112715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 18367. [D 20:42:52.112730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 18368. [D 20:42:52.112745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 18369. [D 20:42:52.112770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 18370. [D 20:42:52.112797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 18371. [D 20:42:52.112812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 18372. [D 20:42:52.112837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 18373. [D 20:42:52.112864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 18374. [D 20:42:52.112879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 18375. [D 20:42:52.112903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 18376. [D 20:42:52.112917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 18377. [D 20:42:52.112945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 18378. [D 20:42:52.112971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 18379. [D 20:42:52.112998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 18380. [D 20:42:52.113014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 18381. [D 20:42:52.113041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 18382. [D 20:42:52.113056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 18383. [D 20:42:52.113072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 18384. [D 20:42:52.113087] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 18385. [D 20:42:52.124340] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18385. [D 20:42:52.124361] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 60/70. [D 20:42:52.124447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.124471] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.124485] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.130195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.130218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.130231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.130271] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4168 [D 20:42:52.130286] element 0: offset: 0x2aaaab014970, size: 24 [D 20:42:52.130304] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 0/70. [D 20:42:52.134035] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4168 [D 20:42:52.134116] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 1/70. [D 20:42:52.134182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18385. [D 20:42:52.134208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18386. [D 20:42:52.134223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18387. [D 20:42:52.134244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18388. [D 20:42:52.134259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18389. [D 20:42:52.134274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18390. [D 20:42:52.134289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18391. [D 20:42:52.134304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18392. [D 20:42:52.134319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18393. [D 20:42:52.134333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18394. [D 20:42:52.134348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18395. [D 20:42:52.134363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18396. [D 20:42:52.134377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18397. [D 20:42:52.134392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18398. [D 20:42:52.134407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18399. [D 20:42:52.134422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18400. [D 20:42:52.134436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18401. [D 20:42:52.134451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18402. [D 20:42:52.134466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18403. [D 20:42:52.134480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18404. [D 20:42:52.134495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18405. [D 20:42:52.134510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18406. [D 20:42:52.134525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18407. [D 20:42:52.134539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18408. [D 20:42:52.134554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18409. [D 20:42:52.134569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18410. [D 20:42:52.134584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18411. [D 20:42:52.134598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18412. [D 20:42:52.134613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18413. [D 20:42:52.134628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18414. [D 20:42:52.134644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18415. [D 20:42:52.134671] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18416. [D 20:42:52.146242] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18416. [D 20:42:52.146270] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 2/70. [D 20:42:52.146368] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.146398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.146411] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.152521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.152541] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.152554] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.152594] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4171 [D 20:42:52.152609] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:52.152629] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 3/70. [D 20:42:52.156446] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4171 [D 20:42:52.156527] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 4/70. [D 20:42:52.156589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18416. [D 20:42:52.156615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18417. [D 20:42:52.156631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18418. [D 20:42:52.156645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18419. [D 20:42:52.156665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18420. [D 20:42:52.156681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18421. [D 20:42:52.156700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18422. [D 20:42:52.156715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18423. [D 20:42:52.156730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18424. [D 20:42:52.156745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18425. [D 20:42:52.156760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18426. [D 20:42:52.156775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18427. [D 20:42:52.156790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18428. [D 20:42:52.156860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18429. [D 20:42:52.156876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18430. [D 20:42:52.156898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18431. [D 20:42:52.156916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18432. [D 20:42:52.156934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18433. [D 20:42:52.156952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18434. [D 20:42:52.156971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18435. [D 20:42:52.156989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18436. [D 20:42:52.157007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18437. [D 20:42:52.157025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18438. [D 20:42:52.157053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18439. [D 20:42:52.157071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18440. [D 20:42:52.157089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18441. [D 20:42:52.157107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18442. [D 20:42:52.157134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18443. [D 20:42:52.157161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18444. [D 20:42:52.157179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18445. [D 20:42:52.157209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18446. [D 20:42:52.157237] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18447. [D 20:42:52.168691] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18447. [D 20:42:52.168721] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 5/70. [D 20:42:52.168854] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.168889] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.168903] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.174810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.174831] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.174844] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.174882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4174 [D 20:42:52.174897] element 0: offset: 0x2aaaab016070, size: 24 [D 20:42:52.174916] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 6/70. [D 20:42:52.178716] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4174 [D 20:42:52.178794] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 7/70. [D 20:42:52.178860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18447. [D 20:42:52.178887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18448. [D 20:42:52.178902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18449. [D 20:42:52.178916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18450. [D 20:42:52.178931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18451. [D 20:42:52.178947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18452. [D 20:42:52.178962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18453. [D 20:42:52.178977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18454. [D 20:42:52.178993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18455. [D 20:42:52.179017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18456. [D 20:42:52.179031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18457. [D 20:42:52.179050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18458. [D 20:42:52.179066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18459. [D 20:42:52.179080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18460. [D 20:42:52.179095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18461. [D 20:42:52.179109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18462. [D 20:42:52.179124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18463. [D 20:42:52.179139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18464. [D 20:42:52.179154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18465. [D 20:42:52.179169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18466. [D 20:42:52.179203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18467. [D 20:42:52.179221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18468. [D 20:42:52.179240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18469. [D 20:42:52.179255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18470. [D 20:42:52.179281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18471. [D 20:42:52.179296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18472. [D 20:42:52.179310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18473. [D 20:42:52.179325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18474. [D 20:42:52.179340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18475. [D 20:42:52.179358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18476. [D 20:42:52.179373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18477. [D 20:42:52.179388] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18478. [D 20:42:52.190177] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18478. [D 20:42:52.190211] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 8/70. [D 20:42:52.190357] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.190381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.190394] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.196900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.196920] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.196933] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.196973] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4177 [D 20:42:52.196988] element 0: offset: 0x2aaaab014330, size: 24 [D 20:42:52.197005] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 9/70. [D 20:42:52.200838] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4177 [D 20:42:52.200918] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 10/70. [D 20:42:52.200984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18478. [D 20:42:52.201012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18479. [D 20:42:52.201027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18480. [D 20:42:52.201042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18481. [D 20:42:52.201056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18482. [D 20:42:52.201076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18483. [D 20:42:52.201091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18484. [D 20:42:52.201106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18485. [D 20:42:52.201121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18486. [D 20:42:52.201136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18487. [D 20:42:52.201151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18488. [D 20:42:52.201166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18489. [D 20:42:52.201181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18490. [D 20:42:52.201195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18491. [D 20:42:52.201211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18492. [D 20:42:52.201248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18493. [D 20:42:52.201268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18494. [D 20:42:52.201282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18495. [D 20:42:52.201297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18496. [D 20:42:52.201312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18497. [D 20:42:52.201327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18498. [D 20:42:52.201342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18499. [D 20:42:52.201366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18500. [D 20:42:52.201380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18501. [D 20:42:52.201395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18502. [D 20:42:52.201411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18503. [D 20:42:52.201428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18504. [D 20:42:52.201443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18505. [D 20:42:52.201458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18506. [D 20:42:52.201473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18507. [D 20:42:52.201535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18508. [D 20:42:52.201551] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18509. [D 20:42:52.212350] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18509. [D 20:42:52.212371] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 11/70. [D 20:42:52.212514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.212538] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.212551] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.239064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.239084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.239098] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.239137] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4180 [D 20:42:52.239152] element 0: offset: 0x2aaaab0255c0, size: 24 [D 20:42:52.239169] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 12/70. [D 20:42:52.242885] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4180 [D 20:42:52.242967] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 13/70. [D 20:42:52.243023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18509. [D 20:42:52.243046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18510. [D 20:42:52.243064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18511. [D 20:42:52.243079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18512. [D 20:42:52.243094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18513. [D 20:42:52.243109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18514. [D 20:42:52.243123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18515. [D 20:42:52.243139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18516. [D 20:42:52.243153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18517. [D 20:42:52.243168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18518. [D 20:42:52.243183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18519. [D 20:42:52.243198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18520. [D 20:42:52.243213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18521. [D 20:42:52.243228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18522. [D 20:42:52.243243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18523. [D 20:42:52.243259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18524. [D 20:42:52.243305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18525. [D 20:42:52.243324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18526. [D 20:42:52.243339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18527. [D 20:42:52.243354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18528. [D 20:42:52.243368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18529. [D 20:42:52.243399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18530. [D 20:42:52.243413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18531. [D 20:42:52.243428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18532. [D 20:42:52.243442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18533. [D 20:42:52.243457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18534. [D 20:42:52.243477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18535. [D 20:42:52.243492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18536. [D 20:42:52.243507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18537. [D 20:42:52.243522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18538. [D 20:42:52.243537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18539. [D 20:42:52.243600] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18540. [D 20:42:52.248903] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18540. [D 20:42:52.248923] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 14/70. [D 20:42:52.249022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.249046] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.249060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.274727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.274747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.274760] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.274799] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4183 [D 20:42:52.274814] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:52.274831] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 15/70. [D 20:42:52.278576] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4183 [D 20:42:52.278654] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 16/70. [D 20:42:52.278716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18540. [D 20:42:52.278743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18541. [D 20:42:52.278758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18542. [D 20:42:52.278773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18543. [D 20:42:52.278790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18544. [D 20:42:52.278806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18545. [D 20:42:52.278821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18546. [D 20:42:52.278835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18547. [D 20:42:52.278851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18548. [D 20:42:52.278876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18549. [D 20:42:52.278891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18550. [D 20:42:52.278910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18551. [D 20:42:52.278924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18552. [D 20:42:52.278939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18553. [D 20:42:52.278954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18554. [D 20:42:52.278969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18555. [D 20:42:52.278983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18556. [D 20:42:52.278998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18557. [D 20:42:52.279013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18558. [D 20:42:52.279028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18559. [D 20:42:52.279061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18560. [D 20:42:52.279080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18561. [D 20:42:52.279099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18562. [D 20:42:52.279114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18563. [D 20:42:52.279129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18564. [D 20:42:52.279144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18565. [D 20:42:52.279162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18566. [D 20:42:52.279176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18567. [D 20:42:52.279191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18568. [D 20:42:52.279206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18569. [D 20:42:52.279224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18570. [D 20:42:52.279239] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18571. [D 20:42:52.284650] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18571. [D 20:42:52.284673] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 17/70. [D 20:42:52.284771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.284795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.284808] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.315732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.315752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.315765] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.315808] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4186 [D 20:42:52.315823] element 0: offset: 0x2aaaab026020, size: 24 [D 20:42:52.315839] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 18/70. [D 20:42:52.319517] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4186 [D 20:42:52.319594] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 19/70. [D 20:42:52.319652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18571. [D 20:42:52.319679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18572. [D 20:42:52.319694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18573. [D 20:42:52.319708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18574. [D 20:42:52.319723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18575. [D 20:42:52.319738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18576. [D 20:42:52.319753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18577. [D 20:42:52.319768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18578. [D 20:42:52.319783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18579. [D 20:42:52.319839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18580. [D 20:42:52.319858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18581. [D 20:42:52.319872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18582. [D 20:42:52.319887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18583. [D 20:42:52.319902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18584. [D 20:42:52.319917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18585. [D 20:42:52.319931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18586. [D 20:42:52.319950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18587. [D 20:42:52.319965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18588. [D 20:42:52.319980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18589. [D 20:42:52.319995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18590. [D 20:42:52.320010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18591. [D 20:42:52.320024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18592. [D 20:42:52.320039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18593. [D 20:42:52.320054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18594. [D 20:42:52.320069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18595. [D 20:42:52.320083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18596. [D 20:42:52.320098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18597. [D 20:42:52.320117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18598. [D 20:42:52.320132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18599. [D 20:42:52.320147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18600. [D 20:42:52.320162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18601. [D 20:42:52.320176] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18602. [D 20:42:52.325578] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18602. [D 20:42:52.325598] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 20/70. [D 20:42:52.325698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.325722] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.325735] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.347396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.347422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.347435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.347476] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4189 [D 20:42:52.347491] element 0: offset: 0x2aaaab025a50, size: 24 [D 20:42:52.347510] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 21/70. [D 20:42:52.348400] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 188096, tag: 4189 [D 20:42:52.348435] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 22/70. [D 20:42:52.349681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 18602. [D 20:42:52.349715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 18603. [D 20:42:52.349733] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 18604. [D 20:42:52.350892] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18604. [D 20:42:52.350911] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 23/70. [D 20:42:52.351058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.351081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.351095] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.360511] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.360536] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.360549] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.360584] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4192 [D 20:42:52.360599] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:52.360616] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 24/70. [D 20:42:52.361543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.361593] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.361608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:52.361647] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4195 [D 20:42:52.361662] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.361679] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 25/70. [D 20:42:52.361774] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.361789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.361802] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:52.365713] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4192 [D 20:42:52.365781] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 26/70. [D 20:42:52.365932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 18604. [D 20:42:52.365961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 18605. [D 20:42:52.365980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18606. [D 20:42:52.365999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18607. [D 20:42:52.366017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18608. [D 20:42:52.366033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18609. [D 20:42:52.366048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18610. [D 20:42:52.366064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18611. [D 20:42:52.366093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18612. [D 20:42:52.366107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18613. [D 20:42:52.366123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18614. [D 20:42:52.366142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18615. [D 20:42:52.366156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18616. [D 20:42:52.366171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18617. [D 20:42:52.366186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18618. [D 20:42:52.366201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18619. [D 20:42:52.366216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18620. [D 20:42:52.366231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18621. [D 20:42:52.366260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18622. [D 20:42:52.366276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18623. [D 20:42:52.366298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18624. [D 20:42:52.366313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18625. [D 20:42:52.366328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18626. [D 20:42:52.366343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18627. [D 20:42:52.366358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18628. [D 20:42:52.366373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18629. [D 20:42:52.366388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18630. [D 20:42:52.366403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18631. [D 20:42:52.366418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18632. [D 20:42:52.366437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18633. [D 20:42:52.366451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18634. [D 20:42:52.366466] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18635. [D 20:42:52.376273] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18635. [D 20:42:52.376299] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 27/70. [D 20:42:52.376395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.376419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.376432] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.383097] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.383118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.383131] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.383170] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4198 [D 20:42:52.383184] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:52.383202] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 28/70. [D 20:42:52.386793] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4198 [D 20:42:52.386872] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 29/70. [D 20:42:52.386929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18635. [D 20:42:52.386953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18636. [D 20:42:52.386969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18637. [D 20:42:52.386984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18638. [D 20:42:52.386999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18639. [D 20:42:52.387014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18640. [D 20:42:52.387029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18641. [D 20:42:52.387044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18642. [D 20:42:52.387059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18643. [D 20:42:52.387074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18644. [D 20:42:52.387089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18645. [D 20:42:52.387104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18646. [D 20:42:52.387147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18647. [D 20:42:52.387162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18648. [D 20:42:52.387182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18649. [D 20:42:52.387196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18650. [D 20:42:52.387212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18651. [D 20:42:52.387226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18652. [D 20:42:52.387241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18653. [D 20:42:52.387256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18654. [D 20:42:52.387271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18655. [D 20:42:52.387290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18656. [D 20:42:52.387307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18657. [D 20:42:52.387322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18658. [D 20:42:52.387337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18659. [D 20:42:52.387352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18660. [D 20:42:52.387396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18661. [D 20:42:52.387418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18662. [D 20:42:52.387433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18663. [D 20:42:52.387448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18664. [D 20:42:52.387463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18665. [D 20:42:52.387489] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18666. [D 20:42:52.398021] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18666. [D 20:42:52.398046] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 30/70. [D 20:42:52.398188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.398212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.398226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.405477] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.405498] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.405511] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.405549] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4201 [D 20:42:52.405564] element 0: offset: 0x2aaaab0255c0, size: 24 [D 20:42:52.405581] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:42:52.409204] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4201 [D 20:42:52.409282] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 32/70. [D 20:42:52.409338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18666. [D 20:42:52.409363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18667. [D 20:42:52.409378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18668. [D 20:42:52.409393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18669. [D 20:42:52.409408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18670. [D 20:42:52.409427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18671. [D 20:42:52.409442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18672. [D 20:42:52.409458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18673. [D 20:42:52.409472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18674. [D 20:42:52.409487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18675. [D 20:42:52.409502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18676. [D 20:42:52.409517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18677. [D 20:42:52.409532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18678. [D 20:42:52.409555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18679. [D 20:42:52.409594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18680. [D 20:42:52.409614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18681. [D 20:42:52.409628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18682. [D 20:42:52.409643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18683. [D 20:42:52.409657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18684. [D 20:42:52.409673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18685. [D 20:42:52.409687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18686. [D 20:42:52.409702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18687. [D 20:42:52.409717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18688. [D 20:42:52.409732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18689. [D 20:42:52.409763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18690. [D 20:42:52.409779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18691. [D 20:42:52.409793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18692. [D 20:42:52.409845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18693. [D 20:42:52.409860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18694. [D 20:42:52.409881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18695. [D 20:42:52.409966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18696. [D 20:42:52.409986] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18697. [D 20:42:52.420396] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18697. [D 20:42:52.420421] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 33/70. [D 20:42:52.420564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.420587] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.420600] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.427961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.427981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.427994] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.428032] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4204 [D 20:42:52.428047] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:52.428064] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 34/70. [D 20:42:52.431616] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4204 [D 20:42:52.431691] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 35/70. [D 20:42:52.431747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18697. [D 20:42:52.431771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18698. [D 20:42:52.431786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18699. [D 20:42:52.431801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18700. [D 20:42:52.431820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18701. [D 20:42:52.431834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18702. [D 20:42:52.431849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18703. [D 20:42:52.431864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18704. [D 20:42:52.431879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18705. [D 20:42:52.431894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18706. [D 20:42:52.431911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18707. [D 20:42:52.431926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18708. [D 20:42:52.431941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18709. [D 20:42:52.431957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18710. [D 20:42:52.431995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18711. [D 20:42:52.432010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18712. [D 20:42:52.432029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18713. [D 20:42:52.432044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18714. [D 20:42:52.432059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18715. [D 20:42:52.432074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18716. [D 20:42:52.432089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18717. [D 20:42:52.432104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18718. [D 20:42:52.432119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18719. [D 20:42:52.432134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18720. [D 20:42:52.432149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18721. [D 20:42:52.432168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18722. [D 20:42:52.432185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18723. [D 20:42:52.432200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18724. [D 20:42:52.432222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18725. [D 20:42:52.432270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18726. [D 20:42:52.432289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18727. [D 20:42:52.432306] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18728. [D 20:42:52.442734] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18728. [D 20:42:52.442757] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 36/70. [D 20:42:52.442894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.442917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.442930] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.450254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.450275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.450288] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.450325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4207 [D 20:42:52.450340] element 0: offset: 0x2aaaab026020, size: 24 [D 20:42:52.450357] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 37/70. [D 20:42:52.453955] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4207 [D 20:42:52.454034] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 38/70. [D 20:42:52.454092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18728. [D 20:42:52.454116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18729. [D 20:42:52.454132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18730. [D 20:42:52.454147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18731. [D 20:42:52.454162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18732. [D 20:42:52.454177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18733. [D 20:42:52.454192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18734. [D 20:42:52.454206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18735. [D 20:42:52.454222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18736. [D 20:42:52.454236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18737. [D 20:42:52.454251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18738. [D 20:42:52.454267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18739. [D 20:42:52.454288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18740. [D 20:42:52.454325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18741. [D 20:42:52.454344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18742. [D 20:42:52.454359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18743. [D 20:42:52.454374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18744. [D 20:42:52.454388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18745. [D 20:42:52.454403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18746. [D 20:42:52.454418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18747. [D 20:42:52.454433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18748. [D 20:42:52.454448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18749. [D 20:42:52.454467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18750. [D 20:42:52.454484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18751. [D 20:42:52.454499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18752. [D 20:42:52.454513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18753. [D 20:42:52.454535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18754. [D 20:42:52.454579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18755. [D 20:42:52.454600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18756. [D 20:42:52.454615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18757. [D 20:42:52.454630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18758. [D 20:42:52.454657] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18759. [D 20:42:52.465148] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18759. [D 20:42:52.465169] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 39/70. [D 20:42:52.465311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.465335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.465349] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.598959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.598980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.598993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.599033] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4210 [D 20:42:52.599048] element 0: offset: 0x2aaaab025a50, size: 24 [D 20:42:52.599066] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 40/70. [D 20:42:52.602912] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4210 [D 20:42:52.602975] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 41/70. [D 20:42:52.603132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18759. [D 20:42:52.603203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18760. [D 20:42:52.603219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18761. [D 20:42:52.603234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18762. [D 20:42:52.603249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18763. [D 20:42:52.603264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18764. [D 20:42:52.603279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18765. [D 20:42:52.603294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18766. [D 20:42:52.603310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18767. [D 20:42:52.603338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18768. [D 20:42:52.603353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18769. [D 20:42:52.603368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18770. [D 20:42:52.603389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18771. [D 20:42:52.603404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18772. [D 20:42:52.603419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18773. [D 20:42:52.603434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18774. [D 20:42:52.603453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18775. [D 20:42:52.603469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18776. [D 20:42:52.603485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18777. [D 20:42:52.603502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18778. [D 20:42:52.603522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18779. [D 20:42:52.603539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18780. [D 20:42:52.603573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18781. [D 20:42:52.603589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18782. [D 20:42:52.603604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18783. [D 20:42:52.603619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18784. [D 20:42:52.603634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18785. [D 20:42:52.603649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18786. [D 20:42:52.603664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18787. [D 20:42:52.603679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18788. [D 20:42:52.603694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18789. [D 20:42:52.603709] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18790. [D 20:42:52.613885] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18790. [D 20:42:52.613914] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 42/70. [D 20:42:52.614039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.614062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.614077] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.620076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.620096] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.620109] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.620146] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4213 [D 20:42:52.620161] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:52.620179] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 43/70. [D 20:42:52.623745] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4213 [D 20:42:52.623829] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 44/70. [D 20:42:52.623887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18790. [D 20:42:52.623911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18791. [D 20:42:52.623939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18792. [D 20:42:52.623954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18793. [D 20:42:52.623969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18794. [D 20:42:52.623984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18795. [D 20:42:52.624000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18796. [D 20:42:52.624027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18797. [D 20:42:52.624042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18798. [D 20:42:52.624057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18799. [D 20:42:52.624077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18800. [D 20:42:52.624092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18801. [D 20:42:52.624106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18802. [D 20:42:52.624125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18803. [D 20:42:52.624141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18804. [D 20:42:52.624156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18805. [D 20:42:52.624172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18806. [D 20:42:52.624207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18807. [D 20:42:52.624222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18808. [D 20:42:52.624245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18809. [D 20:42:52.624262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18810. [D 20:42:52.624289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18811. [D 20:42:52.624304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18812. [D 20:42:52.624320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18813. [D 20:42:52.624335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18814. [D 20:42:52.624350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18815. [D 20:42:52.624365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18816. [D 20:42:52.624384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18817. [D 20:42:52.624399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18818. [D 20:42:52.624414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18819. [D 20:42:52.624429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18820. [D 20:42:52.624444] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18821. [D 20:42:52.634848] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18821. [D 20:42:52.634874] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 45/70. [D 20:42:52.635010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.635034] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.635047] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.642049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.642070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.642083] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.642119] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4216 [D 20:42:52.642134] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.642151] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 46/70. [D 20:42:52.645836] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4216 [D 20:42:52.645901] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 47/70. [D 20:42:52.645960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18821. [D 20:42:52.645984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18822. [D 20:42:52.646003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18823. [D 20:42:52.646020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18824. [D 20:42:52.646035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18825. [D 20:42:52.646050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18826. [D 20:42:52.646079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18827. [D 20:42:52.646094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18828. [D 20:42:52.646108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18829. [D 20:42:52.646139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18830. [D 20:42:52.646158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18831. [D 20:42:52.646174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18832. [D 20:42:52.646189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18833. [D 20:42:52.646203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18834. [D 20:42:52.646225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18835. [D 20:42:52.646307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18836. [D 20:42:52.646325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18837. [D 20:42:52.646340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18838. [D 20:42:52.646358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18839. [D 20:42:52.646373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18840. [D 20:42:52.646388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18841. [D 20:42:52.646895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18842. [D 20:42:52.646914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18843. [D 20:42:52.646928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18844. [D 20:42:52.646969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18845. [D 20:42:52.646993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18846. [D 20:42:52.647009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18847. [D 20:42:52.647024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18848. [D 20:42:52.647056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18849. [D 20:42:52.647075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18850. [D 20:42:52.647089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18851. [D 20:42:52.647104] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18852. [D 20:42:52.657342] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18852. [D 20:42:52.657362] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 48/70. [D 20:42:52.657500] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.657523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.657537] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.667028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.667048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.667061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.667098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4219 [D 20:42:52.667113] element 0: offset: 0x2aaaab00f0f0, size: 24 [D 20:42:52.667129] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 49/70. [D 20:42:52.673966] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4219 [D 20:42:52.674047] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 50/70. [D 20:42:52.674206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18852. [D 20:42:52.674229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18853. [D 20:42:52.674244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18854. [D 20:42:52.674258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18855. [D 20:42:52.674272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18856. [D 20:42:52.674286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18857. [D 20:42:52.674301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18858. [D 20:42:52.674315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18859. [D 20:42:52.674329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18860. [D 20:42:52.674343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18861. [D 20:42:52.674357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18862. [D 20:42:52.674371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18863. [D 20:42:52.674385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18864. [D 20:42:52.674399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18865. [D 20:42:52.674413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18866. [D 20:42:52.674427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18867. [D 20:42:52.674441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18868. [D 20:42:52.674455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18869. [D 20:42:52.674469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18870. [D 20:42:52.674483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18871. [D 20:42:52.674498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18872. [D 20:42:52.674512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18873. [D 20:42:52.674526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18874. [D 20:42:52.674539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18875. [D 20:42:52.674553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18876. [D 20:42:52.674567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18877. [D 20:42:52.674582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18878. [D 20:42:52.674596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18879. [D 20:42:52.674610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18880. [D 20:42:52.674624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18881. [D 20:42:52.674639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18882. [D 20:42:52.674653] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18883. [D 20:42:52.685865] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18883. [D 20:42:52.685914] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 51/70. [D 20:42:52.686006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.686027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.686040] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.692321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.692342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.692355] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.692395] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4222 [D 20:42:52.692410] element 0: offset: 0x2aaaab00ee70, size: 24 [D 20:42:52.692427] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 52/70. [D 20:42:52.696136] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4222 [D 20:42:52.696211] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 53/70. [D 20:42:52.696274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18883. [D 20:42:52.696330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18884. [D 20:42:52.696347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18885. [D 20:42:52.696363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18886. [D 20:42:52.696377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18887. [D 20:42:52.696393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18888. [D 20:42:52.696422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18889. [D 20:42:52.696437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18890. [D 20:42:52.696452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18891. [D 20:42:52.696470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18892. [D 20:42:52.696485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18893. [D 20:42:52.696504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18894. [D 20:42:52.696521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18895. [D 20:42:52.696535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18896. [D 20:42:52.696551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18897. [D 20:42:52.696581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18898. [D 20:42:52.696596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18899. [D 20:42:52.696616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18900. [D 20:42:52.696635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18901. [D 20:42:52.696650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18902. [D 20:42:52.696665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18903. [D 20:42:52.696691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18904. [D 20:42:52.696706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18905. [D 20:42:52.696721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18906. [D 20:42:52.696736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18907. [D 20:42:52.696810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18908. [D 20:42:52.696836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18909. [D 20:42:52.696854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18910. [D 20:42:52.696869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18911. [D 20:42:52.696884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18912. [D 20:42:52.696898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18913. [D 20:42:52.696913] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18914. [D 20:42:52.707484] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18914. [D 20:42:52.707508] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 54/70. [D 20:42:52.707647] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.707671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.707684] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.714470] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.714492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.714506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.714544] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4225 [D 20:42:52.714559] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:52.714576] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 55/70. [D 20:42:52.718213] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4225 [D 20:42:52.718292] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 56/70. [D 20:42:52.718353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18914. [D 20:42:52.718379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18915. [D 20:42:52.718394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18916. [D 20:42:52.718411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18917. [D 20:42:52.718427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18918. [D 20:42:52.718441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18919. [D 20:42:52.718456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18920. [D 20:42:52.718470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18921. [D 20:42:52.718485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18922. [D 20:42:52.718499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18923. [D 20:42:52.718514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18924. [D 20:42:52.718533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18925. [D 20:42:52.718548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18926. [D 20:42:52.718562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18927. [D 20:42:52.718577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18928. [D 20:42:52.718592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18929. [D 20:42:52.718606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18930. [D 20:42:52.718620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18931. [D 20:42:52.718635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18932. [D 20:42:52.718649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18933. [D 20:42:52.718664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18934. [D 20:42:52.718678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18935. [D 20:42:52.718693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18936. [D 20:42:52.718707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18937. [D 20:42:52.718722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18938. [D 20:42:52.718737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18939. [D 20:42:52.718751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18940. [D 20:42:52.718766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18941. [D 20:42:52.718780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18942. [D 20:42:52.718795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18943. [D 20:42:52.718814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18944. [D 20:42:52.718829] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18945. [D 20:42:52.729445] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18945. [D 20:42:52.729466] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 57/70. [D 20:42:52.729607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.729631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.729644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.736617] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.736638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.736651] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.736690] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4228 [D 20:42:52.736705] element 0: offset: 0x2aaaab0255c0, size: 24 [D 20:42:52.736722] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 58/70. [D 20:42:52.740335] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4228 [D 20:42:52.740414] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 59/70. [D 20:42:52.740472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18945. [D 20:42:52.740497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18946. [D 20:42:52.740512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18947. [D 20:42:52.740527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18948. [D 20:42:52.740542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18949. [D 20:42:52.740557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18950. [D 20:42:52.740572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18951. [D 20:42:52.740587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18952. [D 20:42:52.740601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18953. [D 20:42:52.740616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18954. [D 20:42:52.740630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18955. [D 20:42:52.740645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18956. [D 20:42:52.740660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18957. [D 20:42:52.740675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18958. [D 20:42:52.740716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18959. [D 20:42:52.740735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18960. [D 20:42:52.740750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18961. [D 20:42:52.740765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18962. [D 20:42:52.740780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18963. [D 20:42:52.740794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18964. [D 20:42:52.740809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18965. [D 20:42:52.740823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18966. [D 20:42:52.740838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18967. [D 20:42:52.740853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18968. [D 20:42:52.740869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 18969. [D 20:42:52.740885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 18970. [D 20:42:52.740900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 18971. [D 20:42:52.740915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 18972. [D 20:42:52.740969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 18973. [D 20:42:52.740984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 18974. [D 20:42:52.741005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 18975. [D 20:42:52.741032] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 18976. [D 20:42:52.751553] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18976. [D 20:42:52.751574] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 60/70. [D 20:42:52.751713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.751737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.751751] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.758715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.758737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.758750] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.758789] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4231 [D 20:42:52.758804] element 0: offset: 0x2aaaab026020, size: 24 [D 20:42:52.758821] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 0/70. [D 20:42:52.762401] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4231 [D 20:42:52.762480] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 1/70. [D 20:42:52.762541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 18976. [D 20:42:52.762565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 18977. [D 20:42:52.762580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 18978. [D 20:42:52.762595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 18979. [D 20:42:52.762610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 18980. [D 20:42:52.762625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 18981. [D 20:42:52.762639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 18982. [D 20:42:52.762654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 18983. [D 20:42:52.762669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 18984. [D 20:42:52.762683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 18985. [D 20:42:52.762698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 18986. [D 20:42:52.762713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 18987. [D 20:42:52.762735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 18988. [D 20:42:52.762772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 18989. [D 20:42:52.762792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 18990. [D 20:42:52.762807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 18991. [D 20:42:52.762821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 18992. [D 20:42:52.762836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 18993. [D 20:42:52.762851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 18994. [D 20:42:52.762866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 18995. [D 20:42:52.762881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 18996. [D 20:42:52.762896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 18997. [D 20:42:52.762932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 18998. [D 20:42:52.762947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 18999. [D 20:42:52.762968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19000. [D 20:42:52.763006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19001. [D 20:42:52.763022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19002. [D 20:42:52.763045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19003. [D 20:42:52.763060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19004. [D 20:42:52.763075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19005. [D 20:42:52.763089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19006. [D 20:42:52.763104] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19007. [D 20:42:52.773654] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 19007. [D 20:42:52.773690] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 2/70. [D 20:42:52.773836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.773860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.773874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.904931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.904951] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.904965] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.905004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4234 [D 20:42:52.905019] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:52.905037] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 3/70. [D 20:42:52.905950] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 262144, tag: 4234 [D 20:42:52.905985] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 4/70. [D 20:42:52.906039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19007. [D 20:42:52.906087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19008. [D 20:42:52.906106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19009. [D 20:42:52.906122] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19010. [D 20:42:52.906829] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 19010. [D 20:42:52.906849] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 5/70. [D 20:42:52.906932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.906956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.906969] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.910842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.910863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.910876] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.910908] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4237 [D 20:42:52.910922] element 0: offset: 0x2aaaab025a50, size: 24 [D 20:42:52.910939] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 6/70. [D 20:42:52.911226] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.911246] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.911259] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.923363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.923383] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.923396] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.923419] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4240 [D 20:42:52.923433] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.923449] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 7/70. [D 20:42:52.923714] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4240 [D 20:42:52.923742] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 8/70. [D 20:42:52.925029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4240 [D 20:42:52.925050] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.925066] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 9/70. [D 20:42:52.931418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.931445] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.931462] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.931492] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.931507] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.931521] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.931764] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4242 [D 20:42:52.931781] element 0: offset: 0x2aaaab026430, size: 24 [D 20:42:52.931799] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 10/70. [D 20:42:52.931926] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4242 [D 20:42:52.931949] openib_post_sr: 10.1.4.240:43806 bh 12 len 48 wr 11/70. [D 20:42:52.932292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4242 [D 20:42:52.932313] element 0: offset: 0x2aaaab026430, size: 24 [D 20:42:52.935832] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 12/70. [D 20:42:52.936021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.936041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.936054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.938150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.938166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.938178] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.938247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4244 [D 20:42:52.938263] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:52.938277] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 13/70. [D 20:42:52.939861] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4244 [D 20:42:52.939905] openib_post_sr: 10.1.4.240:43806 bh 15 len 48 wr 14/70. [D 20:42:52.940927] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4244 [D 20:42:52.940950] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:52.940969] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 15/70. [D 20:42:52.943837] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.943861] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.943878] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.947266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.947288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.947305] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.947426] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4247 [D 20:42:52.947445] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:52.947464] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 16/70. [D 20:42:52.947535] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4247 [D 20:42:52.947572] openib_post_sr: 10.1.4.240:43806 bh 18 len 48 wr 17/70. [D 20:42:52.947912] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4247 [D 20:42:52.947932] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:52.947951] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 18/70. [D 20:42:52.951865] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.951890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.951904] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.951931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.951944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.951957] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.952025] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4248 [D 20:42:52.952040] element 0: offset: 0x2aaaab025a50, size: 24 [D 20:42:52.952057] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 19/70. [D 20:42:52.952252] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4248 [D 20:42:52.952277] openib_post_sr: 10.1.4.240:43806 bh 1 len 48 wr 20/70. [D 20:42:52.953221] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4248 [D 20:42:52.953243] element 0: offset: 0x2aaaab025a50, size: 24 [D 20:42:52.953260] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 21/70. [D 20:42:52.953312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.953328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.953340] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.953779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.953799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.953812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.953879] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4251 [D 20:42:52.953895] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.953910] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 22/70. [D 20:42:52.953977] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4251 [D 20:42:52.953999] openib_post_sr: 10.1.4.240:43806 bh 4 len 48 wr 23/70. [D 20:42:52.954425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4251 [D 20:42:52.954445] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:52.954474] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 24/70. [D 20:42:52.954523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.954539] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.954551] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:52.955088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:52.955108] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.955121] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:52.955186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4252 [D 20:42:52.955202] element 0: offset: 0x2aaaab00ee70, size: 24 [D 20:42:52.955217] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 25/70. [D 20:42:52.957596] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4252 [D 20:42:52.957622] openib_post_sr: 10.1.4.240:43806 bh 7 len 48 wr 26/70. [D 20:42:52.958580] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4252 [D 20:42:52.958600] element 0: offset: 0x2aaaab00ee70, size: 24 [D 20:42:52.958618] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 27/70. [D 20:42:52.958746] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:52.958763] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:52.958776] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.165910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.165930] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.165943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.166020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4257 [D 20:42:53.166036] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:53.166051] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 28/70. [D 20:42:53.166080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.166094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.166106] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:53.166128] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4258 [D 20:42:53.166142] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:53.166219] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 29/70. [D 20:42:53.166263] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4257 [D 20:42:53.166282] openib_post_sr: 10.1.4.240:43806 bh 11 len 48 wr 30/70. [D 20:42:53.166309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.166323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.166336] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:53.166358] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4261 [D 20:42:53.166372] element 0: offset: 0x2aaaab001c70, size: 24 [D 20:42:53.166386] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 31/70. [D 20:42:53.168217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.168282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.168297] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:53.168341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4263 [D 20:42:53.168356] element 0: offset: 0x2aaaab00f0f0, size: 24 [D 20:42:53.168376] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 32/70. [D 20:42:53.174953] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4258 [D 20:42:53.175026] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 33/70. [D 20:42:53.175145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19010. [D 20:42:53.175234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19011. [D 20:42:53.175259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19012. [D 20:42:53.175274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19013. [D 20:42:53.175292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19014. [D 20:42:53.175308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19015. [D 20:42:53.175322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19016. [D 20:42:53.175337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19017. [D 20:42:53.175369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19018. [D 20:42:53.175384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19019. [D 20:42:53.175398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19020. [D 20:42:53.175429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19021. [D 20:42:53.175445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19022. [D 20:42:53.175460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19023. [D 20:42:53.175475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19024. [D 20:42:53.175491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19025. [D 20:42:53.175506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19026. [D 20:42:53.175538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19027. [D 20:42:53.175561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19028. [D 20:42:53.175577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19029. [D 20:42:53.175593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19030. [D 20:42:53.175608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19031. [D 20:42:53.175623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19032. [D 20:42:53.175638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19033. [D 20:42:53.175654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19034. [D 20:42:53.175682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19035. [D 20:42:53.175697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19036. [D 20:42:53.175712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19037. [D 20:42:53.175728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19038. [D 20:42:53.175743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19039. [D 20:42:53.175768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19040. [D 20:42:53.175783] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19041. [D 20:42:53.178831] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4261 [D 20:42:53.178860] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 34/70. [D 20:42:53.178991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4257 [D 20:42:53.179010] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:53.179032] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 35/70. [D 20:42:53.179126] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4263 [D 20:42:53.179145] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 36/70. [D 20:42:53.183122] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19041. [D 20:42:53.183144] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 37/70. [D 20:42:53.183163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19041. [D 20:42:53.183179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19042. [D 20:42:53.183196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19043. [D 20:42:53.183213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19044. [D 20:42:53.183228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19045. [D 20:42:53.183252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19046. [D 20:42:53.183271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19047. [D 20:42:53.183286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19048. [D 20:42:53.183301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19049. [D 20:42:53.183320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19050. [D 20:42:53.183336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19051. [D 20:42:53.183351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19052. [D 20:42:53.183366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19053. [D 20:42:53.183381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19054. [D 20:42:53.183404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19055. [D 20:42:53.183435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19056. [D 20:42:53.183453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19057. [D 20:42:53.183472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19058. [D 20:42:53.183487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19059. [D 20:42:53.183502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19060. [D 20:42:53.183517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19061. [D 20:42:53.183531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19062. [D 20:42:53.183546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19063. [D 20:42:53.183560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19064. [D 20:42:53.183575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19065. [D 20:42:53.183590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19066. [D 20:42:53.183605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19067. [D 20:42:53.183619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19068. [D 20:42:53.183634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19069. [D 20:42:53.183684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19070. [D 20:42:53.183700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19071. [D 20:42:53.183719] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19072. [D 20:42:53.183736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 19073. [D 20:42:53.183755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 19074. [D 20:42:53.183771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 19075. [D 20:42:53.183786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 19076. [D 20:42:53.183801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 19077. [D 20:42:53.183818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 19078. [D 20:42:53.183834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 19079. [D 20:42:53.183848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 19080. [D 20:42:53.183863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 19081. [D 20:42:53.183878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 19082. [D 20:42:53.183893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 19083. [D 20:42:53.183909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 19084. [D 20:42:53.183924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 19085. [D 20:42:53.183939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 19086. [D 20:42:53.183954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 19087. [D 20:42:53.183969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 19088. [D 20:42:53.183984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 19089. [D 20:42:53.184000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 19090. [D 20:42:53.184015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 19091. [D 20:42:53.184030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 19092. [D 20:42:53.184045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 19093. [D 20:42:53.184087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 19094. [D 20:42:53.184102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 19095. [D 20:42:53.184117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 19096. [D 20:42:53.184131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 19097. [D 20:42:53.184474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 19098. [D 20:42:53.184489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 19099. [D 20:42:53.184503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 19100. [D 20:42:53.184518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 19101. [D 20:42:53.184533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 19102. [D 20:42:53.184549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 19103. [D 20:42:53.184564] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 19104. [D 20:42:53.184620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.184638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.184652] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:53.188110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.188131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.188148] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:53.188175] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.188190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.188204] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:53.188405] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4266 [D 20:42:53.188422] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:53.188437] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 38/70. [D 20:42:53.189691] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19104. [D 20:42:53.189710] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 39/70. [D 20:42:53.195529] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19103. [D 20:42:53.195548] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 40/70. [D 20:42:53.195863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.195888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.195902] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:53.195954] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4266 [D 20:42:53.195979] openib_post_sr: 10.1.4.240:43806 bh 2 len 48 wr 41/70. [D 20:42:53.196013] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.196027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.196040] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:53.197635] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4266 [D 20:42:53.197657] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:42:53.197676] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 42/70. [D 20:42:53.197728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.197743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.197756] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.198723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.198744] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.198757] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.198792] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4269 [D 20:42:53.198806] element 0: offset: 0x2aaaab00ee70, size: 24 [D 20:42:53.198824] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 43/70. [D 20:42:53.202411] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4269 [D 20:42:53.202492] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 44/70. [D 20:42:53.202549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19103. [D 20:42:53.202571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19104. [D 20:42:53.202589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19105. [D 20:42:53.202603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19106. [D 20:42:53.202618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19107. [D 20:42:53.202633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19108. [D 20:42:53.202647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19109. [D 20:42:53.202662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19110. [D 20:42:53.202677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19111. [D 20:42:53.202692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19112. [D 20:42:53.202707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19113. [D 20:42:53.202722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19114. [D 20:42:53.202737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19115. [D 20:42:53.202752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19116. [D 20:42:53.202766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19117. [D 20:42:53.202782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19118. [D 20:42:53.202828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19119. [D 20:42:53.202847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19120. [D 20:42:53.202862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19121. [D 20:42:53.202877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19122. [D 20:42:53.202891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19123. [D 20:42:53.202906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19124. [D 20:42:53.202921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19125. [D 20:42:53.202936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19126. [D 20:42:53.202950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19127. [D 20:42:53.202965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19128. [D 20:42:53.202980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19129. [D 20:42:53.202998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19130. [D 20:42:53.203015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19131. [D 20:42:53.203030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19132. [D 20:42:53.203045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19133. [D 20:42:53.203068] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19134. [D 20:42:53.211894] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19134. [D 20:42:53.211915] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 45/70. [D 20:42:53.212015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.212039] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.212053] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.322737] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.322758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.322771] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.322811] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4272 [D 20:42:53.322826] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:53.322844] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 46/70. [D 20:42:53.327196] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4272 [D 20:42:53.327276] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 47/70. [D 20:42:53.327334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19134. [D 20:42:53.327359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19135. [D 20:42:53.327375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19136. [D 20:42:53.327389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19137. [D 20:42:53.327405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19138. [D 20:42:53.327420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19139. [D 20:42:53.327435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19140. [D 20:42:53.327450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19141. [D 20:42:53.327465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19142. [D 20:42:53.327479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19143. [D 20:42:53.327495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19144. [D 20:42:53.327509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19145. [D 20:42:53.327524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19146. [D 20:42:53.327539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19147. [D 20:42:53.327554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19148. [D 20:42:53.327570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19149. [D 20:42:53.327615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19150. [D 20:42:53.327634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19151. [D 20:42:53.327649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19152. [D 20:42:53.327664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19153. [D 20:42:53.327679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19154. [D 20:42:53.327694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19155. [D 20:42:53.327708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19156. [D 20:42:53.327723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19157. [D 20:42:53.327738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19158. [D 20:42:53.327753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19159. [D 20:42:53.327778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19160. [D 20:42:53.327794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19161. [D 20:42:53.327809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19162. [D 20:42:53.327827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19163. [D 20:42:53.327842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19164. [D 20:42:53.327858] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19165. [D 20:42:53.333263] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19165. [D 20:42:53.333283] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 48/70. [D 20:42:53.333385] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.333409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.333422] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.415870] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.415890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.415903] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.415942] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4275 [D 20:42:53.415957] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:53.415975] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 49/70. [D 20:42:53.419634] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4275 [D 20:42:53.419697] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 50/70. [D 20:42:53.419758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19165. [D 20:42:53.419783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19166. [D 20:42:53.419799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19167. [D 20:42:53.419817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19168. [D 20:42:53.419833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19169. [D 20:42:53.419848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19170. [D 20:42:53.419863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19171. [D 20:42:53.419880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19172. [D 20:42:53.419895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19173. [D 20:42:53.419910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19174. [D 20:42:53.419925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19175. [D 20:42:53.419953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19176. [D 20:42:53.419968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19177. [D 20:42:53.419995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19178. [D 20:42:53.420010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19179. [D 20:42:53.420025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19180. [D 20:42:53.420039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19181. [D 20:42:53.420054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19182. [D 20:42:53.420069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19183. [D 20:42:53.420088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19184. [D 20:42:53.420105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19185. [D 20:42:53.420120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19186. [D 20:42:53.420142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19187. [D 20:42:53.420182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19188. [D 20:42:53.420197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19189. [D 20:42:53.420230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19190. [D 20:42:53.420246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19191. [D 20:42:53.420260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19192. [D 20:42:53.420275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19193. [D 20:42:53.420293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19194. [D 20:42:53.420310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19195. [D 20:42:53.420325] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19196. [D 20:42:53.425725] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19196. [D 20:42:53.425745] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 51/70. [D 20:42:53.425827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.425851] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.425865] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.484604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.484626] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.484639] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.484677] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4279 [D 20:42:53.484692] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:53.484709] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 52/70. [D 20:42:53.488284] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4279 [D 20:42:53.488358] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 53/70. [D 20:42:53.488417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19196. [D 20:42:53.488443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19197. [D 20:42:53.488459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19198. [D 20:42:53.488474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19199. [D 20:42:53.488489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19200. [D 20:42:53.488516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19201. [D 20:42:53.488531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19202. [D 20:42:53.488546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19203. [D 20:42:53.488561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19204. [D 20:42:53.488576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19205. [D 20:42:53.488591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19206. [D 20:42:53.488606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19207. [D 20:42:53.488621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19208. [D 20:42:53.488636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19209. [D 20:42:53.488651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19210. [D 20:42:53.488665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19211. [D 20:42:53.488680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19212. [D 20:42:53.488695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19213. [D 20:42:53.488710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19214. [D 20:42:53.488725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19215. [D 20:42:53.488751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19216. [D 20:42:53.488767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19217. [D 20:42:53.488781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19218. [D 20:42:53.488796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19219. [D 20:42:53.488811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19220. [D 20:42:53.488826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19221. [D 20:42:53.488841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19222. [D 20:42:53.488855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19223. [D 20:42:53.488870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19224. [D 20:42:53.488885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19225. [D 20:42:53.488903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19226. [D 20:42:53.488917] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19227. [D 20:42:53.494389] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19227. [D 20:42:53.494409] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 54/70. [D 20:42:53.494494] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.494518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.494532] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.549969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.549990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.550003] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.550041] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4281 [D 20:42:53.550056] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:53.550073] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 55/70. [D 20:42:53.553728] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4281 [D 20:42:53.553793] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 56/70. [D 20:42:53.553848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19227. [D 20:42:53.553878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19228. [D 20:42:53.553893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19229. [D 20:42:53.553908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19230. [D 20:42:53.553924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19231. [D 20:42:53.553941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19232. [D 20:42:53.553956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19233. [D 20:42:53.553970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19234. [D 20:42:53.554005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19235. [D 20:42:53.554020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19236. [D 20:42:53.554034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19237. [D 20:42:53.554053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19238. [D 20:42:53.554068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19239. [D 20:42:53.554082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19240. [D 20:42:53.554097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19241. [D 20:42:53.554112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19242. [D 20:42:53.554127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19243. [D 20:42:53.554141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19244. [D 20:42:53.554157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19245. [D 20:42:53.554190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19246. [D 20:42:53.554209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19247. [D 20:42:53.554228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19248. [D 20:42:53.554243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19249. [D 20:42:53.554258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19250. [D 20:42:53.554273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19251. [D 20:42:53.554290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19252. [D 20:42:53.554305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19253. [D 20:42:53.554320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19254. [D 20:42:53.554334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19255. [D 20:42:53.554353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19256. [D 20:42:53.554368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19257. [D 20:42:53.554382] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19258. [D 20:42:53.559808] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19258. [D 20:42:53.559832] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 57/70. [D 20:42:53.559929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.559953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.559966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.658365] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.658386] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.658400] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.658437] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4285 [D 20:42:53.658452] element 0: offset: 0x2aaaab001c70, size: 24 [D 20:42:53.658468] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 58/70. [D 20:42:53.661995] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4285 [D 20:42:53.662072] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 59/70. [D 20:42:53.662131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19258. [D 20:42:53.662156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19259. [D 20:42:53.662172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19260. [D 20:42:53.662186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19261. [D 20:42:53.662201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19262. [D 20:42:53.662217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19263. [D 20:42:53.662231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19264. [D 20:42:53.662246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19265. [D 20:42:53.662261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19266. [D 20:42:53.662276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19267. [D 20:42:53.662291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19268. [D 20:42:53.662306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19269. [D 20:42:53.662322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19270. [D 20:42:53.662360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19271. [D 20:42:53.662375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19272. [D 20:42:53.662393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19273. [D 20:42:53.662408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19274. [D 20:42:53.662423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19275. [D 20:42:53.662438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19276. [D 20:42:53.662453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19277. [D 20:42:53.662467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19278. [D 20:42:53.662482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19279. [D 20:42:53.662511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19280. [D 20:42:53.662526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19281. [D 20:42:53.662541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19282. [D 20:42:53.662556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19283. [D 20:42:53.662595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19284. [D 20:42:53.662610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19285. [D 20:42:53.662634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19286. [D 20:42:53.662652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19287. [D 20:42:53.662668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19288. [D 20:42:53.662683] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19289. [D 20:42:53.668078] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19289. [D 20:42:53.668099] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 60/70. [D 20:42:53.668197] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.668220] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.668234] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.726602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.726623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.726635] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.726674] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4287 [D 20:42:53.726689] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:53.726706] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 0/70. [D 20:42:53.730336] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4287 [D 20:42:53.730400] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 1/70. [D 20:42:53.730459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19289. [D 20:42:53.730486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19290. [D 20:42:53.730501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19291. [D 20:42:53.730516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19292. [D 20:42:53.730532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19293. [D 20:42:53.730549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19294. [D 20:42:53.730563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19295. [D 20:42:53.730578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19296. [D 20:42:53.730612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19297. [D 20:42:53.730627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19298. [D 20:42:53.730642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19299. [D 20:42:53.730661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19300. [D 20:42:53.730675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19301. [D 20:42:53.730690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19302. [D 20:42:53.730705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19303. [D 20:42:53.730730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19304. [D 20:42:53.730745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19305. [D 20:42:53.730760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19306. [D 20:42:53.730775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19307. [D 20:42:53.730810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19308. [D 20:42:53.730832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19309. [D 20:42:53.730848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19310. [D 20:42:53.730863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19311. [D 20:42:53.730878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19312. [D 20:42:53.730892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19313. [D 20:42:53.730907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19314. [D 20:42:53.730922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19315. [D 20:42:53.730949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19316. [D 20:42:53.730964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19317. [D 20:42:53.730978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19318. [D 20:42:53.730994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19319. [D 20:42:53.731008] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19320. [D 20:42:53.736388] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19320. [D 20:42:53.736408] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 2/70. [D 20:42:53.736505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.736529] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.736543] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.785825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.785846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.785859] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.785896] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4291 [D 20:42:53.785910] element 0: offset: 0x2aaaab00f0f0, size: 24 [D 20:42:53.785927] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 3/70. [D 20:42:53.789585] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4291 [D 20:42:53.789649] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 4/70. [D 20:42:53.789704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19320. [D 20:42:53.789748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19321. [D 20:42:53.789764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19322. [D 20:42:53.789781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19323. [D 20:42:53.789797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19324. [D 20:42:53.789812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19325. [D 20:42:53.789827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19326. [D 20:42:53.789858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19327. [D 20:42:53.789873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19328. [D 20:42:53.789887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19329. [D 20:42:53.789907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19330. [D 20:42:53.789921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19331. [D 20:42:53.789936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19332. [D 20:42:53.789951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19333. [D 20:42:53.789968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19334. [D 20:42:53.789982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19335. [D 20:42:53.790002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19336. [D 20:42:53.790030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19337. [D 20:42:53.790049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19338. [D 20:42:53.790063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19339. [D 20:42:53.790083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19340. [D 20:42:53.790097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19341. [D 20:42:53.790112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19342. [D 20:42:53.790130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19343. [D 20:42:53.790144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19344. [D 20:42:53.790159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19345. [D 20:42:53.790188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19346. [D 20:42:53.790203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19347. [D 20:42:53.790218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19348. [D 20:42:53.790232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19349. [D 20:42:53.790247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19350. [D 20:42:53.790264] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19351. [D 20:42:53.795673] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19351. [D 20:42:53.795693] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 5/70. [D 20:42:53.795788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.795822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.795836] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.861127] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.861148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.861161] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.861198] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4293 [D 20:42:53.861213] element 0: offset: 0x2aaaab025680, size: 24 [D 20:42:53.861230] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 6/70. [D 20:42:53.864454] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4293 [D 20:42:53.864527] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 7/70. [D 20:42:53.864611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19351. [D 20:42:53.864639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19352. [D 20:42:53.864667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19353. [D 20:42:53.864682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19354. [D 20:42:53.864697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19355. [D 20:42:53.864712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19356. [D 20:42:53.864727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19357. [D 20:42:53.864743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19358. [D 20:42:53.864936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19359. [D 20:42:53.864954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19360. [D 20:42:53.864969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19361. [D 20:42:53.865003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19362. [D 20:42:53.865022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19363. [D 20:42:53.865038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19364. [D 20:42:53.865060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19365. [D 20:42:53.865078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19366. [D 20:42:53.865097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19367. [D 20:42:53.865115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19368. [D 20:42:53.865133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19369. [D 20:42:53.865151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19370. [D 20:42:53.865169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19371. [D 20:42:53.865188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19372. [D 20:42:53.865207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19373. [D 20:42:53.865225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19374. [D 20:42:53.865243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19375. [D 20:42:53.865262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19376. [D 20:42:53.865280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19377. [D 20:42:53.865299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19378. [D 20:42:53.865318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19379. [D 20:42:53.865336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19380. [D 20:42:53.865355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19381. [D 20:42:53.865383] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19382. [D 20:42:53.870548] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19382. [D 20:42:53.870572] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 8/70. [D 20:42:53.870660] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.870683] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.870697] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:53.972090] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:53.972111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.972123] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:53.972159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4297 [D 20:42:53.972174] element 0: offset: 0x2aaaab00ee70, size: 24 [D 20:42:53.972191] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 9/70. [D 20:42:53.975769] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4297 [D 20:42:53.975846] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 10/70. [D 20:42:53.975905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19382. [D 20:42:53.975933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19383. [D 20:42:53.975948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19384. [D 20:42:53.975963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19385. [D 20:42:53.975979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19386. [D 20:42:53.975995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19387. [D 20:42:53.976010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19388. [D 20:42:53.976025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19389. [D 20:42:53.976059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19390. [D 20:42:53.976074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19391. [D 20:42:53.976089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19392. [D 20:42:53.976107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19393. [D 20:42:53.976122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19394. [D 20:42:53.976137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19395. [D 20:42:53.976152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19396. [D 20:42:53.976167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19397. [D 20:42:53.976181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19398. [D 20:42:53.976196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19399. [D 20:42:53.976211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19400. [D 20:42:53.976227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19401. [D 20:42:53.976261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19402. [D 20:42:53.976279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19403. [D 20:42:53.976293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19404. [D 20:42:53.976309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19405. [D 20:42:53.976324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19406. [D 20:42:53.976338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19407. [D 20:42:53.976353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19408. [D 20:42:53.976368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19409. [D 20:42:53.976383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19410. [D 20:42:53.976398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19411. [D 20:42:53.976416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19412. [D 20:42:53.976431] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19413. [D 20:42:53.981856] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19413. [D 20:42:53.981879] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 11/70. [D 20:42:53.981977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:53.982000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:53.982015] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.028383] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.028404] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.028417] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.028454] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4299 [D 20:42:54.028469] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:54.028486] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 12/70. [D 20:42:54.031860] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4299 [D 20:42:54.031889] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 13/70. [D 20:42:54.032054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19413. [D 20:42:54.032077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19414. [D 20:42:54.032094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19415. [D 20:42:54.032113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19416. [D 20:42:54.032133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19417. [D 20:42:54.032157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19418. [D 20:42:54.032172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19419. [D 20:42:54.032187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19420. [D 20:42:54.032202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19421. [D 20:42:54.032217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19422. [D 20:42:54.032244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19423. [D 20:42:54.032259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19424. [D 20:42:54.032273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19425. [D 20:42:54.032288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19426. [D 20:42:54.032303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19427. [D 20:42:54.032339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19428. [D 20:42:54.032354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19429. [D 20:42:54.032372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19430. [D 20:42:54.032390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19431. [D 20:42:54.032408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19432. [D 20:42:54.032426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19433. [D 20:42:54.032444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19434. [D 20:42:54.032460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19435. [D 20:42:54.032475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19436. [D 20:42:54.032493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19437. [D 20:42:54.032511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19438. [D 20:42:54.032529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19439. [D 20:42:54.032547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19440. [D 20:42:54.032565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19441. [D 20:42:54.032583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19442. [D 20:42:54.032600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19443. [D 20:42:54.032618] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19444. [D 20:42:54.037986] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19444. [D 20:42:54.038009] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 14/70. [D 20:42:54.038109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.038163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.038177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.088756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.088777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.088791] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.088828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4303 [D 20:42:54.088844] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:54.088865] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 15/70. [D 20:42:54.092300] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4303 [D 20:42:54.092328] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 16/70. [D 20:42:54.092436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19444. [D 20:42:54.092458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19445. [D 20:42:54.092474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19446. [D 20:42:54.092490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19447. [D 20:42:54.092511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19448. [D 20:42:54.092543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19449. [D 20:42:54.092559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19450. [D 20:42:54.092574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19451. [D 20:42:54.092590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19452. [D 20:42:54.092616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19453. [D 20:42:54.092632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19454. [D 20:42:54.092646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19455. [D 20:42:54.092661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19456. [D 20:42:54.092792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19457. [D 20:42:54.092811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19458. [D 20:42:54.093025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19459. [D 20:42:54.093044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19460. [D 20:42:54.093059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19461. [D 20:42:54.093128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19462. [D 20:42:54.093145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19463. [D 20:42:54.093289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19464. [D 20:42:54.093359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19465. [D 20:42:54.093391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19466. [D 20:42:54.093406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19467. [D 20:42:54.093468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19468. [D 20:42:54.093485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19469. [D 20:42:54.093576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19470. [D 20:42:54.093687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19471. [D 20:42:54.093705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19472. [D 20:42:54.093721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19473. [D 20:42:54.093789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19474. [D 20:42:54.093914] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19475. [D 20:42:54.098380] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19475. [D 20:42:54.098402] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 17/70. [D 20:42:54.098501] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.098553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.098567] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.156538] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.156559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.156572] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.156610] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4305 [D 20:42:54.156625] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:54.156644] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 18/70. [D 20:42:54.159853] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4305 [D 20:42:54.159879] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 19/70. [D 20:42:54.159970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19475. [D 20:42:54.159991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19476. [D 20:42:54.160006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19477. [D 20:42:54.160021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19478. [D 20:42:54.160036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19479. [D 20:42:54.160051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19480. [D 20:42:54.160066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19481. [D 20:42:54.160081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19482. [D 20:42:54.160096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19483. [D 20:42:54.160111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19484. [D 20:42:54.160126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19485. [D 20:42:54.160141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19486. [D 20:42:54.160156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19487. [D 20:42:54.160171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19488. [D 20:42:54.160186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19489. [D 20:42:54.160201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19490. [D 20:42:54.160216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19491. [D 20:42:54.160230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19492. [D 20:42:54.160245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19493. [D 20:42:54.160262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19494. [D 20:42:54.160278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19495. [D 20:42:54.160293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19496. [D 20:42:54.160308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19497. [D 20:42:54.160322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19498. [D 20:42:54.160337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19499. [D 20:42:54.160351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19500. [D 20:42:54.160366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19501. [D 20:42:54.160387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19502. [D 20:42:54.160401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19503. [D 20:42:54.160416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19504. [D 20:42:54.160432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19505. [D 20:42:54.160447] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19506. [D 20:42:54.165899] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19506. [D 20:42:54.165919] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 20/70. [D 20:42:54.166007] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.166061] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.166075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.254177] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.254200] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.254213] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.254251] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4309 [D 20:42:54.254266] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:54.254285] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 21/70. [D 20:42:54.257848] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4309 [D 20:42:54.257879] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 22/70. [D 20:42:54.257933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19506. [D 20:42:54.257952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 19507. [D 20:42:54.257967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 19508. [D 20:42:54.257982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 19509. [D 20:42:54.257997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 19510. [D 20:42:54.258012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 19511. [D 20:42:54.258042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19512. [D 20:42:54.258057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19513. [D 20:42:54.258071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19514. [D 20:42:54.258086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 19515. [D 20:42:54.258101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 19516. [D 20:42:54.258115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 19517. [D 20:42:54.258134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 19518. [D 20:42:54.258149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 19519. [D 20:42:54.258163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19520. [D 20:42:54.258178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19521. [D 20:42:54.258193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19522. [D 20:42:54.258207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19523. [D 20:42:54.258222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19524. [D 20:42:54.258237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19525. [D 20:42:54.258251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19526. [D 20:42:54.258266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19527. [D 20:42:54.258291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19528. [D 20:42:54.258306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19529. [D 20:42:54.258321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19530. [D 20:42:54.258335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19531. [D 20:42:54.258350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19532. [D 20:42:54.258365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19533. [D 20:42:54.258379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19534. [D 20:42:54.258393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19535. [D 20:42:54.258410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19536. [D 20:42:54.258424] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19537. [D 20:42:54.263904] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19537. [D 20:42:54.263924] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 23/70. [D 20:42:54.264031] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.264089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.264102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.389443] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.389464] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.389477] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.389517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4312 [D 20:42:54.389532] element 0: offset: 0x2aaaab026240, size: 24 [D 20:42:54.389552] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 24/70. [D 20:42:54.393172] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4312 [D 20:42:54.393209] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 25/70. [D 20:42:54.393261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19537. [D 20:42:54.393278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 19538. [D 20:42:54.393306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 19539. [D 20:42:54.393321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 19540. [D 20:42:54.393336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 19541. [D 20:42:54.393351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 19542. [D 20:42:54.393369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19543. [D 20:42:54.393384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19544. [D 20:42:54.393399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19545. [D 20:42:54.393414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 19546. [D 20:42:54.393442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 19547. [D 20:42:54.393457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 19548. [D 20:42:54.393471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 19549. [D 20:42:54.393490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 19550. [D 20:42:54.393505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19551. [D 20:42:54.393520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19552. [D 20:42:54.393534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19553. [D 20:42:54.393549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 19554. [D 20:42:54.393564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 19555. [D 20:42:54.393579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 19556. [D 20:42:54.393595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 19557. [D 20:42:54.393627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 19558. [D 20:42:54.393643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19559. [D 20:42:54.393662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19560. [D 20:42:54.393677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19561. [D 20:42:54.393693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 19562. [D 20:42:54.393708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 19563. [D 20:42:54.393723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 19564. [D 20:42:54.393738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 19565. [D 20:42:54.393753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 19566. [D 20:42:54.393767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19567. [D 20:42:54.393782] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19568. [D 20:42:54.399140] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19568. [D 20:42:54.399160] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 26/70. [D 20:42:54.399264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.399315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.399329] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.416414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.416435] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.416449] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.416486] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4314 [D 20:42:54.416501] element 0: offset: 0x2aaaab001c70, size: 24 [D 20:42:54.416521] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 27/70. [D 20:42:54.419855] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4314 [D 20:42:54.419880] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 28/70. [D 20:42:54.419931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19568. [D 20:42:54.419949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19569. [D 20:42:54.419964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19570. [D 20:42:54.419979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19571. [D 20:42:54.419994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19572. [D 20:42:54.420009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19573. [D 20:42:54.420025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19574. [D 20:42:54.420040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19575. [D 20:42:54.420054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19576. [D 20:42:54.420072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19577. [D 20:42:54.420087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19578. [D 20:42:54.420102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19579. [D 20:42:54.420117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19580. [D 20:42:54.420132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19581. [D 20:42:54.420147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19582. [D 20:42:54.420162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19583. [D 20:42:54.420177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19584. [D 20:42:54.420192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19585. [D 20:42:54.420207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19586. [D 20:42:54.420222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19587. [D 20:42:54.420237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19588. [D 20:42:54.420279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19589. [D 20:42:54.420300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19590. [D 20:42:54.420315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19591. [D 20:42:54.420330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19592. [D 20:42:54.420345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19593. [D 20:42:54.420359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19594. [D 20:42:54.420374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19595. [D 20:42:54.420389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19596. [D 20:42:54.420404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19597. [D 20:42:54.420431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19598. [D 20:42:54.420447] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19599. [D 20:42:54.425857] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19599. [D 20:42:54.425880] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 29/70. [D 20:42:54.425984] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.426039] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.426053] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.450650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.450671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.450684] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.450720] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4317 [D 20:42:54.450735] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:54.450754] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 30/70. [D 20:42:54.454325] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4317 [D 20:42:54.454353] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 31/70. [D 20:42:54.454460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19599. [D 20:42:54.454481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19600. [D 20:42:54.454497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 19601. [D 20:42:54.454512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 19602. [D 20:42:54.454534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 19603. [D 20:42:54.454557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 19604. [D 20:42:54.454572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 19605. [D 20:42:54.454586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19606. [D 20:42:54.454601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19607. [D 20:42:54.454616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19608. [D 20:42:54.454643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 19609. [D 20:42:54.454658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 19610. [D 20:42:54.454672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 19611. [D 20:42:54.454687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 19612. [D 20:42:54.454702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 19613. [D 20:42:54.454718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19614. [D 20:42:54.454738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19615. [D 20:42:54.454753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19616. [D 20:42:54.454774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19617. [D 20:42:54.454792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19618. [D 20:42:54.454810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19619. [D 20:42:54.454825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19620. [D 20:42:54.454845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19621. [D 20:42:54.454863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19622. [D 20:42:54.454881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19623. [D 20:42:54.454899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19624. [D 20:42:54.454917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19625. [D 20:42:54.454934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19626. [D 20:42:54.454952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19627. [D 20:42:54.454970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19628. [D 20:42:54.454988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19629. [D 20:42:54.455005] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19630. [D 20:42:54.460342] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19630. [D 20:42:54.460365] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 32/70. [D 20:42:54.460466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.460518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.460532] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.472591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.472611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.472625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.472663] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4320 [D 20:42:54.472678] element 0: offset: 0x2aaaab025680, size: 24 [D 20:42:54.472697] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 33/70. [D 20:42:54.476201] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4320 [D 20:42:54.476229] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 34/70. [D 20:42:54.476281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 19630. [D 20:42:54.476301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 19631. [D 20:42:54.476317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 19632. [D 20:42:54.476332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 19633. [D 20:42:54.476354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 19634. [D 20:42:54.476369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 19635. [D 20:42:54.476384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 19636. [D 20:42:54.476399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 19637. [D 20:42:54.476477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 19638. [D 20:42:54.476597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 19639. [D 20:42:54.476617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 19640. [D 20:42:54.476731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 19641. [D 20:42:54.476748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 19642. [D 20:42:54.476764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 19643. [D 20:42:54.476832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 19644. [D 20:42:54.476850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 19645. [D 20:42:54.476916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 19646. [D 20:42:54.477041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 19647. [D 20:42:54.477059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 19648. [D 20:42:54.477075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 19649. [D 20:42:54.477140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 19650. [D 20:42:54.477157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 19651. [D 20:42:54.477249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 19652. [D 20:42:54.477314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 19653. [D 20:42:54.477382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 19654. [D 20:42:54.477443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 19655. [D 20:42:54.477506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 19656. [D 20:42:54.477633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 19657. [D 20:42:54.477652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 19658. [D 20:42:54.477667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 19659. [D 20:42:54.477734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 19660. [D 20:42:54.477832] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 19661. [D 20:42:54.482229] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19661. [D 20:42:54.482251] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 35/70. [D 20:42:54.482351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.482401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.482415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.514365] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.514387] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.514400] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.514437] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4323 [D 20:42:54.514452] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:54.514471] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 36/70. [D 20:42:54.518171] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4323 [D 20:42:54.518205] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 37/70. [D 20:42:54.518257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19661. [D 20:42:54.518273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19662. [D 20:42:54.518288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19663. [D 20:42:54.518304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19664. [D 20:42:54.518319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19665. [D 20:42:54.518334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19666. [D 20:42:54.518349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19667. [D 20:42:54.518378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19668. [D 20:42:54.518394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19669. [D 20:42:54.518409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19670. [D 20:42:54.518424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19671. [D 20:42:54.518439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19672. [D 20:42:54.518454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19673. [D 20:42:54.518469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19674. [D 20:42:54.518484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19675. [D 20:42:54.518530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19676. [D 20:42:54.518550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19677. [D 20:42:54.518565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19678. [D 20:42:54.518580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19679. [D 20:42:54.518595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19680. [D 20:42:54.518610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19681. [D 20:42:54.518625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19682. [D 20:42:54.518640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19683. [D 20:42:54.518655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19684. [D 20:42:54.518670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19685. [D 20:42:54.518685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19686. [D 20:42:54.518700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19687. [D 20:42:54.518715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19688. [D 20:42:54.518730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19689. [D 20:42:54.518772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19690. [D 20:42:54.518790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19691. [D 20:42:54.518821] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19692. [D 20:42:54.524179] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19692. [D 20:42:54.524198] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 38/70. [D 20:42:54.524300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.524353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.524367] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.655873] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.655895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.655908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.655946] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4326 [D 20:42:54.655961] element 0: offset: 0x2aaaab025f70, size: 24 [D 20:42:54.655981] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 39/70. [D 20:42:54.659622] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4326 [D 20:42:54.659658] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 40/70. [D 20:42:54.659707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19692. [D 20:42:54.659724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19693. [D 20:42:54.659749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19694. [D 20:42:54.659771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19695. [D 20:42:54.659786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19696. [D 20:42:54.659801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19697. [D 20:42:54.659820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19698. [D 20:42:54.659838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19699. [D 20:42:54.659857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19700. [D 20:42:54.659873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19701. [D 20:42:54.659888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19702. [D 20:42:54.659904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19703. [D 20:42:54.659919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19704. [D 20:42:54.659933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19705. [D 20:42:54.659949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19706. [D 20:42:54.659964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19707. [D 20:42:54.659978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19708. [D 20:42:54.659994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19709. [D 20:42:54.660009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19710. [D 20:42:54.660023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19711. [D 20:42:54.660078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19712. [D 20:42:54.660093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19713. [D 20:42:54.660107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19714. [D 20:42:54.660122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19715. [D 20:42:54.660137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19716. [D 20:42:54.660152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19717. [D 20:42:54.660166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19718. [D 20:42:54.660181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19719. [D 20:42:54.660195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19720. [D 20:42:54.660210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19721. [D 20:42:54.660225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19722. [D 20:42:54.660240] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19723. [D 20:42:54.665635] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19723. [D 20:42:54.665655] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 41/70. [D 20:42:54.665757] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.665808] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.665822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.693957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.694005] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.694020] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.694065] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4329 [D 20:42:54.694080] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:54.694101] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 42/70. [D 20:42:54.697813] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4329 [D 20:42:54.697859] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 43/70. [D 20:42:54.697912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19723. [D 20:42:54.697943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19724. [D 20:42:54.697964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19725. [D 20:42:54.697979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19726. [D 20:42:54.697994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19727. [D 20:42:54.698009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19728. [D 20:42:54.698029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19729. [D 20:42:54.698044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19730. [D 20:42:54.698062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19731. [D 20:42:54.698077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19732. [D 20:42:54.698100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19733. [D 20:42:54.698115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19734. [D 20:42:54.698130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19735. [D 20:42:54.698149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19736. [D 20:42:54.698164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19737. [D 20:42:54.698179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19738. [D 20:42:54.698198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19739. [D 20:42:54.698214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19740. [D 20:42:54.698229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19741. [D 20:42:54.698250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19742. [D 20:42:54.698301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19743. [D 20:42:54.698319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19744. [D 20:42:54.698334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19745. [D 20:42:54.698349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19746. [D 20:42:54.698364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19747. [D 20:42:54.698378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19748. [D 20:42:54.698393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19749. [D 20:42:54.698408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19750. [D 20:42:54.698423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19751. [D 20:42:54.698438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19752. [D 20:42:54.698457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19753. [D 20:42:54.698472] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19754. [D 20:42:54.703810] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19754. [D 20:42:54.703833] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 44/70. [D 20:42:54.703934] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.703987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.704001] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.718769] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.718790] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.718804] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.718841] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4333 [D 20:42:54.718856] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:54.718876] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 45/70. [D 20:42:54.722336] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4333 [D 20:42:54.722369] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 46/70. [D 20:42:54.722424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 19754. [D 20:42:54.722441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 19755. [D 20:42:54.722457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 19756. [D 20:42:54.722474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 19757. [D 20:42:54.722489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 19758. [D 20:42:54.722521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 19759. [D 20:42:54.722546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 19760. [D 20:42:54.722561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 19761. [D 20:42:54.722576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 19762. [D 20:42:54.722591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 19763. [D 20:42:54.722606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 19764. [D 20:42:54.722621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 19765. [D 20:42:54.722640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 19766. [D 20:42:54.722657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 19767. [D 20:42:54.722672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 19768. [D 20:42:54.722694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 19769. [D 20:42:54.722726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 19770. [D 20:42:54.722743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 19771. [D 20:42:54.722763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 19772. [D 20:42:54.722778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 19773. [D 20:42:54.722793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 19774. [D 20:42:54.722812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 19775. [D 20:42:54.722827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 19776. [D 20:42:54.722842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 19777. [D 20:42:54.722857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 19778. [D 20:42:54.722885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 19779. [D 20:42:54.722900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 19780. [D 20:42:54.722916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 19781. [D 20:42:54.722931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 19782. [D 20:42:54.722945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 19783. [D 20:42:54.722960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 19784. [D 20:42:54.722977] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 19785. [D 20:42:54.728362] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19785. [D 20:42:54.728381] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 47/70. [D 20:42:54.728487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.728546] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.728560] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.749532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.749552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.749566] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.749606] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4335 [D 20:42:54.749621] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:54.749641] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 48/70. [D 20:42:54.753170] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4335 [D 20:42:54.753203] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 49/70. [D 20:42:54.753263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19785. [D 20:42:54.753280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19786. [D 20:42:54.753295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19787. [D 20:42:54.753319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19788. [D 20:42:54.753334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19789. [D 20:42:54.753349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19790. [D 20:42:54.753364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19791. [D 20:42:54.753384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19792. [D 20:42:54.753399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19793. [D 20:42:54.753414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19794. [D 20:42:54.753429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19795. [D 20:42:54.753444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19796. [D 20:42:54.753459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19797. [D 20:42:54.753474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19798. [D 20:42:54.753517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19799. [D 20:42:54.753532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19800. [D 20:42:54.753570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19801. [D 20:42:54.753585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19802. [D 20:42:54.753599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19803. [D 20:42:54.753614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19804. [D 20:42:54.753629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19805. [D 20:42:54.753644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19806. [D 20:42:54.753659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19807. [D 20:42:54.753675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19808. [D 20:42:54.753690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19809. [D 20:42:54.753711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19810. [D 20:42:54.753747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19811. [D 20:42:54.753763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19812. [D 20:42:54.753788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19813. [D 20:42:54.753803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19814. [D 20:42:54.753818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19815. [D 20:42:54.753832] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19816. [D 20:42:54.759180] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19816. [D 20:42:54.759200] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 50/70. [D 20:42:54.759303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.759355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.759369] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.850185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.850207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.850220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.850257] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4338 [D 20:42:54.850272] element 0: offset: 0x2aaaab026240, size: 24 [D 20:42:54.850291] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 51/70. [D 20:42:54.853897] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4338 [D 20:42:54.853962] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 52/70. [D 20:42:54.854021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19816. [D 20:42:54.854054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19817. [D 20:42:54.854074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19818. [D 20:42:54.854091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19819. [D 20:42:54.854120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19820. [D 20:42:54.854135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19821. [D 20:42:54.854151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19822. [D 20:42:54.854167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19823. [D 20:42:54.854182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19824. [D 20:42:54.854197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19825. [D 20:42:54.854217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19826. [D 20:42:54.854232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19827. [D 20:42:54.854247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19828. [D 20:42:54.854263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19829. [D 20:42:54.854279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19830. [D 20:42:54.854301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19831. [D 20:42:54.854332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19832. [D 20:42:54.854347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19833. [D 20:42:54.854371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19834. [D 20:42:54.854386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19835. [D 20:42:54.854401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19836. [D 20:42:54.854416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19837. [D 20:42:54.854431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19838. [D 20:42:54.854446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19839. [D 20:42:54.854461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19840. [D 20:42:54.854476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19841. [D 20:42:54.854491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19842. [D 20:42:54.854506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19843. [D 20:42:54.854532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19844. [D 20:42:54.854548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19845. [D 20:42:54.854570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19846. [D 20:42:54.854610] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19847. [D 20:42:54.859980] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 19847. [D 20:42:54.860001] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 53/70. [D 20:42:54.860095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.860120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.860134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.899847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.899870] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.899884] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.899920] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4341 [D 20:42:54.899935] element 0: offset: 0x2aaaab001c70, size: 24 [D 20:42:54.899951] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 54/70. [D 20:42:54.906336] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4341 [D 20:42:54.906412] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 55/70. [D 20:42:54.906494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19847. [D 20:42:54.906515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19848. [D 20:42:54.906531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19849. [D 20:42:54.906546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19850. [D 20:42:54.906560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19851. [D 20:42:54.906575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19852. [D 20:42:54.906651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19853. [D 20:42:54.906698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19854. [D 20:42:54.906714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19855. [D 20:42:54.906728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19856. [D 20:42:54.906743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19857. [D 20:42:54.906756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19858. [D 20:42:54.906770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19859. [D 20:42:54.906784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19860. [D 20:42:54.906798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19861. [D 20:42:54.906812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19862. [D 20:42:54.906826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19863. [D 20:42:54.906840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19864. [D 20:42:54.906854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19865. [D 20:42:54.906868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19866. [D 20:42:54.906883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19867. [D 20:42:54.906897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19868. [D 20:42:54.906911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19869. [D 20:42:54.906925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19870. [D 20:42:54.906939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19871. [D 20:42:54.906953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19872. [D 20:42:54.906967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19873. [D 20:42:54.906981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19874. [D 20:42:54.906995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19875. [D 20:42:54.907009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19876. [D 20:42:54.907023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19877. [D 20:42:54.907037] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19878. [D 20:42:54.912453] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 19878. [D 20:42:54.912477] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 56/70. [D 20:42:54.915510] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.915527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.915540] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.930236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.930256] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.930269] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.930306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4344 [D 20:42:54.930320] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:54.930337] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 57/70. [D 20:42:54.933652] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4344 [D 20:42:54.933722] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 58/70. [D 20:42:54.933785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19878. [D 20:42:54.933847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19879. [D 20:42:54.933991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19880. [D 20:42:54.934008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19881. [D 20:42:54.934160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19882. [D 20:42:54.934283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19883. [D 20:42:54.934308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19884. [D 20:42:54.934412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19885. [D 20:42:54.934518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19886. [D 20:42:54.934625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19887. [D 20:42:54.934748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19888. [D 20:42:54.934860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19889. [D 20:42:54.934962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19890. [D 20:42:54.935078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19891. [D 20:42:54.935186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19892. [D 20:42:54.935288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19893. [D 20:42:54.935395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19894. [D 20:42:54.935497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19895. [D 20:42:54.935603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19896. [D 20:42:54.935705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19897. [D 20:42:54.935810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19898. [D 20:42:54.935946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19899. [D 20:42:54.936055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19900. [D 20:42:54.936157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19901. [D 20:42:54.936264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19902. [D 20:42:54.936366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19903. [D 20:42:54.936473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19904. [D 20:42:54.936574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19905. [D 20:42:54.936695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19906. [D 20:42:54.936802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19907. [D 20:42:54.936911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19908. [D 20:42:54.937013] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19909. [D 20:42:54.939775] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 19909. [D 20:42:54.939801] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 59/70. [D 20:42:54.940045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.940068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.940082] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:54.989411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:54.989432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.989444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:54.989481] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4347 [D 20:42:54.989496] element 0: offset: 0x2aaaab025680, size: 24 [D 20:42:54.989513] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 60/70. [D 20:42:54.992641] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4347 [D 20:42:54.992707] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 0/70. [D 20:42:54.992906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 19909. [D 20:42:54.992968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 19910. [D 20:42:54.992997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 19911. [D 20:42:54.993013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 19912. [D 20:42:54.993162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 19913. [D 20:42:54.993185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 19914. [D 20:42:54.993204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 19915. [D 20:42:54.993240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 19916. [D 20:42:54.993259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 19917. [D 20:42:54.993277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 19918. [D 20:42:54.993293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 19919. [D 20:42:54.993308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 19920. [D 20:42:54.993326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 19921. [D 20:42:54.993344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 19922. [D 20:42:54.993363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 19923. [D 20:42:54.993381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 19924. [D 20:42:54.993399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 19925. [D 20:42:54.993418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 19926. [D 20:42:54.993436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 19927. [D 20:42:54.993454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 19928. [D 20:42:54.993473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 19929. [D 20:42:54.993491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 19930. [D 20:42:54.993510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 19931. [D 20:42:54.993528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 19932. [D 20:42:54.993546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 19933. [D 20:42:54.993565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 19934. [D 20:42:54.993583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 19935. [D 20:42:54.993602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 19936. [D 20:42:54.993620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 19937. [D 20:42:54.993639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 19938. [D 20:42:54.993657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 19939. [D 20:42:54.993675] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 19940. [D 20:42:54.998898] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 19940. [D 20:42:54.998923] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 1/70. [D 20:42:54.999097] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:54.999122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:54.999135] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.028221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.028243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.028256] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.028292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4350 [D 20:42:55.028308] element 0: offset: 0x2aaaab002070, size: 24 [D 20:42:55.028325] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 2/70. [D 20:42:55.031780] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4350 [D 20:42:55.031867] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 3/70. [D 20:42:55.032018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19940. [D 20:42:55.032045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19941. [D 20:42:55.032061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 19942. [D 20:42:55.032075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 19943. [D 20:42:55.032098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 19944. [D 20:42:55.032113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 19945. [D 20:42:55.032128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 19946. [D 20:42:55.032147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19947. [D 20:42:55.032161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19948. [D 20:42:55.032176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19949. [D 20:42:55.032191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 19950. [D 20:42:55.032206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 19951. [D 20:42:55.032221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 19952. [D 20:42:55.032235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 19953. [D 20:42:55.032250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 19954. [D 20:42:55.032265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19955. [D 20:42:55.032300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19956. [D 20:42:55.032328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19957. [D 20:42:55.032344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 19958. [D 20:42:55.032358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 19959. [D 20:42:55.032373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 19960. [D 20:42:55.032388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 19961. [D 20:42:55.032402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 19962. [D 20:42:55.032417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19963. [D 20:42:55.032432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19964. [D 20:42:55.032446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19965. [D 20:42:55.032461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 19966. [D 20:42:55.032476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 19967. [D 20:42:55.032491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 19968. [D 20:42:55.032531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 19969. [D 20:42:55.032551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 19970. [D 20:42:55.032580] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19971. [D 20:42:55.039444] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 19971. [D 20:42:55.039469] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 4/70. [D 20:42:55.039567] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.039592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.039605] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.040790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.040810] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.040823] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.040860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4353 [D 20:42:55.040876] element 0: offset: 0x2aaaab025f70, size: 24 [D 20:42:55.040893] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 5/70. [D 20:42:55.044435] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4353 [D 20:42:55.044499] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 6/70. [D 20:42:55.044561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19971. [D 20:42:55.044585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19972. [D 20:42:55.044601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 19973. [D 20:42:55.044616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 19974. [D 20:42:55.044630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 19975. [D 20:42:55.044647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 19976. [D 20:42:55.044662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 19977. [D 20:42:55.044676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19978. [D 20:42:55.044710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19979. [D 20:42:55.044724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19980. [D 20:42:55.044739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 19981. [D 20:42:55.044759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 19982. [D 20:42:55.044773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 19983. [D 20:42:55.044788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 19984. [D 20:42:55.044803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 19985. [D 20:42:55.044818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19986. [D 20:42:55.044832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19987. [D 20:42:55.044847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19988. [D 20:42:55.044862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19989. [D 20:42:55.044893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19990. [D 20:42:55.044908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19991. [D 20:42:55.044932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19992. [D 20:42:55.044948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19993. [D 20:42:55.044962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19994. [D 20:42:55.044977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19995. [D 20:42:55.044992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19996. [D 20:42:55.045030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19997. [D 20:42:55.045046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19998. [D 20:42:55.045061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19999. [D 20:42:55.045075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20000. [D 20:42:55.045090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20001. [D 20:42:55.045105] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20002. [D 20:42:55.050499] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20002. [D 20:42:55.050523] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 7/70. [D 20:42:55.050618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.050643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.050656] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.152375] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.152398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.152411] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.152447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4356 [D 20:42:55.152462] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:55.152479] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 8/70. [D 20:42:55.155883] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4356 [D 20:42:55.155962] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 9/70. [D 20:42:55.156025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 20002. [D 20:42:55.156068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 20003. [D 20:42:55.156084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20004. [D 20:42:55.156099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20005. [D 20:42:55.156114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20006. [D 20:42:55.156130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20007. [D 20:42:55.156144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20008. [D 20:42:55.156159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20009. [D 20:42:55.156174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20010. [D 20:42:55.156189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20011. [D 20:42:55.156204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20012. [D 20:42:55.156219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20013. [D 20:42:55.156234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20014. [D 20:42:55.156249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20015. [D 20:42:55.156286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20016. [D 20:42:55.156306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20017. [D 20:42:55.156320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20018. [D 20:42:55.156335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20019. [D 20:42:55.156350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20020. [D 20:42:55.156364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20021. [D 20:42:55.156379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20022. [D 20:42:55.156394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20023. [D 20:42:55.156409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20024. [D 20:42:55.156435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20025. [D 20:42:55.156453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20026. [D 20:42:55.156468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20027. [D 20:42:55.156482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20028. [D 20:42:55.156505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20029. [D 20:42:55.156550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20030. [D 20:42:55.156572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20031. [D 20:42:55.156587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20032. [D 20:42:55.156601] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20033. [D 20:42:55.161926] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20033. [D 20:42:55.161947] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 10/70. [D 20:42:55.162077] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.162100] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.162114] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.188681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.188702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.188715] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.188753] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4360 [D 20:42:55.188768] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:55.188784] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 11/70. [D 20:42:55.192345] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4360 [D 20:42:55.192408] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 12/70. [D 20:42:55.192469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20033. [D 20:42:55.192493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20034. [D 20:42:55.192509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20035. [D 20:42:55.192524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20036. [D 20:42:55.192538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20037. [D 20:42:55.192554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20038. [D 20:42:55.192571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20039. [D 20:42:55.192586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20040. [D 20:42:55.192600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20041. [D 20:42:55.192615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20042. [D 20:42:55.192640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20043. [D 20:42:55.192655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20044. [D 20:42:55.192669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20045. [D 20:42:55.192688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20046. [D 20:42:55.192703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20047. [D 20:42:55.192717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20048. [D 20:42:55.192732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20049. [D 20:42:55.192762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20050. [D 20:42:55.192777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20051. [D 20:42:55.192792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20052. [D 20:42:55.192838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20053. [D 20:42:55.192854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20054. [D 20:42:55.192873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20055. [D 20:42:55.192887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20056. [D 20:42:55.192902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20057. [D 20:42:55.192916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20058. [D 20:42:55.192931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20059. [D 20:42:55.192945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20060. [D 20:42:55.192964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20061. [D 20:42:55.192993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20062. [D 20:42:55.193008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20063. [D 20:42:55.193023] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20064. [D 20:42:55.198360] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20064. [D 20:42:55.198382] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 13/70. [D 20:42:55.198476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.198501] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.198514] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.218237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.218257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.218270] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.218305] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4362 [D 20:42:55.218320] element 0: offset: 0x2aaaab026240, size: 24 [D 20:42:55.218336] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 14/70. [D 20:42:55.221764] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4362 [D 20:42:55.221828] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 15/70. [D 20:42:55.221884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 20064. [D 20:42:55.221908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 20065. [D 20:42:55.221924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 20066. [D 20:42:55.221939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 20067. [D 20:42:55.221953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 20068. [D 20:42:55.221968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 20069. [D 20:42:55.221989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 20070. [D 20:42:55.222004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 20071. [D 20:42:55.222018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 20072. [D 20:42:55.222047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 20073. [D 20:42:55.222063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 20074. [D 20:42:55.222078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 20075. [D 20:42:55.222096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 20076. [D 20:42:55.222111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 20077. [D 20:42:55.222127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 20078. [D 20:42:55.222159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 20079. [D 20:42:55.222177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 20080. [D 20:42:55.222196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 20081. [D 20:42:55.222211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 20082. [D 20:42:55.222226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 20083. [D 20:42:55.222241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 20084. [D 20:42:55.222256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 20085. [D 20:42:55.222270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 20086. [D 20:42:55.222285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 20087. [D 20:42:55.222300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 20088. [D 20:42:55.222315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 20089. [D 20:42:55.222329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 20090. [D 20:42:55.222344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 20091. [D 20:42:55.222367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 20092. [D 20:42:55.222383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 20093. [D 20:42:55.222423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 20094. [D 20:42:55.222445] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 20095. [D 20:42:55.227819] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20095. [D 20:42:55.227844] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 16/70. [D 20:42:55.227974] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.227998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.228012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.256054] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.256075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.256088] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.256124] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4365 [D 20:42:55.256139] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:55.256156] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 17/70. [D 20:42:55.259587] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4365 [D 20:42:55.259650] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 18/70. [D 20:42:55.259704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20095. [D 20:42:55.259728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20096. [D 20:42:55.259744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20097. [D 20:42:55.259758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20098. [D 20:42:55.259773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20099. [D 20:42:55.259813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20100. [D 20:42:55.259828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20101. [D 20:42:55.259847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20102. [D 20:42:55.259866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20103. [D 20:42:55.259881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20104. [D 20:42:55.259896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20105. [D 20:42:55.259911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20106. [D 20:42:55.259926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20107. [D 20:42:55.259940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20108. [D 20:42:55.259956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20109. [D 20:42:55.259971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20110. [D 20:42:55.259986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20111. [D 20:42:55.260000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20112. [D 20:42:55.260015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20113. [D 20:42:55.260030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20114. [D 20:42:55.260045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20115. [D 20:42:55.260070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20116. [D 20:42:55.260085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20117. [D 20:42:55.260100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20118. [D 20:42:55.260115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20119. [D 20:42:55.260129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20120. [D 20:42:55.260145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20121. [D 20:42:55.260192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20122. [D 20:42:55.260212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20123. [D 20:42:55.260227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20124. [D 20:42:55.260242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20125. [D 20:42:55.260256] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20126. [D 20:42:55.265651] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20126. [D 20:42:55.265674] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 19/70. [D 20:42:55.265768] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.265792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.265805] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.298427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.298448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.298461] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.298496] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4368 [D 20:42:55.298511] element 0: offset: 0x2aaaab025680, size: 24 [D 20:42:55.298527] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 20/70. [D 20:42:55.302076] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4368 [D 20:42:55.302141] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 21/70. [D 20:42:55.302202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20126. [D 20:42:55.302228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20127. [D 20:42:55.302244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20128. [D 20:42:55.302258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20129. [D 20:42:55.302273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20130. [D 20:42:55.302290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20131. [D 20:42:55.302304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20132. [D 20:42:55.302319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20133. [D 20:42:55.302334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20134. [D 20:42:55.302356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20135. [D 20:42:55.302370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20136. [D 20:42:55.302385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20137. [D 20:42:55.302404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20138. [D 20:42:55.302419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20139. [D 20:42:55.302444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20140. [D 20:42:55.302460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20141. [D 20:42:55.302474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20142. [D 20:42:55.302489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20143. [D 20:42:55.302504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20144. [D 20:42:55.302539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20145. [D 20:42:55.302556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20146. [D 20:42:55.302576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20147. [D 20:42:55.302591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20148. [D 20:42:55.302606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20149. [D 20:42:55.302621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20150. [D 20:42:55.302638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20151. [D 20:42:55.302665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20152. [D 20:42:55.302681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20153. [D 20:42:55.302695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20154. [D 20:42:55.302710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20155. [D 20:42:55.302725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20156. [D 20:42:55.302740] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20157. [D 20:42:55.308135] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20157. [D 20:42:55.308157] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 22/70. [D 20:42:55.308251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.308275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.308288] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.350790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.350811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.350824] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.350860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4371 [D 20:42:55.350875] element 0: offset: 0x2aaaab025f70, size: 24 [D 20:42:55.350891] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 23/70. [D 20:42:55.354431] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4371 [D 20:42:55.354496] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 24/70. [D 20:42:55.354553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20157. [D 20:42:55.354580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20158. [D 20:42:55.354596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20159. [D 20:42:55.354610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20160. [D 20:42:55.354639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20161. [D 20:42:55.354653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20162. [D 20:42:55.354668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20163. [D 20:42:55.354684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20164. [D 20:42:55.354704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20165. [D 20:42:55.354719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20166. [D 20:42:55.354734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20167. [D 20:42:55.354753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20168. [D 20:42:55.354767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20169. [D 20:42:55.354782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20170. [D 20:42:55.354796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20171. [D 20:42:55.354811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20172. [D 20:42:55.354826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20173. [D 20:42:55.354841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20174. [D 20:42:55.354877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20175. [D 20:42:55.354892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20176. [D 20:42:55.354915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20177. [D 20:42:55.354930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20178. [D 20:42:55.354944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20179. [D 20:42:55.354959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20180. [D 20:42:55.354974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20181. [D 20:42:55.354988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20182. [D 20:42:55.355003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20183. [D 20:42:55.355017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20184. [D 20:42:55.355032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20185. [D 20:42:55.355060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20186. [D 20:42:55.355075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20187. [D 20:42:55.355089] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20188. [D 20:42:55.360484] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20188. [D 20:42:55.360506] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 25/70. [D 20:42:55.360599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.360623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.360637] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.382847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.382868] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.382881] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.382916] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4374 [D 20:42:55.382932] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:55.382948] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 26/70. [D 20:42:55.386490] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4374 [D 20:42:55.386555] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 27/70. [D 20:42:55.386612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20188. [D 20:42:55.386637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20189. [D 20:42:55.386652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20190. [D 20:42:55.386667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20191. [D 20:42:55.386681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20192. [D 20:42:55.386696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20193. [D 20:42:55.386711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20194. [D 20:42:55.386733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20195. [D 20:42:55.386764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20196. [D 20:42:55.386779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20197. [D 20:42:55.386794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20198. [D 20:42:55.386813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20199. [D 20:42:55.386829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20200. [D 20:42:55.386844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20201. [D 20:42:55.386866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20202. [D 20:42:55.386894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20203. [D 20:42:55.386910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20204. [D 20:42:55.386933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20205. [D 20:42:55.386949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20206. [D 20:42:55.386963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20207. [D 20:42:55.386978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20208. [D 20:42:55.386993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20209. [D 20:42:55.387008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20210. [D 20:42:55.387023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20211. [D 20:42:55.387038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20212. [D 20:42:55.387053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20213. [D 20:42:55.387068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20214. [D 20:42:55.387083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20215. [D 20:42:55.387098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20216. [D 20:42:55.387121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20217. [D 20:42:55.387161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20218. [D 20:42:55.387194] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20219. [D 20:42:55.392551] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20219. [D 20:42:55.392572] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 28/70. [D 20:42:55.392668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.392693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.392706] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.414237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.414257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.414270] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.414306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4377 [D 20:42:55.414321] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:55.414339] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 29/70. [D 20:42:55.417873] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4377 [D 20:42:55.417939] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 30/70. [D 20:42:55.417998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 20219. [D 20:42:55.418036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 20220. [D 20:42:55.418051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20221. [D 20:42:55.418069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20222. [D 20:42:55.418086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20223. [D 20:42:55.418104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20224. [D 20:42:55.418119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20225. [D 20:42:55.418150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20226. [D 20:42:55.418165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20227. [D 20:42:55.418179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20228. [D 20:42:55.418199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20229. [D 20:42:55.418213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20230. [D 20:42:55.418228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20231. [D 20:42:55.418243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20232. [D 20:42:55.418258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20233. [D 20:42:55.418272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20234. [D 20:42:55.418287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20235. [D 20:42:55.418319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20236. [D 20:42:55.418336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20237. [D 20:42:55.418352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20238. [D 20:42:55.418372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20239. [D 20:42:55.418386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20240. [D 20:42:55.418401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20241. [D 20:42:55.418418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20242. [D 20:42:55.418432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20243. [D 20:42:55.418460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20244. [D 20:42:55.418477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20245. [D 20:42:55.418491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20246. [D 20:42:55.418506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20247. [D 20:42:55.418521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20248. [D 20:42:55.418536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20249. [D 20:42:55.418552] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20250. [D 20:42:55.423965] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20250. [D 20:42:55.423987] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 31/70. [D 20:42:55.424083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.424107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.424120] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.465126] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.465146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.465159] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.465196] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4380 [D 20:42:55.465211] element 0: offset: 0x2aaaab026240, size: 24 [D 20:42:55.465228] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 32/70. [D 20:42:55.468776] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4380 [D 20:42:55.468839] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 33/70. [D 20:42:55.468899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 20250. [D 20:42:55.468924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 20251. [D 20:42:55.468939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 20252. [D 20:42:55.468954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 20253. [D 20:42:55.468969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 20254. [D 20:42:55.468986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 20255. [D 20:42:55.469001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 20256. [D 20:42:55.469015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 20257. [D 20:42:55.469049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 20258. [D 20:42:55.469064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 20259. [D 20:42:55.469079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 20260. [D 20:42:55.469098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 20261. [D 20:42:55.469113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 20262. [D 20:42:55.469127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 20263. [D 20:42:55.469142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 20264. [D 20:42:55.469157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 20265. [D 20:42:55.469171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 20266. [D 20:42:55.469194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 20267. [D 20:42:55.469209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 20268. [D 20:42:55.469252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 20269. [D 20:42:55.469271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 20270. [D 20:42:55.469288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 20271. [D 20:42:55.469303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 20272. [D 20:42:55.469318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 20273. [D 20:42:55.469333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 20274. [D 20:42:55.469347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 20275. [D 20:42:55.469365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 20276. [D 20:42:55.469380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 20277. [D 20:42:55.469407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 20278. [D 20:42:55.469422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 20279. [D 20:42:55.469437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 20280. [D 20:42:55.469452] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 20281. [D 20:42:55.474868] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20281. [D 20:42:55.474890] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 34/70. [D 20:42:55.474986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.475010] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.475023] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.533596] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.533617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.533629] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.533665] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4384 [D 20:42:55.533680] element 0: offset: 0x2aaaab025680, size: 24 [D 20:42:55.533697] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 35/70. [D 20:42:55.537279] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4384 [D 20:42:55.537345] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 36/70. [D 20:42:55.537403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20281. [D 20:42:55.537443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20282. [D 20:42:55.537460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20283. [D 20:42:55.537476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20284. [D 20:42:55.537492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20285. [D 20:42:55.537507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20286. [D 20:42:55.537522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20287. [D 20:42:55.537553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20288. [D 20:42:55.537568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20289. [D 20:42:55.537582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20290. [D 20:42:55.537602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20291. [D 20:42:55.537616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20292. [D 20:42:55.537631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20293. [D 20:42:55.537646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20294. [D 20:42:55.537661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20295. [D 20:42:55.537676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20296. [D 20:42:55.537698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20297. [D 20:42:55.537729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20298. [D 20:42:55.537744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20299. [D 20:42:55.537763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20300. [D 20:42:55.537779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20301. [D 20:42:55.537794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20302. [D 20:42:55.537809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20303. [D 20:42:55.537824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20304. [D 20:42:55.537839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20305. [D 20:42:55.537868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20306. [D 20:42:55.537883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20307. [D 20:42:55.537898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20308. [D 20:42:55.537913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20309. [D 20:42:55.537927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20310. [D 20:42:55.537942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20311. [D 20:42:55.537956] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20312. [D 20:42:55.543364] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20312. [D 20:42:55.543383] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 37/70. [D 20:42:55.543480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.543505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.543518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.620408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.620429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.620442] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.620479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4386 [D 20:42:55.620493] element 0: offset: 0x2aaaab025f70, size: 24 [D 20:42:55.620510] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 38/70. [D 20:42:55.623887] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4386 [D 20:42:55.623917] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 39/70. [D 20:42:55.623970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20312. [D 20:42:55.623992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20313. [D 20:42:55.624007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20314. [D 20:42:55.624022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20315. [D 20:42:55.624037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20316. [D 20:42:55.624052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20317. [D 20:42:55.624067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20318. [D 20:42:55.624088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20319. [D 20:42:55.624103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20320. [D 20:42:55.624118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20321. [D 20:42:55.624133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20322. [D 20:42:55.624148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20323. [D 20:42:55.624163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20324. [D 20:42:55.624178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20325. [D 20:42:55.624213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20326. [D 20:42:55.624227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20327. [D 20:42:55.624248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20328. [D 20:42:55.624263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20329. [D 20:42:55.624277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20330. [D 20:42:55.624292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20331. [D 20:42:55.624307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20332. [D 20:42:55.624335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20333. [D 20:42:55.624355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20334. [D 20:42:55.624371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20335. [D 20:42:55.624386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20336. [D 20:42:55.624437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20337. [D 20:42:55.624457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20338. [D 20:42:55.624477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20339. [D 20:42:55.624492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20340. [D 20:42:55.624507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20341. [D 20:42:55.624522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20342. [D 20:42:55.624537] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20343. [D 20:42:55.629922] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20343. [D 20:42:55.629945] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 40/70. [D 20:42:55.630049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.630102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.630117] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.667910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.667931] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.667944] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.667980] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4389 [D 20:42:55.667996] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:55.668017] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 41/70. [D 20:42:55.671412] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4389 [D 20:42:55.671441] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 42/70. [D 20:42:55.671495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 20343. [D 20:42:55.671599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 20344. [D 20:42:55.671678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 20345. [D 20:42:55.671697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 20346. [D 20:42:55.671712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 20347. [D 20:42:55.671781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 20348. [D 20:42:55.671882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 20349. [D 20:42:55.671949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 20350. [D 20:42:55.672013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 20351. [D 20:42:55.672075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 20352. [D 20:42:55.672199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 20353. [D 20:42:55.672218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 20354. [D 20:42:55.672233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 20355. [D 20:42:55.672302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 20356. [D 20:42:55.672319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 20357. [D 20:42:55.672387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 20358. [D 20:42:55.672495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 20359. [D 20:42:55.672514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 20360. [D 20:42:55.672529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 20361. [D 20:42:55.672599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 20362. [D 20:42:55.672616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 20363. [D 20:42:55.672631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 20364. [D 20:42:55.672731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 20365. [D 20:42:55.672872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 20366. [D 20:42:55.672892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 20367. [D 20:42:55.672952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 20368. [D 20:42:55.673015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 20369. [D 20:42:55.673137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 20370. [D 20:42:55.673156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 20371. [D 20:42:55.673171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 20372. [D 20:42:55.673241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 20373. [D 20:42:55.673354] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 20374. [D 20:42:55.677521] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20374. [D 20:42:55.677543] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 43/70. [D 20:42:55.677645] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.677696] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.677710] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.745470] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.745492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.745505] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.745542] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4393 [D 20:42:55.745557] element 0: offset: 0x2aaaab03b3e0, size: 24 [D 20:42:55.745578] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 44/70. [D 20:42:55.748959] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4393 [D 20:42:55.748988] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 45/70. [D 20:42:55.749039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20374. [D 20:42:55.749150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20375. [D 20:42:55.749169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20376. [D 20:42:55.749184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20377. [D 20:42:55.749264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20378. [D 20:42:55.749352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20379. [D 20:42:55.749414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20380. [D 20:42:55.749477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20381. [D 20:42:55.749542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20382. [D 20:42:55.749560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20383. [D 20:42:55.749628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20384. [D 20:42:55.749748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20385. [D 20:42:55.749766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20386. [D 20:42:55.749781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20387. [D 20:42:55.749863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20388. [D 20:42:55.749952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20389. [D 20:42:55.750014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20390. [D 20:42:55.750077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20391. [D 20:42:55.750143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20392. [D 20:42:55.750206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20393. [D 20:42:55.750269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20394. [D 20:42:55.750395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20395. [D 20:42:55.750414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20396. [D 20:42:55.750429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20397. [D 20:42:55.750498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20398. [D 20:42:55.750515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20399. [D 20:42:55.750583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20400. [D 20:42:55.750691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20401. [D 20:42:55.750709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20402. [D 20:42:55.750724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20403. [D 20:42:55.750877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20404. [D 20:42:55.750897] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20405. [D 20:42:55.755091] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20405. [D 20:42:55.755114] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 46/70. [D 20:42:55.755214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.755268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.755281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.800893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.800914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.800928] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.800966] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4395 [D 20:42:55.800981] element 0: offset: 0x2aaaab026240, size: 24 [D 20:42:55.801001] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 47/70. [D 20:42:55.804657] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4395 [D 20:42:55.804692] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 48/70. [D 20:42:55.804743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20405. [D 20:42:55.804761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20406. [D 20:42:55.804776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20407. [D 20:42:55.804797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20408. [D 20:42:55.804813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20409. [D 20:42:55.804827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20410. [D 20:42:55.804842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20411. [D 20:42:55.804873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20412. [D 20:42:55.804888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20413. [D 20:42:55.804903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20414. [D 20:42:55.804918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20415. [D 20:42:55.804933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20416. [D 20:42:55.804948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20417. [D 20:42:55.804963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20418. [D 20:42:55.805007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20419. [D 20:42:55.805022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20420. [D 20:42:55.805042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20421. [D 20:42:55.805057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20422. [D 20:42:55.805072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20423. [D 20:42:55.805087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20424. [D 20:42:55.805102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20425. [D 20:42:55.805116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20426. [D 20:42:55.805131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20427. [D 20:42:55.805150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20428. [D 20:42:55.805166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20429. [D 20:42:55.805181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20430. [D 20:42:55.805196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20431. [D 20:42:55.805237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20432. [D 20:42:55.805252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20433. [D 20:42:55.805273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20434. [D 20:42:55.805288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20435. [D 20:42:55.805303] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20436. [D 20:42:55.810682] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20436. [D 20:42:55.810701] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 49/70. [D 20:42:55.810803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.810855] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.810870] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.842781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.842803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.842816] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.842853] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4398 [D 20:42:55.842868] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:55.842888] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 50/70. [D 20:42:55.846434] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4398 [D 20:42:55.846471] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 51/70. [D 20:42:55.846521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 20436. [D 20:42:55.846538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 20437. [D 20:42:55.846553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20438. [D 20:42:55.846568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20439. [D 20:42:55.846583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20440. [D 20:42:55.846598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20441. [D 20:42:55.846612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20442. [D 20:42:55.846642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20443. [D 20:42:55.846658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20444. [D 20:42:55.846673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20445. [D 20:42:55.846688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20446. [D 20:42:55.846703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20447. [D 20:42:55.846717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20448. [D 20:42:55.846732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20449. [D 20:42:55.846777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20450. [D 20:42:55.846791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20451. [D 20:42:55.846812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20452. [D 20:42:55.846826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20453. [D 20:42:55.846841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20454. [D 20:42:55.846855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20455. [D 20:42:55.846870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20456. [D 20:42:55.846885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20457. [D 20:42:55.846900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20458. [D 20:42:55.846918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20459. [D 20:42:55.846934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20460. [D 20:42:55.846949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20461. [D 20:42:55.846965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20462. [D 20:42:55.847005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20463. [D 20:42:55.847020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20464. [D 20:42:55.847045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20465. [D 20:42:55.847060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20466. [D 20:42:55.847088] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20467. [D 20:42:55.852439] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20467. [D 20:42:55.852458] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 52/70. [D 20:42:55.852564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.852616] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.852630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:55.934354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:55.934375] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.934388] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:55.934426] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4402 [D 20:42:55.934441] element 0: offset: 0x2aaaab025f70, size: 24 [D 20:42:55.934460] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 53/70. [D 20:42:55.937999] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4402 [D 20:42:55.938036] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 54/70. [D 20:42:55.938088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20467. [D 20:42:55.938105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20468. [D 20:42:55.938120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20469. [D 20:42:55.938147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20470. [D 20:42:55.938161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20471. [D 20:42:55.938176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20472. [D 20:42:55.938191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20473. [D 20:42:55.938223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20474. [D 20:42:55.938238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20475. [D 20:42:55.938253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20476. [D 20:42:55.938268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20477. [D 20:42:55.938282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20478. [D 20:42:55.938297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20479. [D 20:42:55.938339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20480. [D 20:42:55.938354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20481. [D 20:42:55.938375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20482. [D 20:42:55.938389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20483. [D 20:42:55.938404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20484. [D 20:42:55.938419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20485. [D 20:42:55.938434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20486. [D 20:42:55.938449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20487. [D 20:42:55.938463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20488. [D 20:42:55.938478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20489. [D 20:42:55.938493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20490. [D 20:42:55.938508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20491. [D 20:42:55.938523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20492. [D 20:42:55.938539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20493. [D 20:42:55.938575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20494. [D 20:42:55.938598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20495. [D 20:42:55.938613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20496. [D 20:42:55.938628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20497. [D 20:42:55.938643] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20498. [D 20:42:55.944042] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20498. [D 20:42:55.944061] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 55/70. [D 20:42:55.944165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:55.944217] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:55.944230] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.113148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.113171] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.113184] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.113223] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4404 [D 20:42:56.113238] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:56.113257] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:42:56.116775] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4404 [D 20:42:56.116814] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 57/70. [D 20:42:56.116869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 20498. [D 20:42:56.116899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 20499. [D 20:42:56.116914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20500. [D 20:42:56.116929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20501. [D 20:42:56.116944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20502. [D 20:42:56.116959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20503. [D 20:42:56.116978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20504. [D 20:42:56.116993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20505. [D 20:42:56.117008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20506. [D 20:42:56.117023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20507. [D 20:42:56.117045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20508. [D 20:42:56.117060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20509. [D 20:42:56.117075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20510. [D 20:42:56.117094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20511. [D 20:42:56.117108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20512. [D 20:42:56.117123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20513. [D 20:42:56.117138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20514. [D 20:42:56.117153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20515. [D 20:42:56.117167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20516. [D 20:42:56.117182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20517. [D 20:42:56.117234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20518. [D 20:42:56.117249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20519. [D 20:42:56.117269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20520. [D 20:42:56.117283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20521. [D 20:42:56.117298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20522. [D 20:42:56.117313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20523. [D 20:42:56.117327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20524. [D 20:42:56.117342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20525. [D 20:42:56.117356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20526. [D 20:42:56.117376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20527. [D 20:42:56.117390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20528. [D 20:42:56.117405] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20529. [D 20:42:56.117700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.117754] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.117769] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.117810] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4407 [D 20:42:56.117826] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:56.117846] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 58/70. [D 20:42:56.122778] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20529. [D 20:42:56.122806] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 59/70. [D 20:42:56.122937] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.122960] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.122973] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.126484] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4407 [D 20:42:56.126507] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 60/70. [D 20:42:56.126572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20529. [D 20:42:56.126589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20530. [D 20:42:56.126604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20531. [D 20:42:56.126619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20532. [D 20:42:56.126634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20533. [D 20:42:56.126649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20534. [D 20:42:56.126664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20535. [D 20:42:56.126683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20536. [D 20:42:56.126698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20537. [D 20:42:56.126713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20538. [D 20:42:56.126728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20539. [D 20:42:56.126745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20540. [D 20:42:56.126760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20541. [D 20:42:56.126775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20542. [D 20:42:56.126790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20543. [D 20:42:56.126828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20544. [D 20:42:56.126843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20545. [D 20:42:56.126863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20546. [D 20:42:56.126878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20547. [D 20:42:56.126893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20548. [D 20:42:56.126908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20549. [D 20:42:56.126923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20550. [D 20:42:56.126938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20551. [D 20:42:56.126952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20552. [D 20:42:56.126970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20553. [D 20:42:56.126986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20554. [D 20:42:56.127001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20555. [D 20:42:56.127016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20556. [D 20:42:56.127059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20557. [D 20:42:56.127074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20558. [D 20:42:56.127099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20559. [D 20:42:56.127115] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20560. [D 20:42:56.132452] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20560. [D 20:42:56.132472] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 0/70. [D 20:42:56.132577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.132630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.132644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.175070] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.175091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.175104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.175144] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4410 [D 20:42:56.175159] element 0: offset: 0x2aaaab0257b0, size: 24 [D 20:42:56.175179] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 1/70. [D 20:42:56.178746] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4410 [D 20:42:56.178777] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 2/70. [D 20:42:56.178831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 20560. [D 20:42:56.178848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 20561. [D 20:42:56.178863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 20562. [D 20:42:56.178878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 20563. [D 20:42:56.178893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 20564. [D 20:42:56.178907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 20565. [D 20:42:56.178944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 20566. [D 20:42:56.178960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 20567. [D 20:42:56.178975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 20568. [D 20:42:56.178990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 20569. [D 20:42:56.179005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 20570. [D 20:42:56.179020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 20571. [D 20:42:56.179039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 20572. [D 20:42:56.179056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 20573. [D 20:42:56.179071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 20574. [D 20:42:56.179086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 20575. [D 20:42:56.179108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 20576. [D 20:42:56.179142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 20577. [D 20:42:56.179163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 20578. [D 20:42:56.179178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 20579. [D 20:42:56.179194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 20580. [D 20:42:56.179209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 20581. [D 20:42:56.179224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 20582. [D 20:42:56.179254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 20583. [D 20:42:56.179269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 20584. [D 20:42:56.179284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 20585. [D 20:42:56.179299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 20586. [D 20:42:56.179313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 20587. [D 20:42:56.179328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 20588. [D 20:42:56.179343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 20589. [D 20:42:56.179358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 20590. [D 20:42:56.179372] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 20591. [D 20:42:56.184709] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20591. [D 20:42:56.184728] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 3/70. [D 20:42:56.184834] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.184892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.184906] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.196949] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.196970] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.196983] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.197023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4414 [D 20:42:56.197038] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:56.197058] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 4/70. [D 20:42:56.200592] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4414 [D 20:42:56.200628] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 5/70. [D 20:42:56.200679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20591. [D 20:42:56.200696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20592. [D 20:42:56.200711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20593. [D 20:42:56.200726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20594. [D 20:42:56.200741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20595. [D 20:42:56.200756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20596. [D 20:42:56.200771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20597. [D 20:42:56.200801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20598. [D 20:42:56.200817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20599. [D 20:42:56.200832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20600. [D 20:42:56.200846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20601. [D 20:42:56.200861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20602. [D 20:42:56.200876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20603. [D 20:42:56.200891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20604. [D 20:42:56.200934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20605. [D 20:42:56.200949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20606. [D 20:42:56.200970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20607. [D 20:42:56.200985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20608. [D 20:42:56.200999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20609. [D 20:42:56.201014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20610. [D 20:42:56.201029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20611. [D 20:42:56.201044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20612. [D 20:42:56.201058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20613. [D 20:42:56.201077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20614. [D 20:42:56.201094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20615. [D 20:42:56.201108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20616. [D 20:42:56.201130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20617. [D 20:42:56.201168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20618. [D 20:42:56.201183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20619. [D 20:42:56.201208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20620. [D 20:42:56.201222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20621. [D 20:42:56.201237] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20622. [D 20:42:56.206636] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20622. [D 20:42:56.206655] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 6/70. [D 20:42:56.206757] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.206809] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.206823] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.227781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.227803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.227816] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.227862] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4416 [D 20:42:56.227877] element 0: offset: 0x2aaaab03b4e0, size: 24 [D 20:42:56.227898] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 7/70. [D 20:42:56.231460] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4416 [D 20:42:56.231496] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 8/70. [D 20:42:56.231551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20622. [D 20:42:56.231567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20623. [D 20:42:56.231582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20624. [D 20:42:56.231598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20625. [D 20:42:56.231613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20626. [D 20:42:56.231627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20627. [D 20:42:56.231642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20628. [D 20:42:56.231673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20629. [D 20:42:56.231688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20630. [D 20:42:56.231703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20631. [D 20:42:56.231718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20632. [D 20:42:56.231733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20633. [D 20:42:56.231748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20634. [D 20:42:56.231763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20635. [D 20:42:56.231807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20636. [D 20:42:56.231822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20637. [D 20:42:56.231846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20638. [D 20:42:56.231860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20639. [D 20:42:56.231875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20640. [D 20:42:56.231890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20641. [D 20:42:56.231905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20642. [D 20:42:56.231919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20643. [D 20:42:56.231934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20644. [D 20:42:56.231949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20645. [D 20:42:56.231963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20646. [D 20:42:56.231979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20647. [D 20:42:56.231994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20648. [D 20:42:56.232016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20649. [D 20:42:56.232057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20650. [D 20:42:56.232072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20651. [D 20:42:56.232094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20652. [D 20:42:56.232110] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20653. [D 20:42:56.242188] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20653. [D 20:42:56.242213] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 9/70. [D 20:42:56.242356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.242409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.242423] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.248744] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.248766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.248779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.248818] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4419 [D 20:42:56.248834] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:56.248853] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 10/70. [D 20:42:56.252412] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4419 [D 20:42:56.252448] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 11/70. [D 20:42:56.252500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20653. [D 20:42:56.252517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20654. [D 20:42:56.252544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20655. [D 20:42:56.252560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20656. [D 20:42:56.252574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20657. [D 20:42:56.252589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20658. [D 20:42:56.252604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20659. [D 20:42:56.252623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20660. [D 20:42:56.252638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20661. [D 20:42:56.252654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20662. [D 20:42:56.252680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20663. [D 20:42:56.252695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20664. [D 20:42:56.252710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20665. [D 20:42:56.252729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20666. [D 20:42:56.252743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20667. [D 20:42:56.252758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20668. [D 20:42:56.252773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20669. [D 20:42:56.252788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20670. [D 20:42:56.252803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20671. [D 20:42:56.252817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20672. [D 20:42:56.252832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20673. [D 20:42:56.252884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20674. [D 20:42:56.252899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20675. [D 20:42:56.252914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20676. [D 20:42:56.252929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20677. [D 20:42:56.252943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20678. [D 20:42:56.252958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20679. [D 20:42:56.252973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20680. [D 20:42:56.252988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20681. [D 20:42:56.253002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20682. [D 20:42:56.253022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20683. [D 20:42:56.253037] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20684. [D 20:42:56.263084] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20684. [D 20:42:56.263109] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 12/70. [D 20:42:56.263251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.263301] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.263315] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.269831] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.269852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.269865] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.269903] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4422 [D 20:42:56.269918] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:56.269937] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 13/70. [D 20:42:56.273470] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4422 [D 20:42:56.273506] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 14/70. [D 20:42:56.273558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20684. [D 20:42:56.273574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20685. [D 20:42:56.273589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20686. [D 20:42:56.273605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20687. [D 20:42:56.273620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20688. [D 20:42:56.273634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20689. [D 20:42:56.273649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20690. [D 20:42:56.273680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20691. [D 20:42:56.273695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20692. [D 20:42:56.273710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20693. [D 20:42:56.273725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20694. [D 20:42:56.273740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20695. [D 20:42:56.273755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20696. [D 20:42:56.273769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20697. [D 20:42:56.273813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20698. [D 20:42:56.273827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20699. [D 20:42:56.273848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20700. [D 20:42:56.273863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20701. [D 20:42:56.273877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20702. [D 20:42:56.273892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20703. [D 20:42:56.273907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20704. [D 20:42:56.273922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20705. [D 20:42:56.273936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20706. [D 20:42:56.273954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20707. [D 20:42:56.273971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20708. [D 20:42:56.273986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20709. [D 20:42:56.274007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20710. [D 20:42:56.274046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20711. [D 20:42:56.274061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20712. [D 20:42:56.274085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20713. [D 20:42:56.274100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20714. [D 20:42:56.274115] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20715. [D 20:42:56.284226] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20715. [D 20:42:56.284250] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 15/70. [D 20:42:56.284394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.284445] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.284459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.290863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.290884] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.290898] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.290935] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4425 [D 20:42:56.290950] element 0: offset: 0x2aaaab0257b0, size: 24 [D 20:42:56.290970] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 16/70. [D 20:42:56.294595] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4425 [D 20:42:56.294632] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 17/70. [D 20:42:56.294685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20715. [D 20:42:56.294702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20716. [D 20:42:56.294717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20717. [D 20:42:56.294732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20718. [D 20:42:56.294747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20719. [D 20:42:56.294762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20720. [D 20:42:56.294777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20721. [D 20:42:56.294796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20722. [D 20:42:56.294814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20723. [D 20:42:56.294828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20724. [D 20:42:56.294843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20725. [D 20:42:56.294858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20726. [D 20:42:56.294873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20727. [D 20:42:56.294887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20728. [D 20:42:56.294903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20729. [D 20:42:56.294938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20730. [D 20:42:56.294953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20731. [D 20:42:56.294974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20732. [D 20:42:56.294988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20733. [D 20:42:56.295003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20734. [D 20:42:56.295018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20735. [D 20:42:56.295033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20736. [D 20:42:56.295047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20737. [D 20:42:56.295062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20738. [D 20:42:56.295080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20739. [D 20:42:56.295097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20740. [D 20:42:56.295112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20741. [D 20:42:56.295133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20742. [D 20:42:56.295174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20743. [D 20:42:56.295189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20744. [D 20:42:56.295211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20745. [D 20:42:56.295227] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20746. [D 20:42:56.305366] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20746. [D 20:42:56.305390] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 18/70. [D 20:42:56.305530] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.305580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.305594] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.312350] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.312372] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.312385] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.312424] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4428 [D 20:42:56.312439] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:56.312458] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 19/70. [D 20:42:56.316021] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4428 [D 20:42:56.316049] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 20/70. [D 20:42:56.318009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20746. [D 20:42:56.318033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20747. [D 20:42:56.318055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20748. [D 20:42:56.318074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20749. [D 20:42:56.318093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20750. [D 20:42:56.318108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20751. [D 20:42:56.318123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20752. [D 20:42:56.318142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20753. [D 20:42:56.318177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20754. [D 20:42:56.318201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20755. [D 20:42:56.318215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20756. [D 20:42:56.318245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20757. [D 20:42:56.318260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20758. [D 20:42:56.318296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20759. [D 20:42:56.318322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20760. [D 20:42:56.318349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20761. [D 20:42:56.318771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20762. [D 20:42:56.318794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20763. [D 20:42:56.318813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20764. [D 20:42:56.318832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20765. [D 20:42:56.318853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20766. [D 20:42:56.318871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20767. [D 20:42:56.318889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20768. [D 20:42:56.318908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20769. [D 20:42:56.318926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20770. [D 20:42:56.318944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20771. [D 20:42:56.318963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20772. [D 20:42:56.318981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20773. [D 20:42:56.318999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20774. [D 20:42:56.319018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20775. [D 20:42:56.319037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20776. [D 20:42:56.319055] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20777. [D 20:42:56.319128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.319193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.319208] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.319252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4432 [D 20:42:56.319267] element 0: offset: 0x2aaaab03b4e0, size: 24 [D 20:42:56.319288] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 21/70. [D 20:42:56.329654] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20777. [D 20:42:56.329682] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 22/70. [D 20:42:56.329803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.329824] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.329837] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.333082] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4432 [D 20:42:56.333111] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 23/70. [D 20:42:56.335002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20777. [D 20:42:56.335026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20778. [D 20:42:56.335047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20779. [D 20:42:56.335066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20780. [D 20:42:56.335084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20781. [D 20:42:56.335102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20782. [D 20:42:56.335121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20783. [D 20:42:56.335140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20784. [D 20:42:56.335158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20785. [D 20:42:56.335177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20786. [D 20:42:56.335196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20787. [D 20:42:56.335214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20788. [D 20:42:56.335233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20789. [D 20:42:56.335251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20790. [D 20:42:56.335270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20791. [D 20:42:56.335289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20792. [D 20:42:56.335307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20793. [D 20:42:56.335326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20794. [D 20:42:56.335345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20795. [D 20:42:56.335363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20796. [D 20:42:56.335381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20797. [D 20:42:56.335400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20798. [D 20:42:56.335419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20799. [D 20:42:56.335438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20800. [D 20:42:56.335456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20801. [D 20:42:56.335472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20802. [D 20:42:56.335487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20803. [D 20:42:56.335506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20804. [D 20:42:56.335524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20805. [D 20:42:56.335542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20806. [D 20:42:56.335561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20807. [D 20:42:56.335577] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20808. [D 20:42:56.335639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.335690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.335703] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.335748] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4434 [D 20:42:56.335763] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:56.335784] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 24/70. [D 20:42:56.340901] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20808. [D 20:42:56.340929] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 25/70. [D 20:42:56.341045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.341066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.341079] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.344190] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4434 [D 20:42:56.344253] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 26/70. [D 20:42:56.344573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20808. [D 20:42:56.344601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20809. [D 20:42:56.344622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20810. [D 20:42:56.344637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20811. [D 20:42:56.344652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20812. [D 20:42:56.344667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20813. [D 20:42:56.344682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20814. [D 20:42:56.344697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20815. [D 20:42:56.344712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20816. [D 20:42:56.344727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20817. [D 20:42:56.344742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20818. [D 20:42:56.344772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20819. [D 20:42:56.344790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20820. [D 20:42:56.344805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20821. [D 20:42:56.344820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20822. [D 20:42:56.344834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20823. [D 20:42:56.344849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20824. [D 20:42:56.344864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20825. [D 20:42:56.344879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20826. [D 20:42:56.344893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20827. [D 20:42:56.344908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20828. [D 20:42:56.344947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20829. [D 20:42:56.344962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20830. [D 20:42:56.344983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20831. [D 20:42:56.344998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20832. [D 20:42:56.345018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20833. [D 20:42:56.345035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20834. [D 20:42:56.345053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20835. [D 20:42:56.345071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20836. [D 20:42:56.345089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20837. [D 20:42:56.345107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20838. [D 20:42:56.345125] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20839. [D 20:42:56.352941] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20839. [D 20:42:56.352966] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 27/70. [D 20:42:56.353059] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.353083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.353096] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.361585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.361605] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.361618] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.361655] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4437 [D 20:42:56.361671] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:56.361687] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 28/70. [D 20:42:56.367000] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4437 [D 20:42:56.367081] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 29/70. [D 20:42:56.370620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20839. [D 20:42:56.370650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20840. [D 20:42:56.370668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20841. [D 20:42:56.370683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20842. [D 20:42:56.370698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20843. [D 20:42:56.370713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20844. [D 20:42:56.370727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20845. [D 20:42:56.370972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20846. [D 20:42:56.371258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20847. [D 20:42:56.371285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20848. [D 20:42:56.371306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20849. [D 20:42:56.371322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20850. [D 20:42:56.371343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20851. [D 20:42:56.371421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20852. [D 20:42:56.371439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20853. [D 20:42:56.371462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20854. [D 20:42:56.371477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20855. [D 20:42:56.371492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20856. [D 20:42:56.371507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20857. [D 20:42:56.371522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20858. [D 20:42:56.371541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20859. [D 20:42:56.371560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20860. [D 20:42:56.371575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20861. [D 20:42:56.371594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20862. [D 20:42:56.371609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20863. [D 20:42:56.371623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20864. [D 20:42:56.371638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20865. [D 20:42:56.371652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20866. [D 20:42:56.371667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20867. [D 20:42:56.371681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20868. [D 20:42:56.371695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20869. [D 20:42:56.371710] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20870. [D 20:42:56.375026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.375051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.375069] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.375113] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4440 [D 20:42:56.375129] element 0: offset: 0x2aaaab037600, size: 24 [D 20:42:56.375146] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 30/70. [D 20:42:56.382487] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 20870. [D 20:42:56.382507] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 31/70. [D 20:42:56.384484] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.384509] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.384523] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.387776] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4440 [D 20:42:56.387833] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 32/70. [D 20:42:56.388234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 20870. [D 20:42:56.388258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 20871. [D 20:42:56.388274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20872. [D 20:42:56.388289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20873. [D 20:42:56.388304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20874. [D 20:42:56.388318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20875. [D 20:42:56.388333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20876. [D 20:42:56.388348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20877. [D 20:42:56.388363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20878. [D 20:42:56.388384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20879. [D 20:42:56.388399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20880. [D 20:42:56.388413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20881. [D 20:42:56.388432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20882. [D 20:42:56.388447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20883. [D 20:42:56.388461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20884. [D 20:42:56.388476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20885. [D 20:42:56.388491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20886. [D 20:42:56.388506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20887. [D 20:42:56.388521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20888. [D 20:42:56.388556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20889. [D 20:42:56.388575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20890. [D 20:42:56.388594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20891. [D 20:42:56.388609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20892. [D 20:42:56.388623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20893. [D 20:42:56.388637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20894. [D 20:42:56.388655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20895. [D 20:42:56.388670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20896. [D 20:42:56.388684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20897. [D 20:42:56.388699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20898. [D 20:42:56.388717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20899. [D 20:42:56.388732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20900. [D 20:42:56.388746] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20901. [D 20:42:56.394492] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 20901. [D 20:42:56.394512] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 33/70. [D 20:42:56.394608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.394632] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.394645] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.394877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.394897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.394910] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.394949] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4443 [D 20:42:56.394964] element 0: offset: 0x2aaaab040f70, size: 24 [D 20:42:56.394981] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 34/70. [D 20:42:56.398585] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4443 [D 20:42:56.398665] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 35/70. [D 20:42:56.398722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 20901. [D 20:42:56.398746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 20902. [D 20:42:56.398761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 20903. [D 20:42:56.398776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 20904. [D 20:42:56.398791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 20905. [D 20:42:56.398805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 20906. [D 20:42:56.398820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 20907. [D 20:42:56.398835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 20908. [D 20:42:56.398849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 20909. [D 20:42:56.398864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 20910. [D 20:42:56.398891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 20911. [D 20:42:56.398906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 20912. [D 20:42:56.398925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 20913. [D 20:42:56.398940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 20914. [D 20:42:56.398955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 20915. [D 20:42:56.398970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 20916. [D 20:42:56.398985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 20917. [D 20:42:56.399002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 20918. [D 20:42:56.399019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 20919. [D 20:42:56.399034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 20920. [D 20:42:56.399049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 20921. [D 20:42:56.399086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 20922. [D 20:42:56.399102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 20923. [D 20:42:56.399125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 20924. [D 20:42:56.399141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 20925. [D 20:42:56.399155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 20926. [D 20:42:56.399170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 20927. [D 20:42:56.399185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 20928. [D 20:42:56.399200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 20929. [D 20:42:56.399239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 20930. [D 20:42:56.399258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 20931. [D 20:42:56.399272] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 20932. [D 20:42:56.404610] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 20932. [D 20:42:56.404630] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 36/70. [D 20:42:56.404715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.404738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.404752] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.427725] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.427747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.427760] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.427800] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4447 [D 20:42:56.427815] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:56.427832] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 37/70. [D 20:42:56.431346] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4447 [D 20:42:56.431426] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 38/70. [D 20:42:56.431486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 20932. [D 20:42:56.431525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 20933. [D 20:42:56.431545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 20934. [D 20:42:56.431561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 20935. [D 20:42:56.431576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 20936. [D 20:42:56.431591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 20937. [D 20:42:56.431606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 20938. [D 20:42:56.431620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 20939. [D 20:42:56.431635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 20940. [D 20:42:56.431649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 20941. [D 20:42:56.431668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 20942. [D 20:42:56.431683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 20943. [D 20:42:56.431698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 20944. [D 20:42:56.431712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 20945. [D 20:42:56.431727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 20946. [D 20:42:56.431742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 20947. [D 20:42:56.431757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 20948. [D 20:42:56.431772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 20949. [D 20:42:56.431787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 20950. [D 20:42:56.431801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 20951. [D 20:42:56.431816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 20952. [D 20:42:56.431831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 20953. [D 20:42:56.431849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 20954. [D 20:42:56.431864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 20955. [D 20:42:56.431879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 20956. [D 20:42:56.431894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 20957. [D 20:42:56.431908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 20958. [D 20:42:56.431923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 20959. [D 20:42:56.431937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 20960. [D 20:42:56.431952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 20961. [D 20:42:56.431968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 20962. [D 20:42:56.431983] openib_post_sr_rdmaw: ibv_post_send wr_id 648f20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 20963. [D 20:42:56.437386] openib_check_cq: completed rdma wr_id 648f20, nic_wr_credit 20963. [D 20:42:56.437406] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 39/70. [D 20:42:56.437490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.437514] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.437527] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.509274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.509295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.509308] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.509347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4449 [D 20:42:56.509362] element 0: offset: 0x2aaaab03b4e0, size: 24 [D 20:42:56.509380] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 40/70. [D 20:42:56.512607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.512679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.512693] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.512735] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4452 [D 20:42:56.512750] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:56.512771] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 41/70. [D 20:42:56.516193] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4449 [D 20:42:56.516276] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 42/70. [D 20:42:56.516426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 20963. [D 20:42:56.516487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 20964. [D 20:42:56.516528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 20965. [D 20:42:56.516544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 20966. [D 20:42:56.516559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 20967. [D 20:42:56.516574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 20968. [D 20:42:56.516588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 20969. [D 20:42:56.516603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 20970. [D 20:42:56.516618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 20971. [D 20:42:56.516641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 20972. [D 20:42:56.516656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 20973. [D 20:42:56.516670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 20974. [D 20:42:56.516685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 20975. [D 20:42:56.516700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 20976. [D 20:42:56.516714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 20977. [D 20:42:56.516729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 20978. [D 20:42:56.516744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 20979. [D 20:42:56.516758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 20980. [D 20:42:56.516773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 20981. [D 20:42:56.516787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 20982. [D 20:42:56.516802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 20983. [D 20:42:56.516817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 20984. [D 20:42:56.516831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 20985. [D 20:42:56.516846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 20986. [D 20:42:56.516844] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4452 [D 20:42:56.516869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 20987. [D 20:42:56.516997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 20988. [D 20:42:56.517012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 20989. [D 20:42:56.517040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 20990. [D 20:42:56.517055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 20991. [D 20:42:56.517070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 20992. [D 20:42:56.517084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 20993. [D 20:42:56.517099] openib_post_sr_rdmaw: ibv_post_send wr_id 6441e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 20994. [D 20:42:56.517163] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 43/70. [D 20:42:56.525405] openib_check_cq: completed rdma wr_id 6441e0, nic_wr_credit 20994. [D 20:42:56.525431] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 44/70. [D 20:42:56.525448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 20994. [D 20:42:56.525463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 20995. [D 20:42:56.525478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 20996. [D 20:42:56.525492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 20997. [D 20:42:56.525507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 20998. [D 20:42:56.525522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 20999. [D 20:42:56.525536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 21000. [D 20:42:56.525551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 21001. [D 20:42:56.525565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 21002. [D 20:42:56.525580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 21003. [D 20:42:56.525595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 21004. [D 20:42:56.525609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 21005. [D 20:42:56.525624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 21006. [D 20:42:56.525639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 21007. [D 20:42:56.525653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 21008. [D 20:42:56.525668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 21009. [D 20:42:56.525682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 21010. [D 20:42:56.525697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 21011. [D 20:42:56.525711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 21012. [D 20:42:56.525726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 21013. [D 20:42:56.525741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 21014. [D 20:42:56.525756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 21015. [D 20:42:56.525770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 21016. [D 20:42:56.525785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 21017. [D 20:42:56.525799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 21018. [D 20:42:56.525814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 21019. [D 20:42:56.525829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 21020. [D 20:42:56.525843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 21021. [D 20:42:56.525858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 21022. [D 20:42:56.525874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 21023. [D 20:42:56.525888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 21024. [D 20:42:56.525903] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 21025. [D 20:42:56.525972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.525996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.526009] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.531338] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 21025. [D 20:42:56.531361] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 45/70. [D 20:42:56.531439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.531461] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.531474] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.532709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.532730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.532743] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.532781] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4455 [D 20:42:56.532796] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:56.532814] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 46/70. [D 20:42:56.536149] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4455 [D 20:42:56.536225] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 47/70. [D 20:42:56.536377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21025. [D 20:42:56.536403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21026. [D 20:42:56.536419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21027. [D 20:42:56.536434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21028. [D 20:42:56.536464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21029. [D 20:42:56.536488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21030. [D 20:42:56.536507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21031. [D 20:42:56.536526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21032. [D 20:42:56.536544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21033. [D 20:42:56.536563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21034. [D 20:42:56.536593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21035. [D 20:42:56.536611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21036. [D 20:42:56.536629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21037. [D 20:42:56.536647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21038. [D 20:42:56.536665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21039. [D 20:42:56.536683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21040. [D 20:42:56.536701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21041. [D 20:42:56.536720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21042. [D 20:42:56.536738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21043. [D 20:42:56.536756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21044. [D 20:42:56.536775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21045. [D 20:42:56.536792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21046. [D 20:42:56.536811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21047. [D 20:42:56.536829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21048. [D 20:42:56.536856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21049. [D 20:42:56.536875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21050. [D 20:42:56.536893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21051. [D 20:42:56.536911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21052. [D 20:42:56.536929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21053. [D 20:42:56.536945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21054. [D 20:42:56.536959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21055. [D 20:42:56.536974] openib_post_sr_rdmaw: ibv_post_send wr_id 66e670 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21056. [D 20:42:56.545367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.545391] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.545405] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.545447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4458 [D 20:42:56.545462] element 0: offset: 0x2aaaab037600, size: 24 [D 20:42:56.545480] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 48/70. [D 20:42:56.548038] openib_check_cq: completed rdma wr_id 66e670, nic_wr_credit 21056. [D 20:42:56.548067] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 49/70. [D 20:42:56.548186] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.548208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.548221] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.551819] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4458 [D 20:42:56.551891] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 50/70. [D 20:42:56.554929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 21056. [D 20:42:56.554956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 21057. [D 20:42:56.554978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 21058. [D 20:42:56.554996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 21059. [D 20:42:56.555014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 21060. [D 20:42:56.555033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 21061. [D 20:42:56.555051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 21062. [D 20:42:56.555069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 21063. [D 20:42:56.555087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 21064. [D 20:42:56.555105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 21065. [D 20:42:56.555124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 21066. [D 20:42:56.555142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 21067. [D 20:42:56.555159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 21068. [D 20:42:56.555178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 21069. [D 20:42:56.555196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 21070. [D 20:42:56.555214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 21071. [D 20:42:56.555232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 21072. [D 20:42:56.555250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 21073. [D 20:42:56.555269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 21074. [D 20:42:56.555287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 21075. [D 20:42:56.555305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 21076. [D 20:42:56.555323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 21077. [D 20:42:56.555342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 21078. [D 20:42:56.555357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 21079. [D 20:42:56.555373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 21080. [D 20:42:56.555394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 21081. [D 20:42:56.555411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 21082. [D 20:42:56.555430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 21083. [D 20:42:56.555448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 21084. [D 20:42:56.555467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 21085. [D 20:42:56.555485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 21086. [D 20:42:56.555501] openib_post_sr_rdmaw: ibv_post_send wr_id 643f00 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 21087. [D 20:42:56.555559] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.555583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.555595] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.555639] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4461 [D 20:42:56.555653] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:56.555671] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 51/70. [D 20:42:56.563698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.563721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.563734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.563758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4464 [D 20:42:56.563772] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:56.563788] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 52/70. [D 20:42:56.566650] openib_check_cq: completed rdma wr_id 643f00, nic_wr_credit 21087. [D 20:42:56.566674] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 53/70. [D 20:42:56.566842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.566865] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.566878] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.571897] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4464 [D 20:42:56.571928] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 54/70. [D 20:42:56.572769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21087. [D 20:42:56.572790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21088. [D 20:42:56.572806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21089. [D 20:42:56.572820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21090. [D 20:42:56.572835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21091. [D 20:42:56.572849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21092. [D 20:42:56.572864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21093. [D 20:42:56.572889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21094. [D 20:42:56.572904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21095. [D 20:42:56.572927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21096. [D 20:42:56.572942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21097. [D 20:42:56.572957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21098. [D 20:42:56.572980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21099. [D 20:42:56.572996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21100. [D 20:42:56.573024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21101. [D 20:42:56.573048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21102. [D 20:42:56.573063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21103. [D 20:42:56.573087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21104. [D 20:42:56.573102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21105. [D 20:42:56.573129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21106. [D 20:42:56.573154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21107. [D 20:42:56.573169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21108. [D 20:42:56.573191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21109. [D 20:42:56.573206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21110. [D 20:42:56.573221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21111. [D 20:42:56.573244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21112. [D 20:42:56.573258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21113. [D 20:42:56.573285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21114. [D 20:42:56.573309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21115. [D 20:42:56.573325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21116. [D 20:42:56.573339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21117. [D 20:42:56.573354] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21118. [D 20:42:56.573423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.573492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.573506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.573551] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4467 [D 20:42:56.573567] element 0: offset: 0x65a860, size: 24 [D 20:42:56.573589] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 55/70. [D 20:42:56.573879] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4461 [D 20:42:56.573907] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 56/70. [D 20:42:56.584575] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 21118. [D 20:42:56.584597] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 57/70. [D 20:42:56.584614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21118. [D 20:42:56.584630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21119. [D 20:42:56.584645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21120. [D 20:42:56.584659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21121. [D 20:42:56.584684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21122. [D 20:42:56.584699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21123. [D 20:42:56.584713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21124. [D 20:42:56.584728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21125. [D 20:42:56.584742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21126. [D 20:42:56.584757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21127. [D 20:42:56.584771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21128. [D 20:42:56.584785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21129. [D 20:42:56.584800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21130. [D 20:42:56.584822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21131. [D 20:42:56.584837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21132. [D 20:42:56.584851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21133. [D 20:42:56.584865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21134. [D 20:42:56.584880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21135. [D 20:42:56.584894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21136. [D 20:42:56.584909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21137. [D 20:42:56.584923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21138. [D 20:42:56.584938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21139. [D 20:42:56.584952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21140. [D 20:42:56.584966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21141. [D 20:42:56.584981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21142. [D 20:42:56.584995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21143. [D 20:42:56.585009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21144. [D 20:42:56.585024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21145. [D 20:42:56.585038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21146. [D 20:42:56.585053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21147. [D 20:42:56.585068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21148. [D 20:42:56.585083] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21149. [D 20:42:56.585148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.585170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.585183] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.588523] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4467 [D 20:42:56.588591] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 58/70. [D 20:42:56.590520] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 21149. [D 20:42:56.590546] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 59/70. [D 20:42:56.590622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.590643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.590656] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.594862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 21149. [D 20:42:56.594889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 21150. [D 20:42:56.594912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 21151. [D 20:42:56.594928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 21152. [D 20:42:56.594943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 21153. [D 20:42:56.594958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 21154. [D 20:42:56.594984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 21155. [D 20:42:56.594999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 21156. [D 20:42:56.595021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 21157. [D 20:42:56.595036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 21158. [D 20:42:56.595076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 21159. [D 20:42:56.595104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 21160. [D 20:42:56.595129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 21161. [D 20:42:56.595144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 21162. [D 20:42:56.595166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 21163. [D 20:42:56.595186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 21164. [D 20:42:56.595219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 21165. [D 20:42:56.595251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 21166. [D 20:42:56.595278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 21167. [D 20:42:56.595293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 21168. [D 20:42:56.595308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 21169. [D 20:42:56.595332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 21170. [D 20:42:56.595346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 21171. [D 20:42:56.595389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 21172. [D 20:42:56.595404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 21173. [D 20:42:56.595419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 21174. [D 20:42:56.595437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 21175. [D 20:42:56.595453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 21176. [D 20:42:56.595467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 21177. [D 20:42:56.595482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 21178. [D 20:42:56.595496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 21179. [D 20:42:56.595511] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 21180. [D 20:42:56.606786] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 21180. [D 20:42:56.606811] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 60/70. [D 20:42:56.606888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.606911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.606924] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.613101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.613122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.613134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.613173] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4470 [D 20:42:56.613188] element 0: offset: 0x5b0030, size: 24 [D 20:42:56.613205] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 0/70. [D 20:42:56.616803] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4470 [D 20:42:56.616882] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 1/70. [D 20:42:56.618662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21180. [D 20:42:56.618690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21181. [D 20:42:56.618708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21182. [D 20:42:56.618723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21183. [D 20:42:56.618738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21184. [D 20:42:56.618753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21185. [D 20:42:56.618767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21186. [D 20:42:56.618782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21187. [D 20:42:56.618797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21188. [D 20:42:56.618821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21189. [D 20:42:56.618835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21190. [D 20:42:56.618850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21191. [D 20:42:56.618865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21192. [D 20:42:56.618879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21193. [D 20:42:56.618904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21194. [D 20:42:56.618930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21195. [D 20:42:56.618946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21196. [D 20:42:56.619377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21197. [D 20:42:56.619398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21198. [D 20:42:56.619413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21199. [D 20:42:56.619429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21200. [D 20:42:56.619443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21201. [D 20:42:56.619471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21202. [D 20:42:56.619485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21203. [D 20:42:56.619500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21204. [D 20:42:56.619517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21205. [D 20:42:56.619532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21206. [D 20:42:56.619547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21207. [D 20:42:56.619565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21208. [D 20:42:56.619579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21209. [D 20:42:56.619594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21210. [D 20:42:56.619612] openib_post_sr_rdmaw: ibv_post_send wr_id 67e8b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21211. [D 20:42:56.619675] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.619699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.619712] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.619755] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4473 [D 20:42:56.619771] element 0: offset: 0x61fad0, size: 24 [D 20:42:56.619787] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 2/70. [D 20:42:56.630239] openib_check_cq: completed rdma wr_id 67e8b0, nic_wr_credit 21211. [D 20:42:56.630268] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 3/70. [D 20:42:56.630418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.630441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.630454] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.633957] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4473 [D 20:42:56.634036] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 4/70. [D 20:42:56.636660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21211. [D 20:42:56.636688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21212. [D 20:42:56.636706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21213. [D 20:42:56.636721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21214. [D 20:42:56.636736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21215. [D 20:42:56.636750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21216. [D 20:42:56.636765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21217. [D 20:42:56.636779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21218. [D 20:42:56.636858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21219. [D 20:42:56.636878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21220. [D 20:42:56.636898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21221. [D 20:42:56.636913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21222. [D 20:42:56.636937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21223. [D 20:42:56.636952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21224. [D 20:42:56.636967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21225. [D 20:42:56.636982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21226. [D 20:42:56.636997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21227. [D 20:42:56.637037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21228. [D 20:42:56.637052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21229. [D 20:42:56.637072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21230. [D 20:42:56.637086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21231. [D 20:42:56.637101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21232. [D 20:42:56.637118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21233. [D 20:42:56.637132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21234. [D 20:42:56.637146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21235. [D 20:42:56.637161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21236. [D 20:42:56.637180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21237. [D 20:42:56.637195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21238. [D 20:42:56.637209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21239. [D 20:42:56.637224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21240. [D 20:42:56.637238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21241. [D 20:42:56.637253] openib_post_sr_rdmaw: ibv_post_send wr_id 67e8b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21242. [D 20:42:56.642581] openib_check_cq: completed rdma wr_id 67e8b0, nic_wr_credit 21242. [D 20:42:56.642601] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 5/70. [D 20:42:56.642611] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.642636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.642649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.642693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4476 [D 20:42:56.642708] element 0: offset: 0x658610, size: 24 [D 20:42:56.642725] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 6/70. [D 20:42:56.642779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.642793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.642806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.646616] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4476 [D 20:42:56.646694] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 7/70. [D 20:42:56.646764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 21242. [D 20:42:56.646789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 21243. [D 20:42:56.646804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21244. [D 20:42:56.646819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21245. [D 20:42:56.646833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21246. [D 20:42:56.646848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21247. [D 20:42:56.646863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21248. [D 20:42:56.646878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21249. [D 20:42:56.646893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21250. [D 20:42:56.646916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21251. [D 20:42:56.646931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21252. [D 20:42:56.646950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21253. [D 20:42:56.646964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21254. [D 20:42:56.646979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21255. [D 20:42:56.646994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21256. [D 20:42:56.647008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21257. [D 20:42:56.647023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21258. [D 20:42:56.647037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21259. [D 20:42:56.647052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21260. [D 20:42:56.647067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21261. [D 20:42:56.647102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21262. [D 20:42:56.647120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21263. [D 20:42:56.647146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21264. [D 20:42:56.647161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21265. [D 20:42:56.647175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21266. [D 20:42:56.647192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21267. [D 20:42:56.647207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21268. [D 20:42:56.647221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21269. [D 20:42:56.647236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21270. [D 20:42:56.647260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21271. [D 20:42:56.647275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21272. [D 20:42:56.647290] openib_post_sr_rdmaw: ibv_post_send wr_id 630450 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21273. [D 20:42:56.658020] openib_check_cq: completed rdma wr_id 630450, nic_wr_credit 21273. [D 20:42:56.658044] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 8/70. [D 20:42:56.658183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.658208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.658221] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.665146] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.665167] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.665180] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.665219] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4479 [D 20:42:56.665235] element 0: offset: 0x5b0030, size: 24 [D 20:42:56.665251] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 9/70. [D 20:42:56.668897] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4479 [D 20:42:56.668975] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 10/70. [D 20:42:56.669037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 21273. [D 20:42:56.669063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 21274. [D 20:42:56.669078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21275. [D 20:42:56.669092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21276. [D 20:42:56.669110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21277. [D 20:42:56.669127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21278. [D 20:42:56.669142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21279. [D 20:42:56.669156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21280. [D 20:42:56.669192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21281. [D 20:42:56.669206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21282. [D 20:42:56.669221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21283. [D 20:42:56.669240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21284. [D 20:42:56.669255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21285. [D 20:42:56.669269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21286. [D 20:42:56.669284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21287. [D 20:42:56.669299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21288. [D 20:42:56.669314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21289. [D 20:42:56.669329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21290. [D 20:42:56.669344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21291. [D 20:42:56.669375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21292. [D 20:42:56.669390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21293. [D 20:42:56.669415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21294. [D 20:42:56.669430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21295. [D 20:42:56.669445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21296. [D 20:42:56.669460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21297. [D 20:42:56.669474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21298. [D 20:42:56.669489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21299. [D 20:42:56.669504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21300. [D 20:42:56.669519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21301. [D 20:42:56.669534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21302. [D 20:42:56.669553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21303. [D 20:42:56.669586] openib_post_sr_rdmaw: ibv_post_send wr_id 630230 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21304. [D 20:42:56.679895] openib_check_cq: completed rdma wr_id 630230, nic_wr_credit 21304. [D 20:42:56.679916] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 11/70. [D 20:42:56.680061] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.680085] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.680099] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.687526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.687547] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.687560] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.687598] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4482 [D 20:42:56.687613] element 0: offset: 0x691fe0, size: 24 [D 20:42:56.687630] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 12/70. [D 20:42:56.691695] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4482 [D 20:42:56.691773] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 13/70. [D 20:42:56.691919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 21304. [D 20:42:56.691944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 21305. [D 20:42:56.691960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21306. [D 20:42:56.691975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21307. [D 20:42:56.691990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21308. [D 20:42:56.692005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21309. [D 20:42:56.692019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21310. [D 20:42:56.692035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21311. [D 20:42:56.692049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21312. [D 20:42:56.692064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21313. [D 20:42:56.692079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21314. [D 20:42:56.692093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21315. [D 20:42:56.692137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21316. [D 20:42:56.692152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21317. [D 20:42:56.692171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21318. [D 20:42:56.692185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21319. [D 20:42:56.692200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21320. [D 20:42:56.692214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21321. [D 20:42:56.692229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21322. [D 20:42:56.692244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21323. [D 20:42:56.692258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21324. [D 20:42:56.692273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21325. [D 20:42:56.692288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21326. [D 20:42:56.692302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21327. [D 20:42:56.692317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21328. [D 20:42:56.692332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21329. [D 20:42:56.692347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21330. [D 20:42:56.692389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21331. [D 20:42:56.692411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21332. [D 20:42:56.692426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21333. [D 20:42:56.692441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21334. [D 20:42:56.692456] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21335. [D 20:42:56.703526] openib_check_cq: completed rdma wr_id 61e6b0, nic_wr_credit 21335. [D 20:42:56.703549] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 14/70. [D 20:42:56.703683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.703707] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.703720] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.708244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.708266] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.708279] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.708318] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4485 [D 20:42:56.708334] element 0: offset: 0x658610, size: 24 [D 20:42:56.708350] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 15/70. [D 20:42:56.711906] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4485 [D 20:42:56.711987] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 16/70. [D 20:42:56.714911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21335. [D 20:42:56.714937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21336. [D 20:42:56.714953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21337. [D 20:42:56.714967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21338. [D 20:42:56.714982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21339. [D 20:42:56.714996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21340. [D 20:42:56.715011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21341. [D 20:42:56.715025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21342. [D 20:42:56.715040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21343. [D 20:42:56.715055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21344. [D 20:42:56.715069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21345. [D 20:42:56.715084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21346. [D 20:42:56.715098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21347. [D 20:42:56.715113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21348. [D 20:42:56.715127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21349. [D 20:42:56.715142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21350. [D 20:42:56.715156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21351. [D 20:42:56.715171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21352. [D 20:42:56.715185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21353. [D 20:42:56.715200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21354. [D 20:42:56.715214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21355. [D 20:42:56.715229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21356. [D 20:42:56.715243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21357. [D 20:42:56.715258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21358. [D 20:42:56.715272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21359. [D 20:42:56.715286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21360. [D 20:42:56.715301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21361. [D 20:42:56.715315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21362. [D 20:42:56.715330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21363. [D 20:42:56.715345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21364. [D 20:42:56.715360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21365. [D 20:42:56.715374] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21366. [D 20:42:56.715433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.715457] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.715470] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.715512] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4488 [D 20:42:56.715527] element 0: offset: 0x61e400, size: 24 [D 20:42:56.715543] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 17/70. [D 20:42:56.720507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.720528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.720541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.720564] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4491 [D 20:42:56.720578] element 0: offset: 0x691fe0, size: 24 [D 20:42:56.720605] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 18/70. [D 20:42:56.721445] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 21366. [D 20:42:56.721471] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 19/70. [D 20:42:56.721616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.721637] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.721650] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.727900] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4491 [D 20:42:56.727984] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 20/70. [D 20:42:56.728051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21366. [D 20:42:56.728077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21367. [D 20:42:56.728093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21368. [D 20:42:56.728108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21369. [D 20:42:56.728123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21370. [D 20:42:56.728137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21371. [D 20:42:56.728152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21372. [D 20:42:56.728166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21373. [D 20:42:56.728168] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4488 [D 20:42:56.728187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21374. [D 20:42:56.728236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21375. [D 20:42:56.728251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21376. [D 20:42:56.728265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21377. [D 20:42:56.728280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21378. [D 20:42:56.728294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21379. [D 20:42:56.728308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21380. [D 20:42:56.728323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21381. [D 20:42:56.728337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21382. [D 20:42:56.728352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21383. [D 20:42:56.728366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21384. [D 20:42:56.728381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21385. [D 20:42:56.728395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21386. [D 20:42:56.728410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21387. [D 20:42:56.728424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21388. [D 20:42:56.728439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21389. [D 20:42:56.728453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21390. [D 20:42:56.728467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21391. [D 20:42:56.728482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21392. [D 20:42:56.728496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21393. [D 20:42:56.728510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21394. [D 20:42:56.728526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21395. [D 20:42:56.728541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21396. [D 20:42:56.728555] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21397. [D 20:42:56.728581] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 21/70. [D 20:42:56.736380] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 21397. [D 20:42:56.736407] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 22/70. [D 20:42:56.736423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 21397. [D 20:42:56.736439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 21398. [D 20:42:56.736453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 21399. [D 20:42:56.736468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 21400. [D 20:42:56.736483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 21401. [D 20:42:56.736497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 21402. [D 20:42:56.736512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 21403. [D 20:42:56.736526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21404. [D 20:42:56.736541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21405. [D 20:42:56.736556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21406. [D 20:42:56.736570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 21407. [D 20:42:56.736585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 21408. [D 20:42:56.736599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 21409. [D 20:42:56.736614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 21410. [D 20:42:56.736629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 21411. [D 20:42:56.736643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21412. [D 20:42:56.736658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21413. [D 20:42:56.736673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21414. [D 20:42:56.736687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 21415. [D 20:42:56.736702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 21416. [D 20:42:56.736717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 21417. [D 20:42:56.736731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 21418. [D 20:42:56.736746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 21419. [D 20:42:56.736760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21420. [D 20:42:56.736775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21421. [D 20:42:56.736789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21422. [D 20:42:56.736804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 21423. [D 20:42:56.736818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 21424. [D 20:42:56.736833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 21425. [D 20:42:56.736849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 21426. [D 20:42:56.736864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 21427. [D 20:42:56.736878] openib_post_sr_rdmaw: ibv_post_send wr_id 61f500 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21428. [D 20:42:56.736951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.736975] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.736988] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.745674] openib_check_cq: completed rdma wr_id 61f500, nic_wr_credit 21428. [D 20:42:56.745701] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 23/70. [D 20:42:56.745778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.745801] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.745813] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.755447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.755468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.755481] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.755520] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4494 [D 20:42:56.755535] element 0: offset: 0x658610, size: 24 [D 20:42:56.755552] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 24/70. [D 20:42:56.759179] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4494 [D 20:42:56.759257] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 25/70. [D 20:42:56.759316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21428. [D 20:42:56.759341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21429. [D 20:42:56.759357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21430. [D 20:42:56.759372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21431. [D 20:42:56.759404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21432. [D 20:42:56.759419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21433. [D 20:42:56.759433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21434. [D 20:42:56.759448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21435. [D 20:42:56.759463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21436. [D 20:42:56.759485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21437. [D 20:42:56.759500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21438. [D 20:42:56.759519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21439. [D 20:42:56.759533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21440. [D 20:42:56.759548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21441. [D 20:42:56.759562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21442. [D 20:42:56.759577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21443. [D 20:42:56.759591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21444. [D 20:42:56.759606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21445. [D 20:42:56.759621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21446. [D 20:42:56.759636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21447. [D 20:42:56.759671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21448. [D 20:42:56.759688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21449. [D 20:42:56.759709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21450. [D 20:42:56.759728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21451. [D 20:42:56.759743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21452. [D 20:42:56.759758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21453. [D 20:42:56.759773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21454. [D 20:42:56.759787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21455. [D 20:42:56.759802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21456. [D 20:42:56.759817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21457. [D 20:42:56.759832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21458. [D 20:42:56.759855] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21459. [D 20:42:56.770128] openib_check_cq: completed rdma wr_id 61f8e0, nic_wr_credit 21459. [D 20:42:56.770153] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 26/70. [D 20:42:56.770291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.770316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.770330] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.783761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.783782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.783795] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.783838] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4500 [D 20:42:56.783858] element 0: offset: 0x62fd10, size: 24 [D 20:42:56.783877] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 27/70. [D 20:42:56.783914] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.783932] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.783947] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.783981] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4501 [D 20:42:56.783995] element 0: offset: 0x2aaaab63aac0, size: 24 [D 20:42:56.784010] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 28/70. [D 20:42:56.784116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.784131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.784144] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.784166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4503 [D 20:42:56.784180] element 0: offset: 0x2aaaab604290, size: 24 [D 20:42:56.784194] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 29/70. [D 20:42:56.791406] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4500 [D 20:42:56.791503] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 30/70. [D 20:42:56.791634] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4501 [D 20:42:56.791655] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 31/70. [D 20:42:56.791790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21459. [D 20:42:56.791888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 21460. [D 20:42:56.791915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 21461. [D 20:42:56.791933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 21462. [D 20:42:56.791949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 21463. [D 20:42:56.791964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 21464. [D 20:42:56.791982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21465. [D 20:42:56.792000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21466. [D 20:42:56.792018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21467. [D 20:42:56.792036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 21468. [D 20:42:56.792055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 21469. [D 20:42:56.792073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 21470. [D 20:42:56.792091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 21471. [D 20:42:56.792109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 21472. [D 20:42:56.792128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21473. [D 20:42:56.792146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21474. [D 20:42:56.792164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21475. [D 20:42:56.792182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 21476. [D 20:42:56.792200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 21477. [D 20:42:56.792218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 21478. [D 20:42:56.792236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 21479. [D 20:42:56.792255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 21480. [D 20:42:56.792273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21481. [D 20:42:56.792291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21482. [D 20:42:56.792309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21483. [D 20:42:56.792328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 21484. [D 20:42:56.792346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 21485. [D 20:42:56.792364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 21486. [D 20:42:56.792382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 21487. [D 20:42:56.792401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 21488. [D 20:42:56.792419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21489. [D 20:42:56.792434] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef40 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21490. [D 20:42:56.792453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21491. [D 20:42:56.792468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21492. [D 20:42:56.792483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21493. [D 20:42:56.792497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21494. [D 20:42:56.792512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21495. [D 20:42:56.792526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21496. [D 20:42:56.792541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21497. [D 20:42:56.792555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21498. [D 20:42:56.792570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21499. [D 20:42:56.792584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21500. [D 20:42:56.792599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21501. [D 20:42:56.792613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21502. [D 20:42:56.792628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21503. [D 20:42:56.792642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21504. [D 20:42:56.792656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21505. [D 20:42:56.792671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21506. [D 20:42:56.792685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21507. [D 20:42:56.792700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21508. [D 20:42:56.792714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21509. [D 20:42:56.792729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21510. [D 20:42:56.792743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21511. [D 20:42:56.792758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21512. [D 20:42:56.792772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21513. [D 20:42:56.792786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21514. [D 20:42:56.792801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21515. [D 20:42:56.792815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21516. [D 20:42:56.792830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21517. [D 20:42:56.792844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21518. [D 20:42:56.792860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21519. [D 20:42:56.792874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21520. [D 20:42:56.792889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21521. [D 20:42:56.792903] openib_post_sr_rdmaw: ibv_post_send wr_id 61e680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21522. [D 20:42:56.797010] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4503 [D 20:42:56.797037] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 32/70. [D 20:42:56.803445] openib_check_cq: completed rdma wr_id 67ef40, nic_wr_credit 21522. [D 20:42:56.803482] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 33/70. [D 20:42:56.812583] openib_check_cq: completed rdma wr_id 61e680, nic_wr_credit 21521. [D 20:42:56.812608] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 34/70. [D 20:42:56.812627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21521. [D 20:42:56.812644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21522. [D 20:42:56.812660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21523. [D 20:42:56.812676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21524. [D 20:42:56.812691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21525. [D 20:42:56.812706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21526. [D 20:42:56.812735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21527. [D 20:42:56.812749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21528. [D 20:42:56.812764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21529. [D 20:42:56.812783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21530. [D 20:42:56.812798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21531. [D 20:42:56.812813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21532. [D 20:42:56.812828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21533. [D 20:42:56.812843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21534. [D 20:42:56.812858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21535. [D 20:42:56.812874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21536. [D 20:42:56.812903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21537. [D 20:42:56.812922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21538. [D 20:42:56.812941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21539. [D 20:42:56.812956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21540. [D 20:42:56.812971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21541. [D 20:42:56.812986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21542. [D 20:42:56.813003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21543. [D 20:42:56.813017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21544. [D 20:42:56.813032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21545. [D 20:42:56.813046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21546. [D 20:42:56.813065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21547. [D 20:42:56.813080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21548. [D 20:42:56.813094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21549. [D 20:42:56.813109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21550. [D 20:42:56.813123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21551. [D 20:42:56.813140] openib_post_sr_rdmaw: ibv_post_send wr_id 648fd0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21552. [D 20:42:56.813235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.813259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.813273] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.813299] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.813313] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.813326] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.818551] openib_check_cq: completed rdma wr_id 648fd0, nic_wr_credit 21552. [D 20:42:56.818575] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 35/70. [D 20:42:56.818649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.818672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.818685] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.824971] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.824991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.825004] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.825043] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4507 [D 20:42:56.825059] element 0: offset: 0x2aaaab60a520, size: 24 [D 20:42:56.825077] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 36/70. [D 20:42:56.825114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.825128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.825140] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.825161] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4509 [D 20:42:56.825175] element 0: offset: 0x2aaaab610330, size: 24 [D 20:42:56.825190] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 37/70. [D 20:42:56.828988] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4507 [D 20:42:56.829077] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 38/70. [D 20:42:56.829155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21552. [D 20:42:56.829216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21553. [D 20:42:56.829231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21554. [D 20:42:56.829249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21555. [D 20:42:56.829264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21556. [D 20:42:56.829278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21557. [D 20:42:56.829293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21558. [D 20:42:56.829307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21559. [D 20:42:56.829322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21560. [D 20:42:56.829337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21561. [D 20:42:56.829366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21562. [D 20:42:56.829381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21563. [D 20:42:56.829404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21564. [D 20:42:56.829418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21565. [D 20:42:56.829433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21566. [D 20:42:56.829447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21567. [D 20:42:56.829462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21568. [D 20:42:56.829477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21569. [D 20:42:56.829493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21570. [D 20:42:56.829508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21571. [D 20:42:56.829522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21572. [D 20:42:56.829537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21573. [D 20:42:56.829587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21574. [D 20:42:56.829607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21575. [D 20:42:56.829622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21576. [D 20:42:56.829636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21577. [D 20:42:56.829651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21578. [D 20:42:56.829665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21579. [D 20:42:56.829680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21580. [D 20:42:56.829694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21581. [D 20:42:56.829713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21582. [D 20:42:56.829728] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21583. [D 20:42:56.834900] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4509 [D 20:42:56.834981] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 39/70. [D 20:42:56.840053] openib_check_cq: completed rdma wr_id 67ef40, nic_wr_credit 21583. [D 20:42:56.840083] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 40/70. [D 20:42:56.840101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21583. [D 20:42:56.840117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21584. [D 20:42:56.840134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21585. [D 20:42:56.840150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21586. [D 20:42:56.840164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21587. [D 20:42:56.840179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21588. [D 20:42:56.840209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21589. [D 20:42:56.840223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21590. [D 20:42:56.840238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21591. [D 20:42:56.840257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21592. [D 20:42:56.840272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21593. [D 20:42:56.840286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21594. [D 20:42:56.840301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21595. [D 20:42:56.840315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21596. [D 20:42:56.840330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21597. [D 20:42:56.840344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21598. [D 20:42:56.840359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21599. [D 20:42:56.840392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21600. [D 20:42:56.840413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21601. [D 20:42:56.840428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21602. [D 20:42:56.840443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21603. [D 20:42:56.840458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21604. [D 20:42:56.840472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21605. [D 20:42:56.840490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21606. [D 20:42:56.840504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21607. [D 20:42:56.840519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21608. [D 20:42:56.840533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21609. [D 20:42:56.840552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21610. [D 20:42:56.840567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21611. [D 20:42:56.840581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21612. [D 20:42:56.840596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21613. [D 20:42:56.840610] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21614. [D 20:42:56.840705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.840729] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.840743] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.848758] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.848780] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.848793] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.848833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4512 [D 20:42:56.848848] element 0: offset: 0x2aaaab604580, size: 24 [D 20:42:56.848866] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 41/70. [D 20:42:56.851813] openib_check_cq: completed rdma wr_id 61f8a0, nic_wr_credit 21614. [D 20:42:56.851837] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 42/70. [D 20:42:56.852012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.852034] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.852046] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.855462] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4512 [D 20:42:56.855535] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 43/70. [D 20:42:56.855684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21614. [D 20:42:56.855708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21615. [D 20:42:56.855723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21616. [D 20:42:56.855738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21617. [D 20:42:56.855752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21618. [D 20:42:56.855767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21619. [D 20:42:56.855783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21620. [D 20:42:56.855798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21621. [D 20:42:56.855812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21622. [D 20:42:56.855832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21623. [D 20:42:56.855866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21624. [D 20:42:56.855883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21625. [D 20:42:56.855897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21626. [D 20:42:56.855915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21627. [D 20:42:56.855933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21628. [D 20:42:56.855950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21629. [D 20:42:56.855965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21630. [D 20:42:56.855980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21631. [D 20:42:56.855995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21632. [D 20:42:56.856010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21633. [D 20:42:56.856025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21634. [D 20:42:56.856040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21635. [D 20:42:56.856055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21636. [D 20:42:56.856070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21637. [D 20:42:56.856085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21638. [D 20:42:56.856107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21639. [D 20:42:56.856122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21640. [D 20:42:56.856137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21641. [D 20:42:56.856168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21642. [D 20:42:56.856183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21643. [D 20:42:56.856197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21644. [D 20:42:56.856212] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21645. [D 20:42:56.864388] openib_check_cq: completed rdma wr_id 67ef40, nic_wr_credit 21645. [D 20:42:56.864411] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 44/70. [D 20:42:56.864494] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.864518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.864532] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.879161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.879182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.879195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.879234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4516 [D 20:42:56.879249] element 0: offset: 0x2aaaab60a520, size: 24 [D 20:42:56.879266] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 45/70. [D 20:42:56.879321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.879336] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.879349] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.879369] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4519 [D 20:42:56.879383] element 0: offset: 0x2aaaab604560, size: 24 [D 20:42:56.879399] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 46/70. [D 20:42:56.883915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.883985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.883999] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.884041] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4522 [D 20:42:56.884056] element 0: offset: 0x2aaaab6103b0, size: 24 [D 20:42:56.884080] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 47/70. [D 20:42:56.884123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.884138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.884151] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:56.884172] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4524 [D 20:42:56.884186] element 0: offset: 0x2aaaab604170, size: 24 [D 20:42:56.884201] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 48/70. [D 20:42:56.887898] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4516 [D 20:42:56.887987] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 49/70. [D 20:42:56.888049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21645. [D 20:42:56.888079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21646. [D 20:42:56.888094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21647. [D 20:42:56.888109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21648. [D 20:42:56.888125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21649. [D 20:42:56.888140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21650. [D 20:42:56.888154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21651. [D 20:42:56.888169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21652. [D 20:42:56.888184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21653. [D 20:42:56.888199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21654. [D 20:42:56.888214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21655. [D 20:42:56.888228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21656. [D 20:42:56.888243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21657. [D 20:42:56.888258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21658. [D 20:42:56.888273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21659. [D 20:42:56.888288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21660. [D 20:42:56.888302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21661. [D 20:42:56.888317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21662. [D 20:42:56.888332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21663. [D 20:42:56.888347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21664. [D 20:42:56.888362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21665. [D 20:42:56.888377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21666. [D 20:42:56.888392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21667. [D 20:42:56.888406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21668. [D 20:42:56.888421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21669. [D 20:42:56.888436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21670. [D 20:42:56.888451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21671. [D 20:42:56.888466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21672. [D 20:42:56.888480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21673. [D 20:42:56.888495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21674. [D 20:42:56.888511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21675. [D 20:42:56.888526] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef40 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21676. [D 20:42:56.889353] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4519 [D 20:42:56.889413] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 50/70. [D 20:42:56.889530] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4522 [D 20:42:56.889548] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 51/70. [D 20:42:56.895058] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4524 [D 20:42:56.895080] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 52/70. [D 20:42:56.898933] openib_check_cq: completed rdma wr_id 67ef40, nic_wr_credit 21676. [D 20:42:56.899009] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 53/70. [D 20:42:56.899032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21676. [D 20:42:56.899048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 21677. [D 20:42:56.899063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 21678. [D 20:42:56.899078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 21679. [D 20:42:56.899093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 21680. [D 20:42:56.899107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 21681. [D 20:42:56.899122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21682. [D 20:42:56.899137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21683. [D 20:42:56.899152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21684. [D 20:42:56.899166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 21685. [D 20:42:56.899181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 21686. [D 20:42:56.899196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 21687. [D 20:42:56.899211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 21688. [D 20:42:56.899225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 21689. [D 20:42:56.899240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21690. [D 20:42:56.899255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21691. [D 20:42:56.899270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21692. [D 20:42:56.899285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 21693. [D 20:42:56.899299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 21694. [D 20:42:56.899314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 21695. [D 20:42:56.899329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 21696. [D 20:42:56.899343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 21697. [D 20:42:56.899358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21698. [D 20:42:56.899373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21699. [D 20:42:56.899388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21700. [D 20:42:56.899402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 21701. [D 20:42:56.899418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 21702. [D 20:42:56.899433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 21703. [D 20:42:56.899447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 21704. [D 20:42:56.899462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 21705. [D 20:42:56.899476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21706. [D 20:42:56.899491] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21707. [D 20:42:56.899508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21708. [D 20:42:56.899523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21709. [D 20:42:56.899537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21710. [D 20:42:56.899551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21711. [D 20:42:56.899566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21712. [D 20:42:56.899581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21713. [D 20:42:56.899595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21714. [D 20:42:56.899609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21715. [D 20:42:56.899624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21716. [D 20:42:56.899639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21717. [D 20:42:56.899653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21718. [D 20:42:56.899668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21719. [D 20:42:56.899682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21720. [D 20:42:56.899696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21721. [D 20:42:56.899711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21722. [D 20:42:56.899725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21723. [D 20:42:56.899740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21724. [D 20:42:56.899754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21725. [D 20:42:56.899769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21726. [D 20:42:56.899783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21727. [D 20:42:56.899798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21728. [D 20:42:56.899812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21729. [D 20:42:56.899827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21730. [D 20:42:56.899842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21731. [D 20:42:56.899862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21732. [D 20:42:56.899876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21733. [D 20:42:56.899891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21734. [D 20:42:56.899905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21735. [D 20:42:56.899920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21736. [D 20:42:56.899934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21737. [D 20:42:56.899948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21738. [D 20:42:56.899963] openib_post_sr_rdmaw: ibv_post_send wr_id 61e450 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21739. [D 20:42:56.899979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 21740. [D 20:42:56.899994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 21741. [D 20:42:56.900008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 21742. [D 20:42:56.900023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 21743. [D 20:42:56.900037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 21744. [D 20:42:56.900052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 21745. [E 20:42:56.900087] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 21746, block for 10 ms. [D 20:42:56.900121] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 21745. [D 20:42:56.900137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 21746. [E 20:42:56.900153] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 21747, block for 10 ms. [D 20:42:56.910568] openib_check_cq: completed rdma wr_id 61f8a0, nic_wr_credit 21746. [D 20:42:56.910590] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 54/70. [D 20:42:56.910605] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 21745. [D 20:42:56.910620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 21746. [D 20:42:56.910635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 21747. [D 20:42:56.910650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 21748. [D 20:42:56.910664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 21749. [D 20:42:56.910679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 21750. [D 20:42:56.910693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 21751. [D 20:42:56.910708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 21752. [D 20:42:56.910723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 21753. [D 20:42:56.910738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 21754. [D 20:42:56.910753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 21755. [D 20:42:56.910768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 21756. [D 20:42:56.910782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 21757. [D 20:42:56.910797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 21758. [D 20:42:56.910811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 21759. [D 20:42:56.910826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 21760. [D 20:42:56.910841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 21761. [D 20:42:56.910855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 21762. [D 20:42:56.910870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 21763. [D 20:42:56.910884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 21764. [D 20:42:56.910899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 21765. [D 20:42:56.910913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 21766. [D 20:42:56.910928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 21767. [D 20:42:56.910943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 21768. [D 20:42:56.910957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 21769. [D 20:42:56.910972] openib_post_sr_rdmaw: ibv_post_send wr_id 61f3d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 21770. [D 20:42:56.911049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.911071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.911084] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:56.922271] openib_check_cq: completed rdma wr_id 61e450, nic_wr_credit 21770. [D 20:42:56.922296] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 55/70. [D 20:42:56.924275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.924295] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.924307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.929046] openib_check_cq: completed rdma wr_id 61f3d0, nic_wr_credit 21769. [D 20:42:56.929071] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 56/70. [D 20:42:56.929116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.929133] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.929146] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.929171] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.929185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.929197] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.949624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.949643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.949656] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.949695] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4529 [D 20:42:56.949710] element 0: offset: 0x2aaaab035830, size: 24 [D 20:42:56.949730] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 57/70. [D 20:42:56.951868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.951934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.951947] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.951991] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4531 [D 20:42:56.952006] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:56.952025] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 58/70. [D 20:42:56.954323] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.954395] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.954408] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:56.954453] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4534 [D 20:42:56.954468] element 0: offset: 0x2aaaab037740, size: 24 [D 20:42:56.954487] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 59/70. [D 20:42:56.959893] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4534 [D 20:42:56.959991] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 60/70. [D 20:42:56.960021] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4529 [D 20:42:56.960037] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 0/70. [D 20:42:56.960140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21769. [D 20:42:56.960172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 21770. [D 20:42:56.960188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 21771. [D 20:42:56.960203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 21772. [D 20:42:56.960218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 21773. [D 20:42:56.960233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 21774. [D 20:42:56.960248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21775. [D 20:42:56.960263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21776. [D 20:42:56.960278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21777. [D 20:42:56.960294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 21778. [D 20:42:56.960309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 21779. [D 20:42:56.960323] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4531 [D 20:42:56.960325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 21780. [D 20:42:56.960387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 21781. [D 20:42:56.960402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 21782. [D 20:42:56.960416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21783. [D 20:42:56.960431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21784. [D 20:42:56.960445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21785. [D 20:42:56.960459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 21786. [D 20:42:56.960474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 21787. [D 20:42:56.960489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 21788. [D 20:42:56.960504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 21789. [D 20:42:56.960518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 21790. [D 20:42:56.960533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21791. [D 20:42:56.960547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21792. [D 20:42:56.960562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21793. [D 20:42:56.960576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 21794. [D 20:42:56.960591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 21795. [D 20:42:56.960605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 21796. [D 20:42:56.960620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 21797. [D 20:42:56.960634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 21798. [D 20:42:56.960649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21799. [D 20:42:56.960663] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21800. [D 20:42:56.960681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21801. [D 20:42:56.960696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21802. [D 20:42:56.960710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21803. [D 20:42:56.960725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21804. [D 20:42:56.960739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21805. [D 20:42:56.960754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21806. [D 20:42:56.960768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21807. [D 20:42:56.960783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21808. [D 20:42:56.960798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21809. [D 20:42:56.960812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21810. [D 20:42:56.960827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21811. [D 20:42:56.960841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21812. [D 20:42:56.960856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21813. [D 20:42:56.960870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21814. [D 20:42:56.960885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21815. [D 20:42:56.960899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21816. [D 20:42:56.960915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21817. [D 20:42:56.960929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21818. [D 20:42:56.960944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21819. [D 20:42:56.960958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21820. [D 20:42:56.960973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21821. [D 20:42:56.960987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21822. [D 20:42:56.961002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21823. [D 20:42:56.961016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21824. [D 20:42:56.961031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21825. [D 20:42:56.961045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21826. [D 20:42:56.961060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21827. [D 20:42:56.961074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21828. [D 20:42:56.961089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21829. [D 20:42:56.961103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21830. [D 20:42:56.961117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21831. [D 20:42:56.961132] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef40 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21832. [D 20:42:56.961157] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 1/70. [D 20:42:56.971781] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 21832. [D 20:42:56.971807] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 2/70. [D 20:42:56.978347] openib_check_cq: completed rdma wr_id 67ef40, nic_wr_credit 21831. [D 20:42:56.978368] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 3/70. [D 20:42:56.978384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21831. [D 20:42:56.978399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21832. [D 20:42:56.978414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21833. [D 20:42:56.978429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21834. [D 20:42:56.978443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21835. [D 20:42:56.978458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21836. [D 20:42:56.978472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21837. [D 20:42:56.978487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21838. [D 20:42:56.978502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21839. [D 20:42:56.978516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21840. [D 20:42:56.978532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21841. [D 20:42:56.978546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21842. [D 20:42:56.978561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21843. [D 20:42:56.978575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21844. [D 20:42:56.978590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21845. [D 20:42:56.978604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21846. [D 20:42:56.978619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21847. [D 20:42:56.978634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21848. [D 20:42:56.978648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21849. [D 20:42:56.978663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21850. [D 20:42:56.978677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21851. [D 20:42:56.978692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21852. [D 20:42:56.978707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21853. [D 20:42:56.978721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21854. [D 20:42:56.978736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21855. [D 20:42:56.978750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21856. [D 20:42:56.978765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21857. [D 20:42:56.978779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21858. [D 20:42:56.978794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21859. [D 20:42:56.978808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21860. [D 20:42:56.978823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21861. [D 20:42:56.978838] openib_post_sr_rdmaw: ibv_post_send wr_id 61e680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21862. [D 20:42:56.978915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.978938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.978951] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:56.978975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.978989] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.979001] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:56.984391] openib_check_cq: completed rdma wr_id 61e680, nic_wr_credit 21862. [D 20:42:56.984411] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 4/70. [D 20:42:56.984469] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:56.984488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.984501] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:56.993255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.993274] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.993287] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:56.993325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4537 [D 20:42:56.993341] element 0: offset: 0x2aaaab037600, size: 24 [D 20:42:56.993357] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 5/70. [D 20:42:56.993395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:56.993409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:56.993421] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:56.993442] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4539 [D 20:42:56.993456] element 0: offset: 0x2aaaab014550, size: 24 [D 20:42:56.993471] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 6/70. [D 20:42:56.999630] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4537 [D 20:42:56.999708] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 7/70. [D 20:42:56.999797] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4539 [D 20:42:56.999817] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 8/70. [D 20:42:56.999848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21862. [D 20:42:56.999879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21863. [D 20:42:56.999898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21864. [D 20:42:56.999913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21865. [D 20:42:56.999928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21866. [D 20:42:56.999943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21867. [D 20:42:56.999958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21868. [D 20:42:56.999973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21869. [D 20:42:56.999988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21870. [D 20:42:57.000003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21871. [D 20:42:57.000018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21872. [D 20:42:57.000033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21873. [D 20:42:57.000048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21874. [D 20:42:57.000063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21875. [D 20:42:57.000077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21876. [D 20:42:57.000092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21877. [D 20:42:57.000107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21878. [D 20:42:57.000122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21879. [D 20:42:57.000137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21880. [D 20:42:57.000151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21881. [D 20:42:57.000166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21882. [D 20:42:57.000182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21883. [D 20:42:57.000196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21884. [D 20:42:57.000211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21885. [D 20:42:57.000225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21886. [D 20:42:57.000240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21887. [D 20:42:57.000254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21888. [D 20:42:57.000269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21889. [D 20:42:57.000283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21890. [D 20:42:57.000298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21891. [D 20:42:57.000312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21892. [D 20:42:57.000326] openib_post_sr_rdmaw: ibv_post_send wr_id 61f440 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21893. [D 20:42:57.000344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21894. [D 20:42:57.000358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21895. [D 20:42:57.000373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21896. [D 20:42:57.000387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21897. [D 20:42:57.000402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21898. [D 20:42:57.000416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21899. [D 20:42:57.000431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21900. [D 20:42:57.000445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21901. [D 20:42:57.000459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21902. [D 20:42:57.000474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21903. [D 20:42:57.000488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21904. [D 20:42:57.000503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21905. [D 20:42:57.000517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21906. [D 20:42:57.000532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21907. [D 20:42:57.000546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 21908. [D 20:42:57.000560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 21909. [D 20:42:57.000575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 21910. [D 20:42:57.000589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 21911. [D 20:42:57.000605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 21912. [D 20:42:57.000630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 21913. [D 20:42:57.000644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 21914. [D 20:42:57.000659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 21915. [D 20:42:57.000685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 21916. [D 20:42:57.000701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 21917. [D 20:42:57.000715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 21918. [D 20:42:57.000729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 21919. [D 20:42:57.000744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 21920. [D 20:42:57.000762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 21921. [D 20:42:57.000777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 21922. [D 20:42:57.000791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 21923. [D 20:42:57.000806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 21924. [D 20:42:57.000821] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 21925. [D 20:42:57.011456] openib_check_cq: completed rdma wr_id 61f440, nic_wr_credit 21925. [D 20:42:57.011478] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 9/70. [D 20:42:57.023017] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 21924. [D 20:42:57.023039] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 10/70. [D 20:42:57.023111] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.023135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.023149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.023180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.023193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.023205] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:57.043470] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.043488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.043501] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:57.043540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4544 [D 20:42:57.043556] element 0: offset: 0x5b0030, size: 24 [D 20:42:57.043573] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 11/70. [D 20:42:57.045710] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.045780] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.045794] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.045839] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4545 [D 20:42:57.045854] element 0: offset: 0x62fd10, size: 24 [D 20:42:57.045873] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 12/70. [D 20:42:57.050270] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4545 [D 20:42:57.050351] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 13/70. [D 20:42:57.050428] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4544 [D 20:42:57.050446] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 14/70. [D 20:42:57.050491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21924. [D 20:42:57.050539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21925. [D 20:42:57.050554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 21926. [D 20:42:57.050577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 21927. [D 20:42:57.050592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 21928. [D 20:42:57.050607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 21929. [D 20:42:57.050621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 21930. [D 20:42:57.050636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21931. [D 20:42:57.050650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21932. [D 20:42:57.050665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21933. [D 20:42:57.050679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 21934. [D 20:42:57.050694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 21935. [D 20:42:57.050708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 21936. [D 20:42:57.050723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 21937. [D 20:42:57.050737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 21938. [D 20:42:57.050752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21939. [D 20:42:57.050767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21940. [D 20:42:57.050781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21941. [D 20:42:57.050796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 21942. [D 20:42:57.050810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 21943. [D 20:42:57.050825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 21944. [D 20:42:57.050840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 21945. [D 20:42:57.050854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 21946. [D 20:42:57.050869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21947. [D 20:42:57.050883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21948. [D 20:42:57.050898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21949. [D 20:42:57.050912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 21950. [D 20:42:57.050927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 21951. [D 20:42:57.050941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 21952. [D 20:42:57.050957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 21953. [D 20:42:57.050971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 21954. [D 20:42:57.050986] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21955. [D 20:42:57.051004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21956. [D 20:42:57.051019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 21957. [D 20:42:57.051033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 21958. [D 20:42:57.051048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 21959. [D 20:42:57.051063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 21960. [D 20:42:57.051078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 21961. [D 20:42:57.051092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21962. [D 20:42:57.051107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21963. [D 20:42:57.051122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21964. [D 20:42:57.051136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 21965. [D 20:42:57.051151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 21966. [D 20:42:57.051166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 21967. [D 20:42:57.051180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 21968. [D 20:42:57.051195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 21969. [D 20:42:57.051210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21970. [D 20:42:57.051224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21971. [D 20:42:57.051239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21972. [D 20:42:57.051254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 21973. [D 20:42:57.051268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 21974. [D 20:42:57.051283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 21975. [D 20:42:57.051298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 21976. [D 20:42:57.051312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 21977. [D 20:42:57.051327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21978. [D 20:42:57.051342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21979. [D 20:42:57.051357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21980. [D 20:42:57.051371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 21981. [D 20:42:57.051387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 21982. [D 20:42:57.051402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 21983. [D 20:42:57.051416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 21984. [D 20:42:57.051431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 21985. [D 20:42:57.051446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21986. [D 20:42:57.051461] openib_post_sr_rdmaw: ibv_post_send wr_id 62fac0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21987. [D 20:42:57.058904] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.058927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.058941] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.058981] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4548 [D 20:42:57.058996] element 0: offset: 0x62fc00, size: 24 [D 20:42:57.059012] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 15/70. [D 20:42:57.061722] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 21987. [D 20:42:57.061747] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 16/70. [D 20:42:57.069047] openib_check_cq: completed rdma wr_id 62fac0, nic_wr_credit 21986. [D 20:42:57.069064] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 17/70. [D 20:42:57.069126] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.069147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.069161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.069247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.069261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.069274] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.072276] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4548 [D 20:42:57.072333] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 18/70. [D 20:42:57.075242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 21986. [D 20:42:57.075263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 21987. [D 20:42:57.075278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 21988. [D 20:42:57.075293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 21989. [D 20:42:57.075308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 21990. [D 20:42:57.075323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 21991. [D 20:42:57.075338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 21992. [D 20:42:57.075352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 21993. [D 20:42:57.075367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 21994. [D 20:42:57.075382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 21995. [D 20:42:57.075397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 21996. [D 20:42:57.075411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 21997. [D 20:42:57.075426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 21998. [D 20:42:57.075442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 21999. [D 20:42:57.075457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22000. [D 20:42:57.075472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22001. [D 20:42:57.075487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22002. [D 20:42:57.075501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22003. [D 20:42:57.075516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22004. [D 20:42:57.075531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22005. [D 20:42:57.075546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22006. [D 20:42:57.075561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22007. [D 20:42:57.075575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22008. [D 20:42:57.075590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22009. [D 20:42:57.075605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22010. [D 20:42:57.075620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22011. [D 20:42:57.075634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22012. [D 20:42:57.075649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22013. [D 20:42:57.075664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22014. [D 20:42:57.075679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22015. [D 20:42:57.075694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22016. [D 20:42:57.075708] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22017. [D 20:42:57.077936] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.077961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.077973] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.078015] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4551 [D 20:42:57.078030] element 0: offset: 0x61f590, size: 24 [D 20:42:57.078046] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 19/70. [D 20:42:57.081125] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 22017. [D 20:42:57.081147] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 20/70. [D 20:42:57.081251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.081272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.081284] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.084568] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4551 [D 20:42:57.084641] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 21/70. [D 20:42:57.086392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22017. [D 20:42:57.086413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22018. [D 20:42:57.086428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22019. [D 20:42:57.086444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22020. [D 20:42:57.086458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22021. [D 20:42:57.086473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22022. [D 20:42:57.086487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22023. [D 20:42:57.086502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22024. [D 20:42:57.086516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22025. [D 20:42:57.086542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22026. [D 20:42:57.086557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22027. [D 20:42:57.086580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22028. [D 20:42:57.086595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22029. [D 20:42:57.086609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22030. [D 20:42:57.086635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22031. [D 20:42:57.086659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22032. [D 20:42:57.086673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22033. [D 20:42:57.086688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22034. [D 20:42:57.086713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22035. [D 20:42:57.086739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22036. [D 20:42:57.086763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22037. [D 20:42:57.086778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22038. [D 20:42:57.086807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22039. [D 20:42:57.086834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22040. [D 20:42:57.086849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22041. [D 20:42:57.086877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22042. [D 20:42:57.086902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22043. [D 20:42:57.086917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22044. [D 20:42:57.086939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22045. [D 20:42:57.086954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22046. [D 20:42:57.086979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22047. [D 20:42:57.086994] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22048. [D 20:42:57.100056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.100094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.100108] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.100164] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4554 [D 20:42:57.100180] element 0: offset: 0x5b0030, size: 24 [D 20:42:57.100001] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 22048. [D 20:42:57.100781] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 22/70. [D 20:42:57.100820] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 23/70. [D 20:42:57.100899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.100929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.100943] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.110016] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.110037] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.110051] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.110075] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4557 [D 20:42:57.110090] element 0: offset: 0x691fe0, size: 24 [D 20:42:57.110120] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 24/70. [D 20:42:57.115948] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4554 [D 20:42:57.116029] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 25/70. [D 20:42:57.117833] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4557 [D 20:42:57.117890] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 26/70. [D 20:42:57.119985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22048. [D 20:42:57.120012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22049. [D 20:42:57.120027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22050. [D 20:42:57.120042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22051. [D 20:42:57.120057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22052. [D 20:42:57.120072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22053. [D 20:42:57.120087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22054. [D 20:42:57.120101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22055. [D 20:42:57.120116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22056. [D 20:42:57.120131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22057. [D 20:42:57.120146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22058. [D 20:42:57.120306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22059. [D 20:42:57.120333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22060. [D 20:42:57.120348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22061. [D 20:42:57.120363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22062. [D 20:42:57.120378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22063. [D 20:42:57.120411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22064. [D 20:42:57.120434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22065. [D 20:42:57.120461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22066. [D 20:42:57.120476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22067. [D 20:42:57.120499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22068. [D 20:42:57.120514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22069. [D 20:42:57.120529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22070. [D 20:42:57.120555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22071. [D 20:42:57.120579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22072. [D 20:42:57.120601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22073. [D 20:42:57.120616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22074. [D 20:42:57.120631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22075. [D 20:42:57.120645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22076. [D 20:42:57.120659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22077. [D 20:42:57.120674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22078. [D 20:42:57.120688] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22079. [D 20:42:57.120705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22080. [D 20:42:57.120720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22081. [D 20:42:57.120734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22082. [D 20:42:57.120749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22083. [D 20:42:57.120763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22084. [D 20:42:57.120778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22085. [D 20:42:57.120792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22086. [D 20:42:57.120807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22087. [D 20:42:57.120821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22088. [D 20:42:57.120836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22089. [D 20:42:57.120850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22090. [D 20:42:57.120865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22091. [D 20:42:57.120879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22092. [D 20:42:57.120893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22093. [D 20:42:57.120909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22094. [D 20:42:57.120924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22095. [D 20:42:57.120938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22096. [D 20:42:57.120953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22097. [D 20:42:57.120967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22098. [D 20:42:57.120981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22099. [D 20:42:57.120996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22100. [D 20:42:57.121011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22101. [D 20:42:57.121025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22102. [D 20:42:57.121039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22103. [D 20:42:57.121054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22104. [D 20:42:57.121068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22105. [D 20:42:57.121083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22106. [D 20:42:57.121097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22107. [D 20:42:57.121111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22108. [D 20:42:57.121126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22109. [D 20:42:57.121140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22110. [D 20:42:57.121154] openib_post_sr_rdmaw: ibv_post_send wr_id 62f960 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22111. [D 20:42:57.122724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.122743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.122756] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.122781] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4561 [D 20:42:57.122797] element 0: offset: 0x62faa0, size: 24 [D 20:42:57.122812] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 27/70. [D 20:42:57.131614] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 22111. [D 20:42:57.131636] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 28/70. [D 20:42:57.143123] openib_check_cq: completed rdma wr_id 62f960, nic_wr_credit 22110. [D 20:42:57.143145] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 29/70. [D 20:42:57.146214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.146231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.146245] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.146299] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.146314] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.146327] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.149393] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4561 [D 20:42:57.149470] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 30/70. [D 20:42:57.153887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 22110. [D 20:42:57.153912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 22111. [D 20:42:57.153926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 22112. [D 20:42:57.153941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 22113. [D 20:42:57.153956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 22114. [D 20:42:57.153971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 22115. [D 20:42:57.153986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22116. [D 20:42:57.154000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22117. [D 20:42:57.154015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22118. [D 20:42:57.154030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 22119. [D 20:42:57.154044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 22120. [D 20:42:57.154059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 22121. [D 20:42:57.154074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 22122. [D 20:42:57.154089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 22123. [D 20:42:57.154104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22124. [D 20:42:57.154118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22125. [D 20:42:57.154133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22126. [D 20:42:57.154148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 22127. [D 20:42:57.154163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 22128. [D 20:42:57.154177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 22129. [D 20:42:57.154192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 22130. [D 20:42:57.154209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 22131. [D 20:42:57.154224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22132. [D 20:42:57.154239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22133. [D 20:42:57.154253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22134. [D 20:42:57.154268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 22135. [D 20:42:57.154282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 22136. [D 20:42:57.154297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 22137. [D 20:42:57.154312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 22138. [D 20:42:57.154327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 22139. [D 20:42:57.154342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22140. [D 20:42:57.154357] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22141. [D 20:42:57.159651] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.159668] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.159681] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.159705] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4564 [D 20:42:57.159720] element 0: offset: 0x61f590, size: 24 [D 20:42:57.159735] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 31/70. [D 20:42:57.159758] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.159772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.159786] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.159805] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4566 [D 20:42:57.159820] element 0: offset: 0x658610, size: 24 [D 20:42:57.159835] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 32/70. [D 20:42:57.160055] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22141. [D 20:42:57.160071] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 33/70. [D 20:42:57.163709] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4564 [D 20:42:57.163789] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 34/70. [D 20:42:57.163836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.163862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.163876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.163898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.163912] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.163925] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.163949] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4569 [D 20:42:57.163964] element 0: offset: 0x691fe0, size: 24 [D 20:42:57.163985] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 35/70. [D 20:42:57.164015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22141. [D 20:42:57.164032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22142. [D 20:42:57.164047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22143. [D 20:42:57.164061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22144. [D 20:42:57.164076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22145. [D 20:42:57.164090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22146. [D 20:42:57.164105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22147. [D 20:42:57.164119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22148. [D 20:42:57.164134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22149. [D 20:42:57.164148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22150. [D 20:42:57.164163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22151. [D 20:42:57.164178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22152. [D 20:42:57.164192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22153. [D 20:42:57.164208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22154. [D 20:42:57.164223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22155. [D 20:42:57.164237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22156. [D 20:42:57.164252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22157. [D 20:42:57.164267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22158. [D 20:42:57.164282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22159. [D 20:42:57.164297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22160. [D 20:42:57.164312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22161. [D 20:42:57.164326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22162. [D 20:42:57.164342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22163. [D 20:42:57.164356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22164. [D 20:42:57.164371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22165. [D 20:42:57.164386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22166. [D 20:42:57.164401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22167. [D 20:42:57.164416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22168. [D 20:42:57.164431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22169. [D 20:42:57.164446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22170. [D 20:42:57.164461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22171. [D 20:42:57.164475] openib_post_sr_rdmaw: ibv_post_send wr_id 646ba0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22172. [D 20:42:57.167111] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4566 [D 20:42:57.167192] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 36/70. [D 20:42:57.171390] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4569 [D 20:42:57.171414] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 37/70. [D 20:42:57.175677] openib_check_cq: completed rdma wr_id 646ba0, nic_wr_credit 22172. [D 20:42:57.175755] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 38/70. [D 20:42:57.175777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22172. [D 20:42:57.175794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22173. [D 20:42:57.175808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22174. [D 20:42:57.175823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22175. [D 20:42:57.175838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22176. [D 20:42:57.175858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22177. [D 20:42:57.175875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22178. [D 20:42:57.175889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22179. [D 20:42:57.175903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22180. [D 20:42:57.175918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22181. [D 20:42:57.175932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22182. [D 20:42:57.175947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22183. [D 20:42:57.175961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22184. [D 20:42:57.175975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22185. [D 20:42:57.175990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22186. [D 20:42:57.176004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22187. [D 20:42:57.176018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22188. [D 20:42:57.176033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22189. [D 20:42:57.176047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22190. [D 20:42:57.176061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22191. [D 20:42:57.176076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22192. [D 20:42:57.176090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22193. [D 20:42:57.176104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22194. [D 20:42:57.176119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22195. [D 20:42:57.176133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22196. [D 20:42:57.176147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22197. [D 20:42:57.176161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22198. [D 20:42:57.176176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22199. [D 20:42:57.176190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22200. [D 20:42:57.176205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22201. [D 20:42:57.176219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22202. [D 20:42:57.176233] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22203. [D 20:42:57.176251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22204. [D 20:42:57.176266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22205. [D 20:42:57.176280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22206. [D 20:42:57.176296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22207. [D 20:42:57.176310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22208. [D 20:42:57.176325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22209. [D 20:42:57.176339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22210. [D 20:42:57.176353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22211. [D 20:42:57.176368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22212. [D 20:42:57.176382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22213. [D 20:42:57.176397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22214. [D 20:42:57.176412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22215. [D 20:42:57.176426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22216. [D 20:42:57.176441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22217. [D 20:42:57.176455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22218. [D 20:42:57.176470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22219. [D 20:42:57.176484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22220. [D 20:42:57.176499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22221. [D 20:42:57.176513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22222. [D 20:42:57.176527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22223. [D 20:42:57.176542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22224. [D 20:42:57.176556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22225. [D 20:42:57.176571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22226. [D 20:42:57.176586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22227. [D 20:42:57.176600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22228. [D 20:42:57.176615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22229. [D 20:42:57.176629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22230. [D 20:42:57.176644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22231. [D 20:42:57.176658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22232. [D 20:42:57.176673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22233. [D 20:42:57.176687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22234. [D 20:42:57.176702] openib_post_sr_rdmaw: ibv_post_send wr_id 66e430 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22235. [D 20:42:57.179778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.179796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.179810] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.185591] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22235. [D 20:42:57.185611] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 39/70. [D 20:42:57.185779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.185803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.185817] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.185860] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4572 [D 20:42:57.185875] element 0: offset: 0x5b0030, size: 24 [D 20:42:57.185894] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 40/70. [D 20:42:57.197274] openib_check_cq: completed rdma wr_id 66e430, nic_wr_credit 22234. [D 20:42:57.197300] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 41/70. [D 20:42:57.197361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.197382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.197398] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.197489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.197504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.197516] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.200559] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4572 [D 20:42:57.200614] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 42/70. [D 20:42:57.203017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22234. [D 20:42:57.203042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22235. [D 20:42:57.203057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22236. [D 20:42:57.203072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22237. [D 20:42:57.203086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22238. [D 20:42:57.203101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22239. [D 20:42:57.203115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22240. [D 20:42:57.203130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22241. [D 20:42:57.203144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22242. [D 20:42:57.203159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22243. [D 20:42:57.203173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22244. [D 20:42:57.203188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22245. [D 20:42:57.203203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22246. [D 20:42:57.203217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22247. [D 20:42:57.203231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22248. [D 20:42:57.203247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22249. [D 20:42:57.203261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22250. [D 20:42:57.203276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22251. [D 20:42:57.203291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22252. [D 20:42:57.203306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22253. [D 20:42:57.203321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22254. [D 20:42:57.203335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22255. [D 20:42:57.203350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22256. [D 20:42:57.203364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22257. [D 20:42:57.203379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22258. [D 20:42:57.203393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22259. [D 20:42:57.203408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22260. [D 20:42:57.203423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22261. [D 20:42:57.203437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22262. [D 20:42:57.203452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22263. [D 20:42:57.203466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22264. [D 20:42:57.203531] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22265. [D 20:42:57.209042] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22265. [D 20:42:57.209059] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 43/70. [D 20:42:57.209136] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.209159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.209172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:57.216980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.216997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.217010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:57.217048] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4577 [D 20:42:57.217063] element 0: offset: 0x61f590, size: 24 [D 20:42:57.217080] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 44/70. [D 20:42:57.217116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.217130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.217142] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.217163] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4580 [D 20:42:57.217177] element 0: offset: 0x62fd10, size: 24 [D 20:42:57.217193] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 45/70. [D 20:42:57.219270] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.219328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.219341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.219378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4581 [D 20:42:57.219394] element 0: offset: 0x691fe0, size: 24 [D 20:42:57.219413] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 46/70. [D 20:42:57.220876] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4577 [D 20:42:57.220948] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 47/70. [D 20:42:57.225141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22265. [D 20:42:57.225176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22266. [D 20:42:57.225191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22267. [D 20:42:57.225214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22268. [D 20:42:57.225229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22269. [D 20:42:57.225252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22270. [D 20:42:57.225267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22271. [D 20:42:57.225296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22272. [D 20:42:57.225311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22273. [D 20:42:57.225335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22274. [D 20:42:57.225350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22275. [D 20:42:57.225365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22276. [D 20:42:57.225380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22277. [D 20:42:57.225395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22278. [D 20:42:57.225410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22279. [D 20:42:57.225443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22280. [D 20:42:57.225473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22281. [D 20:42:57.225489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22282. [D 20:42:57.225514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22283. [D 20:42:57.225537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22284. [D 20:42:57.225553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22285. [D 20:42:57.225580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22286. [D 20:42:57.225595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22287. [D 20:42:57.225619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22288. [D 20:42:57.225634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22289. [D 20:42:57.225649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22290. [D 20:42:57.225677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22291. [D 20:42:57.225702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22292. [D 20:42:57.225725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22293. [D 20:42:57.225742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22294. [D 20:42:57.225771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22295. [D 20:42:57.225796] openib_post_sr_rdmaw: ibv_post_send wr_id 61e680 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22296. [D 20:42:57.227078] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4580 [D 20:42:57.227160] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 48/70. [D 20:42:57.227241] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4581 [D 20:42:57.227258] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 49/70. [D 20:42:57.227901] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.227921] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.227935] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:57.227978] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4584 [D 20:42:57.227992] element 0: offset: 0x633f40, size: 24 [D 20:42:57.228010] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 50/70. [D 20:42:57.236889] openib_check_cq: completed rdma wr_id 61e680, nic_wr_credit 22296. [D 20:42:57.236916] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 51/70. [D 20:42:57.236933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 22296. [D 20:42:57.236948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 22297. [D 20:42:57.236963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 22298. [D 20:42:57.236977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 22299. [D 20:42:57.236992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 22300. [D 20:42:57.237006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 22301. [D 20:42:57.237021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22302. [D 20:42:57.237035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22303. [D 20:42:57.237050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22304. [D 20:42:57.237065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 22305. [D 20:42:57.237079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 22306. [D 20:42:57.237094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 22307. [D 20:42:57.237108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 22308. [D 20:42:57.237123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 22309. [D 20:42:57.237137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22310. [D 20:42:57.237151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22311. [D 20:42:57.237166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22312. [D 20:42:57.237180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 22313. [D 20:42:57.237195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 22314. [D 20:42:57.237211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 22315. [D 20:42:57.237225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 22316. [D 20:42:57.237240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 22317. [D 20:42:57.237255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22318. [D 20:42:57.237269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22319. [D 20:42:57.237284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22320. [D 20:42:57.237298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 22321. [D 20:42:57.237313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 22322. [D 20:42:57.237327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 22323. [D 20:42:57.237342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 22324. [D 20:42:57.237356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 22325. [D 20:42:57.237371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22326. [D 20:42:57.237385] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22327. [D 20:42:57.237402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22328. [D 20:42:57.237416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22329. [D 20:42:57.237431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22330. [D 20:42:57.237446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22331. [D 20:42:57.237460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22332. [D 20:42:57.237475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22333. [D 20:42:57.237489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22334. [D 20:42:57.237504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22335. [D 20:42:57.237519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22336. [D 20:42:57.237533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22337. [D 20:42:57.237548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22338. [D 20:42:57.237562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22339. [D 20:42:57.237577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22340. [D 20:42:57.237591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22341. [D 20:42:57.237606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22342. [D 20:42:57.237620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22343. [D 20:42:57.237636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22344. [D 20:42:57.237650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22345. [D 20:42:57.237664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22346. [D 20:42:57.237679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22347. [D 20:42:57.237693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22348. [D 20:42:57.237708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22349. [D 20:42:57.237722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22350. [D 20:42:57.237737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22351. [D 20:42:57.237751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22352. [D 20:42:57.237766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22353. [D 20:42:57.237780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22354. [D 20:42:57.237795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22355. [D 20:42:57.237809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22356. [D 20:42:57.237824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22357. [D 20:42:57.237838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22358. [D 20:42:57.237853] openib_post_sr_rdmaw: ibv_post_send wr_id 633ca0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22359. [D 20:42:57.237915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.237936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.237949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:57.241130] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4584 [D 20:42:57.241196] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 52/70. [D 20:42:57.248523] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22359. [D 20:42:57.248549] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 53/70. [D 20:42:57.254726] openib_check_cq: completed rdma wr_id 633ca0, nic_wr_credit 22358. [D 20:42:57.254748] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 54/70. [D 20:42:57.254764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22358. [D 20:42:57.254779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22359. [D 20:42:57.254793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22360. [D 20:42:57.254808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22361. [D 20:42:57.254822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22362. [D 20:42:57.254837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22363. [D 20:42:57.254851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22364. [D 20:42:57.254866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22365. [D 20:42:57.254881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22366. [D 20:42:57.254896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22367. [D 20:42:57.254911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22368. [D 20:42:57.254925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22369. [D 20:42:57.254939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22370. [D 20:42:57.254954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22371. [D 20:42:57.254969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22372. [D 20:42:57.254983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22373. [D 20:42:57.254998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22374. [D 20:42:57.255012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22375. [D 20:42:57.255027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22376. [D 20:42:57.255042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22377. [D 20:42:57.255056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22378. [D 20:42:57.255071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22379. [D 20:42:57.255085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22380. [D 20:42:57.255100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22381. [D 20:42:57.255114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22382. [D 20:42:57.255129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22383. [D 20:42:57.255143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22384. [D 20:42:57.255158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22385. [D 20:42:57.255172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22386. [D 20:42:57.255187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22387. [D 20:42:57.255201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22388. [D 20:42:57.255216] openib_post_sr_rdmaw: ibv_post_send wr_id 61e680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22389. [D 20:42:57.255289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.255312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.255325] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.255348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.255362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.255374] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.263713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.263731] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.263743] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.263784] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4587 [D 20:42:57.263799] element 0: offset: 0x658610, size: 24 [D 20:42:57.263816] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 55/70. [D 20:42:57.266144] openib_check_cq: completed rdma wr_id 61e680, nic_wr_credit 22389. [D 20:42:57.266168] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 56/70. [D 20:42:57.266262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.266281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.266294] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.269489] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4587 [D 20:42:57.269556] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 57/70. [D 20:42:57.271341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22389. [D 20:42:57.271366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22390. [D 20:42:57.271381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22391. [D 20:42:57.271396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22392. [D 20:42:57.271410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22393. [D 20:42:57.271479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22394. [D 20:42:57.271811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22395. [D 20:42:57.271836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22396. [D 20:42:57.271850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22397. [D 20:42:57.271984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22398. [D 20:42:57.272000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22399. [D 20:42:57.272015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22400. [D 20:42:57.272029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22401. [D 20:42:57.272044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22402. [D 20:42:57.272059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22403. [D 20:42:57.272074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22404. [D 20:42:57.272089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22405. [D 20:42:57.272103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22406. [D 20:42:57.272118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22407. [D 20:42:57.272133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22408. [D 20:42:57.272148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22409. [D 20:42:57.272163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22410. [D 20:42:57.272178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22411. [D 20:42:57.272193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22412. [D 20:42:57.272209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22413. [D 20:42:57.272223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22414. [D 20:42:57.272238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22415. [D 20:42:57.272252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22416. [D 20:42:57.272267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22417. [D 20:42:57.272281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22418. [D 20:42:57.272296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22419. [D 20:42:57.272310] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22420. [D 20:42:57.274033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.274055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.274068] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.274110] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4590 [D 20:42:57.274125] element 0: offset: 0x2aaaab6103b0, size: 24 [D 20:42:57.274141] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 58/70. [D 20:42:57.283062] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22420. [D 20:42:57.283096] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 59/70. [D 20:42:57.283212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.283232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.283244] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.286374] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4590 [D 20:42:57.286444] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 60/70. [D 20:42:57.289747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22420. [D 20:42:57.289773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22421. [D 20:42:57.289787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22422. [D 20:42:57.289802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22423. [D 20:42:57.289816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22424. [D 20:42:57.290316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22425. [D 20:42:57.290342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22426. [D 20:42:57.290357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22427. [D 20:42:57.290371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22428. [D 20:42:57.290386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22429. [D 20:42:57.290400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22430. [D 20:42:57.290414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22431. [D 20:42:57.290429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22432. [D 20:42:57.290443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22433. [D 20:42:57.290459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22434. [D 20:42:57.290473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22435. [D 20:42:57.290488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22436. [D 20:42:57.290502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22437. [D 20:42:57.290517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22438. [D 20:42:57.290532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22439. [D 20:42:57.290546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22440. [D 20:42:57.290561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22441. [D 20:42:57.290575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22442. [D 20:42:57.290590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22443. [D 20:42:57.290604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22444. [D 20:42:57.290619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22445. [D 20:42:57.290633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22446. [D 20:42:57.290648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22447. [D 20:42:57.290662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22448. [D 20:42:57.290677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22449. [D 20:42:57.290691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22450. [D 20:42:57.290706] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22451. [D 20:42:57.298638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.298661] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.298675] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.298717] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4594 [D 20:42:57.298732] element 0: offset: 0x2aaaab60a520, size: 24 [D 20:42:57.298750] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 0/70. [D 20:42:57.298791] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.298804] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.298817] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.298837] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4597 [D 20:42:57.298851] element 0: offset: 0x2aaaab60a820, size: 24 [D 20:42:57.298865] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 1/70. [D 20:42:57.301493] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22451. [D 20:42:57.301517] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 2/70. [D 20:42:57.301681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.301702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.301715] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.307964] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4594 [D 20:42:57.308044] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 3/70. [D 20:42:57.674313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.674336] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.674351] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.674366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22451. [D 20:42:57.674397] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4599 [D 20:42:57.674425] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:42:57.674251] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4597 [D 20:42:57.674432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22452. [D 20:42:57.674455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22453. [D 20:42:57.674477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22454. [D 20:42:57.674491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22455. [D 20:42:57.674506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22456. [D 20:42:57.674520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22457. [D 20:42:57.674535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22458. [D 20:42:57.674549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22459. [D 20:42:57.674563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22460. [D 20:42:57.674578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22461. [D 20:42:57.674592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22462. [D 20:42:57.674606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22463. [D 20:42:57.674621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22464. [D 20:42:57.674635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22465. [D 20:42:57.674650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22466. [D 20:42:57.674664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22467. [D 20:42:57.674679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22468. [D 20:42:57.674693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22469. [D 20:42:57.674707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22470. [D 20:42:57.674722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22471. [D 20:42:57.674736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22472. [D 20:42:57.674751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22473. [D 20:42:57.674765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22474. [D 20:42:57.674779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22475. [D 20:42:57.674794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22476. [D 20:42:57.674810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22477. [D 20:42:57.674824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22478. [D 20:42:57.674839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22479. [D 20:42:57.674853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22480. [D 20:42:57.674868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22481. [D 20:42:57.674882] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22482. [D 20:42:57.674923] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 4/70. [D 20:42:57.674966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.674981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.674993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:57.675016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4602 [D 20:42:57.675030] element 0: offset: 0x2aaaab025640, size: 24 [D 20:42:57.675045] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 5/70. [D 20:42:57.675077] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 6/70. [D 20:42:57.680307] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22482. [D 20:42:57.680390] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 7/70. [D 20:42:57.680409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 22482. [D 20:42:57.680425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 22483. [D 20:42:57.680439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 22484. [D 20:42:57.680453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 22485. [D 20:42:57.680468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 22486. [D 20:42:57.680482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 22487. [D 20:42:57.680497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22488. [D 20:42:57.680511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22489. [D 20:42:57.680525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22490. [D 20:42:57.680540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 22491. [D 20:42:57.680554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 22492. [D 20:42:57.680569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 22493. [D 20:42:57.680583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 22494. [D 20:42:57.680597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 22495. [D 20:42:57.680612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22496. [D 20:42:57.680626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22497. [D 20:42:57.680640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22498. [D 20:42:57.680655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 22499. [D 20:42:57.680669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 22500. [D 20:42:57.680684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 22501. [D 20:42:57.680698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 22502. [D 20:42:57.680716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 22503. [D 20:42:57.680730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22504. [D 20:42:57.680744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22505. [D 20:42:57.680759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22506. [D 20:42:57.680773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 22507. [D 20:42:57.680788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 22508. [D 20:42:57.680802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 22509. [D 20:42:57.680832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 22510. [D 20:42:57.680847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 22511. [D 20:42:57.680865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22512. [D 20:42:57.680880] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22513. [D 20:42:57.680975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.680997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.681011] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:57.686357] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22513. [D 20:42:57.686438] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 8/70. [D 20:42:57.686520] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.686544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.686557] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.695092] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4599 [D 20:42:57.695122] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 9/70. [D 20:42:57.695143] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4602 [D 20:42:57.695159] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 10/70. [D 20:42:57.695340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22513. [D 20:42:57.695421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22514. [D 20:42:57.695437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22515. [D 20:42:57.695451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22516. [D 20:42:57.695465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22517. [D 20:42:57.695480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22518. [D 20:42:57.695494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22519. [D 20:42:57.695509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22520. [D 20:42:57.695524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22521. [D 20:42:57.695538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22522. [D 20:42:57.695552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22523. [D 20:42:57.695567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22524. [D 20:42:57.695582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22525. [D 20:42:57.695595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22526. [D 20:42:57.695610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22527. [D 20:42:57.695624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22528. [D 20:42:57.695638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22529. [D 20:42:57.695653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22530. [D 20:42:57.695668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22531. [D 20:42:57.695682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22532. [D 20:42:57.695696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22533. [D 20:42:57.695711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22534. [D 20:42:57.695725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22535. [D 20:42:57.695739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22536. [D 20:42:57.695754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22537. [D 20:42:57.695768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22538. [D 20:42:57.695782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22539. [D 20:42:57.695797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22540. [D 20:42:57.695811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22541. [D 20:42:57.695826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22542. [D 20:42:57.695840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22543. [D 20:42:57.695854] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22544. [D 20:42:57.695888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22545. [D 20:42:57.695902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22546. [D 20:42:57.695917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22547. [D 20:42:57.695932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22548. [D 20:42:57.695948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22549. [D 20:42:57.695962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22550. [D 20:42:57.695977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22551. [D 20:42:57.695991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22552. [D 20:42:57.696005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22553. [D 20:42:57.696020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22554. [D 20:42:57.696034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22555. [D 20:42:57.696049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22556. [D 20:42:57.696063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22557. [D 20:42:57.696077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22558. [D 20:42:57.696092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22559. [D 20:42:57.696106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22560. [D 20:42:57.696120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22561. [D 20:42:57.696135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22562. [D 20:42:57.696149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22563. [D 20:42:57.696164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22564. [D 20:42:57.696178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22565. [D 20:42:57.696192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22566. [D 20:42:57.696207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22567. [D 20:42:57.696221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22568. [D 20:42:57.696235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22569. [D 20:42:57.696250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22570. [D 20:42:57.696264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22571. [D 20:42:57.696279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22572. [D 20:42:57.696293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22573. [D 20:42:57.696307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22574. [D 20:42:57.696322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22575. [D 20:42:57.696336] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22576. [D 20:42:57.696394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.696415] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.696429] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.696457] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4606 [D 20:42:57.696472] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:42:57.696487] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 11/70. [D 20:42:57.696515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.696530] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.696542] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:57.696563] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4609 [D 20:42:57.696577] element 0: offset: 0x2aaaab014c20, size: 24 [D 20:42:57.696591] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 12/70. [D 20:42:57.704386] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22576. [D 20:42:57.704415] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 13/70. [D 20:42:57.712964] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22575. [D 20:42:57.712986] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 14/70. [D 20:42:57.713051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.713072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.713085] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:57.713177] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.713192] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.713205] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.721787] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4606 [D 20:42:57.721862] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 15/70. [D 20:42:57.721941] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4609 [D 20:42:57.721959] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 16/70. [D 20:42:57.723420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22575. [D 20:42:57.723442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22576. [D 20:42:57.723457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22577. [D 20:42:57.723471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22578. [D 20:42:57.723486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22579. [D 20:42:57.723500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22580. [D 20:42:57.723515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22581. [D 20:42:57.723530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22582. [D 20:42:57.723544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22583. [D 20:42:57.723559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22584. [D 20:42:57.723574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22585. [D 20:42:57.723588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22586. [D 20:42:57.723603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22587. [D 20:42:57.723617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22588. [D 20:42:57.723632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22589. [D 20:42:57.723647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22590. [D 20:42:57.723661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22591. [D 20:42:57.723676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22592. [D 20:42:57.723691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22593. [D 20:42:57.723705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22594. [D 20:42:57.723720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22595. [D 20:42:57.723734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22596. [D 20:42:57.723749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22597. [D 20:42:57.723763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22598. [D 20:42:57.723777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22599. [D 20:42:57.723792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22600. [D 20:42:57.723806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22601. [D 20:42:57.723821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22602. [D 20:42:57.723835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22603. [D 20:42:57.723849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22604. [D 20:42:57.723868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22605. [D 20:42:57.723883] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22606. [D 20:42:57.723899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 22607. [D 20:42:57.723914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 22608. [D 20:42:57.723929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 22609. [D 20:42:57.723943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 22610. [D 20:42:57.723958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 22611. [D 20:42:57.723972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 22612. [D 20:42:57.723987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22613. [D 20:42:57.724001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22614. [D 20:42:57.724015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22615. [D 20:42:57.724030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 22616. [D 20:42:57.724044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 22617. [D 20:42:57.724059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 22618. [D 20:42:57.724075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 22619. [D 20:42:57.724089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 22620. [D 20:42:57.724104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22621. [D 20:42:57.724118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22622. [D 20:42:57.724132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22623. [D 20:42:57.724147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 22624. [D 20:42:57.724161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 22625. [D 20:42:57.724176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 22626. [D 20:42:57.724190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 22627. [D 20:42:57.724205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 22628. [D 20:42:57.724219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22629. [D 20:42:57.724234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22630. [D 20:42:57.724248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22631. [D 20:42:57.724263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 22632. [D 20:42:57.724277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 22633. [D 20:42:57.724291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 22634. [D 20:42:57.724306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 22635. [D 20:42:57.724320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 22636. [D 20:42:57.724335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22637. [D 20:42:57.724349] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22638. [D 20:42:57.726107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.726130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.726143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.726186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4612 [D 20:42:57.726201] element 0: offset: 0x2aaaab030ff0, size: 24 [D 20:42:57.726217] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 17/70. [D 20:42:57.726257] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.726271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.726284] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:57.726304] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4614 [D 20:42:57.726319] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:42:57.726333] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 18/70. [D 20:42:57.729312] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22638. [D 20:42:57.729338] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 19/70. [D 20:42:57.739088] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22637. [D 20:42:57.739114] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 20/70. [D 20:42:57.739214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.739270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.739284] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:57.739426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.739441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.739454] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.745439] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4614 [D 20:42:57.745519] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 21/70. [D 20:42:57.745685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22637. [D 20:42:57.745706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22638. [D 20:42:57.745721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22639. [D 20:42:57.745735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22640. [D 20:42:57.745749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22641. [D 20:42:57.745764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22642. [D 20:42:57.745778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22643. [D 20:42:57.745792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22644. [D 20:42:57.745806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22645. [D 20:42:57.745821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22646. [D 20:42:57.745835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22647. [D 20:42:57.745849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22648. [D 20:42:57.745864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22649. [D 20:42:57.745878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22650. [D 20:42:57.745892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22651. [D 20:42:57.745907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22652. [D 20:42:57.745921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22653. [D 20:42:57.745935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22654. [D 20:42:57.745950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22655. [D 20:42:57.745964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22656. [D 20:42:57.745978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22657. [D 20:42:57.745993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22658. [D 20:42:57.746007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22659. [D 20:42:57.746021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22660. [D 20:42:57.746037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22661. [D 20:42:57.746052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22662. [D 20:42:57.746066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22663. [D 20:42:57.746081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22664. [D 20:42:57.746096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22665. [D 20:42:57.746110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22666. [D 20:42:57.746125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22667. [D 20:42:57.746139] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22668. [D 20:42:57.748262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.748317] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.748332] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.748378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4617 [D 20:42:57.748393] element 0: offset: 0x2aaaab030fd0, size: 24 [D 20:42:57.748413] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 22/70. [D 20:42:57.754499] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4612 [D 20:42:57.754526] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 23/70. [D 20:42:57.754832] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22668. [D 20:42:57.754854] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 24/70. [D 20:42:57.754887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22668. [D 20:42:57.754903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22669. [D 20:42:57.754918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 22670. [D 20:42:57.754933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 22671. [D 20:42:57.754948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 22672. [D 20:42:57.754962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 22673. [D 20:42:57.754977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 22674. [D 20:42:57.754991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22675. [D 20:42:57.755006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22676. [D 20:42:57.755020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22677. [D 20:42:57.755035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 22678. [D 20:42:57.755049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 22679. [D 20:42:57.755063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 22680. [D 20:42:57.755078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 22681. [D 20:42:57.755092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 22682. [D 20:42:57.755108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22683. [D 20:42:57.755123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22684. [D 20:42:57.755137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22685. [D 20:42:57.755152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22686. [D 20:42:57.755166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22687. [D 20:42:57.755180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22688. [D 20:42:57.755195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22689. [D 20:42:57.755209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22690. [D 20:42:57.755223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22691. [D 20:42:57.755237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22692. [D 20:42:57.755257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22693. [D 20:42:57.755272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22694. [D 20:42:57.755286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22695. [D 20:42:57.755301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22696. [D 20:42:57.755315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22697. [D 20:42:57.755329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22698. [D 20:42:57.755344] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22699. [D 20:42:57.755413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.755476] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.755490] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.759440] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4617 [D 20:42:57.759465] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 25/70. [D 20:42:57.766680] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22699. [D 20:42:57.766742] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 26/70. [D 20:42:57.766762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22699. [D 20:42:57.766779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22700. [D 20:42:57.766793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22701. [D 20:42:57.766808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22702. [D 20:42:57.766823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22703. [D 20:42:57.766837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22704. [D 20:42:57.766852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22705. [D 20:42:57.766866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22706. [D 20:42:57.766883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22707. [D 20:42:57.766897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22708. [D 20:42:57.766911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22709. [D 20:42:57.766926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22710. [D 20:42:57.766940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22711. [D 20:42:57.766955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22712. [D 20:42:57.766969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22713. [D 20:42:57.766984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22714. [D 20:42:57.766998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22715. [D 20:42:57.767012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22716. [D 20:42:57.767027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22717. [D 20:42:57.767041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22718. [D 20:42:57.767055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22719. [D 20:42:57.767070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22720. [D 20:42:57.767084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22721. [D 20:42:57.767099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22722. [D 20:42:57.767112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22723. [D 20:42:57.767127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22724. [D 20:42:57.767141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22725. [D 20:42:57.767155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22726. [D 20:42:57.767170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22727. [D 20:42:57.767184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22728. [D 20:42:57.767199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22729. [D 20:42:57.767213] openib_post_sr_rdmaw: ibv_post_send wr_id 633eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22730. [D 20:42:57.770183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.770200] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.770213] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:57.770255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4620 [D 20:42:57.770270] element 0: offset: 0x2aaaab02a010, size: 24 [D 20:42:57.770287] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 27/70. [D 20:42:57.770327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.770341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.770355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:57.776419] openib_check_cq: completed rdma wr_id 633eb0, nic_wr_credit 22730. [D 20:42:57.776467] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 28/70. [D 20:42:57.776589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.776610] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.776622] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.779555] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4620 [D 20:42:57.779584] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 29/70. [D 20:42:57.789015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22730. [D 20:42:57.789038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22731. [D 20:42:57.789054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22732. [D 20:42:57.789068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22733. [D 20:42:57.789082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22734. [D 20:42:57.789097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22735. [D 20:42:57.789111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22736. [D 20:42:57.789135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22737. [D 20:42:57.789150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22738. [D 20:42:57.789173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22739. [D 20:42:57.789188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22740. [D 20:42:57.789202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22741. [D 20:42:57.789225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22742. [D 20:42:57.789251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22743. [D 20:42:57.789266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22744. [D 20:42:57.789290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22745. [D 20:42:57.789304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22746. [D 20:42:57.789326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22747. [D 20:42:57.789342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22748. [D 20:42:57.789356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22749. [D 20:42:57.789371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22750. [D 20:42:57.789401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22751. [D 20:42:57.789425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22752. [D 20:42:57.789439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22753. [D 20:42:57.789462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22754. [D 20:42:57.789477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22755. [D 20:42:57.789492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22756. [D 20:42:57.789522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22757. [D 20:42:57.789546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22758. [D 20:42:57.789561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22759. [D 20:42:57.789575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22760. [D 20:42:57.789590] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22761. [D 20:42:57.791886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.791935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.791949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.791992] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4623 [D 20:42:57.792008] element 0: offset: 0x658610, size: 24 [D 20:42:57.792028] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 30/70. [D 20:42:57.800761] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22761. [D 20:42:57.800788] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 31/70. [D 20:42:57.800902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.800923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.800936] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.803990] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4623 [D 20:42:57.804016] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 32/70. [D 20:42:57.806617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22761. [D 20:42:57.806637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22762. [D 20:42:57.806652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 22763. [D 20:42:57.806666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 22764. [D 20:42:57.806681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 22765. [D 20:42:57.807028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 22766. [D 20:42:57.807058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 22767. [D 20:42:57.807080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22768. [D 20:42:57.807095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22769. [D 20:42:57.807123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22770. [D 20:42:57.807147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 22771. [D 20:42:57.807161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 22772. [D 20:42:57.807175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 22773. [D 20:42:57.807190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 22774. [D 20:42:57.807204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 22775. [D 20:42:57.807220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22776. [D 20:42:57.807234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22777. [D 20:42:57.807248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22778. [D 20:42:57.807262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 22779. [D 20:42:57.807277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 22780. [D 20:42:57.807291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 22781. [D 20:42:57.807306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 22782. [D 20:42:57.807320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 22783. [D 20:42:57.807334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22784. [D 20:42:57.807349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22785. [D 20:42:57.807363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22786. [D 20:42:57.807377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 22787. [D 20:42:57.807392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 22788. [D 20:42:57.807406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 22789. [D 20:42:57.807420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 22790. [D 20:42:57.807435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 22791. [D 20:42:57.807449] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22792. [D 20:42:57.809289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.809339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.809353] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.809396] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4626 [D 20:42:57.809411] element 0: offset: 0x61f590, size: 24 [D 20:42:57.809431] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 33/70. [D 20:42:57.818345] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22792. [D 20:42:57.818370] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 34/70. [D 20:42:57.818512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.818532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.818546] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.821898] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4626 [D 20:42:57.821921] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 35/70. [D 20:42:57.825194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22792. [D 20:42:57.825214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22793. [D 20:42:57.825228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22794. [D 20:42:57.825243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22795. [D 20:42:57.825257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22796. [D 20:42:57.825272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22797. [D 20:42:57.825287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22798. [D 20:42:57.825302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22799. [D 20:42:57.825316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22800. [D 20:42:57.825343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22801. [D 20:42:57.825358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22802. [D 20:42:57.825446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22803. [D 20:42:57.825651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22804. [D 20:42:57.825874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22805. [D 20:42:57.825892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22806. [D 20:42:57.825907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22807. [D 20:42:57.825921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22808. [D 20:42:57.825936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22809. [D 20:42:57.825950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22810. [D 20:42:57.825965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22811. [D 20:42:57.825979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22812. [D 20:42:57.825994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22813. [D 20:42:57.826008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22814. [D 20:42:57.826023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22815. [D 20:42:57.826037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22816. [D 20:42:57.826052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22817. [D 20:42:57.826066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22818. [D 20:42:57.826081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22819. [D 20:42:57.826095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22820. [D 20:42:57.826110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22821. [D 20:42:57.826125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22822. [D 20:42:57.826139] openib_post_sr_rdmaw: ibv_post_send wr_id 635220 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22823. [D 20:42:57.827971] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.828033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.828047] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.828095] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4629 [D 20:42:57.828110] element 0: offset: 0x658610, size: 24 [D 20:42:57.828130] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 36/70. [D 20:42:57.836902] openib_check_cq: completed rdma wr_id 635220, nic_wr_credit 22823. [D 20:42:57.836928] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 37/70. [D 20:42:57.837053] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.837075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.837088] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.840090] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4629 [D 20:42:57.840114] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 38/70. [D 20:42:57.843073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22823. [D 20:42:57.843093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22824. [D 20:42:57.843107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 22825. [D 20:42:57.843122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 22826. [D 20:42:57.843136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 22827. [D 20:42:57.843151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 22828. [D 20:42:57.843165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 22829. [D 20:42:57.843180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22830. [D 20:42:57.843194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22831. [D 20:42:57.843221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22832. [D 20:42:57.843236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 22833. [D 20:42:57.843497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 22834. [D 20:42:57.843654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 22835. [D 20:42:57.843741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 22836. [D 20:42:57.843755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 22837. [D 20:42:57.843770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22838. [D 20:42:57.843784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22839. [D 20:42:57.843799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22840. [D 20:42:57.843818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 22841. [D 20:42:57.843833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 22842. [D 20:42:57.843847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 22843. [D 20:42:57.843865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 22844. [D 20:42:57.843880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 22845. [D 20:42:57.843894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22846. [D 20:42:57.843909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22847. [D 20:42:57.843924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22848. [D 20:42:57.843939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 22849. [D 20:42:57.843953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 22850. [D 20:42:57.843968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 22851. [D 20:42:57.843982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 22852. [D 20:42:57.843997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 22853. [D 20:42:57.844011] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22854. [D 20:42:57.845832] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:57.845892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.845906] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:57.845951] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4632 [D 20:42:57.845966] element 0: offset: 0x61f590, size: 24 [D 20:42:57.845985] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 39/70. [D 20:42:57.854768] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22854. [D 20:42:57.854793] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 40/70. [D 20:42:57.854913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:57.854934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:57.854947] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:57.858114] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4632 [D 20:42:57.858137] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 41/70. [D 20:42:57.865886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22854. [D 20:42:57.865903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22855. [D 20:42:57.865918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22856. [D 20:42:57.865933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22857. [D 20:42:57.865947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22858. [D 20:42:57.865975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22859. [D 20:42:57.865990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22860. [D 20:42:57.866013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22861. [D 20:42:57.866029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22862. [D 20:42:57.866056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22863. [D 20:42:57.866070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22864. [D 20:42:57.866097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22865. [D 20:42:57.866125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22866. [D 20:42:57.866141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22867. [D 20:42:58.154569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22868. [D 20:42:58.154623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22869. [D 20:42:58.154639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22870. [D 20:42:58.154659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22871. [D 20:42:58.154674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22872. [D 20:42:58.154688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22873. [D 20:42:58.154703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22874. [D 20:42:58.154718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22875. [D 20:42:58.154732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22876. [D 20:42:58.154747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22877. [D 20:42:58.154763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22878. [D 20:42:58.154777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22879. [D 20:42:58.154792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22880. [D 20:42:58.154806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22881. [D 20:42:58.154820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22882. [D 20:42:58.154834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22883. [D 20:42:58.154849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22884. [D 20:42:58.154875] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22885. [D 20:42:58.154977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.155025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.155039] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:58.155085] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4635 [D 20:42:58.155101] element 0: offset: 0x658610, size: 24 [D 20:42:58.155120] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 42/70. [D 20:42:58.155159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.155173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.155185] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.155206] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4639 [D 20:42:58.155220] element 0: offset: 0x633f40, size: 24 [D 20:42:58.155234] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 43/70. [D 20:42:58.155262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.155276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.155288] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.155308] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4641 [D 20:42:58.155322] element 0: offset: 0x62ff00, size: 24 [D 20:42:58.155337] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 44/70. [D 20:42:58.158034] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 22885. [D 20:42:58.158060] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 45/70. [D 20:42:58.158867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.158911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.158925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.169508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.169586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.169600] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.169651] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4644 [D 20:42:58.169666] element 0: offset: 0x646ef0, size: 24 [D 20:42:58.169685] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 46/70. [D 20:42:58.176591] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4644 [D 20:42:58.176674] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 47/70. [D 20:42:58.176702] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4641 [D 20:42:58.176718] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 48/70. [D 20:42:58.176733] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4639 [D 20:42:58.176748] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 49/70. [D 20:42:58.176828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 22885. [D 20:42:58.176847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 22886. [D 20:42:58.176862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 22887. [D 20:42:58.176876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 22888. [D 20:42:58.176890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 22889. [D 20:42:58.176905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 22890. [D 20:42:58.176920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 22891. [D 20:42:58.176934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 22892. [D 20:42:58.176949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 22893. [D 20:42:58.176963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 22894. [D 20:42:58.176978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 22895. [D 20:42:58.176992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 22896. [D 20:42:58.177007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 22897. [D 20:42:58.177021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 22898. [D 20:42:58.177036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 22899. [D 20:42:58.177063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 22900. [D 20:42:58.177078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 22901. [D 20:42:58.177093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 22902. [D 20:42:58.177107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 22903. [D 20:42:58.177132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 22904. [D 20:42:58.177147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 22905. [D 20:42:58.177162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 22906. [D 20:42:58.177176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 22907. [D 20:42:58.177191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 22908. [D 20:42:58.177205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 22909. [D 20:42:58.177220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 22910. [D 20:42:58.177234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 22911. [D 20:42:58.177249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 22912. [D 20:42:58.177263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 22913. [D 20:42:58.177278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 22914. [D 20:42:58.177293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 22915. [D 20:42:58.177307] openib_post_sr_rdmaw: ibv_post_send wr_id 6444f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 22916. [D 20:42:58.177326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 22917. [D 20:42:58.177351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 22918. [D 20:42:58.177374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 22919. [D 20:42:58.177389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 22920. [D 20:42:58.177403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 22921. [D 20:42:58.177418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 22922. [D 20:42:58.177432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 22923. [D 20:42:58.177447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 22924. [D 20:42:58.177462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 22925. [D 20:42:58.177476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 22926. [D 20:42:58.177500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 22927. [D 20:42:58.177515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 22928. [D 20:42:58.177529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 22929. [D 20:42:58.177544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 22930. [D 20:42:58.177558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 22931. [D 20:42:58.177573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 22932. [D 20:42:58.177588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 22933. [D 20:42:58.177603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 22934. [D 20:42:58.177618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 22935. [D 20:42:58.177632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 22936. [D 20:42:58.177647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 22937. [D 20:42:58.177661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 22938. [D 20:42:58.177676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 22939. [D 20:42:58.177690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 22940. [D 20:42:58.177705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 22941. [D 20:42:58.177719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 22942. [D 20:42:58.177734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 22943. [D 20:42:58.177748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 22944. [D 20:42:58.177763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 22945. [D 20:42:58.177777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 22946. [D 20:42:58.177792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 22947. [D 20:42:58.177806] openib_post_sr_rdmaw: ibv_post_send wr_id 6443a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 22948. [D 20:42:58.177822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22949. [D 20:42:58.177837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 22950. [D 20:42:58.177852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 22951. [D 20:42:58.177866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 22952. [D 20:42:58.177881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 22953. [D 20:42:58.177895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 22954. [D 20:42:58.177910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22955. [E 20:42:58.177929] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 22956, block for 10 ms. [D 20:42:58.181305] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4635 [D 20:42:58.183031] openib_check_cq: completed rdma wr_id 6444f0, nic_wr_credit 22955. [D 20:42:58.183058] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 50/70. [D 20:42:58.183073] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22954. [D 20:42:58.183089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22955. [D 20:42:58.183120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22956. [D 20:42:58.183134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 22957. [D 20:42:58.183149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 22958. [D 20:42:58.183163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 22959. [D 20:42:58.183177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 22960. [D 20:42:58.183191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 22961. [D 20:42:58.183206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22962. [D 20:42:58.183220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22963. [D 20:42:58.183234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22964. [D 20:42:58.183248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22965. [D 20:42:58.183263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22966. [D 20:42:58.183277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22967. [D 20:42:58.183291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22968. [D 20:42:58.183305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22969. [D 20:42:58.183320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22970. [D 20:42:58.183334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22971. [D 20:42:58.183348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22972. [D 20:42:58.183362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22973. [D 20:42:58.183377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22974. [D 20:42:58.183391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22975. [D 20:42:58.183405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22976. [D 20:42:58.183419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22977. [D 20:42:58.183434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22978. [D 20:42:58.183448] openib_post_sr_rdmaw: ibv_post_send wr_id 643cc0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22979. [D 20:42:58.183482] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 51/70. [D 20:42:58.188870] openib_check_cq: completed rdma wr_id 6443a0, nic_wr_credit 22979. [D 20:42:58.188896] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 52/70. [D 20:42:58.190004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.190026] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.190039] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.194716] openib_check_cq: completed rdma wr_id 643cc0, nic_wr_credit 22978. [D 20:42:58.194736] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 53/70. [D 20:42:58.194776] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.194794] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.194807] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.194837] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.194851] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.194864] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:58.195646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22978. [D 20:42:58.195666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22979. [D 20:42:58.195681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 22980. [D 20:42:58.195696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 22981. [D 20:42:58.195711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 22982. [D 20:42:58.195725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 22983. [D 20:42:58.195739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 22984. [D 20:42:58.195754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22985. [D 20:42:58.195768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22986. [D 20:42:58.195782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22987. [D 20:42:58.195797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 22988. [D 20:42:58.195812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 22989. [D 20:42:58.195826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 22990. [D 20:42:58.195840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 22991. [D 20:42:58.195855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 22992. [D 20:42:58.195873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22993. [D 20:42:58.195888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22994. [D 20:42:58.195903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22995. [D 20:42:58.195917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 22996. [D 20:42:58.195931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 22997. [D 20:42:58.195946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 22998. [D 20:42:58.195961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 22999. [D 20:42:58.195975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23000. [D 20:42:58.195989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23001. [D 20:42:58.196004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23002. [D 20:42:58.196018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23003. [D 20:42:58.196033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23004. [D 20:42:58.196047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23005. [D 20:42:58.196063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23006. [D 20:42:58.196077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23007. [D 20:42:58.196092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23008. [D 20:42:58.196106] openib_post_sr_rdmaw: ibv_post_send wr_id 6438e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23009. [D 20:42:58.201564] openib_check_cq: completed rdma wr_id 6438e0, nic_wr_credit 23009. [D 20:42:58.201580] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 54/70. [D 20:42:58.201634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.201654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.201667] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:58.212071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.212088] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.212101] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:58.212139] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4649 [D 20:42:58.212154] element 0: offset: 0x61e710, size: 24 [D 20:42:58.212170] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 55/70. [D 20:42:58.214704] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.214765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.214779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:58.214821] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4653 [D 20:42:58.214836] element 0: offset: 0x691fe0, size: 24 [D 20:42:58.214854] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 56/70. [D 20:42:58.214898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.214913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.214926] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.214946] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4654 [D 20:42:58.214960] element 0: offset: 0x5b0030, size: 24 [D 20:42:58.214975] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 57/70. [D 20:42:58.215674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.215698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.215711] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.215735] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4656 [D 20:42:58.215750] element 0: offset: 0x62ff40, size: 24 [D 20:42:58.215766] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 58/70. [D 20:42:58.215802] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4649 [D 20:42:58.215824] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 59/70. [D 20:42:58.215976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23009. [D 20:42:58.216002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23010. [D 20:42:58.216018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 23011. [D 20:42:58.216032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 23012. [D 20:42:58.216047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 23013. [D 20:42:58.216061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 23014. [D 20:42:58.216076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 23015. [D 20:42:58.216090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23016. [D 20:42:58.216106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23017. [D 20:42:58.216121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23018. [D 20:42:58.216135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 23019. [D 20:42:58.216150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 23020. [D 20:42:58.216165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 23021. [D 20:42:58.216179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 23022. [D 20:42:58.216194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 23023. [D 20:42:58.216208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23024. [D 20:42:58.216223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23025. [D 20:42:58.216238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23026. [D 20:42:58.216252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 23027. [D 20:42:58.216267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 23028. [D 20:42:58.216282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 23029. [D 20:42:58.216296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 23030. [D 20:42:58.216311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 23031. [D 20:42:58.216325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23032. [D 20:42:58.216340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23033. [D 20:42:58.216354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23034. [D 20:42:58.216369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 23035. [D 20:42:58.216384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 23036. [D 20:42:58.216398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 23037. [D 20:42:58.216413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 23038. [D 20:42:58.216427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 23039. [D 20:42:58.216442] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23040. [D 20:42:58.223950] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4654 [D 20:42:58.223975] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 60/70. [D 20:42:58.224042] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4653 [D 20:42:58.224059] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 0/70. [D 20:42:58.225028] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4656 [D 20:42:58.225046] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 1/70. [D 20:42:58.226522] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 23040. [D 20:42:58.226544] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 2/70. [D 20:42:58.226561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23040. [D 20:42:58.226577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23041. [D 20:42:58.226592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23042. [D 20:42:58.226607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23043. [D 20:42:58.226621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23044. [D 20:42:58.226636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23045. [D 20:42:58.226651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23046. [D 20:42:58.226666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23047. [D 20:42:58.226680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23048. [D 20:42:58.226695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23049. [D 20:42:58.226710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23050. [D 20:42:58.226725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23051. [D 20:42:58.226740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23052. [D 20:42:58.226754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23053. [D 20:42:58.226769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23054. [D 20:42:58.226784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23055. [D 20:42:58.226798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23056. [D 20:42:58.226813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23057. [D 20:42:58.226828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23058. [D 20:42:58.226843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23059. [D 20:42:58.226858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23060. [D 20:42:58.226872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23061. [D 20:42:58.226887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23062. [D 20:42:58.226902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23063. [D 20:42:58.226916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23064. [D 20:42:58.226931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23065. [D 20:42:58.226946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23066. [D 20:42:58.226961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23067. [D 20:42:58.226975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23068. [D 20:42:58.226991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23069. [D 20:42:58.227005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23070. [D 20:42:58.227020] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23071. [D 20:42:58.227036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23072. [D 20:42:58.227051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 23073. [D 20:42:58.227066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 23074. [D 20:42:58.227080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 23075. [D 20:42:58.227094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 23076. [D 20:42:58.227109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 23077. [D 20:42:58.227123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23078. [D 20:42:58.227138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23079. [D 20:42:58.227152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23080. [D 20:42:58.227167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 23081. [D 20:42:58.227181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 23082. [D 20:42:58.227196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 23083. [D 20:42:58.227210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 23084. [D 20:42:58.227224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 23085. [D 20:42:58.227239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23086. [D 20:42:58.227253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23087. [D 20:42:58.227268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23088. [D 20:42:58.227282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23089. [D 20:42:58.227297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23090. [D 20:42:58.227311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23091. [D 20:42:58.227326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23092. [D 20:42:58.227341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23093. [D 20:42:58.227355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23094. [D 20:42:58.227369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23095. [D 20:42:58.227384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23096. [D 20:42:58.227398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23097. [D 20:42:58.227413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23098. [D 20:42:58.227428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23099. [D 20:42:58.227442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23100. [D 20:42:58.227457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23101. [D 20:42:58.227471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23102. [D 20:42:58.227486] openib_post_sr_rdmaw: ibv_post_send wr_id 643b70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23103. [D 20:42:58.227501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23104. [D 20:42:58.227516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23105. [D 20:42:58.227530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23106. [D 20:42:58.227545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23107. [D 20:42:58.227559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23108. [D 20:42:58.227574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23109. [E 20:42:58.227590] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 23110, block for 10 ms. [D 20:42:58.227620] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23109. [D 20:42:58.227636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23110. [E 20:42:58.227651] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 23111, block for 10 ms. [D 20:42:58.232475] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23110. [D 20:42:58.232504] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 3/70. [D 20:42:58.232519] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23109. [D 20:42:58.232542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23110. [D 20:42:58.232557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23111. [D 20:42:58.232579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23112. [D 20:42:58.232594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23113. [D 20:42:58.232622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23114. [D 20:42:58.232645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23115. [D 20:42:58.232660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23116. [D 20:42:58.232674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23117. [D 20:42:58.232697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23118. [D 20:42:58.232711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23119. [D 20:42:58.232737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23120. [D 20:42:58.232767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23121. [D 20:42:58.232782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23122. [D 20:42:58.232806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23123. [D 20:42:58.232821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23124. [D 20:42:58.232851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23125. [D 20:42:58.232867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23126. [D 20:42:58.232881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23127. [D 20:42:58.232910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23128. [D 20:42:58.232933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23129. [D 20:42:58.232948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23130. [D 20:42:58.232972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23131. [D 20:42:58.232987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23132. [D 20:42:58.233001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23133. [D 20:42:58.233016] openib_post_sr_rdmaw: ibv_post_send wr_id 633ca0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23134. [D 20:42:58.236218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.236276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.236290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.236321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.236334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.236346] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.236386] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4659 [D 20:42:58.236401] element 0: offset: 0x642620, size: 24 [D 20:42:58.236421] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 4/70. [D 20:42:58.244157] openib_check_cq: completed rdma wr_id 643b70, nic_wr_credit 23134. [D 20:42:58.244182] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 5/70. [D 20:42:58.246371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.246392] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.246405] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.255828] openib_check_cq: completed rdma wr_id 633ca0, nic_wr_credit 23133. [D 20:42:58.255849] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 6/70. [D 20:42:58.255904] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.255924] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.255937] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.256019] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.256034] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.256047] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:58.259142] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4659 [D 20:42:58.259164] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 7/70. [D 20:42:58.266895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23133. [D 20:42:58.266914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23134. [D 20:42:58.266929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 23135. [D 20:42:58.266943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 23136. [D 20:42:58.266958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 23137. [D 20:42:58.266972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 23138. [D 20:42:58.266986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 23139. [D 20:42:58.267000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23140. [D 20:42:58.267015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23141. [D 20:42:58.267029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23142. [D 20:42:58.267043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 23143. [D 20:42:58.267070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 23144. [D 20:42:58.267085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 23145. [D 20:42:58.267114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 23146. [D 20:42:58.267128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 23147. [D 20:42:58.267152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23148. [D 20:42:58.267167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23149. [D 20:42:58.267193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23150. [D 20:42:58.267221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 23151. [D 20:42:58.267236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 23152. [D 20:42:58.267250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 23153. [D 20:42:58.267278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 23154. [D 20:42:58.267294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 23155. [D 20:42:58.267319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23156. [D 20:42:58.267333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23157. [D 20:42:58.267358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23158. [D 20:42:58.267373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 23159. [D 20:42:58.267398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 23160. [D 20:42:58.267423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 23161. [D 20:42:58.267438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 23162. [D 20:42:58.267464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 23163. [D 20:42:58.267490] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23164. [D 20:42:58.269711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.269773] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.269787] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:58.269832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4663 [D 20:42:58.269847] element 0: offset: 0x658610, size: 24 [D 20:42:58.269867] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 8/70. [D 20:42:58.269912] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.269926] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.269938] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.269958] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4665 [D 20:42:58.269972] element 0: offset: 0x5b0030, size: 24 [D 20:42:58.269987] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 9/70. [D 20:42:58.278689] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23164. [D 20:42:58.278710] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 10/70. [D 20:42:58.278865] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.278886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.278899] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.283895] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4663 [D 20:42:58.283920] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 11/70. [D 20:42:58.284706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23164. [D 20:42:58.284725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23165. [D 20:42:58.284740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23166. [D 20:42:58.284754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23167. [D 20:42:58.284769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23168. [D 20:42:58.284783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23169. [D 20:42:58.284797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23170. [D 20:42:58.284812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23171. [D 20:42:58.284826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23172. [D 20:42:58.284841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23173. [D 20:42:58.284855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23174. [D 20:42:58.284870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23175. [D 20:42:58.284884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23176. [D 20:42:58.284899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23177. [D 20:42:58.284913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23178. [D 20:42:58.284928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23179. [D 20:42:58.285081] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4665 [D 20:42:58.583410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23180. [D 20:42:58.583437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23181. [D 20:42:58.583452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23182. [D 20:42:58.583467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23183. [D 20:42:58.583482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23184. [D 20:42:58.583496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23185. [D 20:42:58.583511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23186. [D 20:42:58.583525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23187. [D 20:42:58.583540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23188. [D 20:42:58.583554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23189. [D 20:42:58.583569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23190. [D 20:42:58.583583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23191. [D 20:42:58.583598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23192. [D 20:42:58.583613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23193. [D 20:42:58.583627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23194. [D 20:42:58.583642] openib_post_sr_rdmaw: ibv_post_send wr_id 633d60 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23195. [D 20:42:58.583671] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 12/70. [D 20:42:58.583745] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.583813] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.583827] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.583877] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4669 [D 20:42:58.583893] element 0: offset: 0x2aaaab629da0, size: 24 [D 20:42:58.583914] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 13/70. [D 20:42:58.583957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.583971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.583984] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.584005] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4671 [D 20:42:58.584019] element 0: offset: 0x2aaaab60a820, size: 24 [D 20:42:58.584033] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 14/70. [D 20:42:58.586523] openib_check_cq: completed rdma wr_id 633d60, nic_wr_credit 23195. [D 20:42:58.586549] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 15/70. [D 20:42:58.586586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23195. [D 20:42:58.586602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23196. [D 20:42:58.586617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23197. [D 20:42:58.586632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23198. [D 20:42:58.586647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23199. [D 20:42:58.586662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23200. [D 20:42:58.586677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23201. [D 20:42:58.586692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23202. [D 20:42:58.586712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23203. [D 20:42:58.586727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23204. [D 20:42:58.586741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23205. [D 20:42:58.586756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23206. [D 20:42:58.586771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23207. [D 20:42:58.586797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23208. [D 20:42:58.586812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23209. [D 20:42:58.586826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23210. [D 20:42:58.586841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23211. [D 20:42:58.586855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23212. [D 20:42:58.586870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23213. [D 20:42:58.586884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23214. [D 20:42:58.586899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23215. [D 20:42:58.586914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23216. [D 20:42:58.586928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23217. [D 20:42:58.586943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23218. [D 20:42:58.586957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23219. [D 20:42:58.586972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23220. [D 20:42:58.586986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23221. [D 20:42:58.587001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23222. [D 20:42:58.587016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23223. [D 20:42:58.587030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23224. [D 20:42:58.587045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23225. [D 20:42:58.587059] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23226. [D 20:42:58.586697] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.587970] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.587985] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.592920] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23226. [D 20:42:58.592944] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 16/70. [D 20:42:58.595906] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.595925] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.595939] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.595974] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4669 [D 20:42:58.595992] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 17/70. [D 20:42:58.596013] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4671 [D 20:42:58.596028] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 18/70. [D 20:42:58.598466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23226. [D 20:42:58.598482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23227. [D 20:42:58.598497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23228. [D 20:42:58.598512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23229. [D 20:42:58.598526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23230. [D 20:42:58.598541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23231. [D 20:42:58.598556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23232. [D 20:42:58.598570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23233. [D 20:42:58.598585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23234. [D 20:42:58.598599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23235. [D 20:42:58.598614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23236. [D 20:42:58.598628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23237. [D 20:42:58.598643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23238. [D 20:42:58.598657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23239. [D 20:42:58.598672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23240. [D 20:42:58.598687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23241. [D 20:42:58.598701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23242. [D 20:42:58.598716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23243. [D 20:42:58.598730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23244. [D 20:42:58.598745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23245. [D 20:42:58.598760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23246. [D 20:42:58.598774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23247. [D 20:42:58.598789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23248. [D 20:42:58.598803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23249. [D 20:42:58.598818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23250. [D 20:42:58.598832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23251. [D 20:42:58.598847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23252. [D 20:42:58.598873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23253. [D 20:42:58.598888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23254. [D 20:42:58.598903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23255. [D 20:42:58.598917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23256. [D 20:42:58.598932] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23257. [D 20:42:58.598948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23258. [D 20:42:58.598963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23259. [D 20:42:58.598978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23260. [D 20:42:58.598992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23261. [D 20:42:58.599007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23262. [D 20:42:58.599021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23263. [D 20:42:58.599036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23264. [D 20:42:58.599051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23265. [D 20:42:58.599065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23266. [D 20:42:58.599080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23267. [D 20:42:58.599094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23268. [D 20:42:58.599109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23269. [D 20:42:58.599123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23270. [D 20:42:58.599138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23271. [D 20:42:58.599153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23272. [D 20:42:58.599167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23273. [D 20:42:58.599181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23274. [D 20:42:58.599196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23275. [D 20:42:58.599210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23276. [D 20:42:58.599225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23277. [D 20:42:58.599241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23278. [D 20:42:58.599255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23279. [D 20:42:58.599270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23280. [D 20:42:58.599284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23281. [D 20:42:58.599299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23282. [D 20:42:58.599314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23283. [D 20:42:58.599328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23284. [D 20:42:58.599343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23285. [D 20:42:58.599357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23286. [D 20:42:58.599372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23287. [D 20:42:58.599386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23288. [D 20:42:58.599401] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23289. [D 20:42:58.603912] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.603972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.603986] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.604031] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4674 [D 20:42:58.604046] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:42:58.604067] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 19/70. [D 20:42:58.604378] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.604402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.604423] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.604449] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4677 [D 20:42:58.604463] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:42:58.604478] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 20/70. [D 20:42:58.604996] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23289. [D 20:42:58.605016] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 21/70. [D 20:42:58.616517] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23288. [D 20:42:58.616540] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 22/70. [D 20:42:58.619567] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.619582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.619595] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.619696] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.619711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.619724] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.623398] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4674 [D 20:42:58.623477] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 23/70. [D 20:42:58.626226] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4677 [D 20:42:58.626312] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 24/70. [D 20:42:58.627060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23288. [D 20:42:58.627127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23289. [D 20:42:58.627143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23290. [D 20:42:58.627158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23291. [D 20:42:58.627172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23292. [D 20:42:58.627186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23293. [D 20:42:58.627200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23294. [D 20:42:58.627215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23295. [D 20:42:58.627229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23296. [D 20:42:58.627243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23297. [D 20:42:58.627257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23298. [D 20:42:58.627271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23299. [D 20:42:58.627285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23300. [D 20:42:58.627299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23301. [D 20:42:58.627314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23302. [D 20:42:58.627328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23303. [D 20:42:58.627342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23304. [D 20:42:58.627356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23305. [D 20:42:58.627370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23306. [D 20:42:58.627384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23307. [D 20:42:58.627399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23308. [D 20:42:58.627413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23309. [D 20:42:58.627427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23310. [D 20:42:58.627441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23311. [D 20:42:58.627455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23312. [D 20:42:58.627470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23313. [D 20:42:58.627484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23314. [D 20:42:58.627498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23315. [D 20:42:58.627512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23316. [D 20:42:58.627526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23317. [D 20:42:58.627540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23318. [D 20:42:58.627556] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23319. [D 20:42:58.627575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23320. [D 20:42:58.627589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23321. [D 20:42:58.627603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23322. [D 20:42:58.627617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23323. [D 20:42:58.627632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23324. [D 20:42:58.627646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23325. [D 20:42:58.627660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23326. [D 20:42:58.627674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23327. [D 20:42:58.627688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23328. [D 20:42:58.627702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23329. [D 20:42:58.627716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23330. [D 20:42:58.627730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23331. [D 20:42:58.627744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23332. [D 20:42:58.627758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23333. [D 20:42:58.627772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23334. [D 20:42:58.627786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23335. [D 20:42:58.627801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23336. [D 20:42:58.627815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23337. [D 20:42:58.627829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23338. [D 20:42:58.627843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23339. [D 20:42:58.627857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23340. [D 20:42:58.627876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23341. [D 20:42:58.627891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23342. [D 20:42:58.627905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23343. [D 20:42:58.627919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23344. [D 20:42:58.627933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23345. [D 20:42:58.627947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23346. [D 20:42:58.627961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23347. [D 20:42:58.627976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23348. [D 20:42:58.627990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23349. [D 20:42:58.628004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23350. [D 20:42:58.628019] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23351. [D 20:42:58.631883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.631919] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.631935] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.632002] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4682 [D 20:42:58.632019] element 0: offset: 0x2aaaab60a250, size: 24 [D 20:42:58.632036] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 25/70. [D 20:42:58.632085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.632099] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.632112] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.632134] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4683 [D 20:42:58.632149] element 0: offset: 0x2aaaab62e3f0, size: 24 [D 20:42:58.632167] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 26/70. [D 20:42:58.633009] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23351. [D 20:42:58.633032] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 27/70. [D 20:42:58.643171] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23350. [D 20:42:58.643201] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 28/70. [D 20:42:58.643901] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.643917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.643930] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:58.644046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.644062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.644075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.646985] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4682 [D 20:42:58.647015] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 29/70. [D 20:42:58.648927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23350. [D 20:42:58.648945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23351. [D 20:42:58.648960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23352. [D 20:42:58.648975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23353. [D 20:42:58.648989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23354. [D 20:42:58.649004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23355. [D 20:42:58.649018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23356. [D 20:42:58.649032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23357. [D 20:42:58.649047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23358. [D 20:42:58.649061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23359. [D 20:42:58.649076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23360. [D 20:42:58.649092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23361. [D 20:42:58.649107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23362. [D 20:42:58.649122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23363. [D 20:42:58.649136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23364. [D 20:42:58.649151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23365. [D 20:42:58.649165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23366. [D 20:42:58.649180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23367. [D 20:42:58.649195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23368. [D 20:42:58.649210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23369. [D 20:42:58.649225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23370. [D 20:42:58.649239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23371. [D 20:42:58.649254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23372. [D 20:42:58.649268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23373. [D 20:42:58.649283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23374. [D 20:42:58.649298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23375. [D 20:42:58.649313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23376. [D 20:42:58.649327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23377. [D 20:42:58.649342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23378. [D 20:42:58.649356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23379. [D 20:42:58.649371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23380. [D 20:42:58.649386] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23381. [D 20:42:58.650588] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4683 [D 20:42:58.650671] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 30/70. [D 20:42:58.654832] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23381. [D 20:42:58.654853] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 31/70. [D 20:42:58.654869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23381. [D 20:42:58.654883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23382. [D 20:42:58.654898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23383. [D 20:42:58.654912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23384. [D 20:42:58.654928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23385. [D 20:42:58.654942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23386. [D 20:42:58.654958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23387. [D 20:42:58.654973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23388. [D 20:42:58.654987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23389. [D 20:42:58.655003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23390. [D 20:42:58.655017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23391. [D 20:42:58.655032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23392. [D 20:42:58.655047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23393. [D 20:42:58.655061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23394. [D 20:42:58.655076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23395. [D 20:42:58.655091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23396. [D 20:42:58.655105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23397. [D 20:42:58.655120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23398. [D 20:42:58.655135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23399. [D 20:42:58.655149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23400. [D 20:42:58.655164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23401. [D 20:42:58.655179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23402. [D 20:42:58.655193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23403. [D 20:42:58.655208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23404. [D 20:42:58.655223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23405. [D 20:42:58.655237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23406. [D 20:42:58.655252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23407. [D 20:42:58.655267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23408. [D 20:42:58.655282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23409. [D 20:42:58.655297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23410. [D 20:42:58.655311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23411. [D 20:42:58.655326] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23412. [D 20:42:58.659888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.659905] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.659919] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:58.659944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.659958] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.659973] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:58.660001] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4687 [D 20:42:58.660017] element 0: offset: 0x2aaaab60a820, size: 24 [D 20:42:58.660032] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 32/70. [D 20:42:58.660061] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.660076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.660089] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.660116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4689 [D 20:42:58.660132] element 0: offset: 0x2aaaab603ef0, size: 24 [D 20:42:58.660146] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 33/70. [D 20:42:58.660816] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23412. [D 20:42:58.660832] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 34/70. [D 20:42:58.663966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.663984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.663997] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.670960] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4687 [D 20:42:58.671039] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 35/70. [D 20:42:58.671048] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.671071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.671085] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.671109] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4692 [D 20:42:58.671124] element 0: offset: 0x2aaaab610240, size: 24 [D 20:42:58.671123] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4689 [D 20:42:58.671151] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 36/70. [D 20:42:58.671179] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 37/70. [D 20:42:58.671335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 23412. [D 20:42:58.671371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 23413. [D 20:42:58.671387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23414. [D 20:42:58.671401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23415. [D 20:42:58.671416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23416. [D 20:42:58.671430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23417. [D 20:42:58.671445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23418. [D 20:42:58.671459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23419. [D 20:42:58.671474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23420. [D 20:42:58.671488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23421. [D 20:42:58.671503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23422. [D 20:42:58.671517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23423. [D 20:42:58.671532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23424. [D 20:42:58.671546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23425. [D 20:42:58.671561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23426. [D 20:42:58.671577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23427. [D 20:42:58.671591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23428. [D 20:42:58.671606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23429. [D 20:42:58.671620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23430. [D 20:42:58.671635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23431. [D 20:42:58.671650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23432. [D 20:42:58.671664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23433. [D 20:42:58.671679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23434. [D 20:42:58.671693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23435. [D 20:42:58.671708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23436. [D 20:42:58.671722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23437. [D 20:42:58.671737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23438. [D 20:42:58.671752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23439. [D 20:42:58.671766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23440. [D 20:42:58.671781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23441. [D 20:42:58.671795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23442. [D 20:42:58.671810] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23443. [D 20:42:58.671828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23444. [D 20:42:58.671843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23445. [D 20:42:58.671857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23446. [D 20:42:58.671876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23447. [D 20:42:58.671891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23448. [D 20:42:58.671906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23449. [D 20:42:58.671920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23450. [D 20:42:58.671935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23451. [D 20:42:58.671949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23452. [D 20:42:58.671964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23453. [D 20:42:58.671978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23454. [D 20:42:58.671993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23455. [D 20:42:58.672008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23456. [D 20:42:58.672023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23457. [D 20:42:58.672037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23458. [D 20:42:58.672052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23459. [D 20:42:58.672066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23460. [D 20:42:58.672081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23461. [D 20:42:58.672095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23462. [D 20:42:58.672110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23463. [D 20:42:58.672124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23464. [D 20:42:58.672139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23465. [D 20:42:58.672154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23466. [D 20:42:58.672168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23467. [D 20:42:58.672182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23468. [D 20:42:58.672197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23469. [D 20:42:58.672211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23470. [D 20:42:58.672226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23471. [D 20:42:58.672240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23472. [D 20:42:58.672255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23473. [D 20:42:58.672269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23474. [D 20:42:58.672284] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23475. [D 20:42:58.675543] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4692 [D 20:42:58.675618] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 38/70. [D 20:42:58.683126] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23475. [D 20:42:58.683152] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 39/70. [D 20:42:58.694652] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23474. [D 20:42:58.694673] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 40/70. [D 20:42:58.694698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23474. [D 20:42:58.694714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23475. [D 20:42:58.694729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23476. [D 20:42:58.694743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23477. [D 20:42:58.694758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23478. [D 20:42:58.694773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23479. [D 20:42:58.694788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23480. [D 20:42:58.694802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23481. [D 20:42:58.694816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23482. [D 20:42:58.694830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23483. [D 20:42:58.694845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23484. [D 20:42:58.694859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23485. [D 20:42:58.694873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23486. [D 20:42:58.694888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23487. [D 20:42:58.694902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23488. [D 20:42:58.694916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23489. [D 20:42:58.694931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23490. [D 20:42:58.694945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23491. [D 20:42:58.694959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23492. [D 20:42:58.694974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23493. [D 20:42:58.694988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23494. [D 20:42:58.695002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23495. [D 20:42:58.695017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23496. [D 20:42:58.695031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23497. [D 20:42:58.695046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23498. [D 20:42:58.695060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23499. [D 20:42:58.695075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23500. [D 20:42:58.695089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23501. [D 20:42:58.695104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23502. [D 20:42:58.695118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23503. [D 20:42:58.695133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23504. [D 20:42:58.695148] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23505. [D 20:42:58.695881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.695897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.695910] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:58.695930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.695944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.695957] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:58.702174] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23505. [D 20:42:58.702196] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 41/70. [D 20:42:58.705242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:58.705257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.705271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:58.722853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.722872] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.722885] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:58.722908] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4697 [D 20:42:58.722923] element 0: offset: 0x2aaaab62e3f0, size: 24 [D 20:42:58.722937] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 42/70. [D 20:42:58.722958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.722972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.722985] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:58.723004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4701 [D 20:42:58.723023] element 0: offset: 0x2aaaab60a070, size: 24 [D 20:42:58.723039] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 43/70. [D 20:42:58.723059] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.723073] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.723086] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:58.723106] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4702 [D 20:42:58.723120] element 0: offset: 0x2aaaab60ccd0, size: 24 [D 20:42:58.723134] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 44/70. [D 20:42:58.723154] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:58.723168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:58.723181] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:58.723200] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4704 [D 20:42:58.723215] element 0: offset: 0x2aaaab60a820, size: 24 [D 20:42:58.723229] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 45/70. [D 20:42:58.731483] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4697 [D 20:42:58.731571] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 46/70. [D 20:42:58.731735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 23505. [D 20:42:58.731816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 23506. [D 20:42:58.731832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23507. [D 20:42:58.731846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23508. [D 20:42:58.731861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23509. [D 20:42:58.731888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23510. [D 20:42:58.731903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23511. [D 20:42:58.731918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23512. [D 20:42:58.731932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23513. [D 20:42:58.731947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23514. [D 20:42:58.731965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23515. [D 20:42:58.731980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23516. [D 20:42:58.731995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23517. [D 20:42:58.732010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23518. [D 20:42:58.732024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23519. [D 20:42:58.732038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23520. [D 20:42:58.732053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23521. [D 20:42:58.732067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23522. [D 20:42:58.732082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23523. [D 20:42:58.732096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23524. [D 20:42:58.732111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23525. [D 20:42:58.732125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23526. [D 20:42:58.732140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23527. [D 20:42:58.732154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23528. [D 20:42:58.732169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23529. [D 20:42:58.732183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23530. [D 20:42:58.732198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23531. [D 20:42:58.732212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23532. [D 20:42:58.732227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23533. [D 20:42:58.732241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23534. [D 20:42:58.732256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23535. [D 20:42:58.732270] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23536. [D 20:42:58.734974] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4704 [D 20:42:58.735048] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 47/70. [D 20:42:58.735329] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4701 [D 20:42:58.735353] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 48/70. [D 20:42:58.737548] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4702 [D 20:42:58.737567] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 49/70. [D 20:42:58.743583] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23536. [D 20:42:58.743646] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 50/70. [D 20:42:58.743667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23536. [D 20:42:58.743683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23537. [D 20:42:58.743699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23538. [D 20:42:58.743714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23539. [D 20:42:58.743728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23540. [D 20:42:58.743742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23541. [D 20:42:58.743757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23542. [D 20:42:58.743771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23543. [D 20:42:58.743786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23544. [D 20:42:58.743800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23545. [D 20:42:58.743815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23546. [D 20:42:58.743829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23547. [D 20:42:58.743844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23548. [D 20:42:58.743858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23549. [D 20:42:58.743877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23550. [D 20:42:58.743891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23551. [D 20:42:58.743906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23552. [D 20:42:58.743920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23553. [D 20:42:58.743935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23554. [D 20:42:58.743949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23555. [D 20:42:58.743964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23556. [D 20:42:58.743978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23557. [D 20:42:58.743993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23558. [D 20:42:58.744007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23559. [D 20:42:58.744022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23560. [D 20:42:58.744036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23561. [D 20:42:58.744051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23562. [D 20:42:58.744065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23563. [D 20:42:58.744080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23564. [D 20:42:58.744094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23565. [D 20:42:58.744109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23566. [D 20:42:58.744124] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23567. [D 20:42:58.744141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23568. [D 20:42:58.744155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23569. [D 20:42:58.744170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23570. [D 20:42:58.744185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23571. [D 20:42:58.744199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23572. [D 20:42:58.744213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23573. [D 20:42:58.744228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23574. [D 20:42:58.744242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23575. [D 20:42:58.744257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23576. [D 20:42:58.744271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23577. [D 20:42:58.744285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23578. [D 20:42:58.744300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23579. [D 20:42:58.744314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23580. [D 20:42:58.744328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23581. [D 20:42:58.744343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23582. [D 20:42:58.744357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23583. [D 20:42:58.744372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23584. [D 20:42:58.744386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23585. [D 20:42:58.744400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23586. [D 20:42:58.744415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23587. [D 20:42:58.744430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23588. [D 20:42:58.744444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23589. [D 20:42:58.744458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23590. [D 20:42:58.744473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23591. [D 20:42:58.744487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23592. [D 20:42:58.744501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23593. [D 20:42:58.744516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23594. [D 20:42:58.744530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23595. [D 20:42:59.021931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23596. [D 20:42:59.021963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23597. [D 20:42:59.021978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23598. [D 20:42:59.022015] openib_post_sr_rdmaw: ibv_post_send wr_id 63c7b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23599. [D 20:42:59.022033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23600. [D 20:42:59.022048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23601. [D 20:42:59.022062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23602. [D 20:42:59.022077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23603. [D 20:42:59.022091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23604. [D 20:42:59.022701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23605. [E 20:42:59.022723] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 23606, block for 10 ms. [D 20:42:59.022759] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23605. [D 20:42:59.022775] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 51/70. [D 20:42:59.022794] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23604. [D 20:42:59.022809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23605. [D 20:42:59.022824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23606. [D 20:42:59.022839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23607. [D 20:42:59.022853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23608. [D 20:42:59.022868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23609. [D 20:42:59.023491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23610. [D 20:42:59.023506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23611. [D 20:42:59.023520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23612. [D 20:42:59.023548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23613. [D 20:42:59.023563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23614. [D 20:42:59.023577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23615. [D 20:42:59.023591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23616. [D 20:42:59.023606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23617. [D 20:42:59.023620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23618. [D 20:42:59.023635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23619. [D 20:42:59.024134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23620. [D 20:42:59.024152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23621. [D 20:42:59.024182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23622. [D 20:42:59.024197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23623. [D 20:42:59.024211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23624. [D 20:42:59.024226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23625. [D 20:42:59.024240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23626. [D 20:42:59.024255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23627. [D 20:42:59.024269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23628. [D 20:42:59.024284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23629. [D 20:42:59.024298] openib_post_sr_rdmaw: ibv_post_send wr_id 635680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23630. [D 20:42:59.024314] openib_check_cq: completed rdma wr_id 63c7b0, nic_wr_credit 23630. [D 20:42:59.024329] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 52/70. [D 20:42:59.024413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.024430] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.024459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.025055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.025072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.025085] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.025154] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.025170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.025183] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.025225] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4707 [D 20:42:59.025241] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:42:59.025257] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 53/70. [D 20:42:59.028727] openib_check_cq: completed rdma wr_id 635680, nic_wr_credit 23629. [D 20:42:59.028748] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 54/70. [D 20:42:59.028791] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.028806] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.028819] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.034192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.034211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.034225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.037392] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4707 [D 20:42:59.037425] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 55/70. [D 20:42:59.040450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23629. [D 20:42:59.040512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23630. [D 20:42:59.040527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23631. [D 20:42:59.040542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23632. [D 20:42:59.040556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23633. [D 20:42:59.040571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23634. [D 20:42:59.040585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23635. [D 20:42:59.040600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23636. [D 20:42:59.040614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23637. [D 20:42:59.040628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23638. [D 20:42:59.040643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23639. [D 20:42:59.040657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23640. [D 20:42:59.040671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23641. [D 20:42:59.040685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23642. [D 20:42:59.040700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23643. [D 20:42:59.040714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23644. [D 20:42:59.040729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23645. [D 20:42:59.040743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23646. [D 20:42:59.040757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23647. [D 20:42:59.040772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23648. [D 20:42:59.040786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23649. [D 20:42:59.040801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23650. [D 20:42:59.040815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23651. [D 20:42:59.040829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23652. [D 20:42:59.040844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23653. [D 20:42:59.040858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23654. [D 20:42:59.040872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23655. [D 20:42:59.040887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23656. [D 20:42:59.040901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23657. [D 20:42:59.040915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23658. [D 20:42:59.040929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23659. [D 20:42:59.040944] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23660. [D 20:42:59.043942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.043964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.043977] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.044022] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4712 [D 20:42:59.044037] element 0: offset: 0x2aaaab62e5e0, size: 24 [D 20:42:59.044054] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 56/70. [D 20:42:59.044086] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.044100] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.044112] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.044134] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4715 [D 20:42:59.044148] element 0: offset: 0x2aaaab62e3f0, size: 24 [D 20:42:59.044161] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 57/70. [D 20:42:59.044183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.044196] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.044208] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.044228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4716 [D 20:42:59.044241] element 0: offset: 0x2aaaab60a820, size: 24 [D 20:42:59.044331] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 58/70. [D 20:42:59.046388] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23660. [D 20:42:59.046417] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 59/70. [D 20:42:59.046618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.046640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.046653] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.050224] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4715 [D 20:42:59.053450] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 60/70. [D 20:42:59.054156] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4716 [D 20:42:59.054182] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 0/70. [D 20:42:59.054199] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4712 [D 20:42:59.054214] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 1/70. [D 20:42:59.054246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23660. [D 20:42:59.054265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23661. [D 20:42:59.054279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23662. [D 20:42:59.054293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23663. [D 20:42:59.054313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23664. [D 20:42:59.054327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23665. [D 20:42:59.054341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23666. [D 20:42:59.054356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23667. [D 20:42:59.054370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23668. [D 20:42:59.054384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23669. [D 20:42:59.054398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23670. [D 20:42:59.054412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23671. [D 20:42:59.054426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23672. [D 20:42:59.054440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23673. [D 20:42:59.054455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23674. [D 20:42:59.054469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23675. [D 20:42:59.054482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23676. [D 20:42:59.054496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23677. [D 20:42:59.054510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23678. [D 20:42:59.054524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23679. [D 20:42:59.054538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23680. [D 20:42:59.054552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23681. [D 20:42:59.054566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23682. [D 20:42:59.054580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23683. [D 20:42:59.054594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23684. [D 20:42:59.054608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23685. [D 20:42:59.054622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23686. [D 20:42:59.054636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23687. [D 20:42:59.054650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23688. [D 20:42:59.054762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23689. [D 20:42:59.054865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23690. [D 20:42:59.054882] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23691. [D 20:42:59.054901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23692. [D 20:42:59.054915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23693. [D 20:42:59.054929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23694. [D 20:42:59.054943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23695. [D 20:42:59.054957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23696. [D 20:42:59.054971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23697. [D 20:42:59.054984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23698. [D 20:42:59.054998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23699. [D 20:42:59.055012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23700. [D 20:42:59.055026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23701. [D 20:42:59.055040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23702. [D 20:42:59.055055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23703. [D 20:42:59.055070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23704. [D 20:42:59.055084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23705. [D 20:42:59.055098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23706. [D 20:42:59.055112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23707. [D 20:42:59.055127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23708. [D 20:42:59.055141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23709. [D 20:42:59.055155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23710. [D 20:42:59.055169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23711. [D 20:42:59.055184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23712. [D 20:42:59.055198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23713. [D 20:42:59.055212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23714. [D 20:42:59.055226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23715. [D 20:42:59.055240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23716. [D 20:42:59.055255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23717. [D 20:42:59.055269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23718. [D 20:42:59.055283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23719. [D 20:42:59.055297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23720. [D 20:42:59.055311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23721. [D 20:42:59.055325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23722. [D 20:42:59.055340] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23723. [D 20:42:59.055355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23724. [D 20:42:59.055370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23725. [D 20:42:59.055384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23726. [D 20:42:59.055398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23727. [D 20:42:59.055412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23728. [D 20:42:59.055427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23729. [D 20:42:59.055441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23730. [E 20:42:59.055459] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 23731, block for 10 ms. [D 20:42:59.056179] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23730. [E 20:42:59.056200] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 23731, block for 10 ms. [D 20:42:59.065900] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23730. [D 20:42:59.065976] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 2/70. [D 20:42:59.065993] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23729. [D 20:42:59.066011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23730. [D 20:42:59.066026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23731. [D 20:42:59.066040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23732. [D 20:42:59.066055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23733. [D 20:42:59.066069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23734. [D 20:42:59.066083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23735. [D 20:42:59.066098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23736. [D 20:42:59.066112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23737. [D 20:42:59.066127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23738. [D 20:42:59.066141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23739. [D 20:42:59.066156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23740. [D 20:42:59.066170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23741. [D 20:42:59.066185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23742. [D 20:42:59.066199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23743. [D 20:42:59.066214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23744. [D 20:42:59.066228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23745. [D 20:42:59.066243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23746. [D 20:42:59.066257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23747. [D 20:42:59.066271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23748. [D 20:42:59.066286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23749. [D 20:42:59.066300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23750. [D 20:42:59.066318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23751. [D 20:42:59.066333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23752. [D 20:42:59.066347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23753. [D 20:42:59.066361] openib_post_sr_rdmaw: ibv_post_send wr_id 61e680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23754. [D 20:42:59.066426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.066450] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.066463] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.066503] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4719 [D 20:42:59.066518] element 0: offset: 0x2aaaab025720, size: 24 [D 20:42:59.066534] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 3/70. [D 20:42:59.077389] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23754. [D 20:42:59.077416] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 4/70. [D 20:42:59.079611] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.079632] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.079644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.087455] openib_check_cq: completed rdma wr_id 61e680, nic_wr_credit 23753. [D 20:42:59.087480] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 5/70. [D 20:42:59.087534] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.087553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.087566] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.087648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.087663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.087676] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.090732] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4719 [D 20:42:59.090792] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 6/70. [D 20:42:59.093214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23753. [D 20:42:59.093239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23754. [D 20:42:59.093254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23755. [D 20:42:59.093268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23756. [D 20:42:59.093283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23757. [D 20:42:59.093298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23758. [D 20:42:59.093821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23759. [D 20:42:59.093836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23760. [D 20:42:59.093850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23761. [D 20:42:59.093865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23762. [D 20:42:59.093879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23763. [D 20:42:59.093894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23764. [D 20:42:59.093908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23765. [D 20:42:59.093923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23766. [D 20:42:59.093938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23767. [D 20:42:59.093952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23768. [D 20:42:59.093967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23769. [D 20:42:59.093983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23770. [D 20:42:59.093997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23771. [D 20:42:59.094012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23772. [D 20:42:59.094027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23773. [D 20:42:59.094041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23774. [D 20:42:59.094056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23775. [D 20:42:59.094071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23776. [D 20:42:59.094085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23777. [D 20:42:59.094100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23778. [D 20:42:59.094127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23779. [D 20:42:59.094142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23780. [D 20:42:59.094157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23781. [D 20:42:59.094172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23782. [D 20:42:59.094186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23783. [D 20:42:59.094201] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23784. [D 20:42:59.101500] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.101524] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.101537] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.101579] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4723 [D 20:42:59.101594] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.101611] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 7/70. [D 20:42:59.101650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.101664] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.101677] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.101697] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4725 [D 20:42:59.101711] element 0: offset: 0x2aaaab027c60, size: 24 [D 20:42:59.101726] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 8/70. [D 20:42:59.105101] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23784. [D 20:42:59.105135] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 9/70. [D 20:42:59.105286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.105307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.105319] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.108827] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4725 [D 20:42:59.108889] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 10/70. [D 20:42:59.108922] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4723 [D 20:42:59.108940] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 11/70. [D 20:42:59.110535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23784. [D 20:42:59.110594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23785. [D 20:42:59.110611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 23786. [D 20:42:59.110635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 23787. [D 20:42:59.110651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 23788. [D 20:42:59.110674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 23789. [D 20:42:59.110689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 23790. [D 20:42:59.110703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23791. [D 20:42:59.110762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23792. [D 20:42:59.110778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23793. [D 20:42:59.110801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 23794. [D 20:42:59.110815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 23795. [D 20:42:59.110830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 23796. [D 20:42:59.110844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 23797. [D 20:42:59.110859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 23798. [D 20:42:59.110891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23799. [D 20:42:59.110917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23800. [D 20:42:59.110931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23801. [D 20:42:59.110955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23802. [D 20:42:59.110969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23803. [D 20:42:59.110984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23804. [D 20:42:59.111008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23805. [D 20:42:59.111023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23806. [D 20:42:59.111052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23807. [D 20:42:59.111067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23808. [D 20:42:59.111093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23809. [D 20:42:59.111115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23810. [D 20:42:59.111130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23811. [D 20:42:59.111144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23812. [D 20:42:59.111159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23813. [D 20:42:59.111174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23814. [D 20:42:59.111189] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23815. [D 20:42:59.111208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 23816. [D 20:42:59.111223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 23817. [D 20:42:59.111238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 23818. [D 20:42:59.111252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 23819. [D 20:42:59.111267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 23820. [D 20:42:59.111282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 23821. [D 20:42:59.111296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 23822. [D 20:42:59.111311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 23823. [D 20:42:59.111326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 23824. [D 20:42:59.111341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 23825. [D 20:42:59.111355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 23826. [D 20:42:59.111370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 23827. [D 20:42:59.111384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 23828. [D 20:42:59.111399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 23829. [D 20:42:59.111414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 23830. [D 20:42:59.111428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 23831. [D 20:42:59.111443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 23832. [D 20:42:59.111458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 23833. [D 20:42:59.111472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 23834. [D 20:42:59.111487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 23835. [D 20:42:59.111502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 23836. [D 20:42:59.111517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 23837. [D 20:42:59.111531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 23838. [D 20:42:59.111546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 23839. [D 20:42:59.111560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 23840. [D 20:42:59.111575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 23841. [D 20:42:59.111590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 23842. [D 20:42:59.111605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 23843. [D 20:42:59.111620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 23844. [D 20:42:59.111635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 23845. [D 20:42:59.111649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 23846. [D 20:42:59.111664] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 23847. [D 20:42:59.122343] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23847. [D 20:42:59.122373] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 12/70. [D 20:42:59.123998] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.124022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.124036] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.124080] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4729 [D 20:42:59.124095] element 0: offset: 0x2aaaab037630, size: 24 [D 20:42:59.124114] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 13/70. [D 20:42:59.133975] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23846. [D 20:42:59.133999] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 14/70. [D 20:42:59.135900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.135917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.135930] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.136015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.136030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.136044] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.139034] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4729 [D 20:42:59.139060] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 15/70. [D 20:42:59.139496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23846. [D 20:42:59.139513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23847. [D 20:42:59.139527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23848. [D 20:42:59.139542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23849. [D 20:42:59.139557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23850. [D 20:42:59.139571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23851. [D 20:42:59.139586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23852. [D 20:42:59.139601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23853. [D 20:42:59.139615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23854. [D 20:42:59.139630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23855. [D 20:42:59.139645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23856. [D 20:42:59.139659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23857. [D 20:42:59.139674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23858. [D 20:42:59.139688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23859. [D 20:42:59.139703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23860. [D 20:42:59.139719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23861. [D 20:42:59.139733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23862. [D 20:42:59.139748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23863. [D 20:42:59.139763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23864. [D 20:42:59.139778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23865. [D 20:42:59.139792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23866. [D 20:42:59.139807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23867. [D 20:42:59.139822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23868. [D 20:42:59.139836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23869. [D 20:42:59.139851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23870. [D 20:42:59.139866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23871. [D 20:42:59.139889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23872. [D 20:42:59.139903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23873. [D 20:42:59.139918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23874. [D 20:42:59.139933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23875. [D 20:42:59.139947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23876. [D 20:42:59.139962] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23877. [D 20:42:59.145526] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23877. [D 20:42:59.145544] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 16/70. [D 20:42:59.148561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.148577] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.148590] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:59.169485] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.169504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.169517] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:59.169540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4731 [D 20:42:59.169555] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:42:59.169570] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 17/70. [D 20:42:59.174639] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4731 [D 20:42:59.174721] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 18/70. [D 20:42:59.175672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23877. [D 20:42:59.175690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23878. [D 20:42:59.175706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23879. [D 20:42:59.175720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23880. [D 20:42:59.175735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23881. [D 20:42:59.175764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23882. [D 20:42:59.175779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23883. [D 20:42:59.175807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23884. [D 20:42:59.175848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23885. [D 20:42:59.175981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23886. [D 20:42:59.175999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23887. [D 20:42:59.176025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23888. [D 20:42:59.176040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23889. [D 20:42:59.176062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23890. [D 20:42:59.176077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23891. [D 20:42:59.176103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23892. [D 20:42:59.176131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23893. [D 20:42:59.176146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23894. [D 20:42:59.176173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23895. [D 20:42:59.176201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23896. [D 20:42:59.176220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23897. [D 20:42:59.176235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23898. [D 20:42:59.176250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23899. [D 20:42:59.176271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23900. [D 20:42:59.176286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23901. [D 20:42:59.176301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23902. [D 20:42:59.176315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23903. [D 20:42:59.176330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23904. [D 20:42:59.176345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23905. [D 20:42:59.176360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23906. [D 20:42:59.176375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23907. [D 20:42:59.176389] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23908. [D 20:42:59.181686] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.181707] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.181721] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.181769] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4735 [D 20:42:59.181785] element 0: offset: 0x2aaaab0258c0, size: 24 [D 20:42:59.181801] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 19/70. [D 20:42:59.187401] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23908. [D 20:42:59.187429] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 20/70. [D 20:42:59.189915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.189972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.189986] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.192976] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4735 [D 20:42:59.193000] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 21/70. [D 20:42:59.193819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23908. [D 20:42:59.193836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 23909. [D 20:42:59.193850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 23910. [D 20:42:59.193865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 23911. [D 20:42:59.193880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 23912. [D 20:42:59.193895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 23913. [D 20:42:59.193909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23914. [D 20:42:59.193924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23915. [D 20:42:59.193938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23916. [D 20:42:59.193953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 23917. [D 20:42:59.193968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 23918. [D 20:42:59.193983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 23919. [D 20:42:59.193997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 23920. [D 20:42:59.194012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 23921. [D 20:42:59.194027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23922. [D 20:42:59.194041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23923. [D 20:42:59.194056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23924. [D 20:42:59.194071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 23925. [D 20:42:59.194086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 23926. [D 20:42:59.194100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 23927. [D 20:42:59.194115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 23928. [D 20:42:59.194130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 23929. [D 20:42:59.194144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23930. [D 20:42:59.194159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23931. [D 20:42:59.194175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23932. [D 20:42:59.194190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 23933. [D 20:42:59.194204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 23934. [D 20:42:59.194219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 23935. [D 20:42:59.194233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 23936. [D 20:42:59.194248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 23937. [D 20:42:59.194262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23938. [D 20:42:59.194277] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23939. [D 20:42:59.196460] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.196517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.196530] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.196574] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4737 [D 20:42:59.196589] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.196611] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 22/70. [D 20:42:59.199709] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 23939. [D 20:42:59.199733] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 23/70. [D 20:42:59.199848] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.202798] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.202836] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.202910] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4737 [D 20:42:59.202935] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 24/70. [D 20:42:59.202987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 23939. [D 20:42:59.203004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 23940. [D 20:42:59.203018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23941. [D 20:42:59.203033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23942. [D 20:42:59.203047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23943. [D 20:42:59.203061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23944. [D 20:42:59.203076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23945. [D 20:42:59.203090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23946. [D 20:42:59.203104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23947. [D 20:42:59.203119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23948. [D 20:42:59.203133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23949. [D 20:42:59.203147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23950. [D 20:42:59.203162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23951. [D 20:42:59.203177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23952. [D 20:42:59.203192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23953. [D 20:42:59.203207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23954. [D 20:42:59.203221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23955. [D 20:42:59.203235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23956. [D 20:42:59.203250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23957. [D 20:42:59.203264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23958. [D 20:42:59.203279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23959. [D 20:42:59.203293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23960. [D 20:42:59.203320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23961. [D 20:42:59.203335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23962. [D 20:42:59.203359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23963. [D 20:42:59.203384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23964. [D 20:42:59.203399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23965. [D 20:42:59.203425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23966. [D 20:42:59.203439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23967. [D 20:42:59.203465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23968. [D 20:42:59.203480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 23969. [D 20:42:59.203511] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 23970. [D 20:42:59.214500] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 23970. [D 20:42:59.214519] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 25/70. [D 20:42:59.214646] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.214668] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.214680] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:59.250624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.250644] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.250657] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:59.250697] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4740 [D 20:42:59.250712] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:42:59.250731] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 26/70. [D 20:42:59.256894] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4740 [D 20:42:59.256922] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 27/70. [D 20:42:59.257071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 23970. [D 20:42:59.257146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 23971. [D 20:42:59.257164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 23972. [D 20:42:59.257178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 23973. [D 20:42:59.257193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 23974. [D 20:42:59.257207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 23975. [D 20:42:59.257221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 23976. [D 20:42:59.257235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 23977. [D 20:42:59.257249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 23978. [D 20:42:59.257264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 23979. [D 20:42:59.257278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 23980. [D 20:42:59.257292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 23981. [D 20:42:59.257306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 23982. [D 20:42:59.257320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 23983. [D 20:42:59.257334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 23984. [D 20:42:59.257348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 23985. [D 20:42:59.257363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 23986. [D 20:42:59.257377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 23987. [D 20:42:59.257391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 23988. [D 20:42:59.257405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 23989. [D 20:42:59.257419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 23990. [D 20:42:59.257433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 23991. [D 20:42:59.257448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 23992. [D 20:42:59.257462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 23993. [D 20:42:59.257476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 23994. [D 20:42:59.257490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 23995. [D 20:42:59.257504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 23996. [D 20:42:59.257519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 23997. [D 20:42:59.257533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 23998. [D 20:42:59.257547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 23999. [D 20:42:59.257561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24000. [D 20:42:59.257576] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24001. [D 20:42:59.267014] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24001. [D 20:42:59.267039] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 28/70. [D 20:42:59.267105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.267127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.267139] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:59.276046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.276063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.276075] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:59.276098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4743 [D 20:42:59.276112] element 0: offset: 0x2aaaab037630, size: 24 [D 20:42:59.276127] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 29/70. [D 20:42:59.279172] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4743 [D 20:42:59.279246] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 30/70. [D 20:42:59.279309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24001. [D 20:42:59.279342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24002. [D 20:42:59.279357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24003. [D 20:42:59.279372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24004. [D 20:42:59.279387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24005. [D 20:42:59.279402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24006. [D 20:42:59.279416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24007. [D 20:42:59.279431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24008. [D 20:42:59.279445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24009. [D 20:42:59.279460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24010. [D 20:42:59.279474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24011. [D 20:42:59.279489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24012. [D 20:42:59.279503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24013. [D 20:42:59.279518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24014. [D 20:42:59.279532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24015. [D 20:42:59.279547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24016. [D 20:42:59.279561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24017. [D 20:42:59.279576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24018. [D 20:42:59.279590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24019. [D 20:42:59.279605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24020. [D 20:42:59.473442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24021. [D 20:42:59.473502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24022. [D 20:42:59.474030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24023. [D 20:42:59.474047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24024. [D 20:42:59.474072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24025. [D 20:42:59.474098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24026. [D 20:42:59.474112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24027. [D 20:42:59.474127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24028. [D 20:42:59.474141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24029. [D 20:42:59.474156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24030. [D 20:42:59.474170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24031. [D 20:42:59.474185] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24032. [D 20:42:59.474456] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.474482] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.474496] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.474535] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4746 [D 20:42:59.474550] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:59.474566] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 31/70. [D 20:42:59.474599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.474613] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.474625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.474645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4749 [D 20:42:59.474659] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:42:59.474674] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 32/70. [D 20:42:59.474699] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.474712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.474724] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.474744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4753 [D 20:42:59.474757] element 0: offset: 0x2aaaab027af0, size: 24 [D 20:42:59.474774] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 33/70. [D 20:42:59.476048] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24032. [D 20:42:59.476073] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 34/70. [D 20:42:59.476238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.476258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.476271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.482614] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4749 [D 20:42:59.482696] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 35/70. [D 20:42:59.482881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24032. [D 20:42:59.482904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24033. [D 20:42:59.482918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24034. [D 20:42:59.482946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24035. [D 20:42:59.482961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24036. [D 20:42:59.482975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24037. [D 20:42:59.482989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24038. [D 20:42:59.483004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24039. [D 20:42:59.483018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24040. [D 20:42:59.483032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24041. [D 20:42:59.483046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24042. [D 20:42:59.483060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24043. [D 20:42:59.483074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24044. [D 20:42:59.483088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24045. [D 20:42:59.483103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24046. [D 20:42:59.483133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24047. [D 20:42:59.483148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24048. [D 20:42:59.483163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24049. [D 20:42:59.483177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24050. [D 20:42:59.483191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24051. [D 20:42:59.483205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24052. [D 20:42:59.483219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24053. [D 20:42:59.483233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24054. [D 20:42:59.483247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24055. [D 20:42:59.483262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24056. [D 20:42:59.483276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24057. [D 20:42:59.483290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24058. [D 20:42:59.483304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24059. [D 20:42:59.483318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24060. [D 20:42:59.483332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24061. [D 20:42:59.483346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24062. [D 20:42:59.483360] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24063. [D 20:42:59.483444] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4746 [D 20:42:59.484358] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 36/70. [D 20:42:59.484421] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4753 [D 20:42:59.484438] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 37/70. [D 20:42:59.487921] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.487941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.487954] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.487995] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4755 [D 20:42:59.488010] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.488025] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 38/70. [D 20:42:59.488783] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24063. [D 20:42:59.488803] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 39/70. [D 20:42:59.488820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24063. [D 20:42:59.488839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24064. [D 20:42:59.488854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24065. [D 20:42:59.488868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24066. [D 20:42:59.488885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24067. [D 20:42:59.488899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24068. [D 20:42:59.488913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24069. [D 20:42:59.488931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24070. [D 20:42:59.488945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24071. [D 20:42:59.488959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24072. [D 20:42:59.488977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24073. [D 20:42:59.488991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24074. [D 20:42:59.489005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24075. [D 20:42:59.489023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24076. [D 20:42:59.489037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24077. [D 20:42:59.489051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24078. [D 20:42:59.489065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24079. [D 20:42:59.489079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24080. [D 20:42:59.489093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24081. [D 20:42:59.489107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24082. [D 20:42:59.489121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24083. [D 20:42:59.489135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24084. [D 20:42:59.489149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24085. [D 20:42:59.489163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24086. [D 20:42:59.489177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24087. [D 20:42:59.489191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24088. [D 20:42:59.489205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24089. [D 20:42:59.489219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24090. [D 20:42:59.489233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24091. [D 20:42:59.489248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24092. [D 20:42:59.489262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24093. [D 20:42:59.489276] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24094. [D 20:42:59.489291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24095. [D 20:42:59.489305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24096. [D 20:42:59.489319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24097. [D 20:42:59.489333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24098. [D 20:42:59.489347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24099. [D 20:42:59.489364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24100. [D 20:42:59.489378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24101. [D 20:42:59.489392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24102. [D 20:42:59.489410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24103. [D 20:42:59.489424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24104. [D 20:42:59.489437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24105. [D 20:42:59.489458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24106. [D 20:42:59.489472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24107. [D 20:42:59.489486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24108. [D 20:42:59.489500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24109. [D 20:42:59.489514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24110. [D 20:42:59.489527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24111. [D 20:42:59.489541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24112. [D 20:42:59.489555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24113. [D 20:42:59.489570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24114. [D 20:42:59.489584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24115. [D 20:42:59.489598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24116. [D 20:42:59.489612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24117. [D 20:42:59.489625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24118. [D 20:42:59.489639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24119. [D 20:42:59.489653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24120. [D 20:42:59.489667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24121. [D 20:42:59.489681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24122. [D 20:42:59.489694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24123. [D 20:42:59.489708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24124. [D 20:42:59.489722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24125. [D 20:42:59.489736] openib_post_sr_rdmaw: ibv_post_send wr_id 633b00 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24126. [D 20:42:59.493093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.493116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.493129] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.495110] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24126. [D 20:42:59.495128] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 40/70. [D 20:42:59.499821] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.499837] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.499849] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.499878] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4758 [D 20:42:59.499893] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:42:59.499908] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 41/70. [D 20:42:59.500092] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4755 [D 20:42:59.500112] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 42/70. [D 20:42:59.506421] openib_check_cq: completed rdma wr_id 633b00, nic_wr_credit 24125. [D 20:42:59.506440] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 43/70. [D 20:42:59.506456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 24125. [D 20:42:59.506471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 24126. [D 20:42:59.506485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24127. [D 20:42:59.506499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24128. [D 20:42:59.506513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24129. [D 20:42:59.506527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24130. [D 20:42:59.506541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24131. [D 20:42:59.506555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24132. [D 20:42:59.506577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24133. [D 20:42:59.506591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24134. [D 20:42:59.506605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24135. [D 20:42:59.506618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24136. [D 20:42:59.506632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24137. [D 20:42:59.506646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24138. [D 20:42:59.506660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24139. [D 20:42:59.506674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24140. [D 20:42:59.506688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24141. [D 20:42:59.506701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24142. [D 20:42:59.506715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24143. [D 20:42:59.506729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24144. [D 20:42:59.506743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24145. [D 20:42:59.506757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24146. [D 20:42:59.506771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24147. [D 20:42:59.506785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24148. [D 20:42:59.506799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24149. [D 20:42:59.506812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24150. [D 20:42:59.506826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24151. [D 20:42:59.506840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24152. [D 20:42:59.506854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24153. [D 20:42:59.506868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24154. [D 20:42:59.506882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24155. [D 20:42:59.506896] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24156. [D 20:42:59.508003] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.508070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.508086] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.508122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.508137] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.508150] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.512086] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4758 [D 20:42:59.512110] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 44/70. [D 20:42:59.512355] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24156. [D 20:42:59.512370] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 45/70. [D 20:42:59.512469] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.512556] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.512569] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.512680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24156. [D 20:42:59.512699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24157. [D 20:42:59.512714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24158. [D 20:42:59.512729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24159. [D 20:42:59.512743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24160. [D 20:42:59.512757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24161. [D 20:42:59.512771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24162. [D 20:42:59.512785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24163. [D 20:42:59.512799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24164. [D 20:42:59.512813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24165. [D 20:42:59.512841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24166. [D 20:42:59.512855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24167. [D 20:42:59.512869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24168. [D 20:42:59.512883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24169. [D 20:42:59.512897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24170. [D 20:42:59.512911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24171. [D 20:42:59.512925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24172. [D 20:42:59.512939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24173. [D 20:42:59.512953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24174. [D 20:42:59.512967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24175. [D 20:42:59.512981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24176. [D 20:42:59.512995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24177. [D 20:42:59.513009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24178. [D 20:42:59.513023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24179. [D 20:42:59.513038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24180. [D 20:42:59.513052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24181. [D 20:42:59.513067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24182. [D 20:42:59.513081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24183. [D 20:42:59.513103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24184. [D 20:42:59.513116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24185. [D 20:42:59.513132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24186. [D 20:42:59.513146] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24187. [D 20:42:59.524452] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24187. [D 20:42:59.524483] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 46/70. [D 20:42:59.527457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.527476] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.527489] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:59.531947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.531969] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.531982] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:59.532006] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4763 [D 20:42:59.532020] element 0: offset: 0x2aaaab037630, size: 24 [D 20:42:59.532038] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 47/70. [D 20:42:59.532066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.532080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.532092] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.532113] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4766 [D 20:42:59.532127] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.532143] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 48/70. [D 20:42:59.532170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.532184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.532197] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.532217] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4767 [D 20:42:59.532232] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:59.532247] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 49/70. [D 20:42:59.538286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.538352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.538366] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.538404] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4770 [D 20:42:59.538419] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:42:59.538438] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 50/70. [D 20:42:59.538504] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4763 [D 20:42:59.538527] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 51/70. [D 20:42:59.538604] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4766 [D 20:42:59.538611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24187. [D 20:42:59.538641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24188. [D 20:42:59.538656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24189. [D 20:42:59.538674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24190. [D 20:42:59.538689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24191. [D 20:42:59.538704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24192. [D 20:42:59.538719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24193. [D 20:42:59.538733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24194. [D 20:42:59.538747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24195. [D 20:42:59.538762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24196. [D 20:42:59.538776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24197. [D 20:42:59.538790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24198. [D 20:42:59.538804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24199. [D 20:42:59.538819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24200. [D 20:42:59.538833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24201. [D 20:42:59.538847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24202. [D 20:42:59.538862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24203. [D 20:42:59.538876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24204. [D 20:42:59.538890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24205. [D 20:42:59.538904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24206. [D 20:42:59.538919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24207. [D 20:42:59.538933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24208. [D 20:42:59.538947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24209. [D 20:42:59.538962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24210. [D 20:42:59.538976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24211. [D 20:42:59.538990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24212. [D 20:42:59.539005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24213. [D 20:42:59.539019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24214. [D 20:42:59.539033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24215. [D 20:42:59.539047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24216. [D 20:42:59.539062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24217. [D 20:42:59.539076] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24218. [D 20:42:59.539111] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 52/70. [D 20:42:59.544976] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4767 [D 20:42:59.545052] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 53/70. [D 20:42:59.545132] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4770 [D 20:42:59.545150] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 54/70. [D 20:42:59.549260] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24218. [D 20:42:59.549286] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 55/70. [D 20:42:59.549304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24218. [D 20:42:59.549319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24219. [D 20:42:59.549334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24220. [D 20:42:59.549349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24221. [D 20:42:59.549363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24222. [D 20:42:59.549378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24223. [D 20:42:59.549392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24224. [D 20:42:59.549407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24225. [D 20:42:59.549421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24226. [D 20:42:59.549436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24227. [D 20:42:59.549451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24228. [D 20:42:59.549465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24229. [D 20:42:59.549480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24230. [D 20:42:59.549494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24231. [D 20:42:59.549509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24232. [D 20:42:59.549523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24233. [D 20:42:59.549538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24234. [D 20:42:59.549553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24235. [D 20:42:59.549567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24236. [D 20:42:59.549582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24237. [D 20:42:59.549597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24238. [D 20:42:59.549611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24239. [D 20:42:59.549626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24240. [D 20:42:59.549640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24241. [D 20:42:59.549655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24242. [D 20:42:59.549670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24243. [D 20:42:59.549684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24244. [D 20:42:59.549700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24245. [D 20:42:59.549715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24246. [D 20:42:59.549730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24247. [D 20:42:59.549744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24248. [D 20:42:59.549759] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24249. [D 20:42:59.549775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24250. [D 20:42:59.549790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24251. [D 20:42:59.549805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24252. [D 20:42:59.549820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24253. [D 20:42:59.549834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24254. [D 20:42:59.549849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24255. [D 20:42:59.549864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24256. [D 20:42:59.549878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24257. [D 20:42:59.549893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24258. [D 20:42:59.549907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24259. [D 20:42:59.549922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24260. [D 20:42:59.549937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24261. [D 20:42:59.549951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24262. [D 20:42:59.549966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24263. [D 20:42:59.549980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24264. [D 20:42:59.549995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24265. [D 20:42:59.550009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24266. [D 20:42:59.550024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24267. [D 20:42:59.550039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24268. [D 20:42:59.550054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24269. [D 20:42:59.550068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24270. [D 20:42:59.550083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24271. [D 20:42:59.550097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24272. [D 20:42:59.550112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24273. [D 20:42:59.550128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24274. [D 20:42:59.550142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24275. [D 20:42:59.550157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24276. [D 20:42:59.550172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24277. [D 20:42:59.550186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24278. [D 20:42:59.550201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24279. [D 20:42:59.550215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24280. [D 20:42:59.550230] openib_post_sr_rdmaw: ibv_post_send wr_id 61f990 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24281. [D 20:42:59.550246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24282. [D 20:42:59.550260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24283. [D 20:42:59.550275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24284. [D 20:42:59.550290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24285. [D 20:42:59.550305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24286. [D 20:42:59.550319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24287. [E 20:42:59.550341] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24288, block for 10 ms. [D 20:42:59.550373] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24287. [D 20:42:59.550389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24288. [E 20:42:59.550404] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24289, block for 10 ms. [D 20:42:59.560285] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24288. [E 20:42:59.560314] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24289, block for 10 ms. [D 20:42:59.560918] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24288. [D 20:42:59.560946] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 56/70. [D 20:42:59.560961] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24287. [D 20:42:59.560976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24288. [D 20:42:59.560991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24289. [D 20:42:59.561005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24290. [D 20:42:59.561020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24291. [D 20:42:59.561034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24292. [D 20:42:59.561048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24293. [D 20:42:59.561063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24294. [D 20:42:59.561078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24295. [D 20:42:59.561092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24296. [D 20:42:59.561107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24297. [D 20:42:59.561121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24298. [D 20:42:59.561136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24299. [D 20:42:59.561150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24300. [D 20:42:59.561164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24301. [D 20:42:59.561179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24302. [D 20:42:59.561193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24303. [D 20:42:59.561207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24304. [D 20:42:59.561222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24305. [D 20:42:59.561236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24306. [D 20:42:59.561250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24307. [D 20:42:59.561265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24308. [D 20:42:59.561279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24309. [D 20:42:59.561293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24310. [D 20:42:59.561308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24311. [D 20:42:59.561322] openib_post_sr_rdmaw: ibv_post_send wr_id 61e450 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24312. [D 20:42:59.563895] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.563913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.563927] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.563954] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.563968] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.563982] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.564021] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4773 [D 20:42:59.564038] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:42:59.564720] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 57/70. [D 20:42:59.572593] openib_check_cq: completed rdma wr_id 61f990, nic_wr_credit 24312. [D 20:42:59.572610] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 58/70. [D 20:42:59.575931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.575955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.575968] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.579664] openib_check_cq: completed rdma wr_id 61e450, nic_wr_credit 24311. [D 20:42:59.579685] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 59/70. [D 20:42:59.579739] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.579759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.579772] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.579883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.579898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.579911] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.585925] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4773 [D 20:42:59.585950] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 60/70. [D 20:42:59.590776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24311. [D 20:42:59.590853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24312. [D 20:42:59.590869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24313. [D 20:42:59.590906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24314. [D 20:42:59.590934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24315. [D 20:42:59.590948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24316. [D 20:42:59.590977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24317. [D 20:42:59.591001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24318. [D 20:42:59.591032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24319. [D 20:42:59.591046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24320. [D 20:42:59.591074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24321. [D 20:42:59.591103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24322. [D 20:42:59.591118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24323. [D 20:42:59.591143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24324. [D 20:42:59.591171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24325. [D 20:42:59.591186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24326. [D 20:42:59.591212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24327. [D 20:42:59.591239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24328. [D 20:42:59.591254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24329. [D 20:42:59.591279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24330. [D 20:42:59.591294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24331. [D 20:42:59.591308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24332. [D 20:42:59.591323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24333. [D 20:42:59.591337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24334. [D 20:42:59.591352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24335. [D 20:42:59.591366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24336. [D 20:42:59.591383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24337. [D 20:42:59.591397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24338. [D 20:42:59.591412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24339. [D 20:42:59.591427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24340. [D 20:42:59.591441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24341. [D 20:42:59.591456] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24342. [D 20:42:59.593444] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.593466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.593479] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.593518] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4777 [D 20:42:59.593533] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:59.593549] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 0/70. [D 20:42:59.593585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.593599] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.593612] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.593632] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4779 [D 20:42:59.593646] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:42:59.593661] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 1/70. [D 20:42:59.602518] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24342. [D 20:42:59.602548] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 2/70. [D 20:42:59.602672] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.602693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.602706] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.605872] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4777 [D 20:42:59.605947] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 3/70. [D 20:42:59.607568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 24342. [D 20:42:59.607598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 24343. [D 20:42:59.607613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24344. [D 20:42:59.607628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24345. [D 20:42:59.607642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24346. [D 20:42:59.607656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24347. [D 20:42:59.607671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24348. [D 20:42:59.607685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24349. [D 20:42:59.607708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24350. [D 20:42:59.607723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24351. [D 20:42:59.607752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24352. [D 20:42:59.607767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24353. [D 20:42:59.607793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24354. [D 20:42:59.607820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24355. [D 20:42:59.607835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24356. [D 20:42:59.607859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24357. [D 20:42:59.607892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24358. [D 20:42:59.607908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24359. [D 20:42:59.607933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24360. [D 20:42:59.607947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24361. [D 20:42:59.607962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24362. [D 20:42:59.607977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24363. [D 20:42:59.607991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24364. [D 20:42:59.608006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24365. [D 20:42:59.608021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24366. [D 20:42:59.608036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24367. [D 20:42:59.608050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24368. [D 20:42:59.608065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24369. [D 20:42:59.608080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24370. [D 20:42:59.608095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24371. [D 20:42:59.608109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24372. [D 20:42:59.608126] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24373. [D 20:42:59.611258] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4779 [D 20:42:59.611333] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 4/70. [D 20:42:59.616507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.616528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.616541] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.616584] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4784 [D 20:42:59.616599] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.616616] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 5/70. [D 20:42:59.616655] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.616668] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.616681] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.616702] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4785 [D 20:42:59.616716] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:42:59.616730] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 6/70. [D 20:42:59.619282] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24373. [D 20:42:59.619308] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 7/70. [D 20:42:59.619334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24373. [D 20:42:59.619349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24374. [D 20:42:59.619364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24375. [D 20:42:59.619379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24376. [D 20:42:59.619394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24377. [D 20:42:59.619421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24378. [D 20:42:59.619445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24379. [D 20:42:59.619460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24380. [D 20:42:59.619475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24381. [D 20:42:59.619490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24382. [D 20:42:59.619521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24383. [D 20:42:59.619543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24384. [D 20:42:59.619558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24385. [D 20:42:59.619585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24386. [D 20:42:59.619600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24387. [D 20:42:59.619626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24388. [D 20:42:59.619641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24389. [D 20:42:59.619664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24390. [D 20:42:59.619679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24391. [D 20:42:59.619705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24392. [D 20:42:59.619730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24393. [D 20:42:59.619746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24394. [D 20:42:59.619760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24395. [D 20:42:59.619785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24396. [D 20:42:59.619811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24397. [D 20:42:59.619826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24398. [D 20:42:59.619853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24399. [D 20:42:59.619965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24400. [D 20:42:59.619984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24401. [D 20:42:59.620005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24402. [D 20:42:59.620019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24403. [D 20:42:59.620034] openib_post_sr_rdmaw: ibv_post_send wr_id 61f990 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24404. [D 20:42:59.620104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.620126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.620139] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.623926] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4784 [D 20:42:59.623955] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 8/70. [D 20:42:59.626373] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4785 [D 20:42:59.626398] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 9/70. [D 20:42:59.628062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.628126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.628140] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.628185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4788 [D 20:42:59.628200] element 0: offset: 0x2aaaab030940, size: 24 [D 20:42:59.628220] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 10/70. [D 20:42:59.631003] openib_check_cq: completed rdma wr_id 61f990, nic_wr_credit 24404. [D 20:42:59.631028] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 11/70. [D 20:42:59.631066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24404. [D 20:42:59.631082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24405. [D 20:42:59.631097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24406. [D 20:42:59.631112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24407. [D 20:42:59.631127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24408. [D 20:42:59.631141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24409. [D 20:42:59.631156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24410. [D 20:42:59.631171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24411. [D 20:42:59.631195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24412. [D 20:42:59.631210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24413. [D 20:42:59.631234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24414. [D 20:42:59.631257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24415. [D 20:42:59.631271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24416. [D 20:42:59.631286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24417. [D 20:42:59.631315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24418. [D 20:42:59.631330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24419. [D 20:42:59.631355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24420. [D 20:42:59.634559] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4788 [D 20:42:59.927236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24421. [D 20:42:59.927271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24422. [D 20:42:59.927702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24423. [D 20:42:59.927720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24424. [D 20:42:59.927735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24425. [D 20:42:59.927750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24426. [D 20:42:59.927764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24427. [D 20:42:59.927795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24428. [D 20:42:59.927810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24429. [D 20:42:59.927825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24430. [D 20:42:59.927840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24431. [D 20:42:59.927866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24432. [D 20:42:59.927884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24433. [D 20:42:59.927899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24434. [D 20:42:59.927914] openib_post_sr_rdmaw: ibv_post_send wr_id 62d710 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24435. [D 20:42:59.927931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24436. [D 20:42:59.927946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24437. [D 20:42:59.927961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24438. [D 20:42:59.927975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24439. [D 20:42:59.927990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24440. [D 20:42:59.928059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24441. [D 20:42:59.928094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24442. [D 20:42:59.928571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24443. [D 20:42:59.928589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24444. [D 20:42:59.928603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24445. [D 20:42:59.928618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24446. [D 20:42:59.928633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24447. [D 20:42:59.928651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24448. [D 20:42:59.928668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24449. [D 20:42:59.928682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24450. [D 20:42:59.928709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24451. [D 20:42:59.928725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24452. [D 20:42:59.928739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24453. [D 20:42:59.928754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24454. [D 20:42:59.928768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24455. [D 20:42:59.928783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24456. [D 20:42:59.928797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24457. [D 20:42:59.928812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24458. [D 20:42:59.928826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24459. [D 20:42:59.928898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24460. [D 20:42:59.928915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24461. [D 20:42:59.928930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24462. [D 20:42:59.928972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24463. [D 20:42:59.929445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24464. [D 20:42:59.929462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24465. [D 20:42:59.929477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24466. [D 20:42:59.929491] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24467. [D 20:42:59.929522] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 12/70. [D 20:42:59.930288] openib_check_cq: completed rdma wr_id 62d710, nic_wr_credit 24467. [D 20:42:59.930310] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 13/70. [D 20:42:59.934774] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.934795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.934809] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 5 [D 20:42:59.934913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.934929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.934943] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 4 [D 20:42:59.934978] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4791 [D 20:42:59.934993] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:42:59.935009] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 14/70. [D 20:42:59.936118] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 24466. [D 20:42:59.936138] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 15/70. [D 20:42:59.936211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24466. [D 20:42:59.936227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24467. [D 20:42:59.936242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24468. [D 20:42:59.936257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24469. [D 20:42:59.936272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24470. [D 20:42:59.936288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24471. [D 20:42:59.936303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24472. [D 20:42:59.936336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24473. [D 20:42:59.936352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24474. [D 20:42:59.936367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24475. [D 20:42:59.936381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24476. [D 20:42:59.936399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24477. [D 20:42:59.936414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24478. [D 20:42:59.936429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24479. [D 20:42:59.936446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24480. [D 20:42:59.936461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24481. [D 20:42:59.936475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24482. [D 20:42:59.936490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24483. [D 20:42:59.936505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24484. [D 20:42:59.936520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24485. [D 20:42:59.936535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24486. [D 20:42:59.936565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24487. [D 20:42:59.936580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24488. [D 20:42:59.936595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24489. [D 20:42:59.936609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24490. [D 20:42:59.936624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24491. [D 20:42:59.936641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24492. [D 20:42:59.936655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24493. [D 20:42:59.936670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24494. [D 20:42:59.936685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24495. [D 20:42:59.936702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24496. [D 20:42:59.936718] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24497. [D 20:42:59.939924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.939941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.939954] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:42:59.940041] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.940056] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.940070] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:42:59.942135] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 24497. [D 20:42:59.942153] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 16/70. [D 20:42:59.943613] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4791 [D 20:42:59.943693] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 17/70. [D 20:42:59.943701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.943721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.943734] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:42:59.947425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24497. [D 20:42:59.947445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24498. [D 20:42:59.947460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24499. [D 20:42:59.947475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24500. [D 20:42:59.947490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24501. [D 20:42:59.947504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24502. [D 20:42:59.947519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24503. [D 20:42:59.947533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24504. [D 20:42:59.947548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24505. [D 20:42:59.947562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24506. [D 20:42:59.947577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24507. [D 20:42:59.947591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24508. [D 20:42:59.947606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24509. [D 20:42:59.947621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24510. [D 20:42:59.947635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24511. [D 20:42:59.947650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24512. [D 20:42:59.947664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24513. [D 20:42:59.947679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24514. [D 20:42:59.947694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24515. [D 20:42:59.947708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24516. [D 20:42:59.947723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24517. [D 20:42:59.947738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24518. [D 20:42:59.947752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24519. [D 20:42:59.947767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24520. [D 20:42:59.947782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24521. [D 20:42:59.947796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24522. [D 20:42:59.947811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24523. [D 20:42:59.947825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24524. [D 20:42:59.947840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24525. [D 20:42:59.947855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24526. [D 20:42:59.947869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24527. [D 20:42:59.947889] openib_post_sr_rdmaw: ibv_post_send wr_id 61f990 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24528. [D 20:42:59.953364] openib_check_cq: completed rdma wr_id 61f990, nic_wr_credit 24528. [D 20:42:59.953380] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 18/70. [D 20:42:59.956319] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.956343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.956356] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:42:59.959099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.959117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.959130] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:42:59.959174] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4797 [D 20:42:59.959189] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:42:59.959206] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 19/70. [D 20:42:59.959246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.959261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.959273] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:42:59.959295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4798 [D 20:42:59.959309] element 0: offset: 0x2aaaab037660, size: 24 [D 20:42:59.959324] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 20/70. [D 20:42:59.959357] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.959371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.959384] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:42:59.959404] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4800 [D 20:42:59.959418] element 0: offset: 0x2aaaab039060, size: 24 [D 20:42:59.959435] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 21/70. [D 20:42:59.964139] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:42:59.964203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.964218] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:42:59.964260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4803 [D 20:42:59.964275] element 0: offset: 0x691fe0, size: 24 [D 20:42:59.964295] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 22/70. [D 20:42:59.969300] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4797 [D 20:42:59.969376] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 23/70. [D 20:42:59.969551] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4798 [D 20:42:59.969557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24528. [D 20:42:59.969658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24529. [D 20:42:59.969674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24530. [D 20:42:59.969688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24531. [D 20:42:59.969703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24532. [D 20:42:59.969717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24533. [D 20:42:59.969731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24534. [D 20:42:59.969746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24535. [D 20:42:59.969760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24536. [D 20:42:59.969774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24537. [D 20:42:59.969789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24538. [D 20:42:59.969803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24539. [D 20:42:59.969817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24540. [D 20:42:59.969832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24541. [D 20:42:59.969846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24542. [D 20:42:59.969860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24543. [D 20:42:59.969875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24544. [D 20:42:59.969889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24545. [D 20:42:59.969904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24546. [D 20:42:59.969918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24547. [D 20:42:59.969932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24548. [D 20:42:59.969947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24549. [D 20:42:59.969961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24550. [D 20:42:59.969975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24551. [D 20:42:59.969989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24552. [D 20:42:59.970004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24553. [D 20:42:59.970018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24554. [D 20:42:59.970032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24555. [D 20:42:59.970047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24556. [D 20:42:59.970067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24557. [D 20:42:59.970082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24558. [D 20:42:59.970096] openib_post_sr_rdmaw: ibv_post_send wr_id 643c10 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24559. [D 20:42:59.970127] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 24/70. [D 20:42:59.970157] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4800 [D 20:42:59.970173] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 25/70. [D 20:42:59.975414] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4803 [D 20:42:59.975439] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 26/70. [D 20:42:59.981410] openib_check_cq: completed rdma wr_id 643c10, nic_wr_credit 24559. [D 20:42:59.981468] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 27/70. [D 20:42:59.981488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24559. [D 20:42:59.981504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24560. [D 20:42:59.981519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24561. [D 20:42:59.981533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24562. [D 20:42:59.981548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24563. [D 20:42:59.981562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24564. [D 20:42:59.981577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24565. [D 20:42:59.981591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24566. [D 20:42:59.981605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24567. [D 20:42:59.981620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24568. [D 20:42:59.981634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24569. [D 20:42:59.981649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24570. [D 20:42:59.981663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24571. [D 20:42:59.981677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24572. [D 20:42:59.981692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24573. [D 20:42:59.981707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24574. [D 20:42:59.981721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24575. [D 20:42:59.981736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24576. [D 20:42:59.981750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24577. [D 20:42:59.981765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24578. [D 20:42:59.981779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24579. [D 20:42:59.981793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24580. [D 20:42:59.981810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24581. [D 20:42:59.981824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24582. [D 20:42:59.981839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24583. [D 20:42:59.981853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24584. [D 20:42:59.981867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24585. [D 20:42:59.981882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24586. [D 20:42:59.981896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24587. [D 20:42:59.981911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24588. [D 20:42:59.981925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24589. [D 20:42:59.981940] openib_post_sr_rdmaw: ibv_post_send wr_id 6615c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24590. [D 20:42:59.981956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24591. [D 20:42:59.981971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24592. [D 20:42:59.981985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24593. [D 20:42:59.982000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24594. [D 20:42:59.982014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24595. [D 20:42:59.982028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24596. [D 20:42:59.982042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24597. [D 20:42:59.982057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24598. [D 20:42:59.982071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24599. [D 20:42:59.982086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24600. [D 20:42:59.982100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24601. [D 20:42:59.982114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24602. [D 20:42:59.982129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24603. [D 20:42:59.982143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24604. [D 20:42:59.982157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24605. [D 20:42:59.982171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24606. [D 20:42:59.982186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24607. [D 20:42:59.982200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24608. [D 20:42:59.982215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24609. [D 20:42:59.982230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24610. [D 20:42:59.982244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24611. [D 20:42:59.982259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24612. [D 20:42:59.982273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24613. [D 20:42:59.982287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24614. [D 20:42:59.982301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24615. [D 20:42:59.982315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24616. [D 20:42:59.982329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24617. [D 20:42:59.982343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24618. [D 20:42:59.982358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24619. [D 20:42:59.982375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24620. [D 20:42:59.982390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24621. [D 20:42:59.982404] openib_post_sr_rdmaw: ibv_post_send wr_id 6426d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24622. [D 20:42:59.982420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24623. [D 20:42:59.982435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24624. [D 20:42:59.982449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24625. [D 20:42:59.982463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24626. [D 20:42:59.982478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24627. [D 20:42:59.982492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24628. [E 20:42:59.982510] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24629, block for 10 ms. [D 20:42:59.982541] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24628. [D 20:42:59.982557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24629. [E 20:42:59.982572] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24630, block for 10 ms. [D 20:42:59.993138] openib_check_cq: completed rdma wr_id 6615c0, nic_wr_credit 24629. [D 20:42:59.993161] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 28/70. [D 20:42:59.993176] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24628. [D 20:42:59.993191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24629. [D 20:42:59.993205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24630. [D 20:42:59.993220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24631. [D 20:42:59.993235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24632. [D 20:42:59.993250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24633. [D 20:42:59.993265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24634. [D 20:42:59.993279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24635. [D 20:42:59.993294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24636. [D 20:42:59.993308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24637. [D 20:42:59.993323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24638. [D 20:42:59.993337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24639. [D 20:42:59.993352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24640. [D 20:42:59.993366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24641. [D 20:42:59.993381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24642. [D 20:42:59.993395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24643. [D 20:42:59.993410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24644. [D 20:42:59.993425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24645. [D 20:42:59.993439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24646. [D 20:42:59.993453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24647. [D 20:42:59.993468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24648. [D 20:42:59.993482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24649. [D 20:42:59.993497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24650. [D 20:42:59.993511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24651. [D 20:42:59.993526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24652. [D 20:42:59.993540] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef30 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24653. [D 20:42:59.995920] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:42:59.995937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:42:59.995951] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.003711] openib_check_cq: completed rdma wr_id 6426d0, nic_wr_credit 24653. [D 20:43:00.003734] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 29/70. [D 20:43:00.007972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.007989] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.008002] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.009658] openib_check_cq: completed rdma wr_id 67ef30, nic_wr_credit 24652. [D 20:43:00.009674] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 30/70. [D 20:43:00.011924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.011948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.011962] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.011989] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.012004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.012017] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:00.024960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.024979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.024991] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:00.025030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4808 [D 20:43:00.025045] element 0: offset: 0x5b0030, size: 24 [D 20:43:00.025062] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 31/70. [D 20:43:00.025100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.025114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.025127] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.025151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4810 [D 20:43:00.025166] element 0: offset: 0x2aaaab60cbf0, size: 24 [D 20:43:00.025182] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 32/70. [D 20:43:00.025215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.025229] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.025242] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.025266] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4812 [D 20:43:00.025281] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:00.025297] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 33/70. [D 20:43:00.032097] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4808 [D 20:43:00.032187] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 34/70. [D 20:43:00.032248] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4810 [D 20:43:00.032286] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 35/70. [D 20:43:00.033407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24652. [D 20:43:00.033486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24653. [D 20:43:00.033501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24654. [D 20:43:00.033516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24655. [D 20:43:00.033531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24656. [D 20:43:00.033556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24657. [D 20:43:00.033591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24658. [D 20:43:00.033617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24659. [D 20:43:00.033632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24660. [D 20:43:00.033646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24661. [D 20:43:00.033674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24662. [D 20:43:00.033698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24663. [D 20:43:00.033725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24664. [D 20:43:00.033740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24665. [D 20:43:00.033765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24666. [D 20:43:00.033780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24667. [D 20:43:00.033809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24668. [D 20:43:00.033834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24669. [D 20:43:00.033849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24670. [D 20:43:00.033877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24671. [D 20:43:00.033892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24672. [D 20:43:00.033916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24673. [D 20:43:00.033943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24674. [D 20:43:00.033958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24675. [D 20:43:00.033982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24676. [D 20:43:00.033997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24677. [D 20:43:00.034012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24678. [D 20:43:00.034026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24679. [D 20:43:00.034041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24680. [D 20:43:00.034055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24681. [D 20:43:00.034069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24682. [D 20:43:00.034084] openib_post_sr_rdmaw: ibv_post_send wr_id 61f150 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24683. [D 20:43:00.034102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24684. [D 20:43:00.034117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24685. [D 20:43:00.034132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24686. [D 20:43:00.034147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24687. [D 20:43:00.034161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24688. [D 20:43:00.034176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24689. [D 20:43:00.034190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24690. [D 20:43:00.034205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24691. [D 20:43:00.034219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24692. [D 20:43:00.034234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24693. [D 20:43:00.034248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24694. [D 20:43:00.034263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24695. [D 20:43:00.034278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24696. [D 20:43:00.034293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24697. [D 20:43:00.034308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24698. [D 20:43:00.034322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24699. [D 20:43:00.034336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24700. [D 20:43:00.034350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24701. [D 20:43:00.034369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24702. [D 20:43:00.034384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24703. [D 20:43:00.034398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24704. [D 20:43:00.034412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24705. [D 20:43:00.034427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24706. [D 20:43:00.034441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24707. [D 20:43:00.034455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24708. [D 20:43:00.034469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24709. [D 20:43:00.034483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24710. [D 20:43:00.034498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24711. [D 20:43:00.034512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24712. [D 20:43:00.034526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24713. [D 20:43:00.034540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24714. [D 20:43:00.034555] openib_post_sr_rdmaw: ibv_post_send wr_id 66e300 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24715. [D 20:43:00.036420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.036444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.036457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.036498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4816 [D 20:43:00.036514] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:00.036530] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 36/70. [D 20:43:00.039689] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4812 [D 20:43:00.039718] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 37/70. [D 20:43:00.045150] openib_check_cq: completed rdma wr_id 61f150, nic_wr_credit 24715. [D 20:43:00.045178] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 38/70. [D 20:43:00.056832] openib_check_cq: completed rdma wr_id 66e300, nic_wr_credit 24714. [D 20:43:00.056853] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 39/70. [D 20:43:00.056890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24714. [D 20:43:00.056906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24715. [D 20:43:00.056920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24716. [D 20:43:00.056923] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.056941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24717. [D 20:43:00.056962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.056978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24718. [D 20:43:00.056994] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.057013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24719. [D 20:43:00.057042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24720. [D 20:43:00.057058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24721. [D 20:43:00.057072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24722. [D 20:43:00.057087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24723. [D 20:43:00.057102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24724. [D 20:43:00.057116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24725. [D 20:43:00.057131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24726. [D 20:43:00.057145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24727. [D 20:43:00.057160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24728. [D 20:43:00.057174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24729. [D 20:43:00.057189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24730. [D 20:43:00.057203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24731. [D 20:43:00.057218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24732. [D 20:43:00.057232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24733. [D 20:43:00.057247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24734. [D 20:43:00.057262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24735. [D 20:43:00.057276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24736. [D 20:43:00.057291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24737. [D 20:43:00.057305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24738. [D 20:43:00.057320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24739. [D 20:43:00.057334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24740. [D 20:43:00.057349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24741. [D 20:43:00.057363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24742. [D 20:43:00.057378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24743. [D 20:43:00.057393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24744. [D 20:43:00.057407] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e6c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24745. [D 20:43:00.057459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.057479] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.057492] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.060203] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4816 [D 20:43:00.060258] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 40/70. [D 20:43:00.065883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.065904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.065917] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.065961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4818 [D 20:43:00.065976] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:43:00.065994] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 41/70. [D 20:43:00.068724] openib_check_cq: completed rdma wr_id 2aaaab62e6c0, nic_wr_credit 24745. [D 20:43:00.068750] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 42/70. [D 20:43:00.068766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24745. [D 20:43:00.068782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24746. [D 20:43:00.068796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24747. [D 20:43:00.068811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24748. [D 20:43:00.068825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24749. [D 20:43:00.068840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24750. [D 20:43:00.068854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24751. [D 20:43:00.068869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24752. [D 20:43:00.068883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24753. [D 20:43:00.068898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24754. [D 20:43:00.068912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24755. [D 20:43:00.068927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24756. [D 20:43:00.068941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24757. [D 20:43:00.068956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24758. [D 20:43:00.068970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24759. [D 20:43:00.068985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24760. [D 20:43:00.068999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24761. [D 20:43:00.069014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24762. [D 20:43:00.069028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24763. [D 20:43:00.069044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24764. [D 20:43:00.069058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24765. [D 20:43:00.069073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24766. [D 20:43:00.069087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24767. [D 20:43:00.069102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24768. [D 20:43:00.069116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24769. [D 20:43:00.069131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24770. [D 20:43:00.069145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24771. [D 20:43:00.069159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24772. [D 20:43:00.069174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24773. [D 20:43:00.069188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24774. [D 20:43:00.069203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24775. [D 20:43:00.069217] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6101c0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24776. [D 20:43:00.069269] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.069288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.069301] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.075268] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4818 [D 20:43:00.075348] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 43/70. [D 20:43:00.080667] openib_check_cq: completed rdma wr_id 2aaaab6101c0, nic_wr_credit 24776. [D 20:43:00.080694] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 44/70. [D 20:43:00.080709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24776. [D 20:43:00.080724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24777. [D 20:43:00.080738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24778. [D 20:43:00.080753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24779. [D 20:43:00.080767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24780. [D 20:43:00.080781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24781. [D 20:43:00.080795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24782. [D 20:43:00.080809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24783. [D 20:43:00.080823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24784. [D 20:43:00.080837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24785. [D 20:43:00.080851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24786. [D 20:43:00.080866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24787. [D 20:43:00.390378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24788. [D 20:43:00.390406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24789. [D 20:43:00.390421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24790. [D 20:43:00.390435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24791. [D 20:43:00.390449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24792. [D 20:43:00.390464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24793. [D 20:43:00.390478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24794. [D 20:43:00.390492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24795. [D 20:43:00.390507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24796. [D 20:43:00.391090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24797. [D 20:43:00.391105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24798. [D 20:43:00.391119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24799. [D 20:43:00.391133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24800. [D 20:43:00.391147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24801. [D 20:43:00.391162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24802. [D 20:43:00.391176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24803. [D 20:43:00.391190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24804. [D 20:43:00.391204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24805. [D 20:43:00.391218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24806. [D 20:43:00.391233] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e6c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24807. [D 20:43:00.392092] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.392116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.392129] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.392161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.392175] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.392188] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.392227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4821 [D 20:43:00.392242] element 0: offset: 0x2aaaab037660, size: 24 [D 20:43:00.392258] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 45/70. [D 20:43:00.392290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.392304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.392317] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.392337] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4825 [D 20:43:00.392351] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:43:00.392366] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 46/70. [D 20:43:00.392392] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.392407] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.392420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.392479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 4827 [D 20:43:00.392493] element 0: offset: 0x2aaaab033450, size: 104 [D 20:43:00.392508] openib_post_sr: 10.1.4.240:43806 bh 17 len 120 wr 47/70. [D 20:43:00.392536] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.392549] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.392562] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 5 [D 20:43:00.392583] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4830 [D 20:43:00.392598] element 0: offset: 0x2aaaab0335b0, size: 24 [D 20:43:00.392612] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 48/70. [D 20:43:00.394223] openib_check_cq: completed rdma wr_id 2aaaab62e6c0, nic_wr_credit 24807. [D 20:43:00.394250] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 49/70. [D 20:43:00.394392] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.394413] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.394426] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 4 [D 20:43:00.394482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.394497] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.394510] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.403537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.403601] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.403615] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.403659] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4833 [D 20:43:00.403674] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:43:00.403693] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 50/70. [D 20:43:00.406873] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4821 [D 20:43:00.406902] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 51/70. [D 20:43:00.406920] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4825 [D 20:43:00.406940] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 52/70. [D 20:43:00.406955] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4830 [D 20:43:00.406970] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 53/70. [D 20:43:00.406985] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4833 [D 20:43:00.407000] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 54/70. [D 20:43:00.408159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 24807. [D 20:43:00.408197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 24808. [D 20:43:00.408212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 24809. [D 20:43:00.408226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 24810. [D 20:43:00.408240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 24811. [D 20:43:00.408254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 24812. [D 20:43:00.408269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 24813. [D 20:43:00.408283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24814. [D 20:43:00.408297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24815. [D 20:43:00.408311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24816. [D 20:43:00.408326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 24817. [D 20:43:00.408340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 24818. [D 20:43:00.408355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 24819. [D 20:43:00.408369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 24820. [D 20:43:00.408384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 24821. [D 20:43:00.408398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24822. [D 20:43:00.408413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24823. [D 20:43:00.408427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24824. [D 20:43:00.408442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 24825. [D 20:43:00.408456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 24826. [D 20:43:00.408471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 24827. [D 20:43:00.408485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 24828. [D 20:43:00.408500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 24829. [D 20:43:00.408515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24830. [D 20:43:00.408529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24831. [D 20:43:00.408543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24832. [D 20:43:00.408558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 24833. [D 20:43:00.408573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 24834. [D 20:43:00.408587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 24835. [D 20:43:00.408601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 24836. [D 20:43:00.408616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 24837. [D 20:43:00.408630] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e6c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24838. [D 20:43:00.408647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24839. [D 20:43:00.408662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 24840. [D 20:43:00.408676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 24841. [D 20:43:00.408691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 24842. [D 20:43:00.408705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 24843. [D 20:43:00.408720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 24844. [D 20:43:00.408734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24845. [D 20:43:00.408750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24846. [D 20:43:00.408764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24847. [D 20:43:00.408779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 24848. [D 20:43:00.408793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 24849. [D 20:43:00.408807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 24850. [D 20:43:00.408822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 24851. [D 20:43:00.408836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 24852. [D 20:43:00.408851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24853. [D 20:43:00.408865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24854. [D 20:43:00.408880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24855. [D 20:43:00.408893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24856. [D 20:43:00.408908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24857. [D 20:43:00.408923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24858. [D 20:43:00.408937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24859. [D 20:43:00.408951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24860. [D 20:43:00.408966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24861. [D 20:43:00.408980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24862. [D 20:43:00.408995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24863. [D 20:43:00.409009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24864. [D 20:43:00.409023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24865. [D 20:43:00.409038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24866. [D 20:43:00.409052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24867. [D 20:43:00.409066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24868. [D 20:43:00.409081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24869. [D 20:43:00.409095] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6101c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24870. [D 20:43:00.409111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24871. [D 20:43:00.409126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24872. [D 20:43:00.409140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24873. [D 20:43:00.409155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24874. [D 20:43:00.409170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24875. [D 20:43:00.409184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24876. [E 20:43:00.409204] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24877, block for 10 ms. [D 20:43:00.409237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 24877. [D 20:43:00.409252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24878. [E 20:43:00.409352] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24879, block for 10 ms. [D 20:43:00.418645] openib_check_cq: completed rdma wr_id 2aaaab62e6c0, nic_wr_credit 24878. [D 20:43:00.418668] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 55/70. [D 20:43:00.418683] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 24877. [D 20:43:00.418702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 24878. [D 20:43:00.418717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 24879. [D 20:43:00.418731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 24880. [D 20:43:00.418746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 24881. [D 20:43:00.418760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 24882. [D 20:43:00.418775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 24883. [D 20:43:00.418789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 24884. [D 20:43:00.418804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 24885. [D 20:43:00.418818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 24886. [D 20:43:00.418833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 24887. [D 20:43:00.418847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 24888. [D 20:43:00.418862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 24889. [D 20:43:00.418876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 24890. [D 20:43:00.418891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 24891. [D 20:43:00.418905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 24892. [D 20:43:00.418920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 24893. [D 20:43:00.418934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 24894. [D 20:43:00.418949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 24895. [D 20:43:00.418963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 24896. [D 20:43:00.418978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 24897. [D 20:43:00.418993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 24898. [D 20:43:00.419007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 24899. [D 20:43:00.419021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 24900. [D 20:43:00.419035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 24901. [D 20:43:00.419050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 24902. [D 20:43:00.419064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 24903. [D 20:43:00.419077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 24904. [D 20:43:00.419092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 24905. [D 20:43:00.419106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 24906. [D 20:43:00.419120] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a270 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 24907. [D 20:43:00.419135] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24907. [E 20:43:00.419151] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 24908, block for 10 ms. [D 20:43:00.425777] openib_check_cq: completed rdma wr_id 2aaaab6101c0, nic_wr_credit 24907. [D 20:43:00.425801] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 56/70. [D 20:43:00.425815] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24906. [D 20:43:00.425830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24907. [D 20:43:00.425844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24908. [D 20:43:00.425858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24909. [D 20:43:00.425872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24910. [D 20:43:00.425887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24911. [D 20:43:00.425901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24912. [D 20:43:00.425915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24913. [D 20:43:00.425929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24914. [D 20:43:00.425943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24915. [D 20:43:00.425957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24916. [D 20:43:00.425971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24917. [D 20:43:00.425985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24918. [D 20:43:00.425999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24919. [D 20:43:00.426014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24920. [D 20:43:00.426028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24921. [D 20:43:00.426042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24922. [D 20:43:00.426056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24923. [D 20:43:00.426070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24924. [D 20:43:00.426084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24925. [D 20:43:00.426098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24926. [D 20:43:00.426112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24927. [D 20:43:00.426126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24928. [D 20:43:00.426141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24929. [D 20:43:00.426155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24930. [D 20:43:00.426169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24931. [D 20:43:00.426183] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610360 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24932. [D 20:43:00.426932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.426992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.427006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.432623] openib_check_cq: completed rdma wr_id 2aaaab60a270, nic_wr_credit 24932. [D 20:43:00.432643] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 57/70. [D 20:43:00.432687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.432707] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.432721] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.437619] openib_check_cq: completed rdma wr_id 2aaaab610360, nic_wr_credit 24931. [D 20:43:00.437645] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 58/70. [D 20:43:00.437701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.437721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.437734] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.437766] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.437780] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.437793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:00.452459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.452478] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.452492] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:00.452530] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4838 [D 20:43:00.452545] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:00.452564] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 59/70. [D 20:43:00.452610] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.452624] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.452637] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.452657] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4839 [D 20:43:00.452672] element 0: offset: 0x2aaaab016f20, size: 24 [D 20:43:00.452688] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 60/70. [D 20:43:00.456060] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4838 [D 20:43:00.456087] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 0/70. [D 20:43:00.456149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 24931. [D 20:43:00.456167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 24932. [D 20:43:00.456182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 24933. [D 20:43:00.456196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 24934. [D 20:43:00.456211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 24935. [D 20:43:00.456225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 24936. [D 20:43:00.456240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24937. [D 20:43:00.456254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24938. [D 20:43:00.456268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24939. [D 20:43:00.456283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 24940. [D 20:43:00.456297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 24941. [D 20:43:00.456311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 24942. [D 20:43:00.456325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 24943. [D 20:43:00.456340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 24944. [D 20:43:00.456354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24945. [D 20:43:00.456368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24946. [D 20:43:00.456382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24947. [D 20:43:00.456397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 24948. [D 20:43:00.456411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 24949. [D 20:43:00.456425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 24950. [D 20:43:00.456440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 24951. [D 20:43:00.456454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 24952. [D 20:43:00.456468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24953. [D 20:43:00.456482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24954. [D 20:43:00.456497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24955. [D 20:43:00.456511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 24956. [D 20:43:00.456525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 24957. [D 20:43:00.456539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 24958. [D 20:43:00.456554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 24959. [D 20:43:00.456568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 24960. [D 20:43:00.456582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24961. [D 20:43:00.456597] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e6c0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24962. [D 20:43:00.459617] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4839 [D 20:43:00.459634] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 1/70. [D 20:43:00.464340] openib_check_cq: completed rdma wr_id 2aaaab62e6c0, nic_wr_credit 24962. [D 20:43:00.464362] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 2/70. [D 20:43:00.464385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24962. [D 20:43:00.464400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24963. [D 20:43:00.464415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 24964. [D 20:43:00.464429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 24965. [D 20:43:00.464444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 24966. [D 20:43:00.464458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 24967. [D 20:43:00.464473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 24968. [D 20:43:00.464487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24969. [D 20:43:00.464501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24970. [D 20:43:00.464516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24971. [D 20:43:00.464530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 24972. [D 20:43:00.464544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 24973. [D 20:43:00.464559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 24974. [D 20:43:00.464573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 24975. [D 20:43:00.464588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 24976. [D 20:43:00.464602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24977. [D 20:43:00.464616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24978. [D 20:43:00.464631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24979. [D 20:43:00.464645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24980. [D 20:43:00.464659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24981. [D 20:43:00.464674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24982. [D 20:43:00.464688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24983. [D 20:43:00.464703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24984. [D 20:43:00.464717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24985. [D 20:43:00.464731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24986. [D 20:43:00.464746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24987. [D 20:43:00.464761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24988. [D 20:43:00.464776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24989. [D 20:43:00.464790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24990. [D 20:43:00.464805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24991. [D 20:43:00.464819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24992. [D 20:43:00.464834] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6101c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24993. [D 20:43:00.464918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.464984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.464998] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.476172] openib_check_cq: completed rdma wr_id 2aaaab6101c0, nic_wr_credit 24993. [D 20:43:00.476198] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 3/70. [D 20:43:00.476311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.476331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.476344] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:00.493595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.493612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.493625] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:00.493670] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4844 [D 20:43:00.493686] element 0: offset: 0x5b0030, size: 24 [D 20:43:00.493708] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 4/70. [D 20:43:00.493752] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.493766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.493779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.493799] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4845 [D 20:43:00.493814] element 0: offset: 0x61fad0, size: 24 [D 20:43:00.493828] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 5/70. [D 20:43:00.499916] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4844 [D 20:43:00.499942] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 6/70. [D 20:43:00.499996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 24993. [D 20:43:00.500012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 24994. [D 20:43:00.500027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 24995. [D 20:43:00.500041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 24996. [D 20:43:00.500056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 24997. [D 20:43:00.500070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 24998. [D 20:43:00.500085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24999. [D 20:43:00.500099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25000. [D 20:43:00.500113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25001. [D 20:43:00.500128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 25002. [D 20:43:00.500143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 25003. [D 20:43:00.500158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 25004. [D 20:43:00.500172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 25005. [D 20:43:00.500186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 25006. [D 20:43:00.500201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25007. [D 20:43:00.500216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25008. [D 20:43:00.500230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25009. [D 20:43:00.500244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 25010. [D 20:43:00.500259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 25011. [D 20:43:00.500273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 25012. [D 20:43:00.500288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 25013. [D 20:43:00.500302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 25014. [D 20:43:00.500317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25015. [D 20:43:00.500331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25016. [D 20:43:00.500345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25017. [D 20:43:00.500360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 25018. [D 20:43:00.500374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 25019. [D 20:43:00.500388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 25020. [D 20:43:00.500403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 25021. [D 20:43:00.500417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 25022. [D 20:43:00.500432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25023. [D 20:43:00.500446] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e6c0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25024. [D 20:43:00.504409] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4845 [D 20:43:00.504432] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 7/70. [D 20:43:00.510395] openib_check_cq: completed rdma wr_id 2aaaab62e6c0, nic_wr_credit 25024. [D 20:43:00.510412] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 8/70. [D 20:43:00.510447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25024. [D 20:43:00.510462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25025. [D 20:43:00.510477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25026. [D 20:43:00.510491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25027. [D 20:43:00.510506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25028. [D 20:43:00.510521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25029. [D 20:43:00.510535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25030. [D 20:43:00.510550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25031. [D 20:43:00.510564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25032. [D 20:43:00.510578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25033. [D 20:43:00.510593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25034. [D 20:43:00.510607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25035. [D 20:43:00.510622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25036. [D 20:43:00.510636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25037. [D 20:43:00.510651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25038. [D 20:43:00.510665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25039. [D 20:43:00.510679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25040. [D 20:43:00.510694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25041. [D 20:43:00.510709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25042. [D 20:43:00.510723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25043. [D 20:43:00.510738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25044. [D 20:43:00.510752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25045. [D 20:43:00.510766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25046. [D 20:43:00.510781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25047. [D 20:43:00.510795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25048. [D 20:43:00.510810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25049. [D 20:43:00.510824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25050. [D 20:43:00.510838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25051. [D 20:43:00.510853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25052. [D 20:43:00.510867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25053. [D 20:43:00.510882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25054. [D 20:43:00.510896] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d830 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25055. [D 20:43:00.510980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.511044] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.511058] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.522214] openib_check_cq: completed rdma wr_id 2aaaab60d830, nic_wr_credit 25055. [D 20:43:00.522238] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 9/70. [D 20:43:00.522345] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.522364] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.522377] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:00.558499] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.558517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.558530] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:00.558570] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4848 [D 20:43:00.558585] element 0: offset: 0x2aaaab612850, size: 24 [D 20:43:00.558604] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 10/70. [D 20:43:00.561745] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4848 [D 20:43:00.561771] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 11/70. [D 20:43:00.565788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25055. [D 20:43:00.565810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25056. [D 20:43:00.565825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25057. [D 20:43:00.565839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25058. [D 20:43:00.565854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25059. [D 20:43:00.565868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25060. [D 20:43:00.565883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25061. [D 20:43:00.565897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25062. [D 20:43:00.565912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25063. [D 20:43:00.565926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25064. [D 20:43:00.565941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25065. [D 20:43:00.565955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25066. [D 20:43:00.565970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25067. [D 20:43:00.565984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25068. [D 20:43:00.565999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25069. [D 20:43:00.566013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25070. [D 20:43:00.566028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25071. [D 20:43:00.566042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25072. [D 20:43:00.566057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25073. [D 20:43:00.566081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25074. [D 20:43:00.566096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25075. [D 20:43:00.566119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25076. [D 20:43:00.566134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25077. [D 20:43:00.566157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25078. [D 20:43:00.566172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25079. [D 20:43:00.566199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25080. [D 20:43:00.566214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25081. [D 20:43:00.566237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25082. [D 20:43:00.566259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25083. [D 20:43:00.566274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25084. [D 20:43:00.566288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25085. [D 20:43:00.566311] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e1d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25086. [D 20:43:00.568705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.568766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.568780] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.568823] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4851 [D 20:43:00.568838] element 0: offset: 0x2aaaab62e700, size: 24 [D 20:43:00.568859] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 12/70. [D 20:43:00.577286] openib_check_cq: completed rdma wr_id 2aaaab62e1d0, nic_wr_credit 25086. [D 20:43:00.577307] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 13/70. [D 20:43:00.577413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.577434] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.577447] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.580548] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4851 [D 20:43:00.580570] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 14/70. [D 20:43:00.583226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25086. [D 20:43:00.583243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25087. [D 20:43:00.583257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25088. [D 20:43:00.583271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25089. [D 20:43:00.583286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25090. [D 20:43:00.583300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25091. [D 20:43:00.583314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25092. [D 20:43:00.583341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25093. [D 20:43:00.583355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25094. [D 20:43:00.583385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25095. [D 20:43:00.583409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25096. [D 20:43:00.583424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25097. [D 20:43:00.583439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25098. [D 20:43:00.583463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25099. [D 20:43:00.583478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25100. [D 20:43:00.583504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25101. [D 20:43:00.583519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25102. [D 20:43:00.583544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25103. [D 20:43:00.583569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25104. [D 20:43:00.583584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25105. [D 20:43:00.583611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25106. [D 20:43:00.583627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25107. [D 20:43:00.583643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25108. [D 20:43:00.583666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25109. [D 20:43:00.583680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25110. [D 20:43:00.583708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25111. [D 20:43:00.583732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25112. [D 20:43:00.583748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25113. [D 20:43:00.583762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25114. [D 20:43:00.583776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25115. [D 20:43:00.583791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25116. [D 20:43:00.583806] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a4b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25117. [D 20:43:00.587419] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.587482] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.587496] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.587542] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4855 [D 20:43:00.587557] element 0: offset: 0x2aaaab612870, size: 24 [D 20:43:00.587577] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 15/70. [D 20:43:00.587620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.587634] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.587646] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.587666] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4857 [D 20:43:00.587680] element 0: offset: 0x2aaaab62e4f0, size: 24 [D 20:43:00.587694] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 16/70. [D 20:43:00.594953] openib_check_cq: completed rdma wr_id 2aaaab60a4b0, nic_wr_credit 25117. [D 20:43:00.594976] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 17/70. [D 20:43:00.595129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.595150] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.595163] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.599989] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4855 [D 20:43:00.600016] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 18/70. [D 20:43:00.601289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25117. [D 20:43:00.601307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25118. [D 20:43:00.601323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25119. [D 20:43:00.601337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25120. [D 20:43:00.601352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25121. [D 20:43:00.601367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25122. [D 20:43:00.601382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25123. [D 20:43:00.601397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25124. [D 20:43:00.601423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25125. [D 20:43:00.601437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25126. [D 20:43:00.601460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25127. [D 20:43:00.601475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25128. [D 20:43:00.601498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25129. [D 20:43:00.601513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25130. [D 20:43:00.601542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25131. [D 20:43:00.601567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25132. [D 20:43:00.601582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25133. [D 20:43:00.601596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25134. [D 20:43:00.601620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25135. [D 20:43:00.601635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25136. [D 20:43:00.601670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25137. [D 20:43:00.601685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25138. [D 20:43:00.601700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25139. [D 20:43:00.601723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25140. [D 20:43:00.601738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25141. [D 20:43:00.601763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25142. [D 20:43:00.601791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25143. [D 20:43:00.601807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25144. [D 20:43:00.601831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25145. [D 20:43:00.601846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25146. [D 20:43:00.601860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25147. [D 20:43:00.601875] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a4b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25148. [D 20:43:00.603907] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4857 [D 20:43:00.603926] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 19/70. [D 20:43:00.604361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.604428] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.604443] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.604487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4860 [D 20:43:00.604503] element 0: offset: 0x2aaaab62e680, size: 24 [D 20:43:00.604523] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 20/70. [D 20:43:00.613034] openib_check_cq: completed rdma wr_id 2aaaab60a4b0, nic_wr_credit 25148. [D 20:43:00.613060] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 21/70. [D 20:43:00.613077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25148. [D 20:43:00.613092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25149. [D 20:43:00.613107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 25150. [D 20:43:00.613122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 25151. [D 20:43:00.613136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 25152. [D 20:43:00.613161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 25153. [D 20:43:00.613184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 25154. [D 20:43:00.613199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25155. [D 20:43:00.613213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25156. [D 20:43:00.613228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25157. [D 20:43:00.613243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 25158. [D 20:43:00.613266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 25159. [D 20:43:00.613288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 25160. [D 20:43:00.613303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 25161. [D 20:43:00.613326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 25162. [D 20:43:00.613340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25163. [D 20:43:00.613369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25164. [D 20:43:00.613384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25165. [D 20:43:00.613408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25166. [D 20:43:00.613423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25167. [D 20:43:00.613445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25168. [D 20:43:00.613460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25169. [D 20:43:00.613483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25170. [D 20:43:00.613510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25171. [D 20:43:00.613525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25172. [D 20:43:00.613540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25173. [D 20:43:00.613554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25174. [D 20:43:00.613569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25175. [D 20:43:00.613587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25176. [D 20:43:00.613602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25177. [D 20:43:00.613617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25178. [D 20:43:00.613632] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e3a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25179. [D 20:43:00.613692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.613712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.613725] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.616845] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4860 [D 20:43:00.616912] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 22/70. [D 20:43:00.621348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.621368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.621381] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.621422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4863 [D 20:43:00.621437] element 0: offset: 0x2aaaab603ec0, size: 24 [D 20:43:00.621454] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 23/70. [D 20:43:00.624765] openib_check_cq: completed rdma wr_id 2aaaab62e3a0, nic_wr_credit 25179. [D 20:43:00.624790] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 24/70. [D 20:43:00.624813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25179. [D 20:43:00.624828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25180. [D 20:43:00.624843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25181. [D 20:43:00.624858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25182. [D 20:43:00.624873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25183. [D 20:43:00.624889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25184. [D 20:43:00.624904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25185. [D 20:43:00.624919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25186. [D 20:43:00.624948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25187. [D 20:43:00.624963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25188. [D 20:43:00.624986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25189. [D 20:43:00.625001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25190. [D 20:43:00.625028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25191. [D 20:43:00.625043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25192. [D 20:43:00.625058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25193. [D 20:43:00.625084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25194. [D 20:43:00.625109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25195. [D 20:43:00.625135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25196. [D 20:43:00.625150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25197. [D 20:43:00.625178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25198. [D 20:43:00.625193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25199. [D 20:43:00.625217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25200. [D 20:43:00.625232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25201. [D 20:43:00.625258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25202. [D 20:43:00.625282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25203. [D 20:43:00.625296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25204. [D 20:43:00.625325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25205. [D 20:43:00.625348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25206. [D 20:43:00.625363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25207. [D 20:43:00.625388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25208. [D 20:43:00.625403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25209. [D 20:43:00.625428] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25210. [D 20:43:00.625560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.625581] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.625594] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.628775] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4863 [D 20:43:00.834770] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25210. [D 20:43:00.834808] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 25/70. [D 20:43:00.835123] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 26/70. [D 20:43:00.835193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.835211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.835223] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.835264] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4866 [D 20:43:00.835279] element 0: offset: 0x2aaaab612870, size: 24 [D 20:43:00.835295] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 27/70. [D 20:43:00.835327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.835341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.835354] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.835375] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4870 [D 20:43:00.835389] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:00.835406] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 28/70. [D 20:43:00.835444] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.835458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.835471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.840000] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4866 [D 20:43:00.840029] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 29/70. [D 20:43:00.840415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25210. [D 20:43:00.840433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25211. [D 20:43:00.840448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25212. [D 20:43:00.840463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25213. [D 20:43:00.840478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25214. [D 20:43:00.840493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25215. [D 20:43:00.840508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25216. [D 20:43:00.840522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25217. [D 20:43:00.840537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25218. [D 20:43:00.840553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25219. [D 20:43:00.840567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25220. [D 20:43:00.840582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25221. [D 20:43:00.840597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25222. [D 20:43:00.840612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25223. [D 20:43:00.840627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25224. [D 20:43:00.840642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25225. [D 20:43:00.840657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25226. [D 20:43:00.840672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25227. [D 20:43:00.840686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25228. [D 20:43:00.840701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25229. [D 20:43:00.840717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25230. [D 20:43:00.840732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25231. [D 20:43:00.840747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25232. [D 20:43:00.840762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25233. [D 20:43:00.840777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25234. [D 20:43:00.840792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25235. [D 20:43:00.840807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25236. [D 20:43:00.840822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25237. [D 20:43:00.840836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25238. [D 20:43:00.840851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25239. [D 20:43:00.840865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25240. [D 20:43:00.840881] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25241. [D 20:43:00.840898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25242. [D 20:43:00.840913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25243. [D 20:43:00.840928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 25244. [D 20:43:00.840943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 25245. [D 20:43:00.840958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 25246. [D 20:43:00.840973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 25247. [D 20:43:00.840988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 25248. [D 20:43:00.841003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25249. [D 20:43:00.841018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25250. [D 20:43:00.841033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25251. [D 20:43:00.841048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 25252. [D 20:43:00.841063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 25253. [D 20:43:00.841078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 25254. [D 20:43:00.841093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 25255. [D 20:43:00.841110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 25256. [D 20:43:00.841124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25257. [D 20:43:00.841139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25258. [D 20:43:00.841153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25259. [D 20:43:00.841168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25260. [D 20:43:00.841183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25261. [D 20:43:00.841198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25262. [D 20:43:00.841213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25263. [D 20:43:00.841228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25264. [D 20:43:00.841243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25265. [D 20:43:00.841258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25266. [D 20:43:00.841273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25267. [D 20:43:00.841288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25268. [D 20:43:00.841303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25269. [D 20:43:00.841318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25270. [D 20:43:00.841333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25271. [D 20:43:00.841348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25272. [D 20:43:00.841363] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617cc0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25273. [D 20:43:00.843363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.843430] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.843444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.843489] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4872 [D 20:43:00.843504] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:43:00.843525] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 30/70. [D 20:43:00.843580] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4870 [D 20:43:00.843606] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 31/70. [D 20:43:00.846300] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25273. [D 20:43:00.846346] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 32/70. [D 20:43:00.856109] openib_check_cq: completed rdma wr_id 2aaaab617cc0, nic_wr_credit 25272. [D 20:43:00.856131] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 33/70. [D 20:43:00.856161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25272. [D 20:43:00.856177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25273. [D 20:43:00.856192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25274. [D 20:43:00.856195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.856211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25275. [D 20:43:00.856234] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.856250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25276. [D 20:43:00.856265] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.856283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25277. [D 20:43:00.856312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25278. [D 20:43:00.856328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25279. [D 20:43:00.856343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25280. [D 20:43:00.856359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25281. [D 20:43:00.856374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25282. [D 20:43:00.856389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25283. [D 20:43:00.856405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25284. [D 20:43:00.856420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25285. [D 20:43:00.856435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25286. [D 20:43:00.856450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25287. [D 20:43:00.856465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25288. [D 20:43:00.856481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25289. [D 20:43:00.856496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25290. [D 20:43:00.856511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25291. [D 20:43:00.856526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25292. [D 20:43:00.856541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25293. [D 20:43:00.856557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25294. [D 20:43:00.856571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25295. [D 20:43:00.856587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25296. [D 20:43:00.856602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25297. [D 20:43:00.856617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25298. [D 20:43:00.856632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25299. [D 20:43:00.856647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25300. [D 20:43:00.856662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25301. [D 20:43:00.856677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25302. [D 20:43:00.856693] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e300 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25303. [D 20:43:00.856740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.856760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.856773] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.859789] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4872 [D 20:43:00.859811] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 34/70. [D 20:43:00.863950] openib_check_cq: completed rdma wr_id 2aaaab62e300, nic_wr_credit 25303. [D 20:43:00.863972] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 35/70. [D 20:43:00.864050] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.864095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.864108] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.867353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 25303. [D 20:43:00.867377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 25304. [D 20:43:00.867391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25305. [D 20:43:00.867406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25306. [D 20:43:00.867434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25307. [D 20:43:00.867449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25308. [D 20:43:00.867464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25309. [D 20:43:00.867479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25310. [D 20:43:00.867493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25311. [D 20:43:00.867508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25312. [D 20:43:00.867522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25313. [D 20:43:00.867537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25314. [D 20:43:00.867552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25315. [D 20:43:00.867566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25316. [D 20:43:00.867581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25317. [D 20:43:00.867596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25318. [D 20:43:00.867650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25319. [D 20:43:00.867703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25320. [D 20:43:00.867718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25321. [D 20:43:00.867733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25322. [D 20:43:00.867747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25323. [D 20:43:00.867762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25324. [D 20:43:00.867778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25325. [D 20:43:00.867792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25326. [D 20:43:00.867806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25327. [D 20:43:00.867821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25328. [D 20:43:00.867835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25329. [D 20:43:00.867850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25330. [D 20:43:00.867865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25331. [D 20:43:00.867880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25332. [D 20:43:00.867899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25333. [D 20:43:00.867914] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25334. [D 20:43:00.873263] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25334. [D 20:43:00.873284] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 36/70. [D 20:43:00.876404] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.876423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.876437] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.876479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4876 [D 20:43:00.876495] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:43:00.876511] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 37/70. [D 20:43:00.876555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.876571] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.876584] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.880029] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.880051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.880064] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.880102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4879 [D 20:43:00.880117] element 0: offset: 0x2aaaab037660, size: 24 [D 20:43:00.880139] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 38/70. [D 20:43:00.880172] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.880186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.880198] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.880218] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4882 [D 20:43:00.880232] element 0: offset: 0x2aaaab012170, size: 24 [D 20:43:00.880245] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 39/70. [D 20:43:00.882063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.882129] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.882143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.882186] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4884 [D 20:43:00.882201] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:43:00.882220] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 40/70. [D 20:43:00.887959] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4882 [D 20:43:00.887984] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 41/70. [D 20:43:00.888037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25334. [D 20:43:00.888055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25335. [D 20:43:00.888070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25336. [D 20:43:00.888084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25337. [D 20:43:00.888099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25338. [D 20:43:00.888114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25339. [D 20:43:00.888129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25340. [D 20:43:00.888144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25341. [D 20:43:00.888158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25342. [D 20:43:00.888173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25343. [D 20:43:00.888188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25344. [D 20:43:00.888202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25345. [D 20:43:00.888217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25346. [D 20:43:00.888232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25347. [D 20:43:00.888246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25348. [D 20:43:00.888261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25349. [D 20:43:00.888276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25350. [D 20:43:00.888291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25351. [D 20:43:00.888305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25352. [D 20:43:00.888320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25353. [D 20:43:00.888335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25354. [D 20:43:00.888349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25355. [D 20:43:00.888364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25356. [D 20:43:00.888379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25357. [D 20:43:00.888394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25358. [D 20:43:00.888408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25359. [D 20:43:00.888423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25360. [D 20:43:00.888437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25361. [D 20:43:00.888452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25362. [D 20:43:00.888467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25363. [D 20:43:00.888484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25364. [D 20:43:00.888498] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25365. [D 20:43:00.891678] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4884 [D 20:43:00.891696] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 42/70. [D 20:43:00.891748] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4879 [D 20:43:00.891766] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 43/70. [D 20:43:00.894125] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4876 [D 20:43:00.894149] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 44/70. [D 20:43:00.895259] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25365. [D 20:43:00.895275] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 45/70. [D 20:43:00.895305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25365. [D 20:43:00.895321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25366. [D 20:43:00.895336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25367. [D 20:43:00.895351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25368. [D 20:43:00.895366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25369. [D 20:43:00.895381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25370. [D 20:43:00.895395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25371. [D 20:43:00.895410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25372. [D 20:43:00.895425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25373. [D 20:43:00.895440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25374. [D 20:43:00.895455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25375. [D 20:43:00.895470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25376. [D 20:43:00.895485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25377. [D 20:43:00.895500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25378. [D 20:43:00.895514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25379. [D 20:43:00.895529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25380. [D 20:43:00.895544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25381. [D 20:43:00.895559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25382. [D 20:43:00.895574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25383. [D 20:43:00.895589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25384. [D 20:43:00.895604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25385. [D 20:43:00.895619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25386. [D 20:43:00.895635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25387. [D 20:43:00.895650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25388. [D 20:43:00.895665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25389. [D 20:43:00.895679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25390. [D 20:43:00.895694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25391. [D 20:43:00.895709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25392. [D 20:43:00.895724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25393. [D 20:43:00.895739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25394. [D 20:43:00.895754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25395. [D 20:43:00.895769] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25396. [D 20:43:00.895785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25397. [D 20:43:00.895800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25398. [D 20:43:00.895815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 25399. [D 20:43:00.895830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 25400. [D 20:43:00.895845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 25401. [D 20:43:00.895859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 25402. [D 20:43:00.895874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 25403. [D 20:43:00.895894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25404. [D 20:43:00.895909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25405. [D 20:43:00.895924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25406. [D 20:43:00.895940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 25407. [D 20:43:00.895954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 25408. [D 20:43:00.895969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 25409. [D 20:43:00.895984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 25410. [D 20:43:00.895999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 25411. [D 20:43:00.896014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25412. [D 20:43:00.896029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25413. [D 20:43:00.896043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25414. [D 20:43:00.896059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25415. [D 20:43:00.896074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25416. [D 20:43:00.896089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25417. [D 20:43:00.896104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25418. [D 20:43:00.896119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25419. [D 20:43:00.896134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25420. [D 20:43:00.896149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25421. [D 20:43:00.896164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25422. [D 20:43:00.896178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25423. [D 20:43:00.896193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25424. [D 20:43:00.896208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25425. [D 20:43:00.896223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25426. [D 20:43:00.896238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25427. [D 20:43:00.896253] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e070 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25428. [D 20:43:00.896269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25429. [D 20:43:00.896284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25430. [D 20:43:00.896299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25431. [D 20:43:00.896314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25432. [D 20:43:00.896329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25433. [D 20:43:00.896344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25434. [E 20:43:00.896362] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25435, block for 10 ms. [D 20:43:00.896398] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25434. [D 20:43:00.896416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25435. [E 20:43:00.896432] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25436, block for 10 ms. [D 20:43:00.907064] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25435. [D 20:43:00.907086] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 46/70. [D 20:43:00.907101] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25434. [D 20:43:00.907116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25435. [D 20:43:00.907131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25436. [D 20:43:00.907146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25437. [D 20:43:00.907161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25438. [D 20:43:00.907177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25439. [D 20:43:00.907192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25440. [D 20:43:00.907207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25441. [D 20:43:00.907222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25442. [D 20:43:00.907237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25443. [D 20:43:00.907251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25444. [D 20:43:00.907266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25445. [D 20:43:00.907281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25446. [D 20:43:00.907296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25447. [D 20:43:00.907311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25448. [D 20:43:00.907326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25449. [D 20:43:00.907341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25450. [D 20:43:00.907356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25451. [D 20:43:00.907371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25452. [D 20:43:00.907386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25453. [D 20:43:00.907401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25454. [D 20:43:00.907416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25455. [D 20:43:00.907430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25456. [D 20:43:00.907445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25457. [D 20:43:00.907460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25458. [D 20:43:00.907475] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e1d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25459. [D 20:43:00.907557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.907624] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.907637] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.918703] openib_check_cq: completed rdma wr_id 2aaaab62e070, nic_wr_credit 25459. [D 20:43:00.918736] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 47/70. [D 20:43:00.920918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.920937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.920950] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.923620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.923640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.923653] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.923696] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4888 [D 20:43:00.923712] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:00.923732] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 48/70. [D 20:43:00.929043] openib_check_cq: completed rdma wr_id 2aaaab62e1d0, nic_wr_credit 25458. [D 20:43:00.929068] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 49/70. [D 20:43:00.929121] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.929141] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.929155] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:00.929237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.929252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.929264] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:00.932656] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4888 [D 20:43:00.932676] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 50/70. [D 20:43:00.933691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25458. [D 20:43:00.933722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25459. [D 20:43:00.933737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25460. [D 20:43:00.933761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25461. [D 20:43:00.933789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25462. [D 20:43:00.933805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25463. [D 20:43:00.933830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25464. [D 20:43:00.933859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25465. [D 20:43:00.933874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25466. [D 20:43:00.933900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25467. [D 20:43:00.933928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25468. [D 20:43:00.933944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25469. [D 20:43:00.933959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25470. [D 20:43:00.933983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25471. [D 20:43:00.933998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25472. [D 20:43:00.934025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25473. [D 20:43:00.934041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25474. [D 20:43:00.934055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25475. [D 20:43:00.934070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25476. [D 20:43:00.934085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25477. [D 20:43:00.934104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25478. [D 20:43:00.934121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25479. [D 20:43:00.934136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25480. [D 20:43:00.934151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25481. [D 20:43:00.934167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25482. [D 20:43:00.934182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25483. [D 20:43:00.934198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25484. [D 20:43:00.934213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25485. [D 20:43:00.934227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25486. [D 20:43:00.934243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25487. [D 20:43:00.934258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25488. [D 20:43:00.934273] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25489. [D 20:43:00.945313] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25489. [D 20:43:00.945334] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 51/70. [D 20:43:00.945426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.945486] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.945500] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:00.950659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.950678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.950691] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:00.950732] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4892 [D 20:43:00.950747] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:43:00.950766] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 52/70. [D 20:43:00.950812] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.950826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.950838] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:00.950859] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4894 [D 20:43:00.950873] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:00.950890] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 53/70. [D 20:43:00.950988] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.951002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.951015] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:00.951035] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4896 [D 20:43:00.951049] element 0: offset: 0x691fe0, size: 24 [D 20:43:00.951066] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 54/70. [D 20:43:00.956720] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:00.956743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.956758] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:00.956784] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4900 [D 20:43:00.956800] element 0: offset: 0x61e740, size: 24 [D 20:43:00.956817] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 55/70. [D 20:43:00.960007] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4894 [D 20:43:00.960028] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 56/70. [D 20:43:00.960083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25489. [D 20:43:00.960101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25490. [D 20:43:00.960117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25491. [D 20:43:00.960132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25492. [D 20:43:00.960148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25493. [D 20:43:00.960163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25494. [D 20:43:00.960179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25495. [D 20:43:00.960194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25496. [D 20:43:00.960209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25497. [D 20:43:00.960224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25498. [D 20:43:00.960239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25499. [D 20:43:00.960254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25500. [D 20:43:00.960270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25501. [D 20:43:00.960284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25502. [D 20:43:00.960300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25503. [D 20:43:00.960315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25504. [D 20:43:00.960330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25505. [D 20:43:00.960346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25506. [D 20:43:00.960361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25507. [D 20:43:00.960376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25508. [D 20:43:00.960391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25509. [D 20:43:00.960406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25510. [D 20:43:00.960422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25511. [D 20:43:00.960437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25512. [D 20:43:00.960452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25513. [D 20:43:00.960467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25514. [D 20:43:00.960482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25515. [D 20:43:00.960497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25516. [D 20:43:00.960512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25517. [D 20:43:00.960527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25518. [D 20:43:00.960543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25519. [D 20:43:00.960558] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6127e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25520. [D 20:43:00.963194] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4892 [D 20:43:00.963219] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 57/70. [D 20:43:00.963239] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4896 [D 20:43:00.963258] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 58/70. [D 20:43:00.963274] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4900 [D 20:43:00.963289] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 59/70. [D 20:43:00.971097] openib_check_cq: completed rdma wr_id 2aaaab6127e0, nic_wr_credit 25520. [D 20:43:00.971116] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 60/70. [D 20:43:00.971141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25520. [D 20:43:00.971157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25521. [D 20:43:00.971172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25522. [D 20:43:00.971187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25523. [D 20:43:00.971203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25524. [D 20:43:00.971218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25525. [D 20:43:00.971233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25526. [D 20:43:00.971248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25527. [D 20:43:00.971263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25528. [D 20:43:00.971278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25529. [D 20:43:00.971293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25530. [D 20:43:00.971308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25531. [D 20:43:00.971323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25532. [D 20:43:00.971338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25533. [D 20:43:00.971353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25534. [D 20:43:00.971368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25535. [D 20:43:00.971383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25536. [D 20:43:00.971398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25537. [D 20:43:00.971413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25538. [D 20:43:00.971428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25539. [D 20:43:00.971443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25540. [D 20:43:00.971458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25541. [D 20:43:00.971473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25542. [D 20:43:00.971488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25543. [D 20:43:00.971503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25544. [D 20:43:00.971519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25545. [D 20:43:00.971534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25546. [D 20:43:00.971548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25547. [D 20:43:00.971563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25548. [D 20:43:00.971578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25549. [D 20:43:00.971593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25550. [D 20:43:00.971608] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25551. [D 20:43:00.971625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25552. [D 20:43:00.971640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25553. [D 20:43:00.971655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 25554. [D 20:43:00.971670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 25555. [D 20:43:00.971685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 25556. [D 20:43:00.971700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 25557. [D 20:43:00.971715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 25558. [D 20:43:00.971730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25559. [D 20:43:00.971745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25560. [D 20:43:00.971759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25561. [D 20:43:00.971774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 25562. [D 20:43:00.971789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 25563. [D 20:43:00.971804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 25564. [D 20:43:00.971819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 25565. [D 20:43:00.971834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 25566. [D 20:43:00.971849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25567. [D 20:43:00.971864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25568. [D 20:43:00.971879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25569. [D 20:43:00.971898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25570. [D 20:43:00.971913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25571. [D 20:43:00.971928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25572. [D 20:43:00.971943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25573. [D 20:43:00.971959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25574. [D 20:43:00.971974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25575. [D 20:43:00.971989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25576. [D 20:43:00.972004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25577. [D 20:43:00.972018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25578. [D 20:43:00.972033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25579. [D 20:43:00.972048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25580. [D 20:43:00.972063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25581. [D 20:43:00.972077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25582. [D 20:43:00.972092] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e070 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25583. [D 20:43:00.972108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25584. [D 20:43:00.972123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25585. [D 20:43:00.972138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25586. [D 20:43:00.972153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25587. [D 20:43:00.972168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25588. [D 20:43:00.972182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25589. [E 20:43:00.972199] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25590, block for 10 ms. [D 20:43:00.972228] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25589. [D 20:43:00.972244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25590. [E 20:43:00.972260] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25591, block for 10 ms. [D 20:43:00.982839] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25590. [D 20:43:00.982858] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 0/70. [D 20:43:00.982873] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25589. [D 20:43:00.982888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25590. [D 20:43:00.982903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25591. [D 20:43:00.982918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25592. [D 20:43:00.982933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25593. [D 20:43:00.982947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25594. [D 20:43:00.982962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25595. [D 20:43:00.982977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25596. [D 20:43:00.982992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25597. [D 20:43:00.983007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25598. [D 20:43:00.983022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25599. [D 20:43:00.983037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25600. [D 20:43:00.983052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25601. [D 20:43:00.983066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25602. [D 20:43:00.983081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25603. [D 20:43:00.983096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25604. [D 20:43:00.983110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25605. [D 20:43:00.983125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25606. [D 20:43:00.983140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25607. [D 20:43:00.983155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25608. [D 20:43:00.983169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25609. [D 20:43:00.983184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25610. [D 20:43:00.983199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25611. [D 20:43:00.983213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25612. [D 20:43:00.983228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25613. [D 20:43:00.983243] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617b90 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25614. [D 20:43:00.983977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.984041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.984055] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:00.994479] openib_check_cq: completed rdma wr_id 2aaaab62e070, nic_wr_credit 25614. [D 20:43:00.994499] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 1/70. [D 20:43:00.996690] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:00.996711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:00.996724] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.006196] openib_check_cq: completed rdma wr_id 2aaaab617b90, nic_wr_credit 25613. [D 20:43:01.006222] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 2/70. [D 20:43:01.006267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.006288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.006301] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.006328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.006342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.006355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:01.006651] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.006665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.006678] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:01.295755] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4902 [D 20:43:01.295778] element 0: offset: 0x5b0030, size: 24 [D 20:43:01.296365] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 3/70. [D 20:43:01.296416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.296431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.296444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.296467] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4906 [D 20:43:01.296481] element 0: offset: 0x2aaaab6103a0, size: 24 [D 20:43:01.296498] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 4/70. [D 20:43:01.296533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.296547] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.296560] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.296580] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4909 [D 20:43:01.296594] element 0: offset: 0x2aaaab027b30, size: 24 [D 20:43:01.296611] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 5/70. [D 20:43:01.296640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.296654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.296666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.296685] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4911 [D 20:43:01.296699] element 0: offset: 0x2aaaab014b70, size: 24 [D 20:43:01.296715] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 6/70. [D 20:43:01.299984] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 4902 [D 20:43:01.300015] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 7/70. [D 20:43:01.301171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25613. [D 20:43:01.301195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25614. [D 20:43:01.301211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25615. [D 20:43:01.301226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25616. [D 20:43:01.301245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25617. [D 20:43:01.301260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25618. [D 20:43:01.301275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25619. [D 20:43:01.301290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25620. [D 20:43:01.301305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25621. [D 20:43:01.301320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25622. [D 20:43:01.301335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25623. [D 20:43:01.301350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25624. [D 20:43:01.301365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25625. [D 20:43:01.301380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25626. [D 20:43:01.301395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25627. [D 20:43:01.301409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25628. [D 20:43:01.301425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25629. [D 20:43:01.301440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25630. [D 20:43:01.301455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25631. [D 20:43:01.301470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25632. [D 20:43:01.301484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25633. [D 20:43:01.301499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25634. [D 20:43:01.301514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25635. [D 20:43:01.301529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25636. [D 20:43:01.301544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25637. [D 20:43:01.301558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25638. [D 20:43:01.301573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25639. [D 20:43:01.301588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25640. [D 20:43:01.301602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25641. [D 20:43:01.301617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25642. [D 20:43:01.301632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25643. [D 20:43:01.301647] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25644. [D 20:43:01.307557] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25644. [D 20:43:01.307580] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 8/70. [D 20:43:01.310622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.310640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.310654] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.310689] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4906 [D 20:43:01.310705] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 9/70. [D 20:43:01.310721] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4909 [D 20:43:01.310741] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 10/70. [D 20:43:01.310758] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4911 [D 20:43:01.310772] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 11/70. [D 20:43:01.313259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25644. [D 20:43:01.313281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25645. [D 20:43:01.313296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25646. [D 20:43:01.313311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25647. [D 20:43:01.313326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25648. [D 20:43:01.313340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25649. [D 20:43:01.313355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25650. [D 20:43:01.313370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25651. [D 20:43:01.313384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25652. [D 20:43:01.313399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25653. [D 20:43:01.313414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25654. [D 20:43:01.313428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25655. [D 20:43:01.313443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25656. [D 20:43:01.313458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25657. [D 20:43:01.313472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25658. [D 20:43:01.313487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25659. [D 20:43:01.313502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25660. [D 20:43:01.313516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25661. [D 20:43:01.313542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25662. [D 20:43:01.313557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25663. [D 20:43:01.313572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25664. [D 20:43:01.313586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25665. [D 20:43:01.313601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25666. [D 20:43:01.313615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25667. [D 20:43:01.313630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25668. [D 20:43:01.313644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25669. [D 20:43:01.313659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25670. [D 20:43:01.313673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25671. [D 20:43:01.313688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25672. [D 20:43:01.313702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25673. [D 20:43:01.313717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25674. [D 20:43:01.313731] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25675. [D 20:43:01.313748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25676. [D 20:43:01.313763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 25677. [D 20:43:01.313777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 25678. [D 20:43:01.313792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 25679. [D 20:43:01.313807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 25680. [D 20:43:01.313822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 25681. [D 20:43:01.313837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25682. [D 20:43:01.313852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25683. [D 20:43:01.313866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25684. [D 20:43:01.313881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 25685. [D 20:43:01.313896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 25686. [D 20:43:01.313911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 25687. [D 20:43:01.313926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 25688. [D 20:43:01.313940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 25689. [D 20:43:01.313955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25690. [D 20:43:01.313970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25691. [D 20:43:01.313985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25692. [D 20:43:01.313999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25693. [D 20:43:01.314014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25694. [D 20:43:01.314029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25695. [D 20:43:01.314044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25696. [D 20:43:01.314059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25697. [D 20:43:01.314074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25698. [D 20:43:01.314088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25699. [D 20:43:01.314103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25700. [D 20:43:01.314118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25701. [D 20:43:01.314133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25702. [D 20:43:01.314147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25703. [D 20:43:01.314162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25704. [D 20:43:01.314177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25705. [D 20:43:01.314192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25706. [D 20:43:01.314207] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25707. [D 20:43:01.314223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25708. [D 20:43:01.314239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25709. [D 20:43:01.314254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25710. [D 20:43:01.314268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25711. [D 20:43:01.314283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25712. [D 20:43:01.314298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25713. [D 20:43:01.314313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25714. [E 20:43:01.314330] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25715, block for 10 ms. [D 20:43:01.315913] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25714. [E 20:43:01.315936] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25715, block for 10 ms. [D 20:43:01.319210] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 25714. [D 20:43:01.319232] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 12/70. [D 20:43:01.319247] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25713. [D 20:43:01.319263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25714. [D 20:43:01.319281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25715. [D 20:43:01.319296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25716. [D 20:43:01.319312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25717. [D 20:43:01.319327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25718. [D 20:43:01.319342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25719. [D 20:43:01.319357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25720. [D 20:43:01.319372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25721. [D 20:43:01.319387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25722. [D 20:43:01.319402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25723. [D 20:43:01.319417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25724. [D 20:43:01.319432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25725. [D 20:43:01.319447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25726. [D 20:43:01.319463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25727. [D 20:43:01.319477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25728. [D 20:43:01.319493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25729. [D 20:43:01.319508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25730. [D 20:43:01.319523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25731. [D 20:43:01.319537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25732. [D 20:43:01.319552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25733. [D 20:43:01.319567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25734. [D 20:43:01.319582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25735. [D 20:43:01.319597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25736. [D 20:43:01.319612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25737. [D 20:43:01.319626] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25738. [D 20:43:01.319986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.320058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.320072] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.320119] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4914 [D 20:43:01.320134] element 0: offset: 0x2aaaab012170, size: 24 [D 20:43:01.320155] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 13/70. [D 20:43:01.329162] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 25738. [D 20:43:01.329186] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 14/70. [D 20:43:01.331929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.331953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.331967] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.336731] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25737. [D 20:43:01.336755] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 15/70. [D 20:43:01.339649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.339665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.339678] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.339755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.339771] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.339784] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.342654] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4914 [D 20:43:01.342673] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 16/70. [D 20:43:01.347813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25737. [D 20:43:01.347830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25738. [D 20:43:01.347844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25739. [D 20:43:01.347859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25740. [D 20:43:01.347874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25741. [D 20:43:01.347888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25742. [D 20:43:01.347906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25743. [D 20:43:01.347921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25744. [D 20:43:01.347935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25745. [D 20:43:01.347950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25746. [D 20:43:01.347965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25747. [D 20:43:01.347979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25748. [D 20:43:01.347993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25749. [D 20:43:01.348007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25750. [D 20:43:01.348022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25751. [D 20:43:01.348036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25752. [D 20:43:01.348050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25753. [D 20:43:01.348064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25754. [D 20:43:01.348078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25755. [D 20:43:01.348093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25756. [D 20:43:01.348107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25757. [D 20:43:01.348121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25758. [D 20:43:01.348136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25759. [D 20:43:01.348150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25760. [D 20:43:01.348164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25761. [D 20:43:01.348178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25762. [D 20:43:01.348192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25763. [D 20:43:01.348206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25764. [D 20:43:01.348220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25765. [D 20:43:01.348235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25766. [D 20:43:01.348249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25767. [D 20:43:01.348263] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25768. [D 20:43:01.351970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.352029] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.352043] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.352087] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4919 [D 20:43:01.352103] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:01.352124] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 17/70. [D 20:43:01.352161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.352175] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.352188] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.352209] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4922 [D 20:43:01.352223] element 0: offset: 0x2aaaab02d6a0, size: 24 [D 20:43:01.352237] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 18/70. [D 20:43:01.352263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.352277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.352290] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.352312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4923 [D 20:43:01.352326] element 0: offset: 0x2aaaab0335b0, size: 24 [D 20:43:01.352341] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 19/70. [D 20:43:01.353707] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 25768. [D 20:43:01.353732] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 20/70. [D 20:43:01.353997] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.354016] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.354029] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.360054] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4922 [D 20:43:01.360078] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 21/70. [D 20:43:01.360139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25768. [D 20:43:01.360156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 25769. [D 20:43:01.360171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 25770. [D 20:43:01.360185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 25771. [D 20:43:01.360200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 25772. [D 20:43:01.360215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 25773. [D 20:43:01.360229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25774. [D 20:43:01.360244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25775. [D 20:43:01.360258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25776. [D 20:43:01.360273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 25777. [D 20:43:01.360288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 25778. [D 20:43:01.360302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 25779. [D 20:43:01.360317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 25780. [D 20:43:01.360332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 25781. [D 20:43:01.360346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25782. [D 20:43:01.360361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25783. [D 20:43:01.360375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25784. [D 20:43:01.360390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25785. [D 20:43:01.360404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25786. [D 20:43:01.360419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25787. [D 20:43:01.360434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25788. [D 20:43:01.360449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25789. [D 20:43:01.360464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25790. [D 20:43:01.360478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25791. [D 20:43:01.360492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25792. [D 20:43:01.360507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25793. [D 20:43:01.360532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25794. [D 20:43:01.360547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25795. [D 20:43:01.360561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25796. [D 20:43:01.360576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25797. [D 20:43:01.360600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25798. [D 20:43:01.360614] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25799. [D 20:43:01.363922] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4919 [D 20:43:01.363999] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 22/70. [D 20:43:01.364028] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4923 [D 20:43:01.364043] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 23/70. [D 20:43:01.364094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.364111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.364124] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.364165] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4926 [D 20:43:01.364180] element 0: offset: 0x2aaaab014b70, size: 24 [D 20:43:01.364196] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 24/70. [D 20:43:01.371452] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 25799. [D 20:43:01.371478] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 25/70. [D 20:43:01.371494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25799. [D 20:43:01.371509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25800. [D 20:43:01.371523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25801. [D 20:43:01.371537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25802. [D 20:43:01.371552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25803. [D 20:43:01.371566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25804. [D 20:43:01.371580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25805. [D 20:43:01.371594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25806. [D 20:43:01.371608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25807. [D 20:43:01.371622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25808. [D 20:43:01.371637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25809. [D 20:43:01.371651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25810. [D 20:43:01.371666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25811. [D 20:43:01.371680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25812. [D 20:43:01.371695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25813. [D 20:43:01.371709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25814. [D 20:43:01.371723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25815. [D 20:43:01.371737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25816. [D 20:43:01.371752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25817. [D 20:43:01.371766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25818. [D 20:43:01.371780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25819. [D 20:43:01.371794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25820. [D 20:43:01.371809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25821. [D 20:43:01.371823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25822. [D 20:43:01.371837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25823. [D 20:43:01.371851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25824. [D 20:43:01.371865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25825. [D 20:43:01.371880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25826. [D 20:43:01.371898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25827. [D 20:43:01.371913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25828. [D 20:43:01.371927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25829. [D 20:43:01.371942] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25830. [D 20:43:01.371958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25831. [D 20:43:01.371973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25832. [D 20:43:01.371988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25833. [D 20:43:01.372002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25834. [D 20:43:01.372017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25835. [D 20:43:01.372032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25836. [D 20:43:01.372046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25837. [D 20:43:01.372061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25838. [D 20:43:01.372076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25839. [D 20:43:01.372091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25840. [D 20:43:01.372105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25841. [D 20:43:01.372120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25842. [D 20:43:01.372144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25843. [D 20:43:01.372167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25844. [D 20:43:01.372182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25845. [D 20:43:01.372196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25846. [D 20:43:01.372219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25847. [D 20:43:01.372233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25848. [D 20:43:01.372255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25849. [D 20:43:01.372270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25850. [D 20:43:01.372298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25851. [D 20:43:01.372314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25852. [D 20:43:01.372338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25853. [D 20:43:01.372359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25854. [D 20:43:01.372374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25855. [D 20:43:01.372388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25856. [D 20:43:01.372403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25857. [D 20:43:01.372432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25858. [D 20:43:01.372447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25859. [D 20:43:01.372471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25860. [D 20:43:01.372485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25861. [D 20:43:01.372507] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25862. [D 20:43:01.372576] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.372596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.372609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.375731] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4926 [D 20:43:01.375797] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 26/70. [D 20:43:01.383165] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25862. [D 20:43:01.383191] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 27/70. [D 20:43:01.394852] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 25861. [D 20:43:01.394873] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 28/70. [D 20:43:01.394901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25861. [D 20:43:01.394918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25862. [D 20:43:01.394935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 25863. [D 20:43:01.394942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.394950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 25864. [D 20:43:01.394973] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.394989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 25865. [D 20:43:01.395005] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.395023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 25866. [D 20:43:01.395053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 25867. [D 20:43:01.395068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25868. [D 20:43:01.395083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25869. [D 20:43:01.395098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25870. [D 20:43:01.395113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 25871. [D 20:43:01.395127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 25872. [D 20:43:01.395142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 25873. [D 20:43:01.395157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 25874. [D 20:43:01.395171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 25875. [D 20:43:01.395186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25876. [D 20:43:01.395201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25877. [D 20:43:01.395216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25878. [D 20:43:01.395230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 25879. [D 20:43:01.395245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 25880. [D 20:43:01.395260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 25881. [D 20:43:01.395275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 25882. [D 20:43:01.395290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 25883. [D 20:43:01.395304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25884. [D 20:43:01.395319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25885. [D 20:43:01.395334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25886. [D 20:43:01.395349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 25887. [D 20:43:01.395363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 25888. [D 20:43:01.395379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 25889. [D 20:43:01.395393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 25890. [D 20:43:01.395408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 25891. [D 20:43:01.395422] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25892. [D 20:43:01.395463] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.395481] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.395494] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.401191] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 25892. [D 20:43:01.401216] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 29/70. [D 20:43:01.401273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.401293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.401306] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:01.417406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.417423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.417436] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:01.417474] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4931 [D 20:43:01.417490] element 0: offset: 0x2aaaab016f20, size: 24 [D 20:43:01.417507] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 30/70. [D 20:43:01.419760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.419820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.419834] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.419875] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4934 [D 20:43:01.419907] element 0: offset: 0x2aaaab012170, size: 24 [D 20:43:01.419926] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 31/70. [D 20:43:01.420012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.420027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.420040] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.420063] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4935 [D 20:43:01.420077] element 0: offset: 0x2aaaab0335b0, size: 24 [D 20:43:01.420093] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 32/70. [D 20:43:01.423971] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4934 [D 20:43:01.423998] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 33/70. [D 20:43:01.424051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25892. [D 20:43:01.424068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 25893. [D 20:43:01.424083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 25894. [D 20:43:01.424098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 25895. [D 20:43:01.424112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 25896. [D 20:43:01.424127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 25897. [D 20:43:01.424141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25898. [D 20:43:01.424156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25899. [D 20:43:01.424170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25900. [D 20:43:01.424186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 25901. [D 20:43:01.424201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 25902. [D 20:43:01.424215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 25903. [D 20:43:01.424230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 25904. [D 20:43:01.424244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 25905. [D 20:43:01.424259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25906. [D 20:43:01.424273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25907. [D 20:43:01.424288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25908. [D 20:43:01.424302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25909. [D 20:43:01.424317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25910. [D 20:43:01.424331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25911. [D 20:43:01.424346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25912. [D 20:43:01.424361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25913. [D 20:43:01.424387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25914. [D 20:43:01.424403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25915. [D 20:43:01.424417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25916. [D 20:43:01.424431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25917. [D 20:43:01.424446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25918. [D 20:43:01.424461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25919. [D 20:43:01.424475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25920. [D 20:43:01.424490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25921. [D 20:43:01.424504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25922. [D 20:43:01.424519] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25923. [D 20:43:01.427682] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4931 [D 20:43:01.427705] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 34/70. [D 20:43:01.427721] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4935 [D 20:43:01.427736] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 35/70. [D 20:43:01.435425] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 25923. [D 20:43:01.435445] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 36/70. [D 20:43:01.435466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 25923. [D 20:43:01.435481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 25924. [D 20:43:01.435497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 25925. [D 20:43:01.435512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 25926. [D 20:43:01.435526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 25927. [D 20:43:01.435541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 25928. [D 20:43:01.435555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 25929. [D 20:43:01.435570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 25930. [D 20:43:01.435584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 25931. [D 20:43:01.435598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 25932. [D 20:43:01.435613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 25933. [D 20:43:01.435627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 25934. [D 20:43:01.435642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 25935. [D 20:43:01.435656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 25936. [D 20:43:01.435671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 25937. [D 20:43:01.435685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 25938. [D 20:43:01.435699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 25939. [D 20:43:01.435714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 25940. [D 20:43:01.435728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 25941. [D 20:43:01.435743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 25942. [D 20:43:01.435757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 25943. [D 20:43:01.435772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 25944. [D 20:43:01.435786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 25945. [D 20:43:01.435800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 25946. [D 20:43:01.435815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 25947. [D 20:43:01.435830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 25948. [D 20:43:01.435844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 25949. [D 20:43:01.435859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 25950. [D 20:43:01.435873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 25951. [D 20:43:01.435887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 25952. [D 20:43:01.435906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 25953. [D 20:43:01.435921] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 25954. [D 20:43:01.435937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25955. [D 20:43:01.435952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25956. [D 20:43:01.435967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25957. [D 20:43:01.435981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25958. [D 20:43:01.435996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25959. [D 20:43:01.436011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25960. [D 20:43:01.436025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25961. [D 20:43:01.436040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25962. [D 20:43:01.436054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25963. [D 20:43:01.436069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25964. [D 20:43:01.436084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25965. [D 20:43:01.436109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25966. [D 20:43:01.436124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25967. [D 20:43:01.436147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25968. [D 20:43:01.436162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25969. [D 20:43:01.436184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25970. [D 20:43:01.436199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25971. [D 20:43:01.436221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25972. [D 20:43:01.436236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25973. [D 20:43:01.436264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25974. [D 20:43:01.436280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25975. [D 20:43:01.436303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25976. [D 20:43:01.436325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25977. [D 20:43:01.436340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25978. [D 20:43:01.436355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25979. [D 20:43:01.436369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25980. [D 20:43:01.436398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25981. [D 20:43:01.436413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25982. [D 20:43:01.741548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25983. [D 20:43:01.741571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25984. [D 20:43:01.741586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25985. [D 20:43:01.741600] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25986. [D 20:43:01.741621] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 25986. [D 20:43:01.741637] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 37/70. [D 20:43:01.741705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.741751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.741769] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.742985] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 25985. [D 20:43:01.743015] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 38/70. [D 20:43:01.743014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.743055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.743069] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.743102] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.743116] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.743129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.743161] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4941 [D 20:43:01.743176] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:01.743195] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 39/70. [D 20:43:01.743237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.743252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.743265] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.743286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.743300] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.743313] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.743331] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4939 [D 20:43:01.743345] element 0: offset: 0x2aaaab0335b0, size: 24 [D 20:43:01.743360] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 40/70. [D 20:43:01.749865] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4941 [D 20:43:01.749893] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 41/70. [D 20:43:01.749910] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4939 [D 20:43:01.749942] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 42/70. [D 20:43:01.754488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25985. [D 20:43:01.754510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25986. [D 20:43:01.754525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 25987. [D 20:43:01.754539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 25988. [D 20:43:01.754557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 25989. [D 20:43:01.754572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 25990. [D 20:43:01.754587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 25991. [D 20:43:01.754601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25992. [D 20:43:01.754616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25993. [D 20:43:01.754630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25994. [D 20:43:01.754645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 25995. [D 20:43:01.754659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 25996. [D 20:43:01.754674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 25997. [D 20:43:01.754688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 25998. [D 20:43:01.754703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 25999. [D 20:43:01.754717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26000. [D 20:43:01.754732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26001. [D 20:43:01.754746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26002. [D 20:43:01.754761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26003. [D 20:43:01.754775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26004. [D 20:43:01.754790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26005. [D 20:43:01.754804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26006. [D 20:43:01.754818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26007. [D 20:43:01.754833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26008. [D 20:43:01.754848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26009. [D 20:43:01.754862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26010. [D 20:43:01.754876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26011. [D 20:43:01.754891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26012. [D 20:43:01.754905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26013. [D 20:43:01.754920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26014. [D 20:43:01.754934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26015. [D 20:43:01.754948] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26016. [D 20:43:01.754965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26017. [D 20:43:01.754979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 26018. [D 20:43:01.754994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 26019. [D 20:43:01.755008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 26020. [D 20:43:01.755023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 26021. [D 20:43:01.755039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 26022. [D 20:43:01.755053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26023. [D 20:43:01.755067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26024. [D 20:43:01.755081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26025. [D 20:43:01.755096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 26026. [D 20:43:01.755110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 26027. [D 20:43:01.755124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 26028. [D 20:43:01.755138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 26029. [D 20:43:01.755153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 26030. [D 20:43:01.755167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26031. [D 20:43:01.755181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26032. [D 20:43:01.755195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26033. [D 20:43:01.755209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 26034. [D 20:43:01.755224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 26035. [D 20:43:01.755248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 26036. [D 20:43:01.755263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 26037. [D 20:43:01.755278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 26038. [D 20:43:01.755292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26039. [D 20:43:01.755306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26040. [D 20:43:01.755320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26041. [D 20:43:01.755334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 26042. [D 20:43:01.755348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 26043. [D 20:43:01.755363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 26044. [D 20:43:01.755377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 26045. [D 20:43:01.755391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 26046. [D 20:43:01.755405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26047. [D 20:43:01.755420] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26048. [D 20:43:01.756081] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.756144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.756159] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.756204] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4945 [D 20:43:01.756220] element 0: offset: 0x2aaaab014b70, size: 24 [D 20:43:01.756244] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 43/70. [D 20:43:01.756289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.756304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.756316] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.756339] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4947 [D 20:43:01.756353] element 0: offset: 0x2aaaab027b20, size: 24 [D 20:43:01.756367] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 44/70. [D 20:43:01.760400] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 26048. [D 20:43:01.760424] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 45/70. [D 20:43:01.770109] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26047. [D 20:43:01.770130] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 46/70. [D 20:43:01.773177] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.773193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.773205] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.773300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.773316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.773328] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.779465] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4945 [D 20:43:01.779498] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 47/70. [D 20:43:01.779518] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4947 [D 20:43:01.779534] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 48/70. [D 20:43:01.785880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26047. [D 20:43:01.785904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26048. [D 20:43:01.785919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26049. [D 20:43:01.785933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26050. [D 20:43:01.785947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26051. [D 20:43:01.785961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26052. [D 20:43:01.785976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26053. [D 20:43:01.785990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26054. [D 20:43:01.786004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26055. [D 20:43:01.786018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26056. [D 20:43:01.786033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26057. [D 20:43:01.786047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26058. [D 20:43:01.786061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26059. [D 20:43:01.786075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26060. [D 20:43:01.786090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26061. [D 20:43:01.786104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26062. [D 20:43:01.786118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26063. [D 20:43:01.786133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26064. [D 20:43:01.786158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26065. [D 20:43:01.786173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26066. [D 20:43:01.786188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26067. [D 20:43:01.786202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26068. [D 20:43:01.786216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26069. [D 20:43:01.786231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26070. [D 20:43:01.786245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26071. [D 20:43:01.786260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26072. [D 20:43:01.786274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26073. [D 20:43:01.786290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26074. [D 20:43:01.786304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26075. [D 20:43:01.786319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26076. [D 20:43:01.786333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26077. [D 20:43:01.786348] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26078. [D 20:43:01.786365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26079. [D 20:43:01.786380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26080. [D 20:43:01.786394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26081. [D 20:43:01.786409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26082. [D 20:43:01.786423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26083. [D 20:43:01.786438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26084. [D 20:43:01.786452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26085. [D 20:43:01.786470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26086. [D 20:43:01.786484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26087. [D 20:43:01.786499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26088. [D 20:43:01.786513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26089. [D 20:43:01.786528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26090. [D 20:43:01.786542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26091. [D 20:43:01.786557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26092. [D 20:43:01.786571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26093. [D 20:43:01.786586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26094. [D 20:43:01.786600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26095. [D 20:43:01.786615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26096. [D 20:43:01.786629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26097. [D 20:43:01.786644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26098. [D 20:43:01.786658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26099. [D 20:43:01.786673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26100. [D 20:43:01.786687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26101. [D 20:43:01.786702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26102. [D 20:43:01.786717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26103. [D 20:43:01.786731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26104. [D 20:43:01.786746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26105. [D 20:43:01.786760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26106. [D 20:43:01.786775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26107. [D 20:43:01.786789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26108. [D 20:43:01.786804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26109. [D 20:43:01.786818] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26110. [D 20:43:01.788584] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.788645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.788659] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.788702] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4950 [D 20:43:01.788717] element 0: offset: 0x2aaaab016f20, size: 24 [D 20:43:01.788737] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 49/70. [D 20:43:01.791767] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 26110. [D 20:43:01.791786] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 50/70. [D 20:43:01.802000] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 26109. [D 20:43:01.802026] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 51/70. [D 20:43:01.802087] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.802106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.802119] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.802202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.802216] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.802229] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.805182] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4950 [D 20:43:01.805206] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 52/70. [D 20:43:01.808174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26109. [D 20:43:01.808197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26110. [D 20:43:01.808211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 26111. [D 20:43:01.808226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 26112. [D 20:43:01.808241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 26113. [D 20:43:01.808255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 26114. [D 20:43:01.808269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 26115. [D 20:43:01.808284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26116. [D 20:43:01.808299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26117. [D 20:43:01.808313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26118. [D 20:43:01.808328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 26119. [D 20:43:01.808343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 26120. [D 20:43:01.808357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 26121. [D 20:43:01.808372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 26122. [D 20:43:01.808386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 26123. [D 20:43:01.808401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26124. [D 20:43:01.808416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26125. [D 20:43:01.808430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26126. [D 20:43:01.808444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26127. [D 20:43:01.808459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26128. [D 20:43:01.808474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26129. [D 20:43:01.808489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26130. [D 20:43:01.808503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26131. [D 20:43:01.808518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26132. [D 20:43:01.808532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26133. [D 20:43:01.808547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26134. [D 20:43:01.808561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26135. [D 20:43:01.808576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26136. [D 20:43:01.808590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26137. [D 20:43:01.808605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26138. [D 20:43:01.808619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26139. [D 20:43:01.808634] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26140. [D 20:43:01.814150] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26140. [D 20:43:01.814169] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 53/70. [D 20:43:01.814259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.814307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.814320] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:01.820456] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.820476] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.820488] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:01.820527] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4953 [D 20:43:01.820542] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:01.820564] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 54/70. [D 20:43:01.823032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.823102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.823116] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.823162] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4956 [D 20:43:01.823177] element 0: offset: 0x2aaaab0335b0, size: 24 [D 20:43:01.823197] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 55/70. [D 20:43:01.827100] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4953 [D 20:43:01.827126] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 56/70. [D 20:43:01.827145] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4956 [D 20:43:01.827165] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 57/70. [D 20:43:01.827194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 26140. [D 20:43:01.827210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 26141. [D 20:43:01.827225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26142. [D 20:43:01.827239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26143. [D 20:43:01.827254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26144. [D 20:43:01.827268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26145. [D 20:43:01.827283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26146. [D 20:43:01.827297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26147. [D 20:43:01.827312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26148. [D 20:43:01.827326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26149. [D 20:43:01.827341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26150. [D 20:43:01.827355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26151. [D 20:43:01.827370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26152. [D 20:43:01.827384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26153. [D 20:43:01.827398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26154. [D 20:43:01.827413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26155. [D 20:43:01.827427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26156. [D 20:43:01.827442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26157. [D 20:43:01.827456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26158. [D 20:43:01.827471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26159. [D 20:43:01.827485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26160. [D 20:43:01.827499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26161. [D 20:43:01.827514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26162. [D 20:43:01.827528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26163. [D 20:43:01.827543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26164. [D 20:43:01.827558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26165. [D 20:43:01.827573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26166. [D 20:43:01.827587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26167. [D 20:43:01.827601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26168. [D 20:43:01.827616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26169. [D 20:43:01.827630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26170. [D 20:43:01.827645] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26171. [D 20:43:01.827661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26172. [D 20:43:01.827676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26173. [D 20:43:01.827690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26174. [D 20:43:01.827705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26175. [D 20:43:01.827719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26176. [D 20:43:01.827734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26177. [D 20:43:01.827748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26178. [D 20:43:01.827762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26179. [D 20:43:01.827777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26180. [D 20:43:01.827792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26181. [D 20:43:01.827806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26182. [D 20:43:01.827820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26183. [D 20:43:01.827835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26184. [D 20:43:01.827849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26185. [D 20:43:01.827864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26186. [D 20:43:01.827878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26187. [D 20:43:01.827892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26188. [D 20:43:01.827912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26189. [D 20:43:01.827926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26190. [D 20:43:01.827941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26191. [D 20:43:01.827956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26192. [D 20:43:01.827970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26193. [D 20:43:01.827985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26194. [D 20:43:01.827999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26195. [D 20:43:01.828014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26196. [D 20:43:01.828028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26197. [D 20:43:01.828043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26198. [D 20:43:01.828058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26199. [D 20:43:01.828072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26200. [D 20:43:01.828087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26201. [D 20:43:01.828101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26202. [D 20:43:01.828115] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26203. [D 20:43:01.837937] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 26203. [D 20:43:01.837958] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 58/70. [D 20:43:01.849473] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 26202. [D 20:43:01.849495] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 59/70. [D 20:43:01.849574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.849640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.849653] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.849689] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.849702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.849714] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:01.864552] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.864569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.864582] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:01.864621] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4960 [D 20:43:01.864636] element 0: offset: 0x2aaaab033300, size: 24 [D 20:43:01.864656] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 60/70. [D 20:43:01.864695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.864710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.864722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.864744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4962 [D 20:43:01.864757] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:01.864771] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 0/70. [D 20:43:01.870786] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4960 [D 20:43:01.870814] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 1/70. [D 20:43:01.870833] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4962 [D 20:43:01.870853] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 2/70. [D 20:43:01.870883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 26202. [D 20:43:01.870899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 26203. [D 20:43:01.870914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26204. [D 20:43:01.870929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26205. [D 20:43:01.870944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26206. [D 20:43:01.870959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26207. [D 20:43:01.870973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26208. [D 20:43:01.870987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26209. [D 20:43:01.871002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26210. [D 20:43:01.871016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26211. [D 20:43:01.871030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26212. [D 20:43:01.871044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26213. [D 20:43:01.871059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26214. [D 20:43:01.871073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26215. [D 20:43:01.871087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26216. [D 20:43:01.871101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26217. [D 20:43:01.871115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26218. [D 20:43:01.871130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26219. [D 20:43:01.871144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26220. [D 20:43:01.871158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26221. [D 20:43:01.871172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26222. [D 20:43:01.871186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26223. [D 20:43:01.871200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26224. [D 20:43:01.871215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26225. [D 20:43:01.871229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26226. [D 20:43:01.871243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26227. [D 20:43:01.871257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26228. [D 20:43:01.871272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26229. [D 20:43:01.871286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26230. [D 20:43:01.871300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26231. [D 20:43:01.871314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26232. [D 20:43:01.871328] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26233. [D 20:43:01.871344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26234. [D 20:43:01.871360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26235. [D 20:43:01.871375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26236. [D 20:43:01.871389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26237. [D 20:43:01.871404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26238. [D 20:43:01.871418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26239. [D 20:43:01.871433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26240. [D 20:43:01.871447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26241. [D 20:43:01.871462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26242. [D 20:43:01.871477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26243. [D 20:43:01.871491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26244. [D 20:43:01.871506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26245. [D 20:43:01.871521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26246. [D 20:43:01.871535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26247. [D 20:43:01.871550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26248. [D 20:43:01.871564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26249. [D 20:43:01.871579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26250. [D 20:43:01.871593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26251. [D 20:43:01.871608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26252. [D 20:43:01.871623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26253. [D 20:43:01.871638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26254. [D 20:43:01.871665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26255. [D 20:43:01.871680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26256. [D 20:43:01.871702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26257. [D 20:43:01.871717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26258. [D 20:43:01.871744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26259. [D 20:43:01.871759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26260. [D 20:43:01.871773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26261. [D 20:43:01.871798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26262. [D 20:43:01.871824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26263. [D 20:43:01.871840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26264. [D 20:43:01.871854] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26265. [D 20:43:01.881807] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26265. [D 20:43:01.881829] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 3/70. [D 20:43:01.893341] openib_check_cq: completed rdma wr_id 2aaaab6103c0, nic_wr_credit 26264. [D 20:43:01.893362] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 4/70. [D 20:43:01.893443] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.893506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.893520] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.893553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.893566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.893578] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:01.908475] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.908494] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.908507] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:01.908545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4966 [D 20:43:01.908561] element 0: offset: 0x2aaaab014b70, size: 24 [D 20:43:01.908582] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 5/70. [D 20:43:01.908622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.908639] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.908652] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.908673] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4968 [D 20:43:01.908687] element 0: offset: 0x2aaaab030e80, size: 24 [D 20:43:01.908701] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 6/70. [D 20:43:01.912249] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4966 [D 20:43:01.912283] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 7/70. [D 20:43:01.912338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 26264. [D 20:43:01.912355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 26265. [D 20:43:01.912370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26266. [D 20:43:01.912384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26267. [D 20:43:01.912399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26268. [D 20:43:01.912412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26269. [D 20:43:01.912427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26270. [D 20:43:01.912441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26271. [D 20:43:01.912455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26272. [D 20:43:01.912470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26273. [D 20:43:01.912484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26274. [D 20:43:01.912499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26275. [D 20:43:01.912513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26276. [D 20:43:01.912529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26277. [D 20:43:01.912544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26278. [D 20:43:01.912558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26279. [D 20:43:01.912573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26280. [D 20:43:01.912587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26281. [D 20:43:01.912601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26282. [D 20:43:01.912616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26283. [D 20:43:01.912630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26284. [D 20:43:01.912644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26285. [D 20:43:01.912659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26286. [D 20:43:01.912673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26287. [D 20:43:01.912687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26288. [D 20:43:01.912702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26289. [D 20:43:01.912716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26290. [D 20:43:01.912730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26291. [D 20:43:01.912745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26292. [D 20:43:01.912759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26293. [D 20:43:01.912773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26294. [D 20:43:01.912788] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26295. [D 20:43:01.919000] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4968 [D 20:43:01.919079] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 8/70. [D 20:43:01.920405] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.920473] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.920487] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.920531] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4972 [D 20:43:01.920546] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:43:01.920565] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 9/70. [D 20:43:01.920595] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26295. [D 20:43:01.920622] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 10/70. [D 20:43:01.920643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26295. [D 20:43:01.920659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26296. [D 20:43:01.920674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26297. [D 20:43:01.920688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26298. [D 20:43:01.920704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26299. [D 20:43:01.920718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26300. [D 20:43:01.920733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26301. [D 20:43:01.920747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26302. [D 20:43:01.920761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26303. [D 20:43:01.920775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26304. [D 20:43:01.920789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26305. [D 20:43:01.920803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26306. [D 20:43:01.920817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26307. [D 20:43:01.920832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26308. [D 20:43:01.920846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26309. [D 20:43:01.920860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26310. [D 20:43:01.920874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26311. [D 20:43:01.920889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26312. [D 20:43:01.920903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26313. [D 20:43:01.920917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26314. [D 20:43:01.920931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26315. [D 20:43:01.920945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26316. [D 20:43:01.920960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26317. [D 20:43:01.920974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26318. [D 20:43:01.920988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26319. [D 20:43:01.921002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26320. [D 20:43:01.921016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26321. [D 20:43:01.921031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26322. [D 20:43:01.921045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26323. [D 20:43:01.921059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26324. [D 20:43:01.921073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26325. [D 20:43:01.921087] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db90 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26326. [D 20:43:01.921147] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.921167] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.921180] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:01.924568] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4972 [D 20:43:01.924592] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 11/70. [D 20:43:01.932334] openib_check_cq: completed rdma wr_id 2aaaab60db90, nic_wr_credit 26326. [D 20:43:01.932357] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 12/70. [D 20:43:01.932502] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.932565] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.932578] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.933527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26326. [D 20:43:01.933547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26327. [D 20:43:01.933562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26328. [D 20:43:01.933577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26329. [D 20:43:01.933591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26330. [D 20:43:01.933605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26331. [D 20:43:01.933620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26332. [D 20:43:01.933634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26333. [D 20:43:01.933648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26334. [D 20:43:01.933663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26335. [D 20:43:01.933677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26336. [D 20:43:01.933692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26337. [D 20:43:01.933706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26338. [D 20:43:01.933721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26339. [D 20:43:01.933735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26340. [D 20:43:01.933749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26341. [D 20:43:01.933764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26342. [D 20:43:01.933778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26343. [D 20:43:01.933792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26344. [D 20:43:01.933818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26345. [D 20:43:01.933832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26346. [D 20:43:01.933847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26347. [D 20:43:01.933861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26348. [D 20:43:01.933876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26349. [D 20:43:01.933891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26350. [D 20:43:01.933906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26351. [D 20:43:01.933921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26352. [D 20:43:01.933935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26353. [D 20:43:01.933949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26354. [D 20:43:01.933964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26355. [D 20:43:01.933978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26356. [D 20:43:01.933993] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26357. [D 20:43:01.936183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.936204] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.936216] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.936257] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4974 [D 20:43:01.936272] element 0: offset: 0x2aaaab016f20, size: 24 [D 20:43:01.936292] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 13/70. [D 20:43:01.945291] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26357. [D 20:43:01.945316] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 14/70. [D 20:43:01.945420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.945440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.945453] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:01.951835] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4974 [D 20:43:01.951862] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 15/70. [D 20:43:01.952891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 26357. [D 20:43:01.952908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 26358. [D 20:43:01.952923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26359. [D 20:43:01.952937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26360. [D 20:43:01.952952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26361. [D 20:43:01.952967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26362. [D 20:43:01.952981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26363. [D 20:43:01.952996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26364. [D 20:43:01.953010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26365. [D 20:43:01.953025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26366. [D 20:43:01.953039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26367. [D 20:43:01.953054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26368. [D 20:43:01.953069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26369. [D 20:43:01.953084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26370. [D 20:43:01.953099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26371. [D 20:43:01.953114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26372. [D 20:43:01.953128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26373. [D 20:43:01.953143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26374. [D 20:43:01.953157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26375. [D 20:43:01.953172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26376. [D 20:43:01.953186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26377. [D 20:43:01.953201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26378. [D 20:43:01.953215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26379. [D 20:43:01.953230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26380. [D 20:43:01.953245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26381. [D 20:43:01.953259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26382. [D 20:43:01.953274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26383. [D 20:43:01.953288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26384. [D 20:43:01.953303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26385. [D 20:43:01.953317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26386. [D 20:43:01.953332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26387. [D 20:43:01.953346] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26388. [D 20:43:01.953414] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.953480] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.953494] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:01.953538] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4978 [D 20:43:01.953553] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:01.953573] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 16/70. [D 20:43:01.953611] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.953625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.953638] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:01.953658] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4980 [D 20:43:01.953672] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:01.953686] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 17/70. [D 20:43:01.955795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:01.955814] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.955827] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:01.955850] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4984 [D 20:43:01.955864] element 0: offset: 0x2aaaab033300, size: 24 [D 20:43:01.955882] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 18/70. [D 20:43:01.959388] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26388. [D 20:43:01.959415] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 19/70. [D 20:43:01.959598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:01.959619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:01.959632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:01.966259] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4978 [D 20:43:01.966332] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 20/70. [D 20:43:01.966359] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4980 [D 20:43:01.966374] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 21/70. [D 20:43:01.966483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26388. [D 20:43:01.966503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26389. [D 20:43:01.966518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26390. [D 20:43:01.966532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26391. [D 20:43:01.966547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26392. [D 20:43:01.966561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26393. [D 20:43:01.966576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26394. [D 20:43:01.966591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26395. [D 20:43:01.966605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26396. [D 20:43:01.966619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26397. [D 20:43:01.966634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26398. [D 20:43:01.966648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26399. [D 20:43:01.966663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26400. [D 20:43:01.966678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26401. [D 20:43:01.966692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26402. [D 20:43:01.966706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26403. [D 20:43:01.966721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26404. [D 20:43:01.966735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26405. [D 20:43:01.966750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26406. [D 20:43:01.966764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26407. [D 20:43:01.966779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26408. [D 20:43:01.966793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26409. [D 20:43:01.966808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26410. [D 20:43:01.966823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26411. [D 20:43:01.968524] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4984 [D 20:43:02.188777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26412. [D 20:43:02.188801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26413. [D 20:43:02.188816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26414. [D 20:43:02.188831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26415. [D 20:43:02.188858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26416. [D 20:43:02.188883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26417. [D 20:43:02.188908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26418. [D 20:43:02.188933] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26419. [D 20:43:02.189314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26420. [D 20:43:02.189639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26421. [D 20:43:02.189657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26422. [D 20:43:02.189671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26423. [D 20:43:02.189685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26424. [D 20:43:02.189699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26425. [D 20:43:02.189714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26426. [D 20:43:02.189741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26427. [D 20:43:02.189756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26428. [D 20:43:02.189771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26429. [D 20:43:02.189785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26430. [D 20:43:02.189799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26431. [D 20:43:02.190424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26432. [D 20:43:02.190442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26433. [D 20:43:02.190456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26434. [D 20:43:02.190483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26435. [D 20:43:02.190501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26436. [D 20:43:02.190516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26437. [D 20:43:02.190531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26438. [D 20:43:02.190545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26439. [D 20:43:02.191121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26440. [D 20:43:02.191138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26441. [D 20:43:02.191153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26442. [D 20:43:02.191167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26443. [D 20:43:02.191181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26444. [D 20:43:02.191195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26445. [D 20:43:02.191222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26446. [D 20:43:02.191237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26447. [D 20:43:02.191252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26448. [D 20:43:02.191266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26449. [D 20:43:02.191280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26450. [D 20:43:02.191295] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db90 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26451. [D 20:43:02.191314] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26451. [D 20:43:02.191942] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 22/70. [D 20:43:02.191966] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 23/70. [D 20:43:02.192148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.192211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.192225] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.192270] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4986 [D 20:43:02.192285] element 0: offset: 0x2aaaab030e80, size: 24 [D 20:43:02.192305] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 24/70. [D 20:43:02.196748] openib_check_cq: completed rdma wr_id 2aaaab60db90, nic_wr_credit 26450. [D 20:43:02.196774] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 25/70. [D 20:43:02.196791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26450. [D 20:43:02.196805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26451. [D 20:43:02.196836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26452. [D 20:43:02.196851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26453. [D 20:43:02.196865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26454. [D 20:43:02.196879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26455. [D 20:43:02.196894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26456. [D 20:43:02.196908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26457. [D 20:43:02.196922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26458. [D 20:43:02.196936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26459. [D 20:43:02.196963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26460. [D 20:43:02.196977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26461. [D 20:43:02.196992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26462. [D 20:43:02.197006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26463. [D 20:43:02.197027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26464. [D 20:43:02.197041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26465. [D 20:43:02.197055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26466. [D 20:43:02.197070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26467. [D 20:43:02.197084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26468. [D 20:43:02.197099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26469. [D 20:43:02.197113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26470. [D 20:43:02.197128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26471. [D 20:43:02.197142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26472. [D 20:43:02.197157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26473. [D 20:43:02.197171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26474. [D 20:43:02.197185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26475. [D 20:43:02.197200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26476. [D 20:43:02.197214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26477. [D 20:43:02.197228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26478. [D 20:43:02.197243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26479. [D 20:43:02.197257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26480. [D 20:43:02.197272] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612990 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26481. [D 20:43:02.197344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.197365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.197378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.197401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.197414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.197427] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.201766] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4986 [D 20:43:02.201791] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 26/70. [D 20:43:02.202736] openib_check_cq: completed rdma wr_id 2aaaab612990, nic_wr_credit 26481. [D 20:43:02.202802] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 27/70. [D 20:43:02.203965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.203983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.204002] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.207601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 26481. [D 20:43:02.207620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 26482. [D 20:43:02.207634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26483. [D 20:43:02.207651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26484. [D 20:43:02.207666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26485. [D 20:43:02.207680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26486. [D 20:43:02.207694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26487. [D 20:43:02.207708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26488. [D 20:43:02.207722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26489. [D 20:43:02.207736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26490. [D 20:43:02.207749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26491. [D 20:43:02.207764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26492. [D 20:43:02.207777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26493. [D 20:43:02.207791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26494. [D 20:43:02.207805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26495. [D 20:43:02.207819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26496. [D 20:43:02.207833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26497. [D 20:43:02.207847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26498. [D 20:43:02.207861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26499. [D 20:43:02.207875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26500. [D 20:43:02.207892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26501. [D 20:43:02.207909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26502. [D 20:43:02.207923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26503. [D 20:43:02.207937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26504. [D 20:43:02.207951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26505. [D 20:43:02.207965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26506. [D 20:43:02.207979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26507. [D 20:43:02.207993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26508. [D 20:43:02.208007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26509. [D 20:43:02.208021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26510. [D 20:43:02.208040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26511. [D 20:43:02.208053] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26512. [D 20:43:02.213507] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26512. [D 20:43:02.213524] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 28/70. [D 20:43:02.216560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.216576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.216588] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.216625] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4990 [D 20:43:02.216640] element 0: offset: 0x2aaaab014c50, size: 24 [D 20:43:02.216656] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 29/70. [D 20:43:02.216683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.216697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.216709] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.220062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.220080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.220092] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.220115] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4993 [D 20:43:02.220128] element 0: offset: 0x2aaaab037690, size: 24 [D 20:43:02.220143] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 30/70. [D 20:43:02.220172] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.220184] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4990 [D 20:43:02.220186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.220278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.220306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4996 [D 20:43:02.220280] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 31/70. [D 20:43:02.220321] element 0: offset: 0x5b0030, size: 24 [D 20:43:02.220356] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 32/70. [D 20:43:02.220428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26512. [D 20:43:02.220446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26513. [D 20:43:02.220460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26514. [D 20:43:02.220474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26515. [D 20:43:02.220488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26516. [D 20:43:02.220502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26517. [D 20:43:02.220516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26518. [D 20:43:02.220530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26519. [D 20:43:02.220544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26520. [D 20:43:02.220558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26521. [D 20:43:02.220572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26522. [D 20:43:02.220586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26523. [D 20:43:02.220600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26524. [D 20:43:02.220614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26525. [D 20:43:02.220628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26526. [D 20:43:02.220642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26527. [D 20:43:02.220656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26528. [D 20:43:02.220670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26529. [D 20:43:02.220684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26530. [D 20:43:02.220698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26531. [D 20:43:02.220712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26532. [D 20:43:02.220726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26533. [D 20:43:02.220740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26534. [D 20:43:02.220754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26535. [D 20:43:02.220768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26536. [D 20:43:02.220782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26537. [D 20:43:02.220796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26538. [D 20:43:02.220810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26539. [D 20:43:02.220824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26540. [D 20:43:02.220838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26541. [D 20:43:02.220852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26542. [D 20:43:02.220866] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26543. [D 20:43:02.222030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.222046] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.222058] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.222080] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 4998 [D 20:43:02.222094] element 0: offset: 0x643b60, size: 24 [D 20:43:02.222108] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 33/70. [D 20:43:02.226332] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26543. [D 20:43:02.226350] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 34/70. [D 20:43:02.227785] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 4993 [D 20:43:02.227870] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 35/70. [D 20:43:02.227921] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.227940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.227953] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.227980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26543. [D 20:43:02.227997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26544. [D 20:43:02.228011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26545. [D 20:43:02.228026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26546. [D 20:43:02.228040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26547. [D 20:43:02.228060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26548. [D 20:43:02.228045] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 4996 [D 20:43:02.228089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26549. [D 20:43:02.228123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26550. [D 20:43:02.228137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26551. [D 20:43:02.228151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26552. [D 20:43:02.228165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26553. [D 20:43:02.228179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26554. [D 20:43:02.228193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26555. [D 20:43:02.228207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26556. [D 20:43:02.228221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26557. [D 20:43:02.228235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26558. [D 20:43:02.228249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26559. [D 20:43:02.228263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26560. [D 20:43:02.228277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26561. [D 20:43:02.228291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26562. [D 20:43:02.228305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26563. [D 20:43:02.228319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26564. [D 20:43:02.228333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26565. [D 20:43:02.228347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26566. [D 20:43:02.228361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26567. [D 20:43:02.228375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26568. [D 20:43:02.228389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26569. [D 20:43:02.228402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26570. [D 20:43:02.228416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26571. [D 20:43:02.228432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26572. [D 20:43:02.228445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26573. [D 20:43:02.228459] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26574. [D 20:43:02.228483] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 36/70. [D 20:43:02.234744] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 4998 [D 20:43:02.234769] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 37/70. [D 20:43:02.237489] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26574. [D 20:43:02.237511] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 38/70. [D 20:43:02.237530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26574. [D 20:43:02.237546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26575. [D 20:43:02.237561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26576. [D 20:43:02.237575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26577. [D 20:43:02.237590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26578. [D 20:43:02.237604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26579. [D 20:43:02.237619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26580. [D 20:43:02.237634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26581. [D 20:43:02.237648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26582. [D 20:43:02.237663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26583. [D 20:43:02.237677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26584. [D 20:43:02.237692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26585. [D 20:43:02.237706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26586. [D 20:43:02.237721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26587. [D 20:43:02.237735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26588. [D 20:43:02.237750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26589. [D 20:43:02.237765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26590. [D 20:43:02.237779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26591. [D 20:43:02.237794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26592. [D 20:43:02.237808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26593. [D 20:43:02.237823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26594. [D 20:43:02.237837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26595. [D 20:43:02.237852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26596. [D 20:43:02.237868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26597. [D 20:43:02.237883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26598. [D 20:43:02.237897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26599. [D 20:43:02.237912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26600. [D 20:43:02.237927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26601. [D 20:43:02.237942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26602. [D 20:43:02.237957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26603. [D 20:43:02.237972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26604. [D 20:43:02.237986] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db90 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26605. [D 20:43:02.238005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 26606. [D 20:43:02.238020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 26607. [D 20:43:02.238035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26608. [D 20:43:02.238050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26609. [D 20:43:02.238064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26610. [D 20:43:02.238079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26611. [D 20:43:02.238094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26612. [D 20:43:02.238109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26613. [D 20:43:02.238124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26614. [D 20:43:02.238138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26615. [D 20:43:02.238153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26616. [D 20:43:02.238168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26617. [D 20:43:02.238183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26618. [D 20:43:02.238198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26619. [D 20:43:02.238213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26620. [D 20:43:02.238227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26621. [D 20:43:02.238242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26622. [D 20:43:02.238257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26623. [D 20:43:02.238272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26624. [D 20:43:02.238287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26625. [D 20:43:02.238303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26626. [D 20:43:02.238317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26627. [D 20:43:02.238333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26628. [D 20:43:02.238347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26629. [D 20:43:02.238362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26630. [D 20:43:02.238377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26631. [D 20:43:02.238392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26632. [D 20:43:02.238407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26633. [D 20:43:02.238421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26634. [D 20:43:02.238436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26635. [D 20:43:02.238451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26636. [D 20:43:02.238466] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612990 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26637. [D 20:43:02.238550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.238595] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.238609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.249335] openib_check_cq: completed rdma wr_id 2aaaab60db90, nic_wr_credit 26637. [D 20:43:02.249359] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 39/70. [D 20:43:02.260963] openib_check_cq: completed rdma wr_id 2aaaab612990, nic_wr_credit 26636. [D 20:43:02.260984] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 40/70. [D 20:43:02.261028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.261048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.261060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.261097] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.261111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.261123] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:02.266484] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.266499] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.266512] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:02.266551] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5001 [D 20:43:02.266565] element 0: offset: 0x643b60, size: 24 [D 20:43:02.266584] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 41/70. [D 20:43:02.269134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.269201] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.269215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.269255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5005 [D 20:43:02.269271] element 0: offset: 0x5b0030, size: 24 [D 20:43:02.269290] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 42/70. [D 20:43:02.270020] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5001 [D 20:43:02.270046] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 43/70. [D 20:43:02.273062] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5005 [D 20:43:02.273140] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 44/70. [D 20:43:02.277359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26636. [D 20:43:02.277387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26637. [D 20:43:02.277402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26638. [D 20:43:02.277416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26639. [D 20:43:02.277431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26640. [D 20:43:02.277446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26641. [D 20:43:02.277460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26642. [D 20:43:02.277475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26643. [D 20:43:02.277490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26644. [D 20:43:02.277505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26645. [D 20:43:02.277520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26646. [D 20:43:02.277545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26647. [D 20:43:02.277567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26648. [D 20:43:02.277583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26649. [D 20:43:02.277597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26650. [D 20:43:02.277620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26651. [D 20:43:02.277634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26652. [D 20:43:02.277664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26653. [D 20:43:02.277688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26654. [D 20:43:02.277703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26655. [D 20:43:02.277726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26656. [D 20:43:02.277741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26657. [D 20:43:02.277755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26658. [D 20:43:02.277770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26659. [D 20:43:02.277785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26660. [D 20:43:02.277799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26661. [D 20:43:02.277814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26662. [D 20:43:02.277829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26663. [D 20:43:02.277844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26664. [D 20:43:02.277860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26665. [D 20:43:02.277874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26666. [D 20:43:02.277889] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26667. [D 20:43:02.277906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26668. [D 20:43:02.277921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26669. [D 20:43:02.277935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26670. [D 20:43:02.277950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26671. [D 20:43:02.277964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26672. [D 20:43:02.277979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26673. [D 20:43:02.277993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26674. [D 20:43:02.278008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26675. [D 20:43:02.278022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26676. [D 20:43:02.278037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26677. [D 20:43:02.278051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26678. [D 20:43:02.278066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26679. [D 20:43:02.278080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26680. [D 20:43:02.278095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26681. [D 20:43:02.278109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26682. [D 20:43:02.278124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26683. [D 20:43:02.278138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26684. [D 20:43:02.278153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26685. [D 20:43:02.278168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26686. [D 20:43:02.278182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26687. [D 20:43:02.278197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26688. [D 20:43:02.278211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26689. [D 20:43:02.278226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26690. [D 20:43:02.278240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26691. [D 20:43:02.278255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26692. [D 20:43:02.278269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26693. [D 20:43:02.278293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26694. [D 20:43:02.278308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26695. [D 20:43:02.278336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26696. [D 20:43:02.278352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26697. [D 20:43:02.278375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26698. [D 20:43:02.278390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a250 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26699. [D 20:43:02.286103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.286125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.286139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.286179] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5008 [D 20:43:02.286194] element 0: offset: 0x61fa30, size: 24 [D 20:43:02.286212] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 45/70. [D 20:43:02.286251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.286265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.286278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.286298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5010 [D 20:43:02.286312] element 0: offset: 0x691fe0, size: 24 [D 20:43:02.286326] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 46/70. [D 20:43:02.289040] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26699. [D 20:43:02.289066] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 47/70. [D 20:43:02.300576] openib_check_cq: completed rdma wr_id 2aaaab60a250, nic_wr_credit 26698. [D 20:43:02.300598] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 48/70. [D 20:43:02.300661] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.300681] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.300694] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.300802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.300817] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.300829] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.303945] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5008 [D 20:43:02.304007] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 49/70. [D 20:43:02.306296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 26698. [D 20:43:02.306320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 26699. [D 20:43:02.306335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26700. [D 20:43:02.306350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26701. [D 20:43:02.306376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26702. [D 20:43:02.306391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26703. [D 20:43:02.306414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26704. [D 20:43:02.306429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26705. [D 20:43:02.306452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26706. [D 20:43:02.306469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26707. [D 20:43:02.306500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26708. [D 20:43:02.306516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26709. [D 20:43:02.306541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26710. [D 20:43:02.306556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26711. [D 20:43:02.306579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26712. [D 20:43:02.306594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26713. [D 20:43:02.306622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26714. [D 20:43:02.306647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26715. [D 20:43:02.306662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26716. [D 20:43:02.306685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26717. [D 20:43:02.306700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26718. [D 20:43:02.306731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26719. [D 20:43:02.306747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26720. [D 20:43:02.306762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26721. [D 20:43:02.306789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26722. [D 20:43:02.306813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26723. [D 20:43:02.306828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26724. [D 20:43:02.306852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26725. [D 20:43:02.306867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26726. [D 20:43:02.306892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26727. [D 20:43:02.306914] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5010 [D 20:43:02.306919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26728. [D 20:43:02.307430] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26729. [D 20:43:02.307460] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 50/70. [D 20:43:02.314493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.314513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.314526] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.314570] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5014 [D 20:43:02.314585] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:43:02.314604] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 51/70. [D 20:43:02.314649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.314663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.314678] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.314700] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5017 [D 20:43:02.314714] element 0: offset: 0x2aaaab604120, size: 24 [D 20:43:02.314728] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 52/70. [D 20:43:02.318303] openib_check_cq: completed rdma wr_id 2aaaab62e680, nic_wr_credit 26729. [D 20:43:02.318331] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 53/70. [D 20:43:02.318348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26729. [D 20:43:02.318363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26730. [D 20:43:02.318378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26731. [D 20:43:02.318393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26732. [D 20:43:02.318407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26733. [D 20:43:02.318422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26734. [D 20:43:02.318436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26735. [D 20:43:02.318451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26736. [D 20:43:02.318465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26737. [D 20:43:02.318479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26738. [D 20:43:02.318494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26739. [D 20:43:02.318512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26740. [D 20:43:02.318527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26741. [D 20:43:02.318542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26742. [D 20:43:02.318557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26743. [D 20:43:02.318571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26744. [D 20:43:02.318586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26745. [D 20:43:02.318600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26746. [D 20:43:02.318615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26747. [D 20:43:02.318630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26748. [D 20:43:02.318645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26749. [D 20:43:02.318659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26750. [D 20:43:02.318673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26751. [D 20:43:02.318688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26752. [D 20:43:02.318702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26753. [D 20:43:02.318717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26754. [D 20:43:02.318737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26755. [D 20:43:02.318752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26756. [D 20:43:02.318766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26757. [D 20:43:02.318781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26758. [D 20:43:02.318796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26759. [D 20:43:02.318810] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62df40 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26760. [D 20:43:02.318875] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.318895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.318908] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.322084] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5014 [D 20:43:02.322161] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 54/70. [D 20:43:02.324931] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5017 [D 20:43:02.324949] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 55/70. [D 20:43:02.329700] openib_check_cq: completed rdma wr_id 2aaaab62df40, nic_wr_credit 26760. [D 20:43:02.329766] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 56/70. [D 20:43:02.329852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.329873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.329886] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.334993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26760. [D 20:43:02.335015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26761. [D 20:43:02.335030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26762. [D 20:43:02.335045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26763. [D 20:43:02.335059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26764. [D 20:43:02.335074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26765. [D 20:43:02.335088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26766. [D 20:43:02.335103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26767. [D 20:43:02.335118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26768. [D 20:43:02.335145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26769. [D 20:43:02.335171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26770. [D 20:43:02.335187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26771. [D 20:43:02.335212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26772. [D 20:43:02.335227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26773. [D 20:43:02.335253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26774. [D 20:43:02.335278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26775. [D 20:43:02.652162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26776. [D 20:43:02.652197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26777. [D 20:43:02.652233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26778. [D 20:43:02.652257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26779. [D 20:43:02.652273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26780. [D 20:43:02.652287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26781. [D 20:43:02.652302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26782. [D 20:43:02.652317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26783. [D 20:43:02.652332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26784. [D 20:43:02.652941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26785. [D 20:43:02.652974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26786. [D 20:43:02.652999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26787. [D 20:43:02.653014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26788. [D 20:43:02.653028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26789. [D 20:43:02.653043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26790. [D 20:43:02.653058] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab604050 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26791. [D 20:43:02.653077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26792. [D 20:43:02.653092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26793. [D 20:43:02.653106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26794. [D 20:43:02.653121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26795. [D 20:43:02.653720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26796. [D 20:43:02.653741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26797. [D 20:43:02.653769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26798. [D 20:43:02.653784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26799. [D 20:43:02.653799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26800. [D 20:43:02.653814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26801. [D 20:43:02.653829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26802. [D 20:43:02.653844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26803. [D 20:43:02.653859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26804. [D 20:43:02.653884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26805. [D 20:43:02.654466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26806. [D 20:43:02.654484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26807. [D 20:43:02.654499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26808. [D 20:43:02.654513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26809. [D 20:43:02.654531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26810. [D 20:43:02.654545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26811. [D 20:43:02.654560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26812. [D 20:43:02.654575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26813. [D 20:43:02.654602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26814. [D 20:43:02.654617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26815. [D 20:43:02.654632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26816. [D 20:43:02.654646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26817. [D 20:43:02.654661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26818. [D 20:43:02.655274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26819. [D 20:43:02.655291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26820. [D 20:43:02.655306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26821. [D 20:43:02.655333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26822. [D 20:43:02.655349] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a320 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26823. [D 20:43:02.655368] openib_check_cq: completed rdma wr_id 2aaaab604050, nic_wr_credit 26823. [D 20:43:02.655383] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 57/70. [D 20:43:02.655467] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.655493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.655506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.655548] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5019 [D 20:43:02.655563] element 0: offset: 0x2aaaab60a300, size: 24 [D 20:43:02.655580] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 58/70. [D 20:43:02.655612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.655626] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.655638] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.655658] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5022 [D 20:43:02.655672] element 0: offset: 0x2aaaab6104e0, size: 24 [D 20:43:02.655688] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 59/70. [D 20:43:02.661168] openib_check_cq: completed rdma wr_id 2aaaab60a320, nic_wr_credit 26822. [D 20:43:02.661207] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 60/70. [D 20:43:02.661277] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.661299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.661313] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.661417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.661432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.661445] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.664586] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5019 [D 20:43:02.664651] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 0/70. [D 20:43:02.667810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 26822. [D 20:43:02.667883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 26823. [D 20:43:02.667899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26824. [D 20:43:02.667926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26825. [D 20:43:02.667941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26826. [D 20:43:02.667956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26827. [D 20:43:02.667985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26828. [D 20:43:02.667999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26829. [D 20:43:02.668014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26830. [D 20:43:02.668029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26831. [D 20:43:02.668044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26832. [D 20:43:02.668058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26833. [D 20:43:02.668073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26834. [D 20:43:02.668088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26835. [D 20:43:02.668103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26836. [D 20:43:02.668118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26837. [D 20:43:02.668143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26838. [D 20:43:02.668158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26839. [D 20:43:02.668173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26840. [D 20:43:02.668288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26841. [D 20:43:02.668303] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5022 [D 20:43:02.668311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26842. [D 20:43:02.668348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26843. [D 20:43:02.668524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26844. [D 20:43:02.668541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26845. [D 20:43:02.668556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26846. [D 20:43:02.668572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26847. [D 20:43:02.668587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26848. [D 20:43:02.668607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26849. [D 20:43:02.668622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26850. [D 20:43:02.668637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26851. [D 20:43:02.668652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26852. [D 20:43:02.668667] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a320 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26853. [D 20:43:02.668713] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 1/70. [D 20:43:02.673921] openib_check_cq: completed rdma wr_id 2aaaab60a320, nic_wr_credit 26853. [D 20:43:02.673950] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 2/70. [D 20:43:02.673966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26853. [D 20:43:02.673981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26854. [D 20:43:02.674015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26855. [D 20:43:02.674030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26856. [D 20:43:02.674045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26857. [D 20:43:02.674060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26858. [D 20:43:02.674074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26859. [D 20:43:02.674089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26860. [D 20:43:02.674104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26861. [D 20:43:02.674131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26862. [D 20:43:02.674147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26863. [D 20:43:02.674162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26864. [D 20:43:02.674176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26865. [D 20:43:02.674191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26866. [D 20:43:02.674208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26867. [D 20:43:02.674309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26868. [D 20:43:02.674325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26869. [D 20:43:02.674340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26870. [D 20:43:02.674354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26871. [D 20:43:02.674369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26872. [D 20:43:02.674386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26873. [D 20:43:02.674401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26874. [D 20:43:02.674416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 26875. [D 20:43:02.674430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 26876. [D 20:43:02.674445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 26877. [D 20:43:02.674460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 26878. [D 20:43:02.674474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 26879. [D 20:43:02.674489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 26880. [D 20:43:02.674504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 26881. [D 20:43:02.674522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 26882. [D 20:43:02.674537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 26883. [D 20:43:02.674552] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e430 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 26884. [D 20:43:02.674625] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.674649] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.674662] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.679899] openib_check_cq: completed rdma wr_id 2aaaab62e430, nic_wr_credit 26884. [D 20:43:02.679926] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 3/70. [D 20:43:02.680103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.680126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.680140] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.680179] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5026 [D 20:43:02.680193] element 0: offset: 0x2aaaab610490, size: 24 [D 20:43:02.680213] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 4/70. [D 20:43:02.680245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.680259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.680272] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.680293] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5029 [D 20:43:02.680307] element 0: offset: 0x2aaaab610260, size: 24 [D 20:43:02.680323] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 5/70. [D 20:43:02.680357] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.680371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.680384] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.683957] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5026 [D 20:43:02.683985] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 6/70. [D 20:43:02.685406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 26884. [D 20:43:02.685425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 26885. [D 20:43:02.685440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 26886. [D 20:43:02.685454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 26887. [D 20:43:02.685470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 26888. [D 20:43:02.685485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 26889. [D 20:43:02.685500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 26890. [D 20:43:02.685515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 26891. [D 20:43:02.685530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 26892. [D 20:43:02.685544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 26893. [D 20:43:02.685559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 26894. [D 20:43:02.685574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 26895. [D 20:43:02.685589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 26896. [D 20:43:02.685604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 26897. [D 20:43:02.685619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 26898. [D 20:43:02.685634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 26899. [D 20:43:02.685649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 26900. [D 20:43:02.685664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 26901. [D 20:43:02.685679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 26902. [D 20:43:02.685694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 26903. [D 20:43:02.685708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 26904. [D 20:43:02.685723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 26905. [D 20:43:02.685738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 26906. [D 20:43:02.685753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 26907. [D 20:43:02.685768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 26908. [D 20:43:02.685783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 26909. [D 20:43:02.685798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 26910. [D 20:43:02.685813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 26911. [D 20:43:02.685828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 26912. [D 20:43:02.685843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 26913. [D 20:43:02.685858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 26914. [D 20:43:02.685873] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ddd0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 26915. [D 20:43:02.691287] openib_check_cq: completed rdma wr_id 2aaaab60ddd0, nic_wr_credit 26915. [D 20:43:02.691306] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 7/70. [D 20:43:02.692678] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5029 [D 20:43:02.692748] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 8/70. [D 20:43:02.692773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.692795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.692811] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.692867] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5031 [D 20:43:02.692884] element 0: offset: 0x2aaaab6104e0, size: 24 [D 20:43:02.692900] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 9/70. [D 20:43:02.692929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.692944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.692957] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.692978] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5034 [D 20:43:02.692993] element 0: offset: 0x2aaaab62e390, size: 24 [D 20:43:02.693008] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 10/70. [D 20:43:02.693044] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.693058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.693072] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.693492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26915. [D 20:43:02.693515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 26916. [D 20:43:02.693530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 26917. [D 20:43:02.693545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 26918. [D 20:43:02.693559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 26919. [D 20:43:02.693574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 26920. [D 20:43:02.693588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26921. [D 20:43:02.693603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26922. [D 20:43:02.693618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26923. [D 20:43:02.693632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 26924. [D 20:43:02.693647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 26925. [D 20:43:02.693661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 26926. [D 20:43:02.693676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 26927. [D 20:43:02.693690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 26928. [D 20:43:02.693705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26929. [D 20:43:02.693720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26930. [D 20:43:02.693734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26931. [D 20:43:02.693749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26932. [D 20:43:02.693763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26933. [D 20:43:02.693778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26934. [D 20:43:02.693793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26935. [D 20:43:02.693808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26936. [D 20:43:02.693823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26937. [D 20:43:02.693838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26938. [D 20:43:02.693853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26939. [D 20:43:02.693868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26940. [D 20:43:02.693883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26941. [D 20:43:02.693898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26942. [D 20:43:02.693913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26943. [D 20:43:02.693928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26944. [D 20:43:02.693943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26945. [D 20:43:02.693958] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dd10 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26946. [D 20:43:02.699959] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5031 [D 20:43:02.700042] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 11/70. [D 20:43:02.700654] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5034 [D 20:43:02.700672] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 12/70. [D 20:43:02.705198] openib_check_cq: completed rdma wr_id 2aaaab60dd10, nic_wr_credit 26946. [D 20:43:02.705276] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 13/70. [D 20:43:02.707101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 26946. [D 20:43:02.707118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 26947. [D 20:43:02.707133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 26948. [D 20:43:02.707148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 26949. [D 20:43:02.707163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 26950. [D 20:43:02.707178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 26951. [D 20:43:02.707192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 26952. [D 20:43:02.707207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 26953. [D 20:43:02.707222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 26954. [D 20:43:02.707236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 26955. [D 20:43:02.707251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 26956. [D 20:43:02.707266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 26957. [D 20:43:02.707281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 26958. [D 20:43:02.707296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 26959. [D 20:43:02.707310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 26960. [D 20:43:02.707325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 26961. [D 20:43:02.707340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 26962. [D 20:43:02.707355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 26963. [D 20:43:02.707369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 26964. [D 20:43:02.707384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 26965. [D 20:43:02.707399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 26966. [D 20:43:02.707413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 26967. [D 20:43:02.707428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 26968. [D 20:43:02.707443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26969. [D 20:43:02.707457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26970. [D 20:43:02.707472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26971. [D 20:43:02.707487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 26972. [D 20:43:02.707501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 26973. [D 20:43:02.707516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 26974. [D 20:43:02.707531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 26975. [D 20:43:02.707546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 26976. [D 20:43:02.707560] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d2d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26977. [D 20:43:02.707578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 26978. [D 20:43:02.707593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 26979. [D 20:43:02.707608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 26980. [D 20:43:02.707623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 26981. [D 20:43:02.707637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 26982. [D 20:43:02.707652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 26983. [D 20:43:02.707667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 26984. [D 20:43:02.707681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 26985. [D 20:43:02.707696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 26986. [D 20:43:02.707712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 26987. [D 20:43:02.707727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 26988. [D 20:43:02.707741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 26989. [D 20:43:02.707756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 26990. [D 20:43:02.707770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 26991. [D 20:43:02.707785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 26992. [D 20:43:02.707799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 26993. [D 20:43:02.707814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 26994. [D 20:43:02.707828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 26995. [D 20:43:02.707843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 26996. [D 20:43:02.707858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 26997. [D 20:43:02.707872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 26998. [D 20:43:02.707887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 26999. [D 20:43:02.707901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27000. [D 20:43:02.707963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27001. [D 20:43:02.707979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27002. [D 20:43:02.707994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27003. [D 20:43:02.708009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27004. [D 20:43:02.708023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27005. [D 20:43:02.708038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27006. [D 20:43:02.708052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27007. [D 20:43:02.708067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27008. [D 20:43:02.708082] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d690 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27009. [D 20:43:02.707950] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.712588] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.712602] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.712653] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.712667] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.712679] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.712721] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5037 [D 20:43:02.712736] element 0: offset: 0x2aaaab62e4f0, size: 24 [D 20:43:02.712752] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 14/70. [D 20:43:02.718876] openib_check_cq: completed rdma wr_id 2aaaab60d2d0, nic_wr_credit 27009. [D 20:43:02.718901] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 15/70. [D 20:43:02.730589] openib_check_cq: completed rdma wr_id 2aaaab60d690, nic_wr_credit 27008. [D 20:43:02.730611] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 16/70. [D 20:43:02.730674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.730694] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.730707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.730794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.730809] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.730821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.734255] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5037 [D 20:43:02.734330] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 17/70. [D 20:43:02.738167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27008. [D 20:43:02.738192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27009. [D 20:43:02.738207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27010. [D 20:43:02.738221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27011. [D 20:43:02.738236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27012. [D 20:43:02.738260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27013. [D 20:43:02.738275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27014. [D 20:43:02.738290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27015. [D 20:43:02.738312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27016. [D 20:43:02.738327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27017. [D 20:43:02.738355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27018. [D 20:43:02.738379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27019. [D 20:43:02.738394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27020. [D 20:43:02.738416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27021. [D 20:43:02.738431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27022. [D 20:43:02.738445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27023. [D 20:43:02.738460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27024. [D 20:43:02.738482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27025. [D 20:43:02.738497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27026. [D 20:43:02.738528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27027. [D 20:43:02.738552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27028. [D 20:43:02.738567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27029. [D 20:43:02.738582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27030. [D 20:43:02.738607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27031. [D 20:43:02.738622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27032. [D 20:43:02.738648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27033. [D 20:43:02.738664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27034. [D 20:43:02.738679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27035. [D 20:43:02.738707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27036. [D 20:43:02.738730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27037. [D 20:43:02.738745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27038. [D 20:43:02.738769] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d2d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27039. [D 20:43:02.738840] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.738863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.738876] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.738918] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5041 [D 20:43:02.738933] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:43:02.738949] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 18/70. [D 20:43:02.746640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.746658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.746670] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.746693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5044 [D 20:43:02.746707] element 0: offset: 0x2aaaab610260, size: 24 [D 20:43:02.746722] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 19/70. [D 20:43:02.746755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.746769] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.746781] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.746801] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5046 [D 20:43:02.746815] element 0: offset: 0x2aaaab6127b0, size: 24 [D 20:43:02.746832] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 20/70. [D 20:43:02.749918] openib_check_cq: completed rdma wr_id 2aaaab60d2d0, nic_wr_credit 27039. [D 20:43:02.749943] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 21/70. [D 20:43:02.750142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.750161] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.750174] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.756735] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5044 [D 20:43:02.756817] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 22/70. [D 20:43:02.756910] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5041 [D 20:43:02.756929] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 23/70. [D 20:43:02.757080] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5046 [D 20:43:02.757100] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 24/70. [D 20:43:02.757157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 27039. [D 20:43:02.757255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 27040. [D 20:43:02.757271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 27041. [D 20:43:02.757291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 27042. [D 20:43:02.757306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 27043. [D 20:43:02.757321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 27044. [D 20:43:02.757335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 27045. [D 20:43:02.757350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27046. [D 20:43:02.757373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27047. [D 20:43:02.757388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27048. [D 20:43:02.757403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 27049. [D 20:43:02.757417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 27050. [D 20:43:02.757432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 27051. [D 20:43:02.757447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 27052. [D 20:43:02.757461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 27053. [D 20:43:02.757476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27054. [D 20:43:02.757491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27055. [D 20:43:02.757505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27056. [D 20:43:02.757520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 27057. [D 20:43:02.757535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 27058. [D 20:43:02.757549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 27059. [D 20:43:02.757564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 27060. [D 20:43:02.757579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 27061. [D 20:43:02.757593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27062. [D 20:43:02.757608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27063. [D 20:43:02.757622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27064. [D 20:43:02.757637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 27065. [D 20:43:02.757651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 27066. [D 20:43:02.757666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 27067. [D 20:43:02.757681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 27068. [D 20:43:02.757695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 27069. [D 20:43:02.757710] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27070. [D 20:43:02.757730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27071. [D 20:43:02.757746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 27072. [D 20:43:02.757760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 27073. [D 20:43:02.757775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 27074. [D 20:43:02.757789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 27075. [D 20:43:02.757804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 27076. [D 20:43:02.757818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27077. [D 20:43:02.757833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27078. [D 20:43:02.757848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27079. [D 20:43:02.757862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 27080. [D 20:43:02.757877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 27081. [D 20:43:02.757891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 27082. [D 20:43:02.757906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 27083. [D 20:43:02.757920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 27084. [D 20:43:02.757935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27085. [D 20:43:02.757949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27086. [D 20:43:02.757964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27087. [D 20:43:02.757979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27088. [D 20:43:02.757993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27089. [D 20:43:02.758008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27090. [D 20:43:02.758022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27091. [D 20:43:02.758037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27092. [D 20:43:02.758051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27093. [D 20:43:02.758066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27094. [D 20:43:02.758080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27095. [D 20:43:02.758095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27096. [D 20:43:02.758109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27097. [D 20:43:02.758124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27098. [D 20:43:02.758138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27099. [D 20:43:02.758154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27100. [D 20:43:02.758169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27101. [D 20:43:02.758183] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6039f0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27102. [D 20:43:02.758212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27103. [D 20:43:02.758229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27104. [D 20:43:02.758251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27105. [D 20:43:02.758266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27106. [D 20:43:02.758281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27107. [D 20:43:02.758296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27108. [D 20:43:02.758322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27109. [E 20:43:02.758352] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 27110, block for 10 ms. [D 20:43:02.758509] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27109. [E 20:43:02.758536] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 27110, block for 10 ms. [D 20:43:02.768922] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27109. [D 20:43:02.768951] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 25/70. [D 20:43:02.768966] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27108. [D 20:43:02.768982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27109. [D 20:43:02.768996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27110. [D 20:43:02.769011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27111. [D 20:43:02.769026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27112. [D 20:43:02.769040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27113. [D 20:43:02.769055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27114. [D 20:43:02.769069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27115. [D 20:43:02.769084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27116. [D 20:43:02.769098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27117. [D 20:43:02.769113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27118. [D 20:43:02.769128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27119. [D 20:43:02.769142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27120. [D 20:43:02.769157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27121. [D 20:43:02.769172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27122. [D 20:43:02.769188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27123. [D 20:43:02.769202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27124. [D 20:43:02.769217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27125. [D 20:43:02.769231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27126. [D 20:43:02.769246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27127. [D 20:43:02.769261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27128. [D 20:43:02.769276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27129. [D 20:43:02.769290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27130. [D 20:43:02.769305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27131. [D 20:43:02.769320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27132. [D 20:43:02.769334] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27133. [D 20:43:02.769399] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.769422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.769435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.769477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5049 [D 20:43:02.769492] element 0: offset: 0x2aaaab60cea0, size: 24 [D 20:43:02.769508] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 26/70. [D 20:43:02.780581] openib_check_cq: completed rdma wr_id 2aaaab6039f0, nic_wr_credit 27133. [D 20:43:02.780609] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 27/70. [D 20:43:02.782805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.782826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.782838] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.791204] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.791221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.791233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.791256] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5052 [D 20:43:02.791270] element 0: offset: 0x2aaaab62e4f0, size: 24 [D 20:43:02.791286] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 28/70. [D 20:43:02.792267] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27132. [D 20:43:02.792292] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 29/70. [D 20:43:02.792465] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.792485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.792498] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:02.792608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.792623] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.792636] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:02.796052] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5052 [D 20:43:02.796139] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 30/70. [D 20:43:02.797698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 27132. [D 20:43:02.797725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 27133. [D 20:43:02.797740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 27134. [D 20:43:02.797757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 27135. [D 20:43:02.797772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 27136. [D 20:43:02.797786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 27137. [D 20:43:02.797801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 27138. [D 20:43:02.797816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27139. [D 20:43:02.797831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27140. [D 20:43:02.797845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27141. [D 20:43:02.797860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 27142. [D 20:43:02.797888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 27143. [D 20:43:02.797913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 27144. [D 20:43:02.797928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 27145. [D 20:43:02.797943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 27146. [D 20:43:02.797958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27147. [D 20:43:02.797973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27148. [D 20:43:02.797989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27149. [D 20:43:02.798012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 27150. [D 20:43:02.798027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 27151. [D 20:43:02.798042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 27152. [D 20:43:02.798057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 27153. [D 20:43:02.798071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 27154. [D 20:43:02.798086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27155. [D 20:43:02.798100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27156. [D 20:43:02.798115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27157. [D 20:43:02.798130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 27158. [D 20:43:02.798145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 27159. [D 20:43:02.798159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 27160. [D 20:43:02.798174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 27161. [D 20:43:02.798188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 27162. [D 20:43:02.798203] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6103d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27163. [D 20:43:02.803826] openib_check_cq: completed rdma wr_id 2aaaab6103d0, nic_wr_credit 27163. [D 20:43:02.803889] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 31/70. [D 20:43:02.804036] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:02.804058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.804072] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:02.806234] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.806249] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.806261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:02.806302] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5057 [D 20:43:02.806316] element 0: offset: 0x2aaaab60a390, size: 24 [D 20:43:02.806333] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 32/70. [D 20:43:02.806372] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.806386] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.806399] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:02.806420] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5058 [D 20:43:02.806434] element 0: offset: 0x2aaaab604120, size: 24 [D 20:43:02.806448] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 33/70. [D 20:43:02.810471] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5057 [D 20:43:02.810557] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 34/70. [D 20:43:02.811931] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5049 [D 20:43:02.811950] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 35/70. [D 20:43:02.815618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27163. [D 20:43:02.815713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 27164. [D 20:43:02.815741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 27165. [D 20:43:02.815757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 27166. [D 20:43:02.815782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 27167. [D 20:43:02.815799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 27168. [D 20:43:02.815826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27169. [D 20:43:02.815854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27170. [D 20:43:02.815870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27171. [D 20:43:02.815894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 27172. [D 20:43:02.815926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 27173. [D 20:43:02.815941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 27174. [D 20:43:02.815956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 27175. [D 20:43:02.815970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 27176. [D 20:43:02.815985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27177. [D 20:43:02.816000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27178. [D 20:43:02.816026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27179. [D 20:43:02.816056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27180. [D 20:43:02.816082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27181. [D 20:43:02.816097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27182. [D 20:43:02.816121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27183. [D 20:43:02.816147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27184. [D 20:43:02.816162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27185. [D 20:43:02.816177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27186. [D 20:43:02.816192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27187. [D 20:43:02.816207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27188. [D 20:43:02.816222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27189. [D 20:43:02.816237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27190. [D 20:43:02.816262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27191. [D 20:43:02.816278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27192. [D 20:43:02.816293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27193. [D 20:43:02.816308] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27194. [D 20:43:02.816327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27195. [D 20:43:02.816343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27196. [D 20:43:02.816358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27197. [D 20:43:02.816373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27198. [D 20:43:02.816388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27199. [D 20:43:02.816403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27200. [D 20:43:02.816418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27201. [D 20:43:02.816433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27202. [D 20:43:02.816448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27203. [D 20:43:02.816462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27204. [D 20:43:02.816477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27205. [D 20:43:02.816492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27206. [D 20:43:02.816507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27207. [D 20:43:02.816522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27208. [D 20:43:02.816538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27209. [D 20:43:02.816553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27210. [D 20:43:02.816568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27211. [D 20:43:02.816584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27212. [D 20:43:02.816598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27213. [D 20:43:02.816614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27214. [D 20:43:02.816629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27215. [D 20:43:02.816644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27216. [D 20:43:02.816658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27217. [D 20:43:02.816674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27218. [D 20:43:02.816689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27219. [D 20:43:02.816704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27220. [D 20:43:02.816719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27221. [D 20:43:02.816734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27222. [D 20:43:02.816749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27223. [D 20:43:02.816764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27224. [D 20:43:02.816779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27225. [D 20:43:02.816794] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27226. [D 20:43:02.818176] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:02.818199] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:02.818213] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:02.818255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5061 [D 20:43:02.818270] element 0: offset: 0x2aaaab60a190, size: 24 [D 20:43:02.818286] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 36/70. [D 20:43:02.821910] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5058 [D 20:43:02.821987] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 37/70. [D 20:43:02.827337] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27226. [D 20:43:02.827379] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 38/70. [D 20:43:02.838959] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27225. [D 20:43:02.838981] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 39/70. [D 20:43:02.838998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27225. [D 20:43:02.839024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27226. [D 20:43:02.839040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27227. [D 20:43:02.839063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27228. [D 20:43:03.091938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27229. [D 20:43:03.092003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27230. [D 20:43:03.092019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27231. [D 20:43:03.092437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27232. [D 20:43:03.092454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27233. [D 20:43:03.092469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27234. [D 20:43:03.092484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27235. [D 20:43:03.092499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27236. [D 20:43:03.092517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27237. [D 20:43:03.092531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27238. [D 20:43:03.092559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27239. [D 20:43:03.092575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27240. [D 20:43:03.092599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27241. [D 20:43:03.092615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27242. [D 20:43:03.092630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27243. [D 20:43:03.092644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27244. [D 20:43:03.092659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27245. [D 20:43:03.092674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27246. [D 20:43:03.092689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27247. [D 20:43:03.092703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27248. [D 20:43:03.092718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27249. [D 20:43:03.092806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27250. [D 20:43:03.092834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27251. [D 20:43:03.093288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27252. [D 20:43:03.093306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27253. [D 20:43:03.093320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27254. [D 20:43:03.093350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27255. [D 20:43:03.093365] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6174d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27256. [D 20:43:03.093448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.093468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.093483] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.097500] openib_check_cq: completed rdma wr_id 2aaaab6174d0, nic_wr_credit 27256. [D 20:43:03.097522] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 40/70. [D 20:43:03.102366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.102385] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.102414] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.102515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.102531] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.102548] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.102588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5064 [D 20:43:03.102611] element 0: offset: 0x2aaaab60a1b0, size: 24 [D 20:43:03.102628] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 41/70. [D 20:43:03.102669] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.102690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.102703] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.102725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5068 [D 20:43:03.102740] element 0: offset: 0x2aaaab62e410, size: 24 [D 20:43:03.102754] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 42/70. [D 20:43:03.102778] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.102793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.102807] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.109089] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.109110] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.109124] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.109147] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5070 [D 20:43:03.109167] element 0: offset: 0x2aaaab60dd80, size: 24 [D 20:43:03.109183] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 43/70. [D 20:43:03.116144] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5061 [D 20:43:03.116233] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 44/70. [D 20:43:03.116304] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5064 [D 20:43:03.116326] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 45/70. [D 20:43:03.116375] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5068 [D 20:43:03.116392] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 46/70. [D 20:43:03.116416] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5070 [D 20:43:03.116445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 27256. [D 20:43:03.116520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 27257. [D 20:43:03.116536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 27258. [D 20:43:03.116551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 27259. [D 20:43:03.116566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 27260. [D 20:43:03.116581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 27261. [D 20:43:03.116596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 27262. [D 20:43:03.116611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27263. [D 20:43:03.116667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27264. [D 20:43:03.116683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27265. [D 20:43:03.116698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 27266. [D 20:43:03.116712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 27267. [D 20:43:03.116727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 27268. [D 20:43:03.116742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 27269. [D 20:43:03.116756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 27270. [D 20:43:03.116771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27271. [D 20:43:03.116786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27272. [D 20:43:03.116801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27273. [D 20:43:03.116815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 27274. [D 20:43:03.116830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 27275. [D 20:43:03.116845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 27276. [D 20:43:03.116860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 27277. [D 20:43:03.116875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 27278. [D 20:43:03.116889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27279. [D 20:43:03.116904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27280. [D 20:43:03.116919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27281. [D 20:43:03.116934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 27282. [D 20:43:03.116948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 27283. [D 20:43:03.116963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 27284. [D 20:43:03.116978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 27285. [D 20:43:03.116993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 27286. [D 20:43:03.117007] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27287. [D 20:43:03.117026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27288. [D 20:43:03.117041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27289. [D 20:43:03.117056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27290. [D 20:43:03.117071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27291. [D 20:43:03.117086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27292. [D 20:43:03.117101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27293. [D 20:43:03.117117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27294. [D 20:43:03.117131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27295. [D 20:43:03.117146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27296. [D 20:43:03.117160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27297. [D 20:43:03.117175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27298. [D 20:43:03.117190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27299. [D 20:43:03.117204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27300. [D 20:43:03.117219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27301. [D 20:43:03.117234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27302. [D 20:43:03.117248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27303. [D 20:43:03.117263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27304. [D 20:43:03.117277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27305. [D 20:43:03.117292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27306. [D 20:43:03.117307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27307. [D 20:43:03.117322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27308. [D 20:43:03.117336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27309. [D 20:43:03.117351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27310. [D 20:43:03.117366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27311. [D 20:43:03.117380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27312. [D 20:43:03.117395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27313. [D 20:43:03.117409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27314. [D 20:43:03.117424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27315. [D 20:43:03.117439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27316. [D 20:43:03.117453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27317. [D 20:43:03.117468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27318. [D 20:43:03.117483] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27319. [D 20:43:03.117500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27320. [D 20:43:03.117515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 27321. [D 20:43:03.117530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 27322. [D 20:43:03.117545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 27323. [D 20:43:03.117560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 27324. [D 20:43:03.117575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 27325. [D 20:43:03.117590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27326. [E 20:43:03.117609] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 27327, block for 10 ms. [D 20:43:03.122391] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27326. [D 20:43:03.122416] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 47/70. [D 20:43:03.122431] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27325. [D 20:43:03.122446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27326. [D 20:43:03.122461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27327. [D 20:43:03.122476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 27328. [D 20:43:03.122491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 27329. [D 20:43:03.122506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 27330. [D 20:43:03.122520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 27331. [D 20:43:03.122535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 27332. [D 20:43:03.122553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27333. [D 20:43:03.122568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27334. [D 20:43:03.122583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27335. [D 20:43:03.122597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27336. [D 20:43:03.122612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27337. [D 20:43:03.122626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27338. [D 20:43:03.122641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27339. [D 20:43:03.122656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27340. [D 20:43:03.122671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27341. [D 20:43:03.122686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27342. [D 20:43:03.122701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27343. [D 20:43:03.122715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27344. [D 20:43:03.122730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27345. [D 20:43:03.122745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27346. [D 20:43:03.122759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27347. [D 20:43:03.122775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27348. [D 20:43:03.122790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27349. [D 20:43:03.122805] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617a90 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27350. [D 20:43:03.122837] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 48/70. [D 20:43:03.128265] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27350. [D 20:43:03.128286] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 49/70. [D 20:43:03.131961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.131983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.131996] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.134141] openib_check_cq: completed rdma wr_id 2aaaab617a90, nic_wr_credit 27349. [D 20:43:03.134161] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 50/70. [D 20:43:03.134200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.134218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.134230] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.134262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.134275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.134288] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.135236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27349. [D 20:43:03.135257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27350. [D 20:43:03.135272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27351. [D 20:43:03.135286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27352. [D 20:43:03.135301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27353. [D 20:43:03.135316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27354. [D 20:43:03.135330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27355. [D 20:43:03.135345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27356. [D 20:43:03.135360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27357. [D 20:43:03.135374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27358. [D 20:43:03.135389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27359. [D 20:43:03.135404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27360. [D 20:43:03.135418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27361. [D 20:43:03.135433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27362. [D 20:43:03.135448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27363. [D 20:43:03.135462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27364. [D 20:43:03.135477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27365. [D 20:43:03.135492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27366. [D 20:43:03.135507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27367. [D 20:43:03.135522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27368. [D 20:43:03.135537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27369. [D 20:43:03.135552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27370. [D 20:43:03.135566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27371. [D 20:43:03.135581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27372. [D 20:43:03.135596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27373. [D 20:43:03.135611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27374. [D 20:43:03.135625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27375. [D 20:43:03.135640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27376. [D 20:43:03.135654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27377. [D 20:43:03.135669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27378. [D 20:43:03.135684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27379. [D 20:43:03.135699] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab608790 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27380. [D 20:43:03.141350] openib_check_cq: completed rdma wr_id 2aaaab608790, nic_wr_credit 27380. [D 20:43:03.141367] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 51/70. [D 20:43:03.141431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.141449] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.141462] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:03.169970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.169988] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.170001] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:03.170040] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5075 [D 20:43:03.170055] element 0: offset: 0x2aaaab604120, size: 24 [D 20:43:03.170071] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 52/70. [D 20:43:03.170108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.170122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.170134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.170154] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5076 [D 20:43:03.170168] element 0: offset: 0x2aaaab60cea0, size: 24 [D 20:43:03.170183] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 53/70. [D 20:43:03.175992] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5075 [D 20:43:03.176076] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 54/70. [D 20:43:03.176137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27380. [D 20:43:03.176163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27381. [D 20:43:03.176178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27382. [D 20:43:03.176194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27383. [D 20:43:03.176210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27384. [D 20:43:03.176224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27385. [D 20:43:03.176240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27386. [D 20:43:03.176254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27387. [D 20:43:03.176269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27388. [D 20:43:03.176284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27389. [D 20:43:03.176299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27390. [D 20:43:03.176314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27391. [D 20:43:03.176329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27392. [D 20:43:03.176344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27393. [D 20:43:03.176359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27394. [D 20:43:03.176374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27395. [D 20:43:03.176389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27396. [D 20:43:03.176403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27397. [D 20:43:03.176419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27398. [D 20:43:03.176433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27399. [D 20:43:03.176448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27400. [D 20:43:03.176463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27401. [D 20:43:03.176478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27402. [D 20:43:03.176493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27403. [D 20:43:03.176508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27404. [D 20:43:03.176523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27405. [D 20:43:03.176537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27406. [D 20:43:03.176553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27407. [D 20:43:03.176567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27408. [D 20:43:03.176582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27409. [D 20:43:03.176597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27410. [D 20:43:03.176612] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27411. [D 20:43:03.176688] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5076 [D 20:43:03.176719] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 55/70. [D 20:43:03.186740] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27411. [D 20:43:03.186766] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 56/70. [D 20:43:03.186782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27411. [D 20:43:03.186798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27412. [D 20:43:03.186813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27413. [D 20:43:03.186827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27414. [D 20:43:03.186843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27415. [D 20:43:03.186857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27416. [D 20:43:03.186872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27417. [D 20:43:03.186887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27418. [D 20:43:03.186902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27419. [D 20:43:03.186917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27420. [D 20:43:03.186932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27421. [D 20:43:03.186947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27422. [D 20:43:03.186962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27423. [D 20:43:03.186977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27424. [D 20:43:03.186992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27425. [D 20:43:03.187007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27426. [D 20:43:03.187022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27427. [D 20:43:03.187036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27428. [D 20:43:03.187052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27429. [D 20:43:03.187066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27430. [D 20:43:03.187081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27431. [D 20:43:03.187096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27432. [D 20:43:03.187111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27433. [D 20:43:03.187126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27434. [D 20:43:03.187141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27435. [D 20:43:03.187156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27436. [D 20:43:03.187171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27437. [D 20:43:03.187186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27438. [D 20:43:03.187202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27439. [D 20:43:03.187216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27440. [D 20:43:03.187231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27441. [D 20:43:03.187246] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27442. [D 20:43:03.187320] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.187342] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.187355] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.197765] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.197783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.197796] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.197835] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5080 [D 20:43:03.197850] element 0: offset: 0x2aaaab62e4f0, size: 24 [D 20:43:03.197867] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 57/70. [D 20:43:03.198484] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27442. [D 20:43:03.198509] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 58/70. [D 20:43:03.198610] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.198628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.198641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.201793] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5080 [D 20:43:03.201860] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 59/70. [D 20:43:03.205570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27442. [D 20:43:03.205595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27443. [D 20:43:03.205611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27444. [D 20:43:03.205625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27445. [D 20:43:03.205640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27446. [D 20:43:03.205655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27447. [D 20:43:03.205670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27448. [D 20:43:03.205685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27449. [D 20:43:03.205700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27450. [D 20:43:03.205715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27451. [D 20:43:03.205730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27452. [D 20:43:03.205744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27453. [D 20:43:03.205759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27454. [D 20:43:03.205774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27455. [D 20:43:03.205789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27456. [D 20:43:03.205804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27457. [D 20:43:03.205820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27458. [D 20:43:03.205834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27459. [D 20:43:03.205849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27460. [D 20:43:03.205864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27461. [D 20:43:03.205879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27462. [D 20:43:03.205894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27463. [D 20:43:03.205909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27464. [D 20:43:03.205924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27465. [D 20:43:03.205939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27466. [D 20:43:03.205954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27467. [D 20:43:03.205969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27468. [D 20:43:03.205984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27469. [D 20:43:03.205999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27470. [D 20:43:03.206014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27471. [D 20:43:03.206029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27472. [D 20:43:03.206043] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27473. [D 20:43:03.208319] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.208343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.208356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.208399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5082 [D 20:43:03.208414] element 0: offset: 0x2aaaab60cea0, size: 24 [D 20:43:03.208430] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 60/70. [D 20:43:03.216342] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27473. [D 20:43:03.216363] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 0/70. [D 20:43:03.216478] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.216499] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.216512] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.219893] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5082 [D 20:43:03.219987] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 1/70. [D 20:43:03.223063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27473. [D 20:43:03.223085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27474. [D 20:43:03.223099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27475. [D 20:43:03.223115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27476. [D 20:43:03.223129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27477. [D 20:43:03.223146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27478. [D 20:43:03.223160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27479. [D 20:43:03.223175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27480. [D 20:43:03.223190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27481. [D 20:43:03.223218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27482. [D 20:43:03.223244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27483. [D 20:43:03.223259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27484. [D 20:43:03.223290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27485. [D 20:43:03.223313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27486. [D 20:43:03.223328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27487. [D 20:43:03.223360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27488. [D 20:43:03.223384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27489. [D 20:43:03.223399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27490. [D 20:43:03.223428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27491. [D 20:43:03.223459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27492. [D 20:43:03.223486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27493. [D 20:43:03.223502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27494. [D 20:43:03.223529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27495. [D 20:43:03.223544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27496. [D 20:43:03.223571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27497. [D 20:43:03.223597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27498. [D 20:43:03.223612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27499. [D 20:43:03.223636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27500. [D 20:43:03.223662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27501. [D 20:43:03.223677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27502. [D 20:43:03.223692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27503. [D 20:43:03.223706] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27504. [D 20:43:03.225915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.225939] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.225952] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.225997] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5086 [D 20:43:03.226012] element 0: offset: 0x2aaaab60a390, size: 24 [D 20:43:03.226029] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 2/70. [D 20:43:03.234729] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27504. [D 20:43:03.234750] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 3/70. [D 20:43:03.234869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.234889] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.234902] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.238076] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5086 [D 20:43:03.238152] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 4/70. [D 20:43:03.240837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27504. [D 20:43:03.240859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27505. [D 20:43:03.240874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27506. [D 20:43:03.240889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27507. [D 20:43:03.240904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27508. [D 20:43:03.240918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27509. [D 20:43:03.240946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27510. [D 20:43:03.240961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27511. [D 20:43:03.240992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27512. [D 20:43:03.241016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27513. [D 20:43:03.241031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27514. [D 20:43:03.241060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27515. [D 20:43:03.241074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27516. [D 20:43:03.241101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27517. [D 20:43:03.241116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27518. [D 20:43:03.241131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27519. [D 20:43:03.241146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27520. [D 20:43:03.241160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27521. [D 20:43:03.241175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27522. [D 20:43:03.241203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27523. [D 20:43:03.241219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27524. [D 20:43:03.241233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27525. [D 20:43:03.241264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27526. [D 20:43:03.241289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27527. [D 20:43:03.241313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27528. [D 20:43:03.241329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27529. [D 20:43:03.241353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27530. [D 20:43:03.241386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27531. [D 20:43:03.241412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27532. [D 20:43:03.241427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27533. [D 20:43:03.241442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27534. [D 20:43:03.241457] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27535. [D 20:43:03.243533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.243558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.243571] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.243613] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5088 [D 20:43:03.243628] element 0: offset: 0x2aaaab60cea0, size: 24 [D 20:43:03.243644] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 5/70. [D 20:43:03.252544] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27535. [D 20:43:03.252566] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 6/70. [D 20:43:03.252695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.252716] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.252728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:03.255970] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5088 [D 20:43:03.256042] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 7/70. [D 20:43:03.258430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27535. [D 20:43:03.258452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27536. [D 20:43:03.258467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27537. [D 20:43:03.258482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27538. [D 20:43:03.258496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27539. [D 20:43:03.258511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27540. [D 20:43:03.258526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27541. [D 20:43:03.258541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27542. [D 20:43:03.258570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27543. [D 20:43:03.258586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27544. [D 20:43:03.258613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27545. [D 20:43:03.258629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27546. [D 20:43:03.258659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27547. [D 20:43:03.258684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27548. [D 20:43:03.258708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27549. [D 20:43:03.258722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27550. [D 20:43:03.258750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27551. [D 20:43:03.258774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27552. [D 20:43:03.258799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27553. [D 20:43:03.258814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27554. [D 20:43:03.258840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27555. [D 20:43:03.258855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27556. [D 20:43:03.258883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27557. [D 20:43:03.258914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27558. [D 20:43:03.258929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27559. [D 20:43:03.258955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27560. [D 20:43:03.258983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27561. [D 20:43:03.258998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27562. [D 20:43:03.259024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27563. [D 20:43:03.259052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27564. [D 20:43:03.259076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27565. [D 20:43:03.259091] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27566. [D 20:43:03.261119] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.261143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.261155] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:03.261197] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5092 [D 20:43:03.261212] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:03.261228] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 8/70. [D 20:43:03.266899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.266917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.266929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.266953] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5094 [D 20:43:03.266967] element 0: offset: 0x2aaaab014c80, size: 24 [D 20:43:03.266982] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 9/70. [D 20:43:03.270079] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 27566. [D 20:43:03.270101] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 10/70. [D 20:43:03.270249] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.270271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.270283] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.275967] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5092 [D 20:43:03.275995] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 11/70. [D 20:43:03.276129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27566. [D 20:43:03.276146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27567. [D 20:43:03.276161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27568. [D 20:43:03.276176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27569. [D 20:43:03.276191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27570. [D 20:43:03.276206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27571. [D 20:43:03.276221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27572. [D 20:43:03.276254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27573. [D 20:43:03.276279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27574. [D 20:43:03.276295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27575. [D 20:43:03.276323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27576. [D 20:43:03.276338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27577. [D 20:43:03.276353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27578. [D 20:43:03.276367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27579. [D 20:43:03.276400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27580. [D 20:43:03.276425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27581. [D 20:43:03.276450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27582. [D 20:43:03.276465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27583. [D 20:43:03.276492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27584. [D 20:43:03.276508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27585. [D 20:43:03.276522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27586. [D 20:43:03.276546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27587. [D 20:43:03.276561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27588. [D 20:43:03.276590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27589. [D 20:43:03.276614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27590. [D 20:43:03.276628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27591. [D 20:43:03.276656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27592. [D 20:43:03.276681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27593. [D 20:43:03.277036] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5094 [D 20:43:03.550075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27594. [D 20:43:03.550098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27595. [D 20:43:03.550113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27596. [D 20:43:03.550129] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27597. [D 20:43:03.550157] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 12/70. [D 20:43:03.550231] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.550296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.550311] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.550357] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5097 [D 20:43:03.550372] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:03.550393] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 13/70. [D 20:43:03.550434] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.550448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.550460] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.550481] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5100 [D 20:43:03.550495] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:03.550510] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 14/70. [D 20:43:03.550995] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27597. [D 20:43:03.551021] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 15/70. [D 20:43:03.551047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27597. [D 20:43:03.551063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27598. [D 20:43:03.551078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 27599. [D 20:43:03.551093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 27600. [D 20:43:03.551109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 27601. [D 20:43:03.551124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 27602. [D 20:43:03.551139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 27603. [D 20:43:03.551154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27604. [D 20:43:03.551169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27605. [D 20:43:03.551184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27606. [D 20:43:03.551199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 27607. [D 20:43:03.551214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 27608. [D 20:43:03.551228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 27609. [D 20:43:03.551243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 27610. [D 20:43:03.551258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 27611. [D 20:43:03.551273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27612. [D 20:43:03.551290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27613. [D 20:43:03.551305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27614. [D 20:43:03.551320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27615. [D 20:43:03.551334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27616. [D 20:43:03.551349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27617. [D 20:43:03.551364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27618. [D 20:43:03.551378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27619. [D 20:43:03.551393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27620. [D 20:43:03.551408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27621. [D 20:43:03.551423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27622. [D 20:43:03.551437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27623. [D 20:43:03.551452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27624. [D 20:43:03.551467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27625. [D 20:43:03.551482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27626. [D 20:43:03.551496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27627. [D 20:43:03.551511] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27628. [D 20:43:03.551573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.551597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.551609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.556966] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27628. [D 20:43:03.556992] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 16/70. [D 20:43:03.557093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.557153] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.557166] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.559930] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5097 [D 20:43:03.559953] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 17/70. [D 20:43:03.559969] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5100 [D 20:43:03.559985] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 18/70. [D 20:43:03.561600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27628. [D 20:43:03.561619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27629. [D 20:43:03.561634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27630. [D 20:43:03.561648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27631. [D 20:43:03.561664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27632. [D 20:43:03.561678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27633. [D 20:43:03.561694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27634. [D 20:43:03.561734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27635. [D 20:43:03.561751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27636. [D 20:43:03.561766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27637. [D 20:43:03.561781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27638. [D 20:43:03.561797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27639. [D 20:43:03.561812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27640. [D 20:43:03.561827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27641. [D 20:43:03.561843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27642. [D 20:43:03.561858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27643. [D 20:43:03.561872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27644. [D 20:43:03.561888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27645. [D 20:43:03.561903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27646. [D 20:43:03.561918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27647. [D 20:43:03.561934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27648. [D 20:43:03.561974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27649. [D 20:43:03.561988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27650. [D 20:43:03.562003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27651. [D 20:43:03.562018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27652. [D 20:43:03.562034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27653. [D 20:43:03.562049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27654. [D 20:43:03.562063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27655. [D 20:43:03.562079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27656. [D 20:43:03.562094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27657. [D 20:43:03.562109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27658. [D 20:43:03.562151] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27659. [D 20:43:03.562168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27660. [D 20:43:03.562206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27661. [D 20:43:03.562243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27662. [D 20:43:03.562258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27663. [D 20:43:03.562273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27664. [D 20:43:03.562288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27665. [D 20:43:03.562302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27666. [D 20:43:03.562317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27667. [D 20:43:03.562332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27668. [D 20:43:03.562347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27669. [D 20:43:03.562375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27670. [D 20:43:03.562390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27671. [D 20:43:03.562417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27672. [D 20:43:03.562432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27673. [D 20:43:03.562447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27674. [D 20:43:03.562462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27675. [D 20:43:03.562477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27676. [D 20:43:03.562491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27677. [D 20:43:03.562511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27678. [D 20:43:03.562525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27679. [D 20:43:03.562540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27680. [D 20:43:03.562555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27681. [D 20:43:03.562573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27682. [D 20:43:03.562588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27683. [D 20:43:03.562603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27684. [D 20:43:03.562617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27685. [D 20:43:03.562633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27686. [D 20:43:03.562648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27687. [D 20:43:03.562663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27688. [D 20:43:03.562677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27689. [D 20:43:03.562694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27690. [D 20:43:03.562712] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27691. [D 20:43:03.562782] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.562820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.562834] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.562876] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5104 [D 20:43:03.562891] element 0: offset: 0x2aaaab014c80, size: 24 [D 20:43:03.562912] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 19/70. [D 20:43:03.564349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.564368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.564381] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.564405] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5106 [D 20:43:03.564419] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:03.564436] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 20/70. [D 20:43:03.568717] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 27691. [D 20:43:03.568746] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 21/70. [D 20:43:03.579200] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27690. [D 20:43:03.579223] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 22/70. [D 20:43:03.579290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.579314] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.579328] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.579443] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.579459] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.579471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.582560] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5104 [D 20:43:03.582589] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 23/70. [D 20:43:03.584668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27690. [D 20:43:03.584688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27691. [D 20:43:03.584704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27692. [D 20:43:03.584718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27693. [D 20:43:03.584734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27694. [D 20:43:03.584749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27695. [D 20:43:03.584772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27696. [D 20:43:03.584787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27697. [D 20:43:03.584802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27698. [D 20:43:03.584829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27699. [D 20:43:03.584845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27700. [D 20:43:03.584869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27701. [D 20:43:03.584896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27702. [D 20:43:03.584911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27703. [D 20:43:03.584935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27704. [D 20:43:03.584950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27705. [D 20:43:03.584973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27706. [D 20:43:03.584988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27707. [D 20:43:03.585014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27708. [D 20:43:03.585039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27709. [D 20:43:03.585054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27710. [D 20:43:03.585077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27711. [D 20:43:03.585092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27712. [D 20:43:03.585107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27713. [D 20:43:03.585146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27714. [D 20:43:03.585162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27715. [D 20:43:03.585186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27716. [D 20:43:03.585200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27717. [D 20:43:03.585215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27718. [D 20:43:03.585229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27719. [D 20:43:03.585244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27720. [D 20:43:03.585259] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27721. [D 20:43:03.585570] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5106 [D 20:43:03.585651] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 24/70. [D 20:43:03.593043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.593065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.593078] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.593125] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5110 [D 20:43:03.593140] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:03.593159] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 25/70. [D 20:43:03.593199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.593212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.593225] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.593245] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5112 [D 20:43:03.593259] element 0: offset: 0x2aaaab0258f0, size: 24 [D 20:43:03.593273] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 26/70. [D 20:43:03.596389] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27721. [D 20:43:03.596415] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 27/70. [D 20:43:03.596476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27721. [D 20:43:03.596493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27722. [D 20:43:03.596508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 27723. [D 20:43:03.596523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 27724. [D 20:43:03.596537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 27725. [D 20:43:03.596552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 27726. [D 20:43:03.596567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 27727. [D 20:43:03.596582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27728. [D 20:43:03.596602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27729. [D 20:43:03.596617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27730. [D 20:43:03.596632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 27731. [D 20:43:03.596585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.596649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 27732. [D 20:43:03.596694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 27733. [D 20:43:03.596674] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.596710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 27734. [D 20:43:03.596733] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.596752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 27735. [D 20:43:03.596783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27736. [D 20:43:03.596799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27737. [D 20:43:03.596814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27738. [D 20:43:03.596828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27739. [D 20:43:03.596843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27740. [D 20:43:03.596858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27741. [D 20:43:03.596873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27742. [D 20:43:03.596887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27743. [D 20:43:03.596902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27744. [D 20:43:03.596917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27745. [D 20:43:03.596932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27746. [D 20:43:03.596946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27747. [D 20:43:03.596961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27748. [D 20:43:03.596976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27749. [D 20:43:03.596990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27750. [D 20:43:03.597007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27751. [D 20:43:03.597021] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27752. [D 20:43:03.602466] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27752. [D 20:43:03.602499] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 28/70. [D 20:43:03.603056] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5110 [D 20:43:03.603138] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 29/70. [D 20:43:03.603169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.603191] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.603206] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.603230] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5112 [D 20:43:03.603252] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 30/70. [D 20:43:03.607490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27752. [D 20:43:03.607516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27753. [D 20:43:03.607531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27754. [D 20:43:03.607546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27755. [D 20:43:03.607561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27756. [D 20:43:03.607576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27757. [D 20:43:03.607591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27758. [D 20:43:03.607606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27759. [D 20:43:03.607621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27760. [D 20:43:03.607636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27761. [D 20:43:03.607651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27762. [D 20:43:03.607665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27763. [D 20:43:03.607680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27764. [D 20:43:03.607695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27765. [D 20:43:03.607710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27766. [D 20:43:03.607725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27767. [D 20:43:03.607740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27768. [D 20:43:03.607754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27769. [D 20:43:03.607769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27770. [D 20:43:03.607784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27771. [D 20:43:03.607799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27772. [D 20:43:03.607814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27773. [D 20:43:03.607830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27774. [D 20:43:03.607844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27775. [D 20:43:03.607859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27776. [D 20:43:03.607874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27777. [D 20:43:03.607888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27778. [D 20:43:03.607903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27779. [D 20:43:03.607921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27780. [D 20:43:03.607936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27781. [D 20:43:03.607951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27782. [D 20:43:03.607966] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27783. [D 20:43:03.607982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27784. [D 20:43:03.607997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27785. [D 20:43:03.608012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27786. [D 20:43:03.608026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27787. [D 20:43:03.608040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27788. [D 20:43:03.608055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27789. [D 20:43:03.608070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27790. [D 20:43:03.608084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27791. [D 20:43:03.608098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27792. [D 20:43:03.608113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27793. [D 20:43:03.608127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27794. [D 20:43:03.608142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27795. [D 20:43:03.608156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27796. [D 20:43:03.608171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27797. [D 20:43:03.608185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27798. [D 20:43:03.608199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27799. [D 20:43:03.608214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27800. [D 20:43:03.608228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27801. [D 20:43:03.608243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27802. [D 20:43:03.608258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27803. [D 20:43:03.608273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27804. [D 20:43:03.608288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27805. [D 20:43:03.608303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27806. [D 20:43:03.608318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27807. [D 20:43:03.608333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27808. [D 20:43:03.608347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27809. [D 20:43:03.608362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27810. [D 20:43:03.608377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27811. [D 20:43:03.608392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27812. [D 20:43:03.608407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27813. [D 20:43:03.608422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27814. [D 20:43:03.608437] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27815. [D 20:43:03.612836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.612860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.612873] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.612915] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5116 [D 20:43:03.612930] element 0: offset: 0x2aaaab039060, size: 24 [D 20:43:03.612946] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 31/70. [D 20:43:03.612980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.612994] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.613006] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.613027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5118 [D 20:43:03.613040] element 0: offset: 0x2aaaab037640, size: 24 [D 20:43:03.613055] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 32/70. [D 20:43:03.619111] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 27815. [D 20:43:03.619135] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 33/70. [D 20:43:03.625839] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27814. [D 20:43:03.625870] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 34/70. [D 20:43:03.625944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.625964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.625978] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.626093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.626108] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.626120] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.631971] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5116 [D 20:43:03.631999] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 35/70. [D 20:43:03.635160] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5118 [D 20:43:03.635177] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 36/70. [D 20:43:03.637168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 27814. [D 20:43:03.637187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27815. [D 20:43:03.637202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27816. [D 20:43:03.637217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27817. [D 20:43:03.637232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27818. [D 20:43:03.637247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27819. [D 20:43:03.637262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27820. [D 20:43:03.637277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27821. [D 20:43:03.637291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27822. [D 20:43:03.637307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27823. [D 20:43:03.637322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27824. [D 20:43:03.637336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27825. [D 20:43:03.637351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27826. [D 20:43:03.637366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27827. [D 20:43:03.637381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27828. [D 20:43:03.637396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27829. [D 20:43:03.637411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27830. [D 20:43:03.637426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27831. [D 20:43:03.637441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27832. [D 20:43:03.637456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27833. [D 20:43:03.637471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27834. [D 20:43:03.637486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27835. [D 20:43:03.637500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27836. [D 20:43:03.637515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27837. [D 20:43:03.637530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27838. [D 20:43:03.637545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27839. [D 20:43:03.637560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27840. [D 20:43:03.637575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27841. [D 20:43:03.637590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27842. [D 20:43:03.637605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27843. [D 20:43:03.637621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27844. [D 20:43:03.637635] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27845. [D 20:43:03.637652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27846. [D 20:43:03.637667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27847. [D 20:43:03.637682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 27848. [D 20:43:03.637697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 27849. [D 20:43:03.637712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 27850. [D 20:43:03.637727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 27851. [D 20:43:03.637742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 27852. [D 20:43:03.637757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27853. [D 20:43:03.637772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27854. [D 20:43:03.637786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27855. [D 20:43:03.637802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 27856. [D 20:43:03.637816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 27857. [D 20:43:03.637831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 27858. [D 20:43:03.637846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 27859. [D 20:43:03.637861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 27860. [D 20:43:03.637876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27861. [D 20:43:03.637891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27862. [D 20:43:03.637906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27863. [D 20:43:03.637921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27864. [D 20:43:03.637936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27865. [D 20:43:03.637951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27866. [D 20:43:03.637966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27867. [D 20:43:03.638074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27868. [D 20:43:03.638090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27869. [D 20:43:03.638108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27870. [D 20:43:03.638124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27871. [D 20:43:03.638138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27872. [D 20:43:03.638155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27873. [D 20:43:03.638169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27874. [D 20:43:03.638184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27875. [D 20:43:03.638199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27876. [D 20:43:03.638214] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27877. [D 20:43:03.639878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.639950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.639964] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.640009] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5122 [D 20:43:03.640024] element 0: offset: 0x2aaaab015ce0, size: 24 [D 20:43:03.640045] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 37/70. [D 20:43:03.640088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.640102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.640114] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.640136] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5124 [D 20:43:03.640150] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:03.640164] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 38/70. [D 20:43:03.643433] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 27877. [D 20:43:03.643460] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 39/70. [D 20:43:03.650555] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 27876. [D 20:43:03.650580] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 40/70. [D 20:43:03.650642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.650663] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.650678] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.650807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.650822] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.650835] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.653945] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5122 [D 20:43:03.653968] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 41/70. [D 20:43:03.658736] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5124 [D 20:43:03.658755] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 42/70. [D 20:43:03.661162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 27876. [D 20:43:03.661189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 27877. [D 20:43:03.661207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 27878. [D 20:43:03.661222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 27879. [D 20:43:03.661238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 27880. [D 20:43:03.661253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 27881. [D 20:43:03.661268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 27882. [D 20:43:03.661283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 27883. [D 20:43:03.661303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 27884. [D 20:43:03.661322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 27885. [D 20:43:03.661337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 27886. [D 20:43:03.661352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 27887. [D 20:43:03.661367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 27888. [D 20:43:03.661381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 27889. [D 20:43:03.661396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 27890. [D 20:43:03.661411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 27891. [D 20:43:03.661426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 27892. [D 20:43:03.661441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 27893. [D 20:43:03.661456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 27894. [D 20:43:03.661471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 27895. [D 20:43:03.661486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 27896. [D 20:43:03.661501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 27897. [D 20:43:03.661515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 27898. [D 20:43:03.661531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 27899. [D 20:43:03.661545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 27900. [D 20:43:03.661560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 27901. [D 20:43:03.661575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 27902. [D 20:43:03.661590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 27903. [D 20:43:03.661605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 27904. [D 20:43:03.661620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 27905. [D 20:43:03.661635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 27906. [D 20:43:03.661649] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 27907. [D 20:43:03.661666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 27908. [D 20:43:03.661681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 27909. [D 20:43:03.661696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 27910. [D 20:43:03.661711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 27911. [D 20:43:03.661726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 27912. [D 20:43:03.661741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 27913. [D 20:43:03.661757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 27914. [D 20:43:03.661772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 27915. [D 20:43:03.661786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 27916. [D 20:43:03.661801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 27917. [D 20:43:03.661816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 27918. [D 20:43:03.661831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 27919. [D 20:43:03.661846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 27920. [D 20:43:03.661860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 27921. [D 20:43:03.661875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 27922. [D 20:43:03.661890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 27923. [D 20:43:03.661904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 27924. [D 20:43:03.661919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 27925. [D 20:43:03.661934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 27926. [D 20:43:03.661949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 27927. [D 20:43:03.661964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 27928. [D 20:43:03.661978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 27929. [D 20:43:03.661993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 27930. [D 20:43:03.662008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 27931. [D 20:43:03.662023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 27932. [D 20:43:03.662037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 27933. [D 20:43:03.662052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 27934. [D 20:43:03.662067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 27935. [D 20:43:03.662081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 27936. [D 20:43:03.662096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 27937. [D 20:43:03.662111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 27938. [D 20:43:03.662126] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 27939. [D 20:43:03.664025] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.664094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.664108] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.664154] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5129 [D 20:43:03.664170] element 0: offset: 0x5b0030, size: 24 [D 20:43:03.664193] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 43/70. [D 20:43:03.664238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.664252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.664265] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.664285] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5130 [D 20:43:03.664299] element 0: offset: 0x61e400, size: 24 [D 20:43:03.664314] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 44/70. [D 20:43:03.667058] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 27939. [D 20:43:03.667080] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 45/70. [D 20:43:03.674008] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 27938. [D 20:43:03.674030] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 46/70. [D 20:43:03.674097] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.674118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.674131] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.674252] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.674267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.674279] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.679950] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5129 [D 20:43:03.679975] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 47/70. [D 20:43:03.683032] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5130 [D 20:43:03.683050] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 48/70. [D 20:43:03.685505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 27938. [D 20:43:03.685527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 27939. [D 20:43:03.685542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 27940. [D 20:43:03.685557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 27941. [D 20:43:03.685572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 27942. [D 20:43:03.685586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 27943. [D 20:43:03.685601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27944. [D 20:43:03.685616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27945. [D 20:43:03.685630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27946. [D 20:43:03.685645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 27947. [D 20:43:03.685660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 27948. [D 20:43:03.685675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 27949. [D 20:43:03.685689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 27950. [D 20:43:03.685704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 27951. [D 20:43:03.685719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27952. [D 20:43:03.685733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27953. [D 20:43:03.685748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27954. [D 20:43:03.685764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 27955. [D 20:43:03.685779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 27956. [D 20:43:03.685794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 27957. [D 20:43:03.685809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 27958. [D 20:43:03.685824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 27959. [D 20:43:03.685839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27960. [D 20:43:03.685854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27961. [D 20:43:03.685869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27962. [D 20:43:03.685883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 27963. [D 20:43:03.685899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 27964. [D 20:43:03.685913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 27965. [D 20:43:03.685928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 27966. [D 20:43:03.685943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 27967. [D 20:43:03.685958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27968. [D 20:43:03.685973] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27969. [D 20:43:03.685990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27970. [D 20:43:03.686005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27971. [D 20:43:03.686020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 27972. [D 20:43:03.686035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 27973. [D 20:43:03.686049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 27974. [D 20:43:03.686064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 27975. [D 20:43:03.686079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 27976. [D 20:43:03.686094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27977. [D 20:43:03.686109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27978. [D 20:43:03.686123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27979. [D 20:43:03.686138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 27980. [D 20:43:03.686153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 27981. [D 20:43:03.686168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 27982. [D 20:43:03.686183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 27983. [D 20:43:03.686198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 27984. [D 20:43:03.686213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27985. [D 20:43:03.686228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27986. [D 20:43:03.686242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27987. [D 20:43:03.686257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27988. [D 20:43:03.686272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27989. [D 20:43:03.686287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27990. [D 20:43:03.686301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27991. [D 20:43:03.686316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27992. [D 20:43:03.686331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27993. [D 20:43:03.686346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27994. [D 20:43:03.686361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27995. [D 20:43:03.686375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27996. [D 20:43:03.686402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27997. [D 20:43:03.686418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27998. [D 20:43:03.686441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27999. [D 20:43:03.686456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28000. [D 20:43:03.686483] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28001. [D 20:43:03.688416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.688481] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.688495] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.688540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5134 [D 20:43:03.688556] element 0: offset: 0x643b60, size: 24 [D 20:43:03.688576] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 49/70. [D 20:43:03.688621] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.688636] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.688648] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.688669] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5136 [D 20:43:03.688683] element 0: offset: 0x61f760, size: 24 [D 20:43:03.688700] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 50/70. [D 20:43:03.691392] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 28001. [D 20:43:03.691418] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 51/70. [D 20:43:03.698346] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28000. [D 20:43:03.698368] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 52/70. [D 20:43:03.698429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.698450] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.698464] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.698581] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.698597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.698609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.703958] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5134 [D 20:43:03.703984] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 53/70. [D 20:43:03.707086] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5136 [D 20:43:03.707104] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 54/70. [D 20:43:03.709802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28000. [D 20:43:03.709824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28001. [D 20:43:03.709840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28002. [D 20:43:03.709855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28003. [D 20:43:03.709870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28004. [D 20:43:03.710376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28005. [D 20:43:03.710391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28006. [D 20:43:03.710406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28007. [D 20:43:03.710420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28008. [D 20:43:03.710435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28009. [D 20:43:03.710451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28010. [D 20:43:03.710466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28011. [D 20:43:03.710480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28012. [D 20:43:03.710495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28013. [D 20:43:03.710510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28014. [D 20:43:03.710525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28015. [D 20:43:03.710540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28016. [D 20:43:03.710555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28017. [D 20:43:03.710570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28018. [D 20:43:03.710589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28019. [D 20:43:03.710603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28020. [D 20:43:03.710618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28021. [D 20:43:03.710633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28022. [D 20:43:03.710648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28023. [D 20:43:03.710663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28024. [D 20:43:03.967324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28025. [D 20:43:03.967359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28026. [D 20:43:03.967799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28027. [D 20:43:03.967817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28028. [D 20:43:03.967832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28029. [D 20:43:03.967846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28030. [D 20:43:03.967862] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28031. [D 20:43:03.967884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28032. [D 20:43:03.967899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28033. [D 20:43:03.967914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28034. [D 20:43:03.967945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28035. [D 20:43:03.967961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28036. [D 20:43:03.967976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28037. [D 20:43:03.968000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28038. [D 20:43:03.968015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28039. [D 20:43:03.968030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28040. [D 20:43:03.968045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28041. [D 20:43:03.968060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28042. [D 20:43:03.968178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28043. [D 20:43:03.968646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28044. [D 20:43:03.968664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28045. [D 20:43:03.968679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28046. [D 20:43:03.968694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28047. [D 20:43:03.968709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28048. [D 20:43:03.968740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28049. [D 20:43:03.968766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28050. [D 20:43:03.968780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28051. [D 20:43:03.968795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28052. [D 20:43:03.968810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28053. [D 20:43:03.968827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28054. [D 20:43:03.968842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28055. [D 20:43:03.968857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28056. [D 20:43:03.968872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28057. [D 20:43:03.968886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28058. [D 20:43:03.968901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28059. [D 20:43:03.968916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28060. [D 20:43:03.968930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28061. [D 20:43:03.968945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28062. [D 20:43:03.969023] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28063. [D 20:43:03.969045] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28063. [D 20:43:03.969080] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 55/70. [D 20:43:03.974424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.974445] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.974460] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.974505] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5139 [D 20:43:03.974521] element 0: offset: 0x61fa30, size: 24 [D 20:43:03.974537] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 56/70. [D 20:43:03.974576] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.974591] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.974608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.974630] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5143 [D 20:43:03.974646] element 0: offset: 0x636ca0, size: 24 [D 20:43:03.974682] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 57/70. [D 20:43:03.974754] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28062. [D 20:43:03.974770] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 58/70. [D 20:43:03.974818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.974833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.974847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.976019] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.976037] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.976051] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:03.984574] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5139 [D 20:43:03.984651] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 59/70. [D 20:43:03.986197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28062. [D 20:43:03.986218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28063. [D 20:43:03.986233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28064. [D 20:43:03.986248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28065. [D 20:43:03.986263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28066. [D 20:43:03.986278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28067. [D 20:43:03.986293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28068. [D 20:43:03.986308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28069. [D 20:43:03.986323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28070. [D 20:43:03.986338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28071. [D 20:43:03.986353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28072. [D 20:43:03.986368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28073. [D 20:43:03.986382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28074. [D 20:43:03.986397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28075. [D 20:43:03.986412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28076. [D 20:43:03.986427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28077. [D 20:43:03.986442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28078. [D 20:43:03.986456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28079. [D 20:43:03.986471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28080. [D 20:43:03.986486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28081. [D 20:43:03.986501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28082. [D 20:43:03.986516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28083. [D 20:43:03.986531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28084. [D 20:43:03.986545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28085. [D 20:43:03.986560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28086. [D 20:43:03.986575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28087. [D 20:43:03.986590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28088. [D 20:43:03.986611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28089. [D 20:43:03.986626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28090. [D 20:43:03.986641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28091. [D 20:43:03.986656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28092. [D 20:43:03.986671] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28093. [D 20:43:03.987992] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5143 [D 20:43:03.988061] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 60/70. [D 20:43:03.991420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.991441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.991455] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:03.991502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5146 [D 20:43:03.991517] element 0: offset: 0x61e400, size: 24 [D 20:43:03.991534] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 0/70. [D 20:43:03.991578] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:03.991592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.991604] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:03.991626] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5148 [D 20:43:03.991640] element 0: offset: 0x630350, size: 24 [D 20:43:03.991655] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 1/70. [D 20:43:03.992082] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 28093. [D 20:43:03.992110] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 2/70. [D 20:43:03.992128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28093. [D 20:43:03.992144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 28094. [D 20:43:03.992159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 28095. [D 20:43:03.992174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 28096. [D 20:43:03.992189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 28097. [D 20:43:03.992204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 28098. [D 20:43:03.992219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28099. [D 20:43:03.992234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28100. [D 20:43:03.992249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28101. [D 20:43:03.992264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 28102. [D 20:43:03.992279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 28103. [D 20:43:03.992294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 28104. [D 20:43:03.992309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 28105. [D 20:43:03.992324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 28106. [D 20:43:03.992338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28107. [D 20:43:03.992353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28108. [D 20:43:03.992368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28109. [D 20:43:03.992383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28110. [D 20:43:03.992398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28111. [D 20:43:03.992413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28112. [D 20:43:03.992428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28113. [D 20:43:03.992443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28114. [D 20:43:03.992460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28115. [D 20:43:03.992474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28116. [D 20:43:03.992489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28117. [D 20:43:03.992503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28118. [D 20:43:03.992518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28119. [D 20:43:03.992533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28120. [D 20:43:03.992547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28121. [D 20:43:03.992562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28122. [D 20:43:03.992576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28123. [D 20:43:03.992591] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28124. [D 20:43:03.992654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.992674] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.992687] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:03.997419] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5146 [D 20:43:03.997504] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 3/70. [D 20:43:03.998073] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28124. [D 20:43:03.998101] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 4/70. [D 20:43:03.998118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28124. [D 20:43:03.998133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28125. [D 20:43:03.998148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28126. [D 20:43:03.998163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28127. [D 20:43:03.998187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28128. [D 20:43:03.998202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28129. [D 20:43:03.998217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28130. [D 20:43:03.998241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28131. [D 20:43:03.998255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28132. [D 20:43:03.998285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28133. [D 20:43:03.998310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28134. [D 20:43:03.998325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28135. [D 20:43:03.998354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28136. [D 20:43:03.998369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28137. [D 20:43:03.998394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28138. [D 20:43:03.998423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28139. [D 20:43:03.998439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28140. [D 20:43:03.998465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28141. [D 20:43:03.998492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28142. [D 20:43:03.998508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28143. [D 20:43:03.998533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28144. [D 20:43:03.998557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28145. [D 20:43:03.998571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28146. [D 20:43:03.998603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28147. [D 20:43:03.998629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28148. [D 20:43:03.998644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28149. [D 20:43:03.998672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28150. [D 20:43:03.998687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28151. [D 20:43:03.998712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28152. [D 20:43:03.998743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28153. [D 20:43:03.998767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28154. [D 20:43:03.998783] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28155. [D 20:43:03.998887] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:03.998943] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:03.998957] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.000985] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5148 [D 20:43:04.001049] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 5/70. [D 20:43:04.003543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.003563] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.003576] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.003618] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5151 [D 20:43:04.003633] element 0: offset: 0x691fe0, size: 24 [D 20:43:04.003650] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 6/70. [D 20:43:04.006093] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.006110] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.006122] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.006145] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5155 [D 20:43:04.006159] element 0: offset: 0x61f9e0, size: 24 [D 20:43:04.006175] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 7/70. [D 20:43:04.009930] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28155. [D 20:43:04.009965] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 8/70. [D 20:43:04.009987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28155. [D 20:43:04.010004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28156. [D 20:43:04.010019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28157. [D 20:43:04.010034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28158. [D 20:43:04.010049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28159. [D 20:43:04.010063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28160. [D 20:43:04.010078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28161. [D 20:43:04.010093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28162. [D 20:43:04.010108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28163. [D 20:43:04.010122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28164. [D 20:43:04.010137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28165. [D 20:43:04.010152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28166. [D 20:43:04.010167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28167. [D 20:43:04.010182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28168. [D 20:43:04.010197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28169. [D 20:43:04.010211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28170. [D 20:43:04.010226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28171. [D 20:43:04.010241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28172. [D 20:43:04.010256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28173. [D 20:43:04.010270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28174. [D 20:43:04.010285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28175. [D 20:43:04.010300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28176. [D 20:43:04.010315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28177. [D 20:43:04.010330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28178. [D 20:43:04.010345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28179. [D 20:43:04.010359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28180. [D 20:43:04.010374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28181. [D 20:43:04.010389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28182. [D 20:43:04.010404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28183. [D 20:43:04.010419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28184. [D 20:43:04.010435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28185. [D 20:43:04.010449] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28186. [D 20:43:04.010508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.010528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.010541] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.015046] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5155 [D 20:43:04.015122] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 9/70. [D 20:43:04.016991] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5151 [D 20:43:04.017059] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 10/70. [D 20:43:04.021475] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28186. [D 20:43:04.021501] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 11/70. [D 20:43:04.021587] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.021609] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.021622] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.026984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28186. [D 20:43:04.027009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 28187. [D 20:43:04.027024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 28188. [D 20:43:04.027039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 28189. [D 20:43:04.027054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 28190. [D 20:43:04.027069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 28191. [D 20:43:04.027095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28192. [D 20:43:04.027109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28193. [D 20:43:04.027132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28194. [D 20:43:04.027147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 28195. [D 20:43:04.027174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 28196. [D 20:43:04.027190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 28197. [D 20:43:04.027214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 28198. [D 20:43:04.027229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 28199. [D 20:43:04.027255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28200. [D 20:43:04.027279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28201. [D 20:43:04.027302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28202. [D 20:43:04.027317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28203. [D 20:43:04.027331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28204. [D 20:43:04.027360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28205. [D 20:43:04.027385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28206. [D 20:43:04.027411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28207. [D 20:43:04.027427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28208. [D 20:43:04.027442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28209. [D 20:43:04.027465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28210. [D 20:43:04.027492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28211. [D 20:43:04.027516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28212. [D 20:43:04.027531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28213. [D 20:43:04.027546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28214. [D 20:43:04.027561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28215. [D 20:43:04.027576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28216. [D 20:43:04.027590] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28217. [D 20:43:04.027607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28218. [D 20:43:04.027622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28219. [D 20:43:04.027637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28220. [D 20:43:04.027652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28221. [D 20:43:04.027667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28222. [D 20:43:04.027681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28223. [D 20:43:04.027696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28224. [D 20:43:04.027711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28225. [D 20:43:04.027726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28226. [D 20:43:04.027740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28227. [D 20:43:04.027755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28228. [D 20:43:04.027770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28229. [D 20:43:04.027785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28230. [D 20:43:04.027799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28231. [D 20:43:04.027814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28232. [D 20:43:04.027829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28233. [D 20:43:04.027844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28234. [D 20:43:04.027859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28235. [D 20:43:04.027874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28236. [D 20:43:04.027889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28237. [D 20:43:04.027904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28238. [D 20:43:04.027922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28239. [D 20:43:04.027938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28240. [D 20:43:04.027952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28241. [D 20:43:04.027968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28242. [D 20:43:04.027983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28243. [D 20:43:04.027998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28244. [D 20:43:04.028013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28245. [D 20:43:04.028029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28246. [D 20:43:04.028044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28247. [D 20:43:04.028059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28248. [D 20:43:04.028074] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28249. [D 20:43:04.035546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.035569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.035582] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.035623] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5158 [D 20:43:04.035638] element 0: offset: 0x5b0030, size: 24 [D 20:43:04.035658] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 12/70. [D 20:43:04.035696] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.035710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.035722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.035743] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5160 [D 20:43:04.035757] element 0: offset: 0x636ca0, size: 24 [D 20:43:04.035773] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 13/70. [D 20:43:04.038731] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 28249. [D 20:43:04.038755] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 14/70. [D 20:43:04.048148] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28248. [D 20:43:04.048167] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 15/70. [D 20:43:04.048216] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.048237] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.048251] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.048367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.048382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.048394] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.051958] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5158 [D 20:43:04.051981] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 16/70. [D 20:43:04.054091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28248. [D 20:43:04.054109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28249. [D 20:43:04.054124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28250. [D 20:43:04.054139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28251. [D 20:43:04.054163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28252. [D 20:43:04.054178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28253. [D 20:43:04.054193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28254. [D 20:43:04.054221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28255. [D 20:43:04.054246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28256. [D 20:43:04.054261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28257. [D 20:43:04.054288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28258. [D 20:43:04.054304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28259. [D 20:43:04.054329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28260. [D 20:43:04.054356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28261. [D 20:43:04.054372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28262. [D 20:43:04.054397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28263. [D 20:43:04.054426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28264. [D 20:43:04.054441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28265. [D 20:43:04.054466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28266. [D 20:43:04.054492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28267. [D 20:43:04.054508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28268. [D 20:43:04.054532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28269. [D 20:43:04.054547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28270. [D 20:43:04.054575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28271. [D 20:43:04.054590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28272. [D 20:43:04.054619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28273. [D 20:43:04.054646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28274. [D 20:43:04.054661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28275. [D 20:43:04.054685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28276. [D 20:43:04.054713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28277. [D 20:43:04.054729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28278. [D 20:43:04.054754] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28279. [D 20:43:04.055951] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5160 [D 20:43:04.056034] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 17/70. [D 20:43:04.065080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.065101] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.065114] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.065155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5164 [D 20:43:04.065170] element 0: offset: 0x61e400, size: 24 [D 20:43:04.065185] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 18/70. [D 20:43:04.065213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.065226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.065239] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.065258] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5167 [D 20:43:04.065273] element 0: offset: 0x644640, size: 24 [D 20:43:04.065286] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 19/70. [D 20:43:04.065876] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28279. [D 20:43:04.065894] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 20/70. [D 20:43:04.065921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28279. [D 20:43:04.065938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28280. [D 20:43:04.065953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28281. [D 20:43:04.065967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28282. [D 20:43:04.065981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28283. [D 20:43:04.065995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28284. [D 20:43:04.066008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28285. [D 20:43:04.066022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28286. [D 20:43:04.066036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28287. [D 20:43:04.066050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28288. [D 20:43:04.066064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28289. [D 20:43:04.066078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28290. [D 20:43:04.066092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28291. [D 20:43:04.066106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28292. [D 20:43:04.066120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28293. [D 20:43:04.066133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28294. [D 20:43:04.066148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28295. [D 20:43:04.066163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28296. [D 20:43:04.066178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28297. [D 20:43:04.066192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28298. [D 20:43:04.066207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28299. [D 20:43:04.066221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28300. [D 20:43:04.066235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28301. [D 20:43:04.066249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28302. [D 20:43:04.066263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28303. [D 20:43:04.066278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28304. [D 20:43:04.066292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28305. [D 20:43:04.066306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28306. [D 20:43:04.066321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28307. [D 20:43:04.066335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28308. [D 20:43:04.066349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28309. [D 20:43:04.066363] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28310. [D 20:43:04.068109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.068134] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.068148] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.071197] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5164 [D 20:43:04.071218] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 21/70. [D 20:43:04.074263] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5167 [D 20:43:04.074279] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 22/70. [D 20:43:04.077530] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28310. [D 20:43:04.077546] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 23/70. [D 20:43:04.077702] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.077767] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.077782] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.083108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28310. [D 20:43:04.083136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28311. [D 20:43:04.083151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28312. [D 20:43:04.083165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28313. [D 20:43:04.083190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28314. [D 20:43:04.083205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28315. [D 20:43:04.083228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28316. [D 20:43:04.083244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28317. [D 20:43:04.083268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28318. [D 20:43:04.083283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28319. [D 20:43:04.083310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28320. [D 20:43:04.083326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28321. [D 20:43:04.083350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28322. [D 20:43:04.083364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28323. [D 20:43:04.083392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28324. [D 20:43:04.083406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28325. [D 20:43:04.083431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28326. [D 20:43:04.083458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28327. [D 20:43:04.083473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28328. [D 20:43:04.083497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28329. [D 20:43:04.083512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28330. [D 20:43:04.083538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28331. [D 20:43:04.083563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28332. [D 20:43:04.083579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28333. [D 20:43:04.083606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28334. [D 20:43:04.083621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28335. [D 20:43:04.083653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28336. [D 20:43:04.083668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28337. [D 20:43:04.083696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28338. [D 20:43:04.083710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28339. [D 20:43:04.083725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28340. [D 20:43:04.083739] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60df00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28341. [D 20:43:04.083761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28342. [D 20:43:04.083776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 28343. [D 20:43:04.083790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 28344. [D 20:43:04.083804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 28345. [D 20:43:04.083824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 28346. [D 20:43:04.083838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 28347. [D 20:43:04.083853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28348. [D 20:43:04.083867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28349. [D 20:43:04.083882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28350. [D 20:43:04.083896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 28351. [D 20:43:04.083911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 28352. [D 20:43:04.084188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 28353. [D 20:43:04.084206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 28354. [D 20:43:04.084220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 28355. [D 20:43:04.084235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28356. [D 20:43:04.084249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28357. [D 20:43:04.084264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28358. [D 20:43:04.084278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28359. [D 20:43:04.084293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28360. [D 20:43:04.084307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28361. [D 20:43:04.084322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28362. [D 20:43:04.084336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28363. [D 20:43:04.084350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28364. [D 20:43:04.084365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28365. [D 20:43:04.084380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28366. [D 20:43:04.084394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28367. [D 20:43:04.084408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28368. [D 20:43:04.084423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28369. [D 20:43:04.084437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28370. [D 20:43:04.084452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28371. [D 20:43:04.084466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28372. [D 20:43:04.084481] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28373. [D 20:43:04.091970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.091993] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.092007] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.092030] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5170 [D 20:43:04.092044] element 0: offset: 0x62e8b0, size: 24 [D 20:43:04.092058] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 24/70. [D 20:43:04.092086] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.092099] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.092112] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.092131] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5172 [D 20:43:04.092145] element 0: offset: 0x636a50, size: 24 [D 20:43:04.092159] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 25/70. [D 20:43:04.094854] openib_check_cq: completed rdma wr_id 2aaaab60df00, nic_wr_credit 28373. [D 20:43:04.094871] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 26/70. [D 20:43:04.106487] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28372. [D 20:43:04.106516] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 27/70. [D 20:43:04.106584] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.106606] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.106619] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.106736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.106751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.106764] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.112087] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5170 [D 20:43:04.112176] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 28/70. [D 20:43:04.116375] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5172 [D 20:43:04.116399] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 29/70. [D 20:43:04.117417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28372. [D 20:43:04.117489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28373. [D 20:43:04.117504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28374. [D 20:43:04.117519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28375. [D 20:43:04.117534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28376. [D 20:43:04.117548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28377. [D 20:43:04.117562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28378. [D 20:43:04.117577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28379. [D 20:43:04.117591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28380. [D 20:43:04.117606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28381. [D 20:43:04.117620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28382. [D 20:43:04.117635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28383. [D 20:43:04.117649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28384. [D 20:43:04.117663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28385. [D 20:43:04.117677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28386. [D 20:43:04.407118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28387. [D 20:43:04.407146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28388. [D 20:43:04.407551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28389. [D 20:43:04.407588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28390. [D 20:43:04.407603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28391. [D 20:43:04.407618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28392. [D 20:43:04.407633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28393. [D 20:43:04.407647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28394. [D 20:43:04.407675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28395. [D 20:43:04.407689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28396. [D 20:43:04.407704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28397. [D 20:43:04.407718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28398. [D 20:43:04.407733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28399. [D 20:43:04.407748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28400. [D 20:43:04.407762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28401. [D 20:43:04.407788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28402. [D 20:43:04.407803] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28403. [D 20:43:04.407823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28404. [D 20:43:04.407906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28405. [D 20:43:04.408419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28406. [D 20:43:04.408436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28407. [D 20:43:04.408451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28408. [D 20:43:04.408466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28409. [D 20:43:04.408480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28410. [D 20:43:04.408500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28411. [D 20:43:04.408528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28412. [D 20:43:04.408543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28413. [D 20:43:04.408558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28414. [D 20:43:04.408573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28415. [D 20:43:04.408589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28416. [D 20:43:04.408604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28417. [D 20:43:04.408632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28418. [D 20:43:04.408647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28419. [D 20:43:04.408661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28420. [D 20:43:04.408676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28421. [D 20:43:04.408691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28422. [D 20:43:04.408784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28423. [D 20:43:04.408811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28424. [D 20:43:04.408838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28425. [D 20:43:04.409301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28426. [D 20:43:04.409319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28427. [D 20:43:04.409334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28428. [D 20:43:04.409348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28429. [D 20:43:04.409379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28430. [D 20:43:04.409394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28431. [D 20:43:04.409409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28432. [D 20:43:04.409424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28433. [D 20:43:04.409438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28434. [D 20:43:04.409453] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28435. [D 20:43:04.410507] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28435. [D 20:43:04.410547] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 30/70. [D 20:43:04.411932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.411953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.411968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.412014] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5177 [D 20:43:04.412030] element 0: offset: 0x636ca0, size: 24 [D 20:43:04.412047] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 31/70. [D 20:43:04.412083] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.412111] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.412125] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.412147] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5178 [D 20:43:04.412162] element 0: offset: 0x5b0030, size: 24 [D 20:43:04.412236] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 32/70. [D 20:43:04.416314] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28434. [D 20:43:04.416335] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 33/70. [D 20:43:04.416406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.416423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.416443] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.421882] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.421901] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.421915] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.422836] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5177 [D 20:43:04.422929] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 34/70. [D 20:43:04.427763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28434. [D 20:43:04.427827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 28435. [D 20:43:04.427842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 28436. [D 20:43:04.427857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 28437. [D 20:43:04.427873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 28438. [D 20:43:04.427887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 28439. [D 20:43:04.427902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28440. [D 20:43:04.427916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28441. [D 20:43:04.427942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28442. [D 20:43:04.427957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 28443. [D 20:43:04.427971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 28444. [D 20:43:04.427986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 28445. [D 20:43:04.428000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 28446. [D 20:43:04.428015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 28447. [D 20:43:04.428029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28448. [D 20:43:04.428044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28449. [D 20:43:04.428059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28450. [D 20:43:04.428073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28451. [D 20:43:04.428088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28452. [D 20:43:04.428102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28453. [D 20:43:04.428117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28454. [D 20:43:04.428189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28455. [D 20:43:04.428204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28456. [D 20:43:04.428218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28457. [D 20:43:04.428233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28458. [D 20:43:04.428248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28459. [D 20:43:04.428269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28460. [D 20:43:04.428284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28461. [D 20:43:04.428299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28462. [D 20:43:04.428314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28463. [D 20:43:04.428328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28464. [D 20:43:04.428344] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28465. [D 20:43:04.431956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.431978] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.431992] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.432035] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5182 [D 20:43:04.432051] element 0: offset: 0x691fe0, size: 24 [D 20:43:04.432255] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 35/70. [D 20:43:04.432297] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.432311] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.432324] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.432347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5184 [D 20:43:04.432362] element 0: offset: 0x61e400, size: 24 [D 20:43:04.432378] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 36/70. [D 20:43:04.433694] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28465. [D 20:43:04.433722] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 37/70. [D 20:43:04.433875] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.433895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.433908] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.437353] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5178 [D 20:43:04.437429] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 38/70. [D 20:43:04.439135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28465. [D 20:43:04.439165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28466. [D 20:43:04.439180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28467. [D 20:43:04.439195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28468. [D 20:43:04.439210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28469. [D 20:43:04.439237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28470. [D 20:43:04.439253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28471. [D 20:43:04.439277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28472. [D 20:43:04.439292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28473. [D 20:43:04.439318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28474. [D 20:43:04.439335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28475. [D 20:43:04.439363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28476. [D 20:43:04.439394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28477. [D 20:43:04.439409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28478. [D 20:43:04.439423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28479. [D 20:43:04.439449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28480. [D 20:43:04.439478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28481. [D 20:43:04.439493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28482. [D 20:43:04.439530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28483. [D 20:43:04.439558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28484. [D 20:43:04.439572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28485. [D 20:43:04.439611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28486. [D 20:43:04.439627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28487. [D 20:43:04.439650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28488. [D 20:43:04.439668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28489. [D 20:43:04.439692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28490. [D 20:43:04.439717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28491. [D 20:43:04.439732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28492. [D 20:43:04.439760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28493. [D 20:43:04.439775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28494. [D 20:43:04.439800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28495. [D 20:43:04.439814] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28496. [D 20:43:04.441342] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5182 [D 20:43:04.441424] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 39/70. [D 20:43:04.441508] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5184 [D 20:43:04.441526] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 40/70. [D 20:43:04.441910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.441946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.441960] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.442003] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5188 [D 20:43:04.442018] element 0: offset: 0x62e8b0, size: 24 [D 20:43:04.442036] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 41/70. [D 20:43:04.450879] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28496. [D 20:43:04.450915] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 42/70. [D 20:43:04.450932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28496. [D 20:43:04.450948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28497. [D 20:43:04.450963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28498. [D 20:43:04.450977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28499. [D 20:43:04.450991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28500. [D 20:43:04.451006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28501. [D 20:43:04.451021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28502. [D 20:43:04.451036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28503. [D 20:43:04.451050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28504. [D 20:43:04.451065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28505. [D 20:43:04.451079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28506. [D 20:43:04.451094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28507. [D 20:43:04.451109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28508. [D 20:43:04.451123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28509. [D 20:43:04.451138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28510. [D 20:43:04.451153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28511. [D 20:43:04.451167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28512. [D 20:43:04.451182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28513. [D 20:43:04.451196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28514. [D 20:43:04.451211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28515. [D 20:43:04.451226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28516. [D 20:43:04.451240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28517. [D 20:43:04.451255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28518. [D 20:43:04.451270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28519. [D 20:43:04.451284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28520. [D 20:43:04.451298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28521. [D 20:43:04.451313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28522. [D 20:43:04.451328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28523. [D 20:43:04.451343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28524. [D 20:43:04.451358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28525. [D 20:43:04.451372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28526. [D 20:43:04.451387] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28527. [D 20:43:04.451403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28528. [D 20:43:04.451418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28529. [D 20:43:04.451433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28530. [D 20:43:04.451447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28531. [D 20:43:04.451462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28532. [D 20:43:04.451476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28533. [D 20:43:04.451491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28534. [D 20:43:04.451505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28535. [D 20:43:04.451520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28536. [D 20:43:04.451535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28537. [D 20:43:04.451549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28538. [D 20:43:04.451564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28539. [D 20:43:04.451578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28540. [D 20:43:04.451593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28541. [D 20:43:04.451607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28542. [D 20:43:04.451622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28543. [D 20:43:04.451636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28544. [D 20:43:04.451650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28545. [D 20:43:04.451665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28546. [D 20:43:04.451680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28547. [D 20:43:04.451694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28548. [D 20:43:04.451709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28549. [D 20:43:04.451723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28550. [D 20:43:04.451738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28551. [D 20:43:04.451752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28552. [D 20:43:04.451767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28553. [D 20:43:04.451783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28554. [D 20:43:04.451797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28555. [D 20:43:04.451812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28556. [D 20:43:04.451826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28557. [D 20:43:04.451841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28558. [D 20:43:04.451855] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28559. [D 20:43:04.451922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.451943] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.451956] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.455043] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5188 [D 20:43:04.455108] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 43/70. [D 20:43:04.462574] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28559. [D 20:43:04.462604] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 44/70. [D 20:43:04.469670] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28558. [D 20:43:04.469692] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 45/70. [D 20:43:04.469720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28558. [D 20:43:04.469736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 28559. [D 20:43:04.469752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 28560. [D 20:43:04.469763] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.469767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 28561. [D 20:43:04.469792] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.469809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 28562. [D 20:43:04.469825] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.469843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 28563. [D 20:43:04.469873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28564. [D 20:43:04.469888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28565. [D 20:43:04.469902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28566. [D 20:43:04.469917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 28567. [D 20:43:04.469932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 28568. [D 20:43:04.469946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 28569. [D 20:43:04.469961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 28570. [D 20:43:04.469975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 28571. [D 20:43:04.469990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28572. [D 20:43:04.470004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28573. [D 20:43:04.470020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28574. [D 20:43:04.470035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28575. [D 20:43:04.470049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28576. [D 20:43:04.470064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28577. [D 20:43:04.470078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28578. [D 20:43:04.470092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28579. [D 20:43:04.470107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28580. [D 20:43:04.470121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28581. [D 20:43:04.470135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28582. [D 20:43:04.470150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28583. [D 20:43:04.470164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28584. [D 20:43:04.470179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28585. [D 20:43:04.470193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28586. [D 20:43:04.470207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28587. [D 20:43:04.470222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28588. [D 20:43:04.470236] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28589. [D 20:43:04.470276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.470294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.470306] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:04.480451] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28589. [D 20:43:04.480475] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 46/70. [D 20:43:04.480532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.480551] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.480564] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:04.491002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.491019] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.491031] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:04.491069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5191 [D 20:43:04.491083] element 0: offset: 0x636ca0, size: 24 [D 20:43:04.491101] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 47/70. [D 20:43:04.494209] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5191 [D 20:43:04.494281] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 48/70. [D 20:43:04.494342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28589. [D 20:43:04.494368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 28590. [D 20:43:04.494382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 28591. [D 20:43:04.494397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 28592. [D 20:43:04.494412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 28593. [D 20:43:04.494427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 28594. [D 20:43:04.494441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28595. [D 20:43:04.494456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28596. [D 20:43:04.494470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28597. [D 20:43:04.494485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 28598. [D 20:43:04.494499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 28599. [D 20:43:04.494513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 28600. [D 20:43:04.494528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 28601. [D 20:43:04.494543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 28602. [D 20:43:04.494557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28603. [D 20:43:04.494572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28604. [D 20:43:04.494586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28605. [D 20:43:04.494601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 28606. [D 20:43:04.494615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 28607. [D 20:43:04.494633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 28608. [D 20:43:04.494648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 28609. [D 20:43:04.494663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 28610. [D 20:43:04.494677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28611. [D 20:43:04.494691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28612. [D 20:43:04.494706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28613. [D 20:43:04.494720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 28614. [D 20:43:04.494735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 28615. [D 20:43:04.494750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 28616. [D 20:43:04.494764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 28617. [D 20:43:04.494779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 28618. [D 20:43:04.494793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28619. [D 20:43:04.494808] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28620. [D 20:43:04.504698] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28620. [D 20:43:04.504721] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 49/70. [D 20:43:04.504855] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.504878] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.504891] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:04.514767] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.514784] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.514796] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:04.514833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5194 [D 20:43:04.514848] element 0: offset: 0x643f70, size: 24 [D 20:43:04.514864] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 50/70. [D 20:43:04.517894] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5194 [D 20:43:04.517962] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 51/70. [D 20:43:04.518049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28620. [D 20:43:04.518075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 28621. [D 20:43:04.518089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 28622. [D 20:43:04.518104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 28623. [D 20:43:04.518118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 28624. [D 20:43:04.518133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 28625. [D 20:43:04.518147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28626. [D 20:43:04.518161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28627. [D 20:43:04.518176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28628. [D 20:43:04.518190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 28629. [D 20:43:04.518204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 28630. [D 20:43:04.518219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 28631. [D 20:43:04.518233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 28632. [D 20:43:04.518247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 28633. [D 20:43:04.518262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28634. [D 20:43:04.518276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28635. [D 20:43:04.518290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28636. [D 20:43:04.518305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 28637. [D 20:43:04.518319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 28638. [D 20:43:04.518333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 28639. [D 20:43:04.518347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 28640. [D 20:43:04.518362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 28641. [D 20:43:04.518376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28642. [D 20:43:04.518391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28643. [D 20:43:04.518406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28644. [D 20:43:04.518420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 28645. [D 20:43:04.518435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 28646. [D 20:43:04.518450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 28647. [D 20:43:04.518464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 28648. [D 20:43:04.518478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 28649. [D 20:43:04.518493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28650. [D 20:43:04.518508] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28651. [D 20:43:04.526606] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28651. [D 20:43:04.526630] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 52/70. [D 20:43:04.526767] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.526789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.526801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:04.536521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.536538] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.536550] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:04.536586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5197 [D 20:43:04.536601] element 0: offset: 0x643b60, size: 24 [D 20:43:04.536617] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 53/70. [D 20:43:04.539643] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5197 [D 20:43:04.539710] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 54/70. [D 20:43:04.539767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28651. [D 20:43:04.539793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 28652. [D 20:43:04.539808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 28653. [D 20:43:04.539823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 28654. [D 20:43:04.539837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 28655. [D 20:43:04.539852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 28656. [D 20:43:04.539866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28657. [D 20:43:04.539881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28658. [D 20:43:04.539896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28659. [D 20:43:04.539910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 28660. [D 20:43:04.539929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 28661. [D 20:43:04.539944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 28662. [D 20:43:04.539959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 28663. [D 20:43:04.539974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 28664. [D 20:43:04.539988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28665. [D 20:43:04.540003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28666. [D 20:43:04.540017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28667. [D 20:43:04.540032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 28668. [D 20:43:04.540046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 28669. [D 20:43:04.540061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 28670. [D 20:43:04.540075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 28671. [D 20:43:04.540090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 28672. [D 20:43:04.540105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28673. [D 20:43:04.540119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28674. [D 20:43:04.540134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28675. [D 20:43:04.540148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 28676. [D 20:43:04.540163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 28677. [D 20:43:04.540178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 28678. [D 20:43:04.540192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 28679. [D 20:43:04.540207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 28680. [D 20:43:04.540222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28681. [D 20:43:04.540236] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28682. [D 20:43:04.549313] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28682. [D 20:43:04.549335] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 55/70. [D 20:43:04.549466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.549488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.549501] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:04.591421] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.591439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.591452] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:04.591488] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5199 [D 20:43:04.591504] element 0: offset: 0x691fe0, size: 24 [D 20:43:04.591520] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 56/70. [D 20:43:04.594611] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5199 [D 20:43:04.594695] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 57/70. [D 20:43:04.594759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28682. [D 20:43:04.594785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28683. [D 20:43:04.594800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28684. [D 20:43:04.594815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28685. [D 20:43:04.594830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28686. [D 20:43:04.594844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28687. [D 20:43:04.594859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28688. [D 20:43:04.594873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28689. [D 20:43:04.594888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28690. [D 20:43:04.594902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28691. [D 20:43:04.594917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28692. [D 20:43:04.594931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28693. [D 20:43:04.594946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28694. [D 20:43:04.594960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28695. [D 20:43:04.594975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28696. [D 20:43:04.594989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28697. [D 20:43:04.595004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28698. [D 20:43:04.595018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28699. [D 20:43:04.595033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28700. [D 20:43:04.595047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28701. [D 20:43:04.595062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28702. [D 20:43:04.595076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28703. [D 20:43:04.595091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28704. [D 20:43:04.595105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28705. [D 20:43:04.595120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28706. [D 20:43:04.595134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28707. [D 20:43:04.595149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28708. [D 20:43:04.595164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28709. [D 20:43:04.595178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28710. [D 20:43:04.595193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28711. [D 20:43:04.595208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28712. [D 20:43:04.595222] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28713. [D 20:43:04.603106] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28713. [D 20:43:04.603129] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 58/70. [D 20:43:04.603259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.603281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.603294] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:04.613047] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.613064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.613077] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:04.613117] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5204 [D 20:43:04.613132] element 0: offset: 0x61e740, size: 24 [D 20:43:04.613149] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 59/70. [D 20:43:04.613194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.613207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.613220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:04.613245] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5206 [D 20:43:04.613259] element 0: offset: 0x636a50, size: 24 [D 20:43:04.613275] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:43:04.613359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.613374] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.613387] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.613408] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5208 [D 20:43:04.613422] element 0: offset: 0x62e8b0, size: 24 [D 20:43:04.613438] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 0/70. [D 20:43:04.619973] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5206 [D 20:43:04.620002] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 1/70. [D 20:43:04.620056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28713. [D 20:43:04.620073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28714. [D 20:43:04.620088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 28715. [D 20:43:04.620102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 28716. [D 20:43:04.620117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 28717. [D 20:43:04.620132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 28718. [D 20:43:04.620146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 28719. [D 20:43:04.620161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28720. [D 20:43:04.620175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28721. [D 20:43:04.620190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28722. [D 20:43:04.620204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 28723. [D 20:43:04.620219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 28724. [D 20:43:04.620233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 28725. [D 20:43:04.620249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 28726. [D 20:43:04.620263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 28727. [D 20:43:04.620278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28728. [D 20:43:04.620293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28729. [D 20:43:04.620307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28730. [D 20:43:04.620322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28731. [D 20:43:04.620337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28732. [D 20:43:04.620352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28733. [D 20:43:04.620367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28734. [D 20:43:04.620381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28735. [D 20:43:04.620396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28736. [D 20:43:04.620410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28737. [D 20:43:04.620425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28738. [D 20:43:04.620440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28739. [D 20:43:04.620454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28740. [D 20:43:04.620469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28741. [D 20:43:04.620483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28742. [D 20:43:04.620498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28743. [D 20:43:04.620512] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28744. [D 20:43:04.624195] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5208 [D 20:43:04.624218] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 2/70. [D 20:43:04.624722] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5204 [D 20:43:04.624745] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 3/70. [D 20:43:04.630690] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28744. [D 20:43:04.630708] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 4/70. [D 20:43:04.630739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 28744. [D 20:43:04.630754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 28745. [D 20:43:04.630769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28746. [D 20:43:04.630784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28747. [D 20:43:04.630798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28748. [D 20:43:04.630813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28749. [D 20:43:04.891335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28750. [D 20:43:04.891358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28751. [D 20:43:04.891373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28752. [D 20:43:04.891388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28753. [D 20:43:04.891406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28754. [D 20:43:04.891421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28755. [D 20:43:04.891435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28756. [D 20:43:04.891450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28757. [D 20:43:04.891464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28758. [D 20:43:04.891479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28759. [D 20:43:04.891494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28760. [D 20:43:04.891519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28761. [D 20:43:04.891534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28762. [D 20:43:04.891549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28763. [D 20:43:04.891564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28764. [D 20:43:04.891578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28765. [D 20:43:04.891592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28766. [D 20:43:04.891607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28767. [D 20:43:04.891622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28768. [D 20:43:04.891637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28769. [D 20:43:04.891651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28770. [D 20:43:04.891666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28771. [D 20:43:04.891680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28772. [D 20:43:04.891695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28773. [D 20:43:04.891710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28774. [D 20:43:04.891724] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28775. [D 20:43:04.891742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28776. [D 20:43:04.891757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28777. [D 20:43:04.891772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28778. [D 20:43:04.891788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28779. [D 20:43:04.891802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28780. [D 20:43:04.891817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28781. [D 20:43:04.891832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28782. [D 20:43:04.891846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28783. [D 20:43:04.891861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28784. [D 20:43:04.891875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28785. [D 20:43:04.891890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28786. [D 20:43:04.891904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28787. [D 20:43:04.891918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28788. [D 20:43:04.891937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28789. [D 20:43:04.891952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28790. [D 20:43:04.891966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28791. [D 20:43:04.891980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28792. [D 20:43:04.891995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28793. [D 20:43:04.892009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28794. [D 20:43:04.892024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28795. [D 20:43:04.892039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28796. [D 20:43:04.892053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28797. [D 20:43:04.892067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28798. [D 20:43:04.892082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28799. [D 20:43:04.892096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28800. [D 20:43:04.892111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28801. [D 20:43:04.892125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28802. [D 20:43:04.892140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28803. [D 20:43:04.892154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28804. [D 20:43:04.892168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28805. [D 20:43:04.892184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28806. [D 20:43:04.892198] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28807. [D 20:43:04.896049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.896107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.896120] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.896290] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28807. [D 20:43:04.896310] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 5/70. [D 20:43:04.899760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.899779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.899793] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.899832] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5211 [D 20:43:04.899856] element 0: offset: 0x643f70, size: 24 [D 20:43:04.899872] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 6/70. [D 20:43:04.899900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.899913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.899930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.899951] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5215 [D 20:43:04.899965] element 0: offset: 0x61e400, size: 24 [D 20:43:04.899979] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 7/70. [D 20:43:04.902147] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28806. [D 20:43:04.902167] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 8/70. [D 20:43:04.905182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.905197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.905210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.905308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.905323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.905335] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.908349] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5211 [D 20:43:04.908392] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 9/70. [D 20:43:04.911078] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5215 [D 20:43:04.911135] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 10/70. [D 20:43:04.913779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28806. [D 20:43:04.913839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28807. [D 20:43:04.913854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 28808. [D 20:43:04.913869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 28809. [D 20:43:04.913883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 28810. [D 20:43:04.913897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 28811. [D 20:43:04.913911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 28812. [D 20:43:04.913928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28813. [D 20:43:04.913942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28814. [D 20:43:04.913956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28815. [D 20:43:04.913974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 28816. [D 20:43:04.913989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 28817. [D 20:43:04.914004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 28818. [D 20:43:04.914018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 28819. [D 20:43:04.914032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 28820. [D 20:43:04.914046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28821. [D 20:43:04.914060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28822. [D 20:43:04.914075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28823. [D 20:43:04.914090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28824. [D 20:43:04.914104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28825. [D 20:43:04.914118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28826. [D 20:43:04.914132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28827. [D 20:43:04.914147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28828. [D 20:43:04.914161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28829. [D 20:43:04.914178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28830. [D 20:43:04.914192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28831. [D 20:43:04.914206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28832. [D 20:43:04.914224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28833. [D 20:43:04.914238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28834. [D 20:43:04.914252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28835. [D 20:43:04.914266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28836. [D 20:43:04.914285] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28837. [D 20:43:04.914303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28838. [D 20:43:04.914318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28839. [D 20:43:04.914332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28840. [D 20:43:04.914346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28841. [D 20:43:04.914360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28842. [D 20:43:04.914378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28843. [D 20:43:04.914392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28844. [D 20:43:04.914406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28845. [D 20:43:04.914424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28846. [D 20:43:04.914439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28847. [D 20:43:04.914454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28848. [D 20:43:04.914469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28849. [D 20:43:04.914483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28850. [D 20:43:04.914498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28851. [D 20:43:04.914512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28852. [D 20:43:04.914530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28853. [D 20:43:04.914544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28854. [D 20:43:04.914558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28855. [D 20:43:04.914573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28856. [D 20:43:04.914587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28857. [D 20:43:04.914601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28858. [D 20:43:04.914616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28859. [D 20:43:04.914630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28860. [D 20:43:04.914644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28861. [D 20:43:04.914659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28862. [D 20:43:04.914673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28863. [D 20:43:04.914688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28864. [D 20:43:04.914702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28865. [D 20:43:04.914716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28866. [D 20:43:04.914730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28867. [D 20:43:04.914744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28868. [D 20:43:04.914758] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28869. [D 20:43:04.918187] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.918208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.918221] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.918265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5218 [D 20:43:04.918280] element 0: offset: 0x5b0030, size: 24 [D 20:43:04.918298] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 11/70. [D 20:43:04.918332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.918346] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.918359] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.918379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5220 [D 20:43:04.918393] element 0: offset: 0x636a50, size: 24 [D 20:43:04.918407] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 12/70. [D 20:43:04.919724] openib_check_cq: completed rdma wr_id 2aaaab60c9b0, nic_wr_credit 28869. [D 20:43:04.919741] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 13/70. [D 20:43:04.930719] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28868. [D 20:43:04.930756] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 14/70. [D 20:43:04.930826] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.930845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.930858] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.930973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.930988] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.931000] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.936925] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5218 [D 20:43:04.936953] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 15/70. [D 20:43:04.936973] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5220 [D 20:43:04.936988] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 16/70. [D 20:43:04.941141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28868. [D 20:43:04.941162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28869. [D 20:43:04.941176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28870. [D 20:43:04.941191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28871. [D 20:43:04.941206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28872. [D 20:43:04.941221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28873. [D 20:43:04.941235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28874. [D 20:43:04.941250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28875. [D 20:43:04.941264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 28876. [D 20:43:04.941278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 28877. [D 20:43:04.941293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 28878. [D 20:43:04.941307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 28879. [D 20:43:04.941322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 28880. [D 20:43:04.941337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 28881. [D 20:43:04.941351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 28882. [D 20:43:04.941366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 28883. [D 20:43:04.941380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 28884. [D 20:43:04.941394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 28885. [D 20:43:04.941409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 28886. [D 20:43:04.941423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 28887. [D 20:43:04.941438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 28888. [D 20:43:04.941452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 28889. [D 20:43:04.941467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 28890. [D 20:43:04.941481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 28891. [D 20:43:04.941496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 28892. [D 20:43:04.941510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 28893. [D 20:43:04.941524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 28894. [D 20:43:04.941539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 28895. [D 20:43:04.941553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 28896. [D 20:43:04.941568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 28897. [D 20:43:04.941582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 28898. [D 20:43:04.941596] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 28899. [D 20:43:04.941614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 28900. [D 20:43:04.941628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 28901. [D 20:43:04.941643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 28902. [D 20:43:04.941657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 28903. [D 20:43:04.941672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 28904. [D 20:43:04.941686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 28905. [D 20:43:04.941700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 28906. [D 20:43:04.941715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28907. [D 20:43:04.941729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28908. [D 20:43:04.941744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28909. [D 20:43:04.941758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 28910. [D 20:43:04.941773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 28911. [D 20:43:04.941787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 28912. [D 20:43:04.941801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 28913. [D 20:43:04.941816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 28914. [D 20:43:04.941845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28915. [D 20:43:04.941860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28916. [D 20:43:04.941876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28917. [D 20:43:04.941890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 28918. [D 20:43:04.941905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 28919. [D 20:43:04.941923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 28920. [D 20:43:04.941938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 28921. [D 20:43:04.941952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 28922. [D 20:43:04.941966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28923. [D 20:43:04.941981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28924. [D 20:43:04.941996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28925. [D 20:43:04.942010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 28926. [D 20:43:04.942024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 28927. [D 20:43:04.942039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 28928. [D 20:43:04.942053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 28929. [D 20:43:04.942068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 28930. [D 20:43:04.942082] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28931. [D 20:43:04.942159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.942218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.942232] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.942276] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5224 [D 20:43:04.942292] element 0: offset: 0x636ca0, size: 24 [D 20:43:04.942311] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 17/70. [D 20:43:04.942349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.942363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.942379] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.942400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5227 [D 20:43:04.942414] element 0: offset: 0x633c60, size: 24 [D 20:43:04.942431] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 18/70. [D 20:43:04.947054] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28931. [D 20:43:04.947079] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 19/70. [D 20:43:04.956202] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28930. [D 20:43:04.956223] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 20/70. [D 20:43:04.956285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.956306] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.956319] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.956432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.956447] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.956459] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.959385] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5224 [D 20:43:04.959411] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 21/70. [D 20:43:04.962332] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5227 [D 20:43:04.962356] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 22/70. [D 20:43:04.962380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28930. [D 20:43:04.962396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28931. [D 20:43:04.962612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 28932. [D 20:43:04.962641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 28933. [D 20:43:04.962659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 28934. [D 20:43:04.962683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 28935. [D 20:43:04.962699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 28936. [D 20:43:04.962726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28937. [D 20:43:04.962741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28938. [D 20:43:04.962765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28939. [D 20:43:04.962780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 28940. [D 20:43:04.962809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 28941. [D 20:43:04.962823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 28942. [D 20:43:04.962838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 28943. [D 20:43:04.962852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 28944. [D 20:43:04.962867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28945. [D 20:43:04.962885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28946. [D 20:43:04.962899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28947. [D 20:43:04.962914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28948. [D 20:43:04.962929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28949. [D 20:43:04.962943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28950. [D 20:43:04.962958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28951. [D 20:43:04.962972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28952. [D 20:43:04.962986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28953. [D 20:43:04.963001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28954. [D 20:43:04.963016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28955. [D 20:43:04.963030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28956. [D 20:43:04.963045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28957. [D 20:43:04.963060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28958. [D 20:43:04.963074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28959. [D 20:43:04.963089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28960. [D 20:43:04.963103] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28961. [D 20:43:04.968197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28962. [D 20:43:04.968218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28963. [D 20:43:04.968233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28964. [D 20:43:04.968247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28965. [D 20:43:04.968261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28966. [D 20:43:04.968277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28967. [D 20:43:04.968291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28968. [D 20:43:04.968305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28969. [D 20:43:04.968320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28970. [D 20:43:04.968334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28971. [D 20:43:04.968349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28972. [D 20:43:04.968363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28973. [D 20:43:04.968378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28974. [D 20:43:04.968392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28975. [D 20:43:04.968406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28976. [D 20:43:04.968421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28977. [D 20:43:04.968435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28978. [D 20:43:04.968450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28979. [D 20:43:04.968464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28980. [D 20:43:04.968479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28981. [D 20:43:04.968494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28982. [D 20:43:04.968508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28983. [D 20:43:04.968522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28984. [D 20:43:04.968537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28985. [D 20:43:04.968551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28986. [D 20:43:04.968567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28987. [D 20:43:04.968582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28988. [D 20:43:04.968597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28989. [D 20:43:04.968611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28990. [D 20:43:04.968626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28991. [D 20:43:04.968640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28992. [D 20:43:04.968655] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28993. [D 20:43:04.968718] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.968782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.968796] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.968840] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5230 [D 20:43:04.968855] element 0: offset: 0x61e740, size: 24 [D 20:43:04.968875] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 23/70. [D 20:43:04.968919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.968933] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.968949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.968970] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5232 [D 20:43:04.968984] element 0: offset: 0x643b60, size: 24 [D 20:43:04.969001] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 24/70. [D 20:43:04.974089] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 28993. [D 20:43:04.974113] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 25/70. [D 20:43:04.980607] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 28992. [D 20:43:04.980626] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 26/70. [D 20:43:04.980691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.980712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.980726] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:04.980844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.980859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.980871] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:04.984020] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5230 [D 20:43:04.984044] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 27/70. [D 20:43:04.986270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 28992. [D 20:43:04.986288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 28993. [D 20:43:04.986303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 28994. [D 20:43:04.986318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 28995. [D 20:43:04.986333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 28996. [D 20:43:04.986347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 28997. [D 20:43:04.986371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 28998. [D 20:43:04.986395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 28999. [D 20:43:04.986411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29000. [D 20:43:04.986434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29001. [D 20:43:04.986459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29002. [D 20:43:04.986473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29003. [D 20:43:04.986502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29004. [D 20:43:04.986526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29005. [D 20:43:04.986541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29006. [D 20:43:04.986556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29007. [D 20:43:04.986571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29008. [D 20:43:04.986585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29009. [D 20:43:04.986600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29010. [D 20:43:04.986615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29011. [D 20:43:04.986658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29012. [D 20:43:04.986681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29013. [D 20:43:04.986696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29014. [D 20:43:04.986720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29015. [D 20:43:04.986735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29016. [D 20:43:04.986759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29017. [D 20:43:04.986774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29018. [D 20:43:04.986802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29019. [D 20:43:04.986828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29020. [D 20:43:04.986842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29021. [D 20:43:04.986856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29022. [D 20:43:04.986871] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29023. [D 20:43:04.990161] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5232 [D 20:43:04.990185] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 28/70. [D 20:43:04.991949] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.992012] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.992026] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:04.992071] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5236 [D 20:43:04.992086] element 0: offset: 0x643f70, size: 24 [D 20:43:04.992105] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 29/70. [D 20:43:04.992153] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:04.992167] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.992179] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:04.992199] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5239 [D 20:43:04.992213] element 0: offset: 0x61e400, size: 24 [D 20:43:04.992230] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 30/70. [D 20:43:04.998010] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29023. [D 20:43:04.998037] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 31/70. [D 20:43:04.998063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 29023. [D 20:43:04.998079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 29024. [D 20:43:04.998094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29025. [D 20:43:04.998109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29026. [D 20:43:04.998124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29027. [D 20:43:04.998139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29028. [D 20:43:04.998154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29029. [D 20:43:04.998169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29030. [D 20:43:04.998184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29031. [D 20:43:04.998199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29032. [D 20:43:04.998214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29033. [D 20:43:04.998228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29034. [D 20:43:04.998243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29035. [D 20:43:04.998258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29036. [D 20:43:04.998273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29037. [D 20:43:04.998287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29038. [D 20:43:04.998302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29039. [D 20:43:04.998317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29040. [D 20:43:04.998332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29041. [D 20:43:04.998346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29042. [D 20:43:04.998361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29043. [D 20:43:04.998376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29044. [D 20:43:04.998391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29045. [D 20:43:04.998406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29046. [D 20:43:04.998420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29047. [D 20:43:04.998436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29048. [D 20:43:04.998451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29049. [D 20:43:04.998465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29050. [D 20:43:04.998480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29051. [D 20:43:04.998494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29052. [D 20:43:04.998509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29053. [D 20:43:04.998524] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29054. [D 20:43:04.998580] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:04.998604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:04.998617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.002988] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5239 [D 20:43:05.003015] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 32/70. [D 20:43:05.003974] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 29054. [D 20:43:05.003994] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 33/70. [D 20:43:05.004082] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.004146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.004160] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.004439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29054. [D 20:43:05.004460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29055. [D 20:43:05.004475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29056. [D 20:43:05.004490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29057. [D 20:43:05.004505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29058. [D 20:43:05.004520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29059. [D 20:43:05.004535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29060. [D 20:43:05.004549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29061. [D 20:43:05.004564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29062. [D 20:43:05.004579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29063. [D 20:43:05.004593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29064. [D 20:43:05.004608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29065. [D 20:43:05.004623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29066. [D 20:43:05.004638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29067. [D 20:43:05.004652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29068. [D 20:43:05.004666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29069. [D 20:43:05.004682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29070. [D 20:43:05.004697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29071. [D 20:43:05.004711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29072. [D 20:43:05.004726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29073. [D 20:43:05.004740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29074. [D 20:43:05.004755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29075. [D 20:43:05.004769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29076. [D 20:43:05.004784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29077. [D 20:43:05.004799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29078. [D 20:43:05.004813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29079. [D 20:43:05.004828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29080. [D 20:43:05.004842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29081. [D 20:43:05.004857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29082. [D 20:43:05.004871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29083. [D 20:43:05.004886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29084. [D 20:43:05.004900] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29085. [D 20:43:05.007877] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5236 [D 20:43:05.007896] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 34/70. [D 20:43:05.010863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.010884] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.010897] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.010938] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5242 [D 20:43:05.010953] element 0: offset: 0x636a50, size: 24 [D 20:43:05.010973] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 35/70. [D 20:43:05.011015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.011030] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.011042] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.011062] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5244 [D 20:43:05.011076] element 0: offset: 0x62e8b0, size: 24 [D 20:43:05.011092] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 36/70. [D 20:43:05.016452] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29085. [D 20:43:05.016480] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 37/70. [D 20:43:05.016497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29085. [D 20:43:05.016511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29086. [D 20:43:05.016526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29087. [D 20:43:05.016541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29088. [D 20:43:05.016557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29089. [D 20:43:05.016571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29090. [D 20:43:05.016586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29091. [D 20:43:05.016600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29092. [D 20:43:05.016614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29093. [D 20:43:05.016629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29094. [D 20:43:05.016644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29095. [D 20:43:05.016658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29096. [D 20:43:05.016673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29097. [D 20:43:05.016687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29098. [D 20:43:05.016701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29099. [D 20:43:05.016717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29100. [D 20:43:05.016731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29101. [D 20:43:05.016745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29102. [D 20:43:05.016760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29103. [D 20:43:05.016774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29104. [D 20:43:05.016789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29105. [D 20:43:05.016803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29106. [D 20:43:05.016818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29107. [D 20:43:05.016832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29108. [D 20:43:05.016847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29109. [D 20:43:05.016861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29110. [D 20:43:05.016876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29111. [D 20:43:05.016890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29112. [D 20:43:05.016905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29113. [D 20:43:05.016920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29114. [D 20:43:05.016934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29115. [D 20:43:05.016948] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29116. [D 20:43:05.016995] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.017015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.017028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.023088] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5242 [D 20:43:05.023112] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 38/70. [D 20:43:05.023132] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5244 [D 20:43:05.023148] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 39/70. [D 20:43:05.028063] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 29116. [D 20:43:05.028085] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 40/70. [D 20:43:05.028167] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.028228] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.028241] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.032978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29116. [D 20:43:05.033004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29117. [D 20:43:05.033018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29118. [D 20:43:05.033033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29119. [D 20:43:05.033047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29120. [D 20:43:05.033062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29121. [D 20:43:05.033077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29122. [D 20:43:05.033091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29123. [D 20:43:05.033106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29124. [D 20:43:05.033120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29125. [D 20:43:05.033135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29126. [D 20:43:05.033149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29127. [D 20:43:05.033164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29128. [D 20:43:05.033178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29129. [D 20:43:05.033193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29130. [D 20:43:05.033208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29131. [D 20:43:05.033222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29132. [D 20:43:05.033237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29133. [D 20:43:05.033251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29134. [D 20:43:05.033266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29135. [D 20:43:05.033280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29136. [D 20:43:05.033294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29137. [D 20:43:05.033309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29138. [D 20:43:05.033324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29139. [D 20:43:05.033339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29140. [D 20:43:05.033354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29141. [D 20:43:05.033368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29142. [D 20:43:05.033393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29143. [D 20:43:05.033408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29144. [D 20:43:05.033422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29145. [D 20:43:05.033437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29146. [D 20:43:05.033451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29147. [D 20:43:05.033467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29148. [D 20:43:05.033482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29149. [D 20:43:05.033496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29150. [D 20:43:05.033511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29151. [D 20:43:05.033525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29152. [D 20:43:05.033540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29153. [D 20:43:05.033554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29154. [D 20:43:05.033569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29155. [D 20:43:05.033583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29156. [D 20:43:05.033597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29157. [D 20:43:05.033612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29158. [D 20:43:05.033627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29159. [D 20:43:05.033641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29160. [D 20:43:05.033655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29161. [D 20:43:05.033670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29162. [D 20:43:05.033684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29163. [D 20:43:05.033699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29164. [D 20:43:05.033713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29165. [D 20:43:05.033727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29166. [D 20:43:05.033742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29167. [D 20:43:05.316407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29168. [D 20:43:05.316435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29169. [D 20:43:05.316450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29170. [D 20:43:05.316465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29171. [D 20:43:05.316479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29172. [D 20:43:05.316493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29173. [D 20:43:05.316508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29174. [D 20:43:05.316523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29175. [D 20:43:05.316537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29176. [D 20:43:05.316552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29177. [D 20:43:05.316566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29178. [D 20:43:05.316581] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e270 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29179. [D 20:43:05.316599] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29179. [D 20:43:05.316615] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 41/70. [D 20:43:05.316669] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.316690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.316703] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.316743] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5249 [D 20:43:05.316758] element 0: offset: 0x644640, size: 24 [D 20:43:05.316779] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 42/70. [D 20:43:05.316816] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.316830] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.316843] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.316864] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5250 [D 20:43:05.316878] element 0: offset: 0x6426a0, size: 24 [D 20:43:05.316893] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 43/70. [D 20:43:05.318788] openib_check_cq: completed rdma wr_id 2aaaab62e270, nic_wr_credit 29178. [D 20:43:05.318808] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 44/70. [D 20:43:05.321726] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.321741] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.321754] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.321847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.321862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.321874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.326871] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5250 [D 20:43:05.326900] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 45/70. [D 20:43:05.328041] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5249 [D 20:43:05.328116] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 46/70. [D 20:43:05.330718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29178. [D 20:43:05.330736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29179. [D 20:43:05.330752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29180. [D 20:43:05.330766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29181. [D 20:43:05.330780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29182. [D 20:43:05.330795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29183. [D 20:43:05.330809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29184. [D 20:43:05.330824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29185. [D 20:43:05.330838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29186. [D 20:43:05.330852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29187. [D 20:43:05.330866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29188. [D 20:43:05.330880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29189. [D 20:43:05.330899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29190. [D 20:43:05.330914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29191. [D 20:43:05.330928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29192. [D 20:43:05.330943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29193. [D 20:43:05.330957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29194. [D 20:43:05.330971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29195. [D 20:43:05.330985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29196. [D 20:43:05.330999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29197. [D 20:43:05.331013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29198. [D 20:43:05.331027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29199. [D 20:43:05.331041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29200. [D 20:43:05.331055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29201. [D 20:43:05.331069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29202. [D 20:43:05.331083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29203. [D 20:43:05.331097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29204. [D 20:43:05.331111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29205. [D 20:43:05.331129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29206. [D 20:43:05.331143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29207. [D 20:43:05.331157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29208. [D 20:43:05.331173] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29209. [D 20:43:05.331191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29210. [D 20:43:05.331205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29211. [D 20:43:05.331219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29212. [D 20:43:05.331233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29213. [D 20:43:05.331247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29214. [D 20:43:05.331261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29215. [D 20:43:05.331275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29216. [D 20:43:05.331289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29217. [D 20:43:05.331303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29218. [D 20:43:05.331317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29219. [D 20:43:05.331332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29220. [D 20:43:05.331345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29221. [D 20:43:05.331359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29222. [D 20:43:05.331373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29223. [D 20:43:05.331387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29224. [D 20:43:05.331401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29225. [D 20:43:05.331415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29226. [D 20:43:05.331429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29227. [D 20:43:05.331443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29228. [D 20:43:05.331457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29229. [D 20:43:05.331471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29230. [D 20:43:05.331488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29231. [D 20:43:05.331502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29232. [D 20:43:05.331516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29233. [D 20:43:05.331616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29234. [D 20:43:05.331631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29235. [D 20:43:05.331647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29236. [D 20:43:05.331661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29237. [D 20:43:05.331676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29238. [D 20:43:05.331690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29239. [D 20:43:05.331704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29240. [D 20:43:05.331718] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29241. [D 20:43:05.336665] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 29241. [D 20:43:05.336686] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 47/70. [D 20:43:05.339820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.339836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.339849] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.339890] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5254 [D 20:43:05.339905] element 0: offset: 0x61e740, size: 24 [D 20:43:05.339919] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 48/70. [D 20:43:05.339957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.339971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.339983] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.340004] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5256 [D 20:43:05.340018] element 0: offset: 0x691fe0, size: 24 [D 20:43:05.340031] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 49/70. [D 20:43:05.343552] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29240. [D 20:43:05.343586] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 50/70. [D 20:43:05.343647] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.343666] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.343681] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.343794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.343809] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.343821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.348029] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5254 [D 20:43:05.348109] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 51/70. [D 20:43:05.349370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29240. [D 20:43:05.349394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29241. [D 20:43:05.349409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29242. [D 20:43:05.349424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29243. [D 20:43:05.349439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29244. [D 20:43:05.349453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29245. [D 20:43:05.349468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29246. [D 20:43:05.349483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29247. [D 20:43:05.349498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29248. [D 20:43:05.349513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29249. [D 20:43:05.349527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29250. [D 20:43:05.349543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29251. [D 20:43:05.349557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29252. [D 20:43:05.349572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29253. [D 20:43:05.349586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29254. [D 20:43:05.349601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29255. [D 20:43:05.349616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29256. [D 20:43:05.349631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29257. [D 20:43:05.349646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29258. [D 20:43:05.349660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29259. [D 20:43:05.349675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29260. [D 20:43:05.349689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29261. [D 20:43:05.349704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29262. [D 20:43:05.349718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29263. [D 20:43:05.349733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29264. [D 20:43:05.349748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29265. [D 20:43:05.349762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29266. [D 20:43:05.349777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29267. [D 20:43:05.349793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29268. [D 20:43:05.349808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29269. [D 20:43:05.349822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29270. [D 20:43:05.349837] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29271. [D 20:43:05.349859] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5256 [D 20:43:05.349912] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 52/70. [D 20:43:05.357280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.357300] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.357313] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.357360] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5260 [D 20:43:05.357375] element 0: offset: 0x643f70, size: 24 [D 20:43:05.357391] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 53/70. [D 20:43:05.357430] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.357444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.357457] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.357477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5263 [D 20:43:05.357491] element 0: offset: 0x633c60, size: 24 [D 20:43:05.357508] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 54/70. [D 20:43:05.360243] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 29271. [D 20:43:05.360268] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 55/70. [D 20:43:05.360286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 29271. [D 20:43:05.360300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 29272. [D 20:43:05.360315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29273. [D 20:43:05.360330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29274. [D 20:43:05.360344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29275. [D 20:43:05.360359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29276. [D 20:43:05.360373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29277. [D 20:43:05.360387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29278. [D 20:43:05.360402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29279. [D 20:43:05.360417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29280. [D 20:43:05.360431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29281. [D 20:43:05.360445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29282. [D 20:43:05.360460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29283. [D 20:43:05.360474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29284. [D 20:43:05.360489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29285. [D 20:43:05.360503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29286. [D 20:43:05.360517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29287. [D 20:43:05.360532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29288. [D 20:43:05.360546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29289. [D 20:43:05.360561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29290. [D 20:43:05.360575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29291. [D 20:43:05.360590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29292. [D 20:43:05.360604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29293. [D 20:43:05.360619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29294. [D 20:43:05.360633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29295. [D 20:43:05.360648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29296. [D 20:43:05.360662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29297. [D 20:43:05.360676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29298. [D 20:43:05.360692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29299. [D 20:43:05.360706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29300. [D 20:43:05.360721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29301. [D 20:43:05.360735] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29302. [D 20:43:05.360797] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.360818] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.360830] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.364458] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5260 [D 20:43:05.364541] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 56/70. [D 20:43:05.366203] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29302. [D 20:43:05.366226] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 57/70. [D 20:43:05.366323] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.366379] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.366392] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.366698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29302. [D 20:43:05.366720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29303. [D 20:43:05.366735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29304. [D 20:43:05.366749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29305. [D 20:43:05.366764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29306. [D 20:43:05.366778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29307. [D 20:43:05.366793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29308. [D 20:43:05.366808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29309. [D 20:43:05.366822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29310. [D 20:43:05.366837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29311. [D 20:43:05.366852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29312. [D 20:43:05.366866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29313. [D 20:43:05.366881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29314. [D 20:43:05.366896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29315. [D 20:43:05.366910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29316. [D 20:43:05.366924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29317. [D 20:43:05.366939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29318. [D 20:43:05.366953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29319. [D 20:43:05.366968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29320. [D 20:43:05.366984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29321. [D 20:43:05.366999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29322. [D 20:43:05.367013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29323. [D 20:43:05.367027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29324. [D 20:43:05.367042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29325. [D 20:43:05.367057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29326. [D 20:43:05.367072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29327. [D 20:43:05.367086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29328. [D 20:43:05.367100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29329. [D 20:43:05.367115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29330. [D 20:43:05.367129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29331. [D 20:43:05.367144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29332. [D 20:43:05.367159] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615fc0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29333. [D 20:43:05.368075] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5263 [D 20:43:05.368135] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 58/70. [D 20:43:05.372658] openib_check_cq: completed rdma wr_id 2aaaab615fc0, nic_wr_credit 29333. [D 20:43:05.372681] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 59/70. [D 20:43:05.372756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.372778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.372791] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:05.372835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29333. [D 20:43:05.372855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29334. [D 20:43:05.372870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29335. [D 20:43:05.372884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29336. [D 20:43:05.372898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29337. [D 20:43:05.372926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29338. [D 20:43:05.372942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29339. [D 20:43:05.372969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29340. [D 20:43:05.372984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29341. [D 20:43:05.373009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29342. [D 20:43:05.373025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29343. [D 20:43:05.373040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29344. [D 20:43:05.373071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29345. [D 20:43:05.373086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29346. [D 20:43:05.373111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29347. [D 20:43:05.373125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29348. [D 20:43:05.373151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29349. [D 20:43:05.373165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29350. [D 20:43:05.373193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29351. [D 20:43:05.373218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29352. [D 20:43:05.373234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29353. [D 20:43:05.373256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29354. [D 20:43:05.373271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29355. [D 20:43:05.373298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29356. [D 20:43:05.373313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29357. [D 20:43:05.373338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29358. [D 20:43:05.373353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29359. [D 20:43:05.373367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29360. [D 20:43:05.373391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29361. [D 20:43:05.373406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29362. [D 20:43:05.373432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29363. [D 20:43:05.373455] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e170 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29364. [D 20:43:05.375586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.375608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.375621] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:05.375662] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5266 [D 20:43:05.375677] element 0: offset: 0x66e770, size: 24 [D 20:43:05.375693] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 60/70. [D 20:43:05.375729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.375743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.375756] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.375776] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5268 [D 20:43:05.375790] element 0: offset: 0x636a50, size: 24 [D 20:43:05.375804] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 0/70. [D 20:43:05.384763] openib_check_cq: completed rdma wr_id 2aaaab62e170, nic_wr_credit 29364. [D 20:43:05.384799] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 1/70. [D 20:43:05.384992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.385013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.385028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.390892] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5266 [D 20:43:05.390964] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 2/70. [D 20:43:05.391045] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5268 [D 20:43:05.391062] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 3/70. [D 20:43:05.395778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29364. [D 20:43:05.395803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29365. [D 20:43:05.395818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29366. [D 20:43:05.395833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29367. [D 20:43:05.395848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29368. [D 20:43:05.395862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29369. [D 20:43:05.395876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29370. [D 20:43:05.395891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29371. [D 20:43:05.395906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29372. [D 20:43:05.395920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29373. [D 20:43:05.395939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29374. [D 20:43:05.395954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29375. [D 20:43:05.395968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29376. [D 20:43:05.395983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29377. [D 20:43:05.395997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29378. [D 20:43:05.396012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29379. [D 20:43:05.396026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29380. [D 20:43:05.396041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29381. [D 20:43:05.396055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29382. [D 20:43:05.396070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29383. [D 20:43:05.396084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29384. [D 20:43:05.396099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29385. [D 20:43:05.396113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29386. [D 20:43:05.396128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29387. [D 20:43:05.396142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29388. [D 20:43:05.396157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29389. [D 20:43:05.396173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29390. [D 20:43:05.396187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29391. [D 20:43:05.396202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29392. [D 20:43:05.396216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29393. [D 20:43:05.396230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29394. [D 20:43:05.396245] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617bb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29395. [D 20:43:05.396272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29396. [D 20:43:05.396287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29397. [D 20:43:05.396301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29398. [D 20:43:05.396316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29399. [D 20:43:05.396330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29400. [D 20:43:05.396345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29401. [D 20:43:05.396359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29402. [D 20:43:05.396373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29403. [D 20:43:05.396388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29404. [D 20:43:05.396402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29405. [D 20:43:05.396417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29406. [D 20:43:05.396431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29407. [D 20:43:05.396445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29408. [D 20:43:05.396460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29409. [D 20:43:05.396474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29410. [D 20:43:05.396488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29411. [D 20:43:05.396503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29412. [D 20:43:05.396517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29413. [D 20:43:05.396532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29414. [D 20:43:05.396546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29415. [D 20:43:05.396560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29416. [D 20:43:05.396575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29417. [D 20:43:05.396589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29418. [D 20:43:05.396605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29419. [D 20:43:05.396619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29420. [D 20:43:05.396633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29421. [D 20:43:05.396648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29422. [D 20:43:05.396663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29423. [D 20:43:05.396677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29424. [D 20:43:05.396692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29425. [D 20:43:05.396706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29426. [D 20:43:05.396721] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e600 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29427. [D 20:43:05.401967] openib_check_cq: completed rdma wr_id 2aaaab617bb0, nic_wr_credit 29427. [D 20:43:05.401999] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 4/70. [D 20:43:05.404522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.404545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.404559] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.404599] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5273 [D 20:43:05.404614] element 0: offset: 0x2aaaab6104e0, size: 24 [D 20:43:05.404630] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 5/70. [D 20:43:05.404662] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.404676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.404689] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.404709] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5274 [D 20:43:05.404723] element 0: offset: 0x2aaaab639180, size: 24 [D 20:43:05.404737] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 6/70. [D 20:43:05.413459] openib_check_cq: completed rdma wr_id 2aaaab62e600, nic_wr_credit 29426. [D 20:43:05.413499] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 7/70. [D 20:43:05.413582] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.413604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.413617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.413727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.413742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.413754] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.419800] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5273 [D 20:43:05.419870] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 8/70. [D 20:43:05.420011] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5274 [D 20:43:05.420032] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 9/70. [D 20:43:05.425185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29426. [D 20:43:05.425210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29427. [D 20:43:05.425225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29428. [D 20:43:05.425239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29429. [D 20:43:05.425254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29430. [D 20:43:05.425269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29431. [D 20:43:05.425294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29432. [D 20:43:05.425309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29433. [D 20:43:05.425331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29434. [D 20:43:05.425346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29435. [D 20:43:05.425361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29436. [D 20:43:05.425375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29437. [D 20:43:05.425390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29438. [D 20:43:05.425404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29439. [D 20:43:05.425419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29440. [D 20:43:05.425433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29441. [D 20:43:05.425461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29442. [D 20:43:05.425476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29443. [D 20:43:05.425490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29444. [D 20:43:05.425515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29445. [D 20:43:05.425538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29446. [D 20:43:05.425565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29447. [D 20:43:05.425589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29448. [D 20:43:05.425604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29449. [D 20:43:05.425618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29450. [D 20:43:05.425641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29451. [D 20:43:05.425656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29452. [D 20:43:05.425680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29453. [D 20:43:05.425703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29454. [D 20:43:05.425717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29455. [D 20:43:05.425731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29456. [D 20:43:05.425762] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617c50 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29457. [D 20:43:05.425779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29458. [D 20:43:05.425793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29459. [D 20:43:05.425809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29460. [D 20:43:05.425827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29461. [D 20:43:05.425842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29462. [D 20:43:05.425856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29463. [D 20:43:05.425870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29464. [D 20:43:05.425885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29465. [D 20:43:05.425900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29466. [D 20:43:05.425914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29467. [D 20:43:05.425929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29468. [D 20:43:05.425943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29469. [D 20:43:05.425958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29470. [D 20:43:05.425972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29471. [D 20:43:05.425987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29472. [D 20:43:05.426001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29473. [D 20:43:05.426016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29474. [D 20:43:05.426030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29475. [D 20:43:05.426045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29476. [D 20:43:05.426059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29477. [D 20:43:05.426074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29478. [D 20:43:05.426088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29479. [D 20:43:05.426103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29480. [D 20:43:05.426117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29481. [D 20:43:05.426132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29482. [D 20:43:05.426146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29483. [D 20:43:05.426161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29484. [D 20:43:05.426175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29485. [D 20:43:05.426190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29486. [D 20:43:05.426204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29487. [D 20:43:05.426219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29488. [D 20:43:05.426234] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a4f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29489. [D 20:43:05.434375] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.434398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.434411] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.434454] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5278 [D 20:43:05.434469] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:43:05.434486] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:43:05.434525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.434539] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.434552] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.434572] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5280 [D 20:43:05.434586] element 0: offset: 0x2aaaab60d6f0, size: 24 [D 20:43:05.434600] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 11/70. [D 20:43:05.436986] openib_check_cq: completed rdma wr_id 2aaaab617c50, nic_wr_credit 29489. [D 20:43:05.437017] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 12/70. [D 20:43:05.448550] openib_check_cq: completed rdma wr_id 2aaaab60a4f0, nic_wr_credit 29488. [D 20:43:05.448571] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 13/70. [D 20:43:05.448634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.448656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.448669] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.448783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.448798] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.448811] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.454847] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5278 [D 20:43:05.454919] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 14/70. [D 20:43:05.454976] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5280 [D 20:43:05.454994] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 15/70. [D 20:43:05.459894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 29488. [D 20:43:05.459919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 29489. [D 20:43:05.459938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29490. [D 20:43:05.459953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29491. [D 20:43:05.459968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29492. [D 20:43:05.459982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29493. [D 20:43:05.459997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29494. [D 20:43:05.460012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29495. [D 20:43:05.460026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29496. [D 20:43:05.460041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29497. [D 20:43:05.460055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29498. [D 20:43:05.460070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29499. [D 20:43:05.460084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29500. [D 20:43:05.460099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29501. [D 20:43:05.460115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29502. [D 20:43:05.460129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29503. [D 20:43:05.460143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29504. [D 20:43:05.460158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29505. [D 20:43:05.460173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29506. [D 20:43:05.460187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29507. [D 20:43:05.460202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29508. [D 20:43:05.460217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29509. [D 20:43:05.460231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29510. [D 20:43:05.460246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29511. [D 20:43:05.460260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29512. [D 20:43:05.460275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29513. [D 20:43:05.460289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29514. [D 20:43:05.460304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29515. [D 20:43:05.460318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29516. [D 20:43:05.460333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29517. [D 20:43:05.460348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29518. [D 20:43:05.460362] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d790 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29519. [D 20:43:05.460378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29520. [D 20:43:05.460393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29521. [D 20:43:05.460408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29522. [D 20:43:05.460422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29523. [D 20:43:05.460437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29524. [D 20:43:05.460451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29525. [D 20:43:05.460466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29526. [D 20:43:05.460480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29527. [D 20:43:05.460495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29528. [D 20:43:05.460509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29529. [D 20:43:05.460524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29530. [D 20:43:05.460539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29531. [D 20:43:05.460554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29532. [D 20:43:05.460568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29533. [D 20:43:05.460582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29534. [D 20:43:05.460597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29535. [D 20:43:05.460611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29536. [D 20:43:05.460626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29537. [D 20:43:05.460640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29538. [D 20:43:05.460654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29539. [D 20:43:05.460669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29540. [D 20:43:05.460683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29541. [D 20:43:05.460698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29542. [D 20:43:05.460712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29543. [D 20:43:05.460727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29544. [D 20:43:05.460741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29545. [D 20:43:05.460755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29546. [D 20:43:05.460770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29547. [D 20:43:05.460784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29548. [D 20:43:05.460798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29549. [D 20:43:05.460813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29550. [D 20:43:05.460827] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d610 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29551. [D 20:43:05.462495] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.462518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.462531] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.462574] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5284 [D 20:43:05.462588] element 0: offset: 0x2aaaab6104e0, size: 24 [D 20:43:05.462605] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 16/70. [D 20:43:05.462645] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.462659] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.462673] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:05.462694] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5287 [D 20:43:05.462708] element 0: offset: 0x2aaaab60d740, size: 24 [D 20:43:05.462725] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 17/70. [D 20:43:05.775743] openib_check_cq: completed rdma wr_id 2aaaab60d790, nic_wr_credit 29551. [D 20:43:05.775772] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 18/70. [D 20:43:05.775787] openib_check_cq: completed rdma wr_id 2aaaab60d610, nic_wr_credit 29550. [D 20:43:05.775812] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 19/70. [D 20:43:05.775875] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.775894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.775907] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:05.776021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.776036] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.776049] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.779026] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5284 [D 20:43:05.779099] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 20/70. [D 20:43:05.782121] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5287 [D 20:43:05.782187] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 21/70. [D 20:43:05.784802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29550. [D 20:43:05.784831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29551. [D 20:43:05.784846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29552. [D 20:43:05.784861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29553. [D 20:43:05.784879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29554. [D 20:43:05.784895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29555. [D 20:43:05.784910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29556. [D 20:43:05.784924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29557. [D 20:43:05.784939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29558. [D 20:43:05.784954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29559. [D 20:43:05.784969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29560. [D 20:43:05.784984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29561. [D 20:43:05.785007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29562. [D 20:43:05.785022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29563. [D 20:43:05.785051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29564. [D 20:43:05.785067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29565. [D 20:43:05.785081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29566. [D 20:43:05.785095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29567. [D 20:43:05.785110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29568. [D 20:43:05.785124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29569. [D 20:43:05.785139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29570. [D 20:43:05.785155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29571. [D 20:43:05.785169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29572. [D 20:43:05.785183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29573. [D 20:43:05.785197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29574. [D 20:43:05.785212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29575. [D 20:43:05.785226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29576. [D 20:43:05.785241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29577. [D 20:43:05.785256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29578. [D 20:43:05.785270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29579. [D 20:43:05.785284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29580. [D 20:43:05.785298] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29581. [D 20:43:05.785316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29582. [D 20:43:05.785331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29583. [D 20:43:05.785346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29584. [D 20:43:05.785361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29585. [D 20:43:05.785376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29586. [D 20:43:05.785390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29587. [D 20:43:05.785405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29588. [D 20:43:05.785419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29589. [D 20:43:05.785434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29590. [D 20:43:05.785451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29591. [D 20:43:05.785466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29592. [D 20:43:05.785480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29593. [D 20:43:05.785498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29594. [D 20:43:05.785512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29595. [D 20:43:05.785527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29596. [D 20:43:05.785545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29597. [D 20:43:05.785560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29598. [D 20:43:05.785574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29599. [D 20:43:05.785734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29600. [D 20:43:05.785757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29601. [D 20:43:05.785771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29602. [D 20:43:05.785786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29603. [D 20:43:05.785801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29604. [D 20:43:05.785815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29605. [D 20:43:05.785831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29606. [D 20:43:05.785845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29607. [D 20:43:05.785859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29608. [D 20:43:05.785875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29609. [D 20:43:05.785911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29610. [D 20:43:05.785926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29611. [D 20:43:05.785941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29612. [D 20:43:05.785956] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29613. [D 20:43:05.790836] openib_check_cq: completed rdma wr_id 2aaaab60f370, nic_wr_credit 29613. [D 20:43:05.790856] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 22/70. [D 20:43:05.794233] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.794258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.794272] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.794314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5289 [D 20:43:05.794329] element 0: offset: 0x2aaaab60dc20, size: 24 [D 20:43:05.794346] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 23/70. [D 20:43:05.796765] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 29612. [D 20:43:05.796788] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 24/70. [D 20:43:05.796854] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.796875] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.796888] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:05.796975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.796990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.797002] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:05.807510] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5289 [D 20:43:05.807538] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 25/70. [D 20:43:05.808288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 29612. [D 20:43:05.808359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 29613. [D 20:43:05.808375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29614. [D 20:43:05.808390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29615. [D 20:43:05.808404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29616. [D 20:43:05.808420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29617. [D 20:43:05.808434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29618. [D 20:43:05.808449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29619. [D 20:43:05.808463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29620. [D 20:43:05.808478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29621. [D 20:43:05.808492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29622. [D 20:43:05.808527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29623. [D 20:43:05.808551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29624. [D 20:43:05.808565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29625. [D 20:43:05.808580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29626. [D 20:43:05.808594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29627. [D 20:43:05.808609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29628. [D 20:43:05.808624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29629. [D 20:43:05.808638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29630. [D 20:43:05.808652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29631. [D 20:43:05.808667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29632. [D 20:43:05.808681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29633. [D 20:43:05.808696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29634. [D 20:43:05.808710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29635. [D 20:43:05.808724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29636. [D 20:43:05.808739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29637. [D 20:43:05.808754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29638. [D 20:43:05.808768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29639. [D 20:43:05.808782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29640. [D 20:43:05.808797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29641. [D 20:43:05.808812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29642. [D 20:43:05.808826] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29643. [D 20:43:05.811006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.811026] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.811039] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:05.811064] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5293 [D 20:43:05.811078] element 0: offset: 0x2aaaab639180, size: 24 [D 20:43:05.811093] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 26/70. [D 20:43:05.814283] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29643. [D 20:43:05.814312] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 27/70. [D 20:43:05.814409] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.814429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.814442] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:05.817537] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5293 [D 20:43:05.817609] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 28/70. [D 20:43:05.832815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29643. [D 20:43:05.832839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 29644. [D 20:43:05.832854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 29645. [D 20:43:05.832869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 29646. [D 20:43:05.832883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 29647. [D 20:43:05.832908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 29648. [D 20:43:05.832922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29649. [D 20:43:05.832950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29650. [D 20:43:05.832974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29651. [D 20:43:05.832990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 29652. [D 20:43:05.833016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 29653. [D 20:43:05.833031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 29654. [D 20:43:05.833058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 29655. [D 20:43:05.833086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 29656. [D 20:43:05.833101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29657. [D 20:43:05.833126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29658. [D 20:43:05.833154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29659. [D 20:43:05.833168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 29660. [D 20:43:05.833193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 29661. [D 20:43:05.833221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 29662. [D 20:43:05.833236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 29663. [D 20:43:05.833262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 29664. [D 20:43:05.833277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29665. [D 20:43:05.833304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29666. [D 20:43:05.833331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29667. [D 20:43:05.833346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 29668. [D 20:43:05.833360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 29669. [D 20:43:05.833374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 29670. [D 20:43:05.833390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 29671. [D 20:43:05.833404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 29672. [D 20:43:05.833418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29673. [D 20:43:05.833433] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617650 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29674. [D 20:43:05.844498] openib_check_cq: completed rdma wr_id 2aaaab617650, nic_wr_credit 29674. [D 20:43:05.844529] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 29/70. [D 20:43:05.844618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.844641] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.844654] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:05.913434] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.913453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.913465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:05.913503] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5295 [D 20:43:05.913518] element 0: offset: 0x2aaaab0259a0, size: 24 [D 20:43:05.913535] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 30/70. [D 20:43:05.919929] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5295 [D 20:43:05.920023] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 31/70. [D 20:43:05.920164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29674. [D 20:43:05.920187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29675. [D 20:43:05.920202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29676. [D 20:43:05.920217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29677. [D 20:43:05.920232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29678. [D 20:43:05.920247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29679. [D 20:43:05.920261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29680. [D 20:43:05.920276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29681. [D 20:43:05.920290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29682. [D 20:43:05.920304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29683. [D 20:43:05.920319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29684. [D 20:43:05.920334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29685. [D 20:43:05.920348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29686. [D 20:43:05.920364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29687. [D 20:43:05.920379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29688. [D 20:43:05.920393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29689. [D 20:43:05.920408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29690. [D 20:43:05.920423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29691. [D 20:43:05.920437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29692. [D 20:43:05.920452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29693. [D 20:43:05.920467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29694. [D 20:43:05.920481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29695. [D 20:43:05.920496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29696. [D 20:43:05.920510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29697. [D 20:43:05.920525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29698. [D 20:43:05.920540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29699. [D 20:43:05.920554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29700. [D 20:43:05.920569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29701. [D 20:43:05.920583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29702. [D 20:43:05.920598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29703. [D 20:43:05.920613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29704. [D 20:43:05.920627] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29705. [D 20:43:05.929551] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29705. [D 20:43:05.929573] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 32/70. [D 20:43:05.929656] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.929679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.929692] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:05.938585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.938602] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.938616] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:05.938654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5299 [D 20:43:05.938669] element 0: offset: 0x2aaaab025980, size: 24 [D 20:43:05.938686] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 33/70. [D 20:43:05.938730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.938744] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.938756] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:05.938776] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5301 [D 20:43:05.938790] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:05.938804] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 34/70. [D 20:43:05.944014] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5299 [D 20:43:05.944096] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 35/70. [D 20:43:05.944161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29705. [D 20:43:05.944188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29706. [D 20:43:05.944203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29707. [D 20:43:05.944219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29708. [D 20:43:05.944233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29709. [D 20:43:05.944248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29710. [D 20:43:05.944263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29711. [D 20:43:05.944278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29712. [D 20:43:05.944293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29713. [D 20:43:05.944307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29714. [D 20:43:05.944322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29715. [D 20:43:05.944336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29716. [D 20:43:05.944351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29717. [D 20:43:05.944367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29718. [D 20:43:05.944381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29719. [D 20:43:05.944396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29720. [D 20:43:05.944411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29721. [D 20:43:05.944425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29722. [D 20:43:05.944440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29723. [D 20:43:05.944455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29724. [D 20:43:05.944470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29725. [D 20:43:05.944484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29726. [D 20:43:05.944499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29727. [D 20:43:05.944514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29728. [D 20:43:05.944529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29729. [D 20:43:05.944543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29730. [D 20:43:05.944558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29731. [D 20:43:05.944573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29732. [D 20:43:05.944589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29733. [D 20:43:05.944604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29734. [D 20:43:05.944619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29735. [D 20:43:05.944633] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29736. [D 20:43:05.945228] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5301 [D 20:43:05.945279] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 36/70. [D 20:43:05.952262] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29736. [D 20:43:05.952287] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 37/70. [D 20:43:05.952312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29736. [D 20:43:05.952328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29737. [D 20:43:05.952343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29738. [D 20:43:05.952357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29739. [D 20:43:05.952372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29740. [D 20:43:05.952387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29741. [D 20:43:05.952401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29742. [D 20:43:05.952416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29743. [D 20:43:05.952431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29744. [D 20:43:05.952445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29745. [D 20:43:05.952460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29746. [D 20:43:05.952475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29747. [D 20:43:05.952489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29748. [D 20:43:05.952504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29749. [D 20:43:05.952519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29750. [D 20:43:05.952534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29751. [D 20:43:05.952548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29752. [D 20:43:05.952563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29753. [D 20:43:05.952578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29754. [D 20:43:05.952592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29755. [D 20:43:05.952607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29756. [D 20:43:05.952622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29757. [D 20:43:05.952637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29758. [D 20:43:05.952652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29759. [D 20:43:05.952666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29760. [D 20:43:05.952681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29761. [D 20:43:05.952696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29762. [D 20:43:05.952710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29763. [D 20:43:05.952725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29764. [D 20:43:05.952740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29765. [D 20:43:05.952754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29766. [D 20:43:05.952769] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610250 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29767. [D 20:43:05.952846] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.952869] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.952882] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:05.964035] openib_check_cq: completed rdma wr_id 2aaaab610250, nic_wr_credit 29767. [D 20:43:05.964061] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 38/70. [D 20:43:05.964170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.964190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.964203] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:05.973862] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.973880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.973892] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:05.973930] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5305 [D 20:43:05.973946] element 0: offset: 0x2aaaab001dc0, size: 24 [D 20:43:05.973963] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 39/70. [D 20:43:05.974001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.974015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.974028] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:05.974048] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5307 [D 20:43:05.974062] element 0: offset: 0x2aaaab001de0, size: 24 [D 20:43:05.974079] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 40/70. [D 20:43:05.976614] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:05.976678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.976692] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:05.976733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5310 [D 20:43:05.976748] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:05.976768] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 41/70. [D 20:43:05.980255] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5310 [D 20:43:05.980329] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 42/70. [D 20:43:05.980388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29767. [D 20:43:05.980414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29768. [D 20:43:05.980429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29769. [D 20:43:05.980445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29770. [D 20:43:05.980460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29771. [D 20:43:05.980475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29772. [D 20:43:05.980489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29773. [D 20:43:05.980504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29774. [D 20:43:05.980519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29775. [D 20:43:05.980534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29776. [D 20:43:05.980549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29777. [D 20:43:05.980563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29778. [D 20:43:05.980578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29779. [D 20:43:05.980593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29780. [D 20:43:05.980607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29781. [D 20:43:05.980622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29782. [D 20:43:05.980637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29783. [D 20:43:05.980651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29784. [D 20:43:05.980666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29785. [D 20:43:05.980681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29786. [D 20:43:05.980696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29787. [D 20:43:05.980710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29788. [D 20:43:05.980725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29789. [D 20:43:05.980740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29790. [D 20:43:05.980754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29791. [D 20:43:05.980769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29792. [D 20:43:05.980784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29793. [D 20:43:05.980798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29794. [D 20:43:05.980813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29795. [D 20:43:05.980828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29796. [D 20:43:05.980843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29797. [D 20:43:05.980857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29798. [D 20:43:05.982493] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5307 [D 20:43:05.982556] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 43/70. [D 20:43:05.983856] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5305 [D 20:43:05.983917] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 44/70. [D 20:43:05.990997] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29798. [D 20:43:05.991024] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 45/70. [D 20:43:05.991043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29798. [D 20:43:05.991058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29799. [D 20:43:05.991073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29800. [D 20:43:05.991088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29801. [D 20:43:05.991103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29802. [D 20:43:05.991117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29803. [D 20:43:05.991131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29804. [D 20:43:05.991146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29805. [D 20:43:05.991161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29806. [D 20:43:05.991175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29807. [D 20:43:05.991190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29808. [D 20:43:05.991204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29809. [D 20:43:05.991219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29810. [D 20:43:05.991234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29811. [D 20:43:05.991248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29812. [D 20:43:05.991263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29813. [D 20:43:05.991277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29814. [D 20:43:05.991292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29815. [D 20:43:05.991307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29816. [D 20:43:05.991321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29817. [D 20:43:05.991336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29818. [D 20:43:05.991350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29819. [D 20:43:05.991365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29820. [D 20:43:05.991379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29821. [D 20:43:05.991394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29822. [D 20:43:05.991409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29823. [D 20:43:05.991424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29824. [D 20:43:05.991438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29825. [D 20:43:05.991453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29826. [D 20:43:05.991468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29827. [D 20:43:05.991482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29828. [D 20:43:05.991497] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610250 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29829. [D 20:43:05.991513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29830. [D 20:43:05.991529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29831. [D 20:43:05.991543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29832. [D 20:43:05.991558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29833. [D 20:43:05.991572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29834. [D 20:43:05.991587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29835. [D 20:43:05.991602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29836. [D 20:43:05.991616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29837. [D 20:43:05.991631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29838. [D 20:43:05.991645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29839. [D 20:43:05.991660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29840. [D 20:43:05.991675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29841. [D 20:43:05.991689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29842. [D 20:43:05.991704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29843. [D 20:43:05.991719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29844. [D 20:43:05.991733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29845. [D 20:43:05.991748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29846. [D 20:43:05.991762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29847. [D 20:43:05.991777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29848. [D 20:43:05.991791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29849. [D 20:43:05.991806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29850. [D 20:43:05.991821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29851. [D 20:43:05.991836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29852. [D 20:43:05.991851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29853. [D 20:43:05.991865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29854. [D 20:43:05.991880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29855. [D 20:43:05.991895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29856. [D 20:43:05.991909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29857. [D 20:43:05.991924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29858. [D 20:43:05.991943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29859. [D 20:43:05.991958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29860. [D 20:43:05.991973] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60a4d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29861. [D 20:43:05.992049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:05.992072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:05.992086] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.002721] openib_check_cq: completed rdma wr_id 2aaaab610250, nic_wr_credit 29861. [D 20:43:06.002747] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 46/70. [D 20:43:06.004771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.004793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.004806] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.004844] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5314 [D 20:43:06.004859] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:06.004877] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 47/70. [D 20:43:06.014382] openib_check_cq: completed rdma wr_id 2aaaab60a4d0, nic_wr_credit 29860. [D 20:43:06.014409] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 48/70. [D 20:43:06.014457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.014477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.014490] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.014579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.014594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.014607] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.017687] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5314 [D 20:43:06.017757] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 49/70. [D 20:43:06.019888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29860. [D 20:43:06.019913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29861. [D 20:43:06.019928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29862. [D 20:43:06.019946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29863. [D 20:43:06.019961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29864. [D 20:43:06.019976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29865. [D 20:43:06.020038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29866. [D 20:43:06.020055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29867. [D 20:43:06.020070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29868. [D 20:43:06.020118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29869. [D 20:43:06.020136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29870. [D 20:43:06.020163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29871. [D 20:43:06.020188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29872. [D 20:43:06.020508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29873. [D 20:43:06.020661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29874. [D 20:43:06.020680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 29875. [D 20:43:06.020695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 29876. [D 20:43:06.020710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 29877. [D 20:43:06.020725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 29878. [D 20:43:06.020740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 29879. [D 20:43:06.020754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 29880. [D 20:43:06.020769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 29881. [D 20:43:06.020783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 29882. [D 20:43:06.020798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 29883. [D 20:43:06.020812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 29884. [D 20:43:06.020827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 29885. [D 20:43:06.020841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 29886. [D 20:43:06.020856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 29887. [D 20:43:06.020870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 29888. [D 20:43:06.020885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 29889. [D 20:43:06.020900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 29890. [D 20:43:06.020914] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 29891. [D 20:43:06.031526] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29891. [D 20:43:06.031543] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 50/70. [D 20:43:06.031678] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.031701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.031714] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.036795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.036816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.036830] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.036869] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5318 [D 20:43:06.036884] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:06.036900] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:43:06.036939] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.036953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.036965] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.036986] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5320 [D 20:43:06.036999] element 0: offset: 0x2aaaab02a0e0, size: 24 [D 20:43:06.037015] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 52/70. [D 20:43:06.037103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.037118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.037131] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.037151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5322 [D 20:43:06.037166] element 0: offset: 0x2aaaab035830, size: 24 [D 20:43:06.037182] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 53/70. [D 20:43:06.039740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.039798] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.039811] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.039853] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5326 [D 20:43:06.039868] element 0: offset: 0x6426a0, size: 24 [D 20:43:06.039888] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 54/70. [D 20:43:06.043978] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5320 [D 20:43:06.044006] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 55/70. [D 20:43:06.044061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29891. [D 20:43:06.044077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29892. [D 20:43:06.044092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 29893. [D 20:43:06.044107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 29894. [D 20:43:06.044122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 29895. [D 20:43:06.044138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 29896. [D 20:43:06.044153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 29897. [D 20:43:06.044167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29898. [D 20:43:06.044182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29899. [D 20:43:06.044197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29900. [D 20:43:06.044212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 29901. [D 20:43:06.044227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 29902. [D 20:43:06.044242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 29903. [D 20:43:06.044257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 29904. [D 20:43:06.044272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 29905. [D 20:43:06.044288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29906. [D 20:43:06.044303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29907. [D 20:43:06.044318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29908. [D 20:43:06.044346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 29909. [D 20:43:06.044361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 29910. [D 20:43:06.044376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 29911. [D 20:43:06.044390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 29912. [D 20:43:06.044405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 29913. [D 20:43:06.044419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29914. [D 20:43:06.044434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29915. [D 20:43:06.044448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29916. [D 20:43:06.044463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 29917. [D 20:43:06.044478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 29918. [D 20:43:06.044492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 29919. [D 20:43:06.044507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 29920. [D 20:43:06.044521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 29921. [D 20:43:06.044536] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29922. [D 20:43:06.047818] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5318 [D 20:43:06.047841] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 56/70. [D 20:43:06.047962] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5322 [D 20:43:06.047980] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 57/70. [D 20:43:06.050007] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5326 [D 20:43:06.050030] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 58/70. [D 20:43:06.052631] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 29922. [D 20:43:06.052652] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 59/70. [D 20:43:06.052678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 29922. [D 20:43:06.052693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 29923. [D 20:43:06.052708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 29924. [D 20:43:06.052722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 29925. [D 20:43:06.052737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 29926. [D 20:43:06.052752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 29927. [D 20:43:06.052766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 29928. [D 20:43:06.052781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 29929. [D 20:43:06.052796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 29930. [D 20:43:06.052810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 29931. [D 20:43:06.052825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 29932. [D 20:43:06.052840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 29933. [D 20:43:06.052854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 29934. [D 20:43:06.052869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 29935. [D 20:43:06.052883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 29936. [D 20:43:06.052898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 29937. [D 20:43:06.052912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 29938. [D 20:43:06.052927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 29939. [D 20:43:06.052941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 29940. [D 20:43:06.052956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 29941. [D 20:43:06.052971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 29942. [D 20:43:06.052985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 29943. [D 20:43:06.053000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 29944. [D 20:43:06.053014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 29945. [D 20:43:06.053029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 29946. [D 20:43:06.053043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 29947. [D 20:43:06.053057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 29948. [D 20:43:06.053072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 29949. [D 20:43:06.053086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 29950. [D 20:43:06.053101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 29951. [D 20:43:06.053116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 29952. [D 20:43:06.053130] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 29953. [D 20:43:06.053146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 29954. [D 20:43:06.053161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 29955. [D 20:43:06.053176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 29956. [D 20:43:06.053190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 29957. [D 20:43:06.222088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 29958. [D 20:43:06.222113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 29959. [D 20:43:06.222129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 29960. [D 20:43:06.222143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 29961. [D 20:43:06.222158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 29962. [D 20:43:06.222172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 29963. [D 20:43:06.222187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 29964. [D 20:43:06.222202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 29965. [D 20:43:06.222217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 29966. [D 20:43:06.222231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 29967. [D 20:43:06.222246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 29968. [D 20:43:06.222260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 29969. [D 20:43:06.222275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 29970. [D 20:43:06.222289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 29971. [D 20:43:06.222304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 29972. [D 20:43:06.222319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 29973. [D 20:43:06.222333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 29974. [D 20:43:06.222348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 29975. [D 20:43:06.222362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 29976. [D 20:43:06.222377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 29977. [D 20:43:06.222391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 29978. [D 20:43:06.222406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 29979. [D 20:43:06.222420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 29980. [D 20:43:06.222435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 29981. [D 20:43:06.222449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 29982. [D 20:43:06.222464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 29983. [D 20:43:06.222478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 29984. [D 20:43:06.222493] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 29985. [D 20:43:06.222511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 29986. [D 20:43:06.222527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 29987. [D 20:43:06.222542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 29988. [D 20:43:06.222556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 29989. [D 20:43:06.222571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 29990. [D 20:43:06.222586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29991. [E 20:43:06.222604] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 29992, block for 10 ms. [D 20:43:06.223900] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 29991. [D 20:43:06.223922] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 60/70. [D 20:43:06.223943] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 29990. [D 20:43:06.223960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 29991. [D 20:43:06.223974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 29992. [D 20:43:06.223988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 29993. [D 20:43:06.224003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 29994. [D 20:43:06.224018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 29995. [D 20:43:06.224032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 29996. [D 20:43:06.224046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 29997. [D 20:43:06.224061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 29998. [D 20:43:06.224075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 29999. [D 20:43:06.224090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30000. [D 20:43:06.224104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30001. [D 20:43:06.224119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30002. [D 20:43:06.224133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30003. [D 20:43:06.224148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30004. [D 20:43:06.224162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30005. [D 20:43:06.224177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30006. [D 20:43:06.224191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30007. [D 20:43:06.224206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30008. [D 20:43:06.224220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30009. [D 20:43:06.224235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30010. [D 20:43:06.224249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30011. [D 20:43:06.224264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30012. [D 20:43:06.224279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30013. [D 20:43:06.224293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30014. [D 20:43:06.224307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30015. [D 20:43:06.224322] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610080 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30016. [D 20:43:06.227383] openib_check_cq: completed rdma wr_id 2aaaab60fcc0, nic_wr_credit 30016. [D 20:43:06.227399] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 0/70. [D 20:43:06.227988] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.228058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.228072] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 5 [D 20:43:06.228121] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.228135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.228148] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 4 [D 20:43:06.228184] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5328 [D 20:43:06.228199] element 0: offset: 0x66e770, size: 24 [D 20:43:06.228219] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 1/70. [D 20:43:06.229476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.229491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.229503] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.233349] openib_check_cq: completed rdma wr_id 2aaaab610080, nic_wr_credit 30015. [D 20:43:06.233375] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 2/70. [D 20:43:06.233431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.233453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.233466] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.233553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.233568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.233580] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.238773] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5328 [D 20:43:06.238799] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 3/70. [D 20:43:06.244488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30015. [D 20:43:06.244505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30016. [D 20:43:06.244520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30017. [D 20:43:06.244534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30018. [D 20:43:06.244549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30019. [D 20:43:06.244563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30020. [D 20:43:06.244578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30021. [D 20:43:06.244592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30022. [D 20:43:06.244607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30023. [D 20:43:06.244621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30024. [D 20:43:06.244635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30025. [D 20:43:06.244650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30026. [D 20:43:06.244664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30027. [D 20:43:06.244679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30028. [D 20:43:06.244693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30029. [D 20:43:06.244707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30030. [D 20:43:06.244722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30031. [D 20:43:06.244736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30032. [D 20:43:06.244751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30033. [D 20:43:06.244766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30034. [D 20:43:06.244780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30035. [D 20:43:06.244795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30036. [D 20:43:06.244809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30037. [D 20:43:06.244823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30038. [D 20:43:06.244838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30039. [D 20:43:06.244852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30040. [D 20:43:06.244867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30041. [D 20:43:06.244881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30042. [D 20:43:06.244896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30043. [D 20:43:06.244910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30044. [D 20:43:06.244925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30045. [D 20:43:06.244939] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ef60 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30046. [D 20:43:06.247229] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.247294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.247308] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.247352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5333 [D 20:43:06.247368] element 0: offset: 0x61e400, size: 24 [D 20:43:06.247388] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 4/70. [D 20:43:06.247433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.247447] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.247459] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.247480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5335 [D 20:43:06.247494] element 0: offset: 0x6426a0, size: 24 [D 20:43:06.247510] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 5/70. [D 20:43:06.249532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.249549] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.249562] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.249584] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5338 [D 20:43:06.249599] element 0: offset: 0x62f910, size: 24 [D 20:43:06.249616] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 6/70. [D 20:43:06.250372] openib_check_cq: completed rdma wr_id 2aaaab60ef60, nic_wr_credit 30046. [D 20:43:06.250396] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 7/70. [D 20:43:06.250579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.250600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.250612] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.262266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.262290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.262304] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.262345] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5340 [D 20:43:06.262361] element 0: offset: 0x5b0030, size: 24 [D 20:43:06.262377] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 8/70. [D 20:43:06.262657] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5333 [D 20:43:06.262681] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 9/70. [D 20:43:06.262698] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5335 [D 20:43:06.262713] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 10/70. [D 20:43:06.262732] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5338 [D 20:43:06.262747] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 11/70. [D 20:43:06.263051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30046. [D 20:43:06.263072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30047. [D 20:43:06.263096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30048. [D 20:43:06.263110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30049. [D 20:43:06.263137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30050. [D 20:43:06.263152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30051. [D 20:43:06.263176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30052. [D 20:43:06.263191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30053. [D 20:43:06.263217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30054. [D 20:43:06.263232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30055. [D 20:43:06.263258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30056. [D 20:43:06.263284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30057. [D 20:43:06.263299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30058. [D 20:43:06.263323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30059. [D 20:43:06.263350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30060. [D 20:43:06.263364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30061. [D 20:43:06.263389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30062. [D 20:43:06.263404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30063. [D 20:43:06.263431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30064. [D 20:43:06.263456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30065. [D 20:43:06.263471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30066. [D 20:43:06.263498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30067. [D 20:43:06.263513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30068. [D 20:43:06.263537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30069. [D 20:43:06.263552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30070. [D 20:43:06.263578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30071. [D 20:43:06.263593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30072. [D 20:43:06.263618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30073. [D 20:43:06.263632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30074. [D 20:43:06.263660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30075. [D 20:43:06.263684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30076. [D 20:43:06.263711] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30077. [D 20:43:06.263729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30078. [D 20:43:06.263753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30079. [D 20:43:06.263768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30080. [D 20:43:06.263797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30081. [D 20:43:06.263820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30082. [D 20:43:06.263843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30083. [D 20:43:06.263858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30084. [D 20:43:06.263872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30085. [D 20:43:06.263896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30086. [D 20:43:06.263910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30087. [D 20:43:06.263925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30088. [D 20:43:06.263940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30089. [D 20:43:06.263958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30090. [D 20:43:06.263974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30091. [D 20:43:06.263988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30092. [D 20:43:06.264003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30093. [D 20:43:06.264017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30094. [D 20:43:06.264033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30095. [D 20:43:06.264048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30096. [D 20:43:06.264062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30097. [D 20:43:06.264077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30098. [D 20:43:06.264092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30099. [D 20:43:06.264107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30100. [D 20:43:06.264121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30101. [D 20:43:06.264136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30102. [D 20:43:06.264155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30103. [D 20:43:06.264169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30104. [D 20:43:06.264184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30105. [D 20:43:06.264198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30106. [D 20:43:06.264213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30107. [D 20:43:06.264228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30108. [D 20:43:06.264242] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30109. [D 20:43:06.264258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30110. [D 20:43:06.264273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30111. [D 20:43:06.264288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30112. [D 20:43:06.264302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30113. [D 20:43:06.264316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30114. [D 20:43:06.264331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30115. [D 20:43:06.264345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30116. [E 20:43:06.264362] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30117, block for 10 ms. [D 20:43:06.274833] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30116. [D 20:43:06.274856] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 12/70. [D 20:43:06.274871] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30115. [D 20:43:06.274889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30116. [D 20:43:06.274904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30117. [D 20:43:06.274919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30118. [D 20:43:06.274933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30119. [D 20:43:06.274948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30120. [D 20:43:06.274962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30121. [D 20:43:06.274977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30122. [D 20:43:06.274991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30123. [D 20:43:06.275005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30124. [D 20:43:06.275020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30125. [D 20:43:06.275048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30126. [D 20:43:06.275062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30127. [D 20:43:06.275077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30128. [D 20:43:06.275091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30129. [D 20:43:06.275106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30130. [D 20:43:06.275120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30131. [D 20:43:06.275135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30132. [D 20:43:06.275149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30133. [D 20:43:06.275164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30134. [D 20:43:06.275178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30135. [D 20:43:06.275192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30136. [D 20:43:06.275207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30137. [D 20:43:06.275221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30138. [D 20:43:06.275236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30139. [D 20:43:06.275250] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcc0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30140. [D 20:43:06.279165] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5340 [D 20:43:06.279244] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 13/70. [D 20:43:06.286436] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 30140. [D 20:43:06.286476] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 14/70. [D 20:43:06.288614] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.288638] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.288652] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.296939] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.296957] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.296970] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.297010] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5343 [D 20:43:06.297025] element 0: offset: 0x691fe0, size: 24 [D 20:43:06.297043] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 15/70. [D 20:43:06.298056] openib_check_cq: completed rdma wr_id 2aaaab60fcc0, nic_wr_credit 30139. [D 20:43:06.298080] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 16/70. [D 20:43:06.298111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30139. [D 20:43:06.298127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30140. [D 20:43:06.298133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.298149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30141. [D 20:43:06.298157] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.298172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30142. [D 20:43:06.298189] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.298208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30143. [D 20:43:06.298239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30144. [D 20:43:06.298255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30145. [D 20:43:06.298269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30146. [D 20:43:06.298284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30147. [D 20:43:06.298299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30148. [D 20:43:06.298314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30149. [D 20:43:06.298329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30150. [D 20:43:06.298343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30151. [D 20:43:06.298358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30152. [D 20:43:06.298372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30153. [D 20:43:06.298387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30154. [D 20:43:06.298401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30155. [D 20:43:06.298416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30156. [D 20:43:06.298431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30157. [D 20:43:06.298446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30158. [D 20:43:06.298460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30159. [D 20:43:06.298475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30160. [D 20:43:06.298489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30161. [D 20:43:06.298505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30162. [D 20:43:06.298520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30163. [D 20:43:06.298535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30164. [D 20:43:06.298550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30165. [D 20:43:06.298564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30166. [D 20:43:06.298580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30167. [D 20:43:06.298595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30168. [D 20:43:06.298609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30169. [D 20:43:06.298624] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610080 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30170. [D 20:43:06.298668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.298690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.298703] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.301587] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5343 [D 20:43:06.301661] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 17/70. [D 20:43:06.304199] openib_check_cq: completed rdma wr_id 2aaaab610080, nic_wr_credit 30170. [D 20:43:06.304238] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 18/70. [D 20:43:06.307457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.307475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.307488] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.308727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30170. [D 20:43:06.308744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30171. [D 20:43:06.308758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30172. [D 20:43:06.308773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30173. [D 20:43:06.308788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30174. [D 20:43:06.308802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30175. [D 20:43:06.308817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30176. [D 20:43:06.308831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30177. [D 20:43:06.308846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30178. [D 20:43:06.308860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30179. [D 20:43:06.308875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30180. [D 20:43:06.308889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30181. [D 20:43:06.308904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30182. [D 20:43:06.308918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30183. [D 20:43:06.308934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30184. [D 20:43:06.308949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30185. [D 20:43:06.308963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30186. [D 20:43:06.308977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30187. [D 20:43:06.308992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30188. [D 20:43:06.309006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30189. [D 20:43:06.309021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30190. [D 20:43:06.309035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30191. [D 20:43:06.309049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30192. [D 20:43:06.309064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30193. [D 20:43:06.309078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30194. [D 20:43:06.309093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30195. [D 20:43:06.309107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30196. [D 20:43:06.309122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30197. [D 20:43:06.309136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30198. [D 20:43:06.309150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30199. [D 20:43:06.309165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30200. [D 20:43:06.309179] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30201. [D 20:43:06.315786] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30201. [D 20:43:06.315804] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 19/70. [D 20:43:06.315964] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.315980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.315993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.316020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5347 [D 20:43:06.316036] element 0: offset: 0x61e400, size: 24 [D 20:43:06.316052] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 20/70. [D 20:43:06.316077] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.316092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.316105] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.323373] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5347 [D 20:43:06.323455] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 21/70. [D 20:43:06.323464] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.323487] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.323501] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.323525] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5351 [D 20:43:06.323539] element 0: offset: 0x627470, size: 24 [D 20:43:06.323555] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 22/70. [D 20:43:06.323580] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.323594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.323606] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.323626] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5352 [D 20:43:06.323641] element 0: offset: 0x67edf0, size: 24 [D 20:43:06.323656] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 23/70. [D 20:43:06.323677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.323691] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.323704] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.323725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5355 [D 20:43:06.323739] element 0: offset: 0x691fe0, size: 24 [D 20:43:06.323754] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 24/70. [D 20:43:06.323782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30201. [D 20:43:06.323799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30202. [D 20:43:06.323813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30203. [D 20:43:06.323828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30204. [D 20:43:06.323843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30205. [D 20:43:06.323858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30206. [D 20:43:06.323873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30207. [D 20:43:06.323887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30208. [D 20:43:06.323902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30209. [D 20:43:06.323917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30210. [D 20:43:06.323932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30211. [D 20:43:06.323951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30212. [D 20:43:06.323966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30213. [D 20:43:06.323981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30214. [D 20:43:06.323996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30215. [D 20:43:06.324011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30216. [D 20:43:06.324025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30217. [D 20:43:06.324040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30218. [D 20:43:06.324055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30219. [D 20:43:06.324070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30220. [D 20:43:06.324084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30221. [D 20:43:06.324099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30222. [D 20:43:06.324114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30223. [D 20:43:06.324129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30224. [D 20:43:06.324144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30225. [D 20:43:06.324159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30226. [D 20:43:06.324174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30227. [D 20:43:06.324189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30228. [D 20:43:06.324204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30229. [D 20:43:06.324218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30230. [D 20:43:06.324233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30231. [D 20:43:06.324248] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30232. [D 20:43:06.331072] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5352 [D 20:43:06.331167] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 25/70. [D 20:43:06.331255] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5351 [D 20:43:06.331272] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 26/70. [D 20:43:06.331704] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5355 [D 20:43:06.331724] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 27/70. [D 20:43:06.333352] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30232. [D 20:43:06.333424] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 28/70. [D 20:43:06.333447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30232. [D 20:43:06.333464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30233. [D 20:43:06.333478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30234. [D 20:43:06.333493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30235. [D 20:43:06.333508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30236. [D 20:43:06.333522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30237. [D 20:43:06.333537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30238. [D 20:43:06.333552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30239. [D 20:43:06.333566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30240. [D 20:43:06.333581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30241. [D 20:43:06.333596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30242. [D 20:43:06.333610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30243. [D 20:43:06.333625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30244. [D 20:43:06.333640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30245. [D 20:43:06.333654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30246. [D 20:43:06.333671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30247. [D 20:43:06.333686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30248. [D 20:43:06.333700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30249. [D 20:43:06.333715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30250. [D 20:43:06.333730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30251. [D 20:43:06.333745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30252. [D 20:43:06.333759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30253. [D 20:43:06.333774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30254. [D 20:43:06.333789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30255. [D 20:43:06.333804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30256. [D 20:43:06.333818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30257. [D 20:43:06.333833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30258. [D 20:43:06.333848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30259. [D 20:43:06.333862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30260. [D 20:43:06.333877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30261. [D 20:43:06.333892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30262. [D 20:43:06.333907] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610250 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30263. [D 20:43:06.333925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30264. [D 20:43:06.333940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30265. [D 20:43:06.333955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30266. [D 20:43:06.333969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30267. [D 20:43:06.333984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30268. [D 20:43:06.333999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30269. [D 20:43:06.334014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30270. [D 20:43:06.334028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30271. [D 20:43:06.334043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30272. [D 20:43:06.334058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30273. [D 20:43:06.334073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30274. [D 20:43:06.334088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30275. [D 20:43:06.334103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30276. [D 20:43:06.334117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30277. [D 20:43:06.334131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30278. [D 20:43:06.334146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30279. [D 20:43:06.334160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30280. [D 20:43:06.334174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30281. [D 20:43:06.334188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30282. [D 20:43:06.334203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30283. [D 20:43:06.334217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30284. [D 20:43:06.334231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30285. [D 20:43:06.334246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30286. [D 20:43:06.334260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30287. [D 20:43:06.334274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30288. [D 20:43:06.334288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30289. [D 20:43:06.334302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30290. [D 20:43:06.334317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30291. [D 20:43:06.334331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30292. [D 20:43:06.334345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30293. [D 20:43:06.334359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30294. [D 20:43:06.334374] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcc0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30295. [D 20:43:06.334390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30296. [D 20:43:06.334404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30297. [D 20:43:06.334418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30298. [D 20:43:06.334433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30299. [D 20:43:06.334447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30300. [D 20:43:06.334461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30301. [E 20:43:06.334480] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30302, block for 10 ms. [D 20:43:06.334512] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30301. [D 20:43:06.334528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30302. [E 20:43:06.334544] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30303, block for 10 ms. [D 20:43:06.339412] openib_check_cq: completed rdma wr_id 2aaaab610250, nic_wr_credit 30302. [D 20:43:06.339448] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 29/70. [D 20:43:06.339464] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30301. [D 20:43:06.339479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30302. [D 20:43:06.339505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30303. [D 20:43:06.339532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30304. [D 20:43:06.339547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30305. [D 20:43:06.339571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30306. [D 20:43:06.339586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30307. [D 20:43:06.339613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30308. [D 20:43:06.339638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30309. [D 20:43:06.339653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30310. [D 20:43:06.339680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30311. [D 20:43:06.339709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30312. [D 20:43:06.339739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30313. [D 20:43:06.339764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30314. [D 20:43:06.339780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30315. [D 20:43:06.339804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30316. [D 20:43:06.339819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30317. [D 20:43:06.339847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30318. [D 20:43:06.339872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30319. [D 20:43:06.339887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30320. [D 20:43:06.339914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30321. [D 20:43:06.339929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30322. [D 20:43:06.339965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30323. [D 20:43:06.339981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30324. [D 20:43:06.339996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30325. [D 20:43:06.340025] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610080 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30326. [D 20:43:06.343987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.344011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.344025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.344055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.344069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.344081] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.344121] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5358 [D 20:43:06.344136] element 0: offset: 0x6696e0, size: 24 [D 20:43:06.344152] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 30/70. [D 20:43:06.351088] openib_check_cq: completed rdma wr_id 2aaaab60fcc0, nic_wr_credit 30326. [D 20:43:06.351125] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 31/70. [D 20:43:06.353301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.353322] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.353335] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.362739] openib_check_cq: completed rdma wr_id 2aaaab610080, nic_wr_credit 30325. [D 20:43:06.362761] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 32/70. [D 20:43:06.362877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.362897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.362910] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.363001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.363015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.363028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.366096] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5358 [D 20:43:06.366164] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 33/70. [D 20:43:06.369527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30325. [D 20:43:06.369549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30326. [D 20:43:06.369564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30327. [D 20:43:06.369578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30328. [D 20:43:06.369593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30329. [D 20:43:06.369608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30330. [D 20:43:06.369622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30331. [D 20:43:06.369637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30332. [D 20:43:06.369652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30333. [D 20:43:06.369666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30334. [D 20:43:06.369681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30335. [D 20:43:06.369696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30336. [D 20:43:06.369711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30337. [D 20:43:06.369725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30338. [D 20:43:06.369740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30339. [D 20:43:06.369754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30340. [D 20:43:06.369771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30341. [D 20:43:06.369785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30342. [D 20:43:06.369800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30343. [D 20:43:06.369815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30344. [D 20:43:06.369829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30345. [D 20:43:06.369844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30346. [D 20:43:06.369859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30347. [D 20:43:06.369873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30348. [D 20:43:06.369888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30349. [D 20:43:06.369903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30350. [D 20:43:06.369917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30351. [D 20:43:06.369932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30352. [D 20:43:06.369947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30353. [D 20:43:06.369962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30354. [D 20:43:06.369976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30355. [D 20:43:06.369991] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30356. [D 20:43:06.375470] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30356. [D 20:43:06.375487] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 34/70. [D 20:43:06.375565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.375588] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.375602] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.382945] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.382963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.382976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.383016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5363 [D 20:43:06.383031] element 0: offset: 0x62f910, size: 24 [D 20:43:06.383047] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 35/70. [D 20:43:06.383084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.383099] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.383112] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.383133] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5366 [D 20:43:06.383147] element 0: offset: 0x6426a0, size: 24 [D 20:43:06.383162] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 36/70. [D 20:43:06.383193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.383208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.383220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.383240] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5367 [D 20:43:06.383255] element 0: offset: 0x5b0030, size: 24 [D 20:43:06.383270] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 37/70. [D 20:43:06.666827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.666848] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.666861] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:06.666883] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5370 [D 20:43:06.666898] element 0: offset: 0x61e400, size: 24 [D 20:43:06.666913] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 38/70. [D 20:43:06.673602] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5363 [D 20:43:06.673674] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 39/70. [D 20:43:06.673751] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5366 [D 20:43:06.673770] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 40/70. [D 20:43:06.673815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30356. [D 20:43:06.673900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30357. [D 20:43:06.673916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30358. [D 20:43:06.673931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30359. [D 20:43:06.673946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30360. [D 20:43:06.673961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30361. [D 20:43:06.673975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30362. [D 20:43:06.673990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30363. [D 20:43:06.674004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30364. [D 20:43:06.674019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30365. [D 20:43:06.674033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30366. [D 20:43:06.674048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30367. [D 20:43:06.674063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30368. [D 20:43:06.674077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30369. [D 20:43:06.674092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30370. [D 20:43:06.674106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30371. [D 20:43:06.674121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30372. [D 20:43:06.674135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30373. [D 20:43:06.674150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30374. [D 20:43:06.674165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30375. [D 20:43:06.674179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30376. [D 20:43:06.674194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30377. [D 20:43:06.674208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30378. [D 20:43:06.674223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30379. [D 20:43:06.674239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30380. [D 20:43:06.674254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30381. [D 20:43:06.674269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30382. [D 20:43:06.674283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30383. [D 20:43:06.674298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30384. [D 20:43:06.674313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30385. [D 20:43:06.674327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30386. [D 20:43:06.674342] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30387. [D 20:43:06.674361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30388. [D 20:43:06.674375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30389. [D 20:43:06.674391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30390. [D 20:43:06.674405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30391. [D 20:43:06.674420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30392. [D 20:43:06.674435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30393. [D 20:43:06.674449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30394. [D 20:43:06.674464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30395. [D 20:43:06.674479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30396. [D 20:43:06.674494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30397. [D 20:43:06.674508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30398. [D 20:43:06.674523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30399. [D 20:43:06.674538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30400. [D 20:43:06.674553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30401. [D 20:43:06.674567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30402. [D 20:43:06.674582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30403. [D 20:43:06.674596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30404. [D 20:43:06.674611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30405. [D 20:43:06.674626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30406. [D 20:43:06.674641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30407. [D 20:43:06.674656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30408. [D 20:43:06.675864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30409. [D 20:43:06.675886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30410. [D 20:43:06.675901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30411. [D 20:43:06.675916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30412. [D 20:43:06.675930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30413. [D 20:43:06.675955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30414. [D 20:43:06.675970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30415. [D 20:43:06.675984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30416. [D 20:43:06.675999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30417. [D 20:43:06.676014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30418. [D 20:43:06.676028] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30419. [D 20:43:06.679795] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30419. [D 20:43:06.679819] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 41/70. [D 20:43:06.683011] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5370 [D 20:43:06.683088] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 42/70. [D 20:43:06.683983] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5367 [D 20:43:06.684003] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 43/70. [D 20:43:06.685611] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 30418. [D 20:43:06.685638] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 44/70. [D 20:43:06.685671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30418. [D 20:43:06.685686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30419. [D 20:43:06.685702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30420. [D 20:43:06.685717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30421. [D 20:43:06.685731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30422. [D 20:43:06.685746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30423. [D 20:43:06.685761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30424. [D 20:43:06.685776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30425. [D 20:43:06.685791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30426. [D 20:43:06.685805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30427. [D 20:43:06.685820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30428. [D 20:43:06.685835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30429. [D 20:43:06.685850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30430. [D 20:43:06.685865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30431. [D 20:43:06.685880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30432. [D 20:43:06.685894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30433. [D 20:43:06.685908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30434. [D 20:43:06.685923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30435. [D 20:43:06.685938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30436. [D 20:43:06.685953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30437. [D 20:43:06.685968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30438. [D 20:43:06.685983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30439. [D 20:43:06.685998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30440. [D 20:43:06.686012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30441. [D 20:43:06.686027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30442. [D 20:43:06.686042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30443. [D 20:43:06.686057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30444. [D 20:43:06.686072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30445. [D 20:43:06.686086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30446. [D 20:43:06.686101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30447. [D 20:43:06.686116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30448. [D 20:43:06.686131] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30449. [D 20:43:06.686148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30450. [D 20:43:06.686163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30451. [D 20:43:06.686178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30452. [D 20:43:06.686193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30453. [D 20:43:06.686207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30454. [D 20:43:06.686222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30455. [D 20:43:06.686237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30456. [D 20:43:06.686252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30457. [D 20:43:06.686267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30458. [D 20:43:06.686282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30459. [D 20:43:06.686298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30460. [D 20:43:06.686312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30461. [D 20:43:06.686327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30462. [D 20:43:06.686341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30463. [D 20:43:06.686357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30464. [D 20:43:06.686371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30465. [D 20:43:06.686386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30466. [D 20:43:06.686401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30467. [D 20:43:06.686416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30468. [D 20:43:06.686431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30469. [D 20:43:06.686446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30470. [D 20:43:06.686461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30471. [D 20:43:06.686476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30472. [D 20:43:06.686491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30473. [D 20:43:06.686505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30474. [D 20:43:06.686520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30475. [D 20:43:06.686535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30476. [D 20:43:06.686550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30477. [D 20:43:06.686565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30478. [D 20:43:06.686580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30479. [D 20:43:06.686595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30480. [D 20:43:06.686610] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610080 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30481. [D 20:43:06.686692] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.686715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.686728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:06.686757] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.686770] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.686783] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.691647] openib_check_cq: completed rdma wr_id 2aaaab60fcc0, nic_wr_credit 30481. [D 20:43:06.691682] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 45/70. [D 20:43:06.697537] openib_check_cq: completed rdma wr_id 2aaaab610080, nic_wr_credit 30480. [D 20:43:06.697555] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 46/70. [D 20:43:06.697612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.697637] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.697651] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.697677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.697690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.697703] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.703514] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.703533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.703546] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.703586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5374 [D 20:43:06.703600] element 0: offset: 0x5b0030, size: 24 [D 20:43:06.703618] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 47/70. [D 20:43:06.703663] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.703678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.703691] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.703712] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5377 [D 20:43:06.703726] element 0: offset: 0x2aaaab62e730, size: 24 [D 20:43:06.703741] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 48/70. [D 20:43:06.712488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.712550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.712564] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.712608] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5379 [D 20:43:06.712623] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:06.712643] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 49/70. [D 20:43:06.715663] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5374 [D 20:43:06.715684] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 50/70. [D 20:43:06.715701] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5377 [D 20:43:06.715717] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 51/70. [D 20:43:06.715846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30480. [D 20:43:06.715867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30481. [D 20:43:06.715882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30482. [D 20:43:06.715896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30483. [D 20:43:06.715910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30484. [D 20:43:06.715924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30485. [D 20:43:06.715937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30486. [D 20:43:06.715962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30487. [D 20:43:06.715976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30488. [D 20:43:06.715990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30489. [D 20:43:06.716004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30490. [D 20:43:06.716019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30491. [D 20:43:06.716033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30492. [D 20:43:06.716047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30493. [D 20:43:06.716061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30494. [D 20:43:06.716075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30495. [D 20:43:06.716089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30496. [D 20:43:06.716103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30497. [D 20:43:06.716117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30498. [D 20:43:06.716131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30499. [D 20:43:06.716146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30500. [D 20:43:06.716160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30501. [D 20:43:06.716174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30502. [D 20:43:06.716188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30503. [D 20:43:06.716202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30504. [D 20:43:06.716216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30505. [D 20:43:06.716230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30506. [D 20:43:06.716244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30507. [D 20:43:06.716258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30508. [D 20:43:06.716272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30509. [D 20:43:06.716286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30510. [D 20:43:06.716300] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30511. [D 20:43:06.716320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30512. [D 20:43:06.716334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30513. [D 20:43:06.716348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30514. [D 20:43:06.716362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30515. [D 20:43:06.716376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30516. [D 20:43:06.716390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30517. [D 20:43:06.716405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30518. [D 20:43:06.716419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30519. [D 20:43:06.716433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30520. [D 20:43:06.716446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30521. [D 20:43:06.716461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30522. [D 20:43:06.716475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30523. [D 20:43:06.716490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30524. [D 20:43:06.716504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30525. [D 20:43:06.716518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30526. [D 20:43:06.716532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30527. [D 20:43:06.716546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30528. [D 20:43:06.716561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30529. [D 20:43:06.716575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30530. [D 20:43:06.716589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30531. [D 20:43:06.716604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30532. [D 20:43:06.716618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30533. [D 20:43:06.716633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30534. [D 20:43:06.716647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30535. [D 20:43:06.716661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30536. [D 20:43:06.716675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30537. [D 20:43:06.716690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30538. [D 20:43:06.716704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30539. [D 20:43:06.716718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30540. [D 20:43:06.716733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30541. [D 20:43:06.716747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30542. [D 20:43:06.716761] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fc10 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30543. [D 20:43:06.719827] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5379 [D 20:43:06.719843] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 52/70. [D 20:43:06.727625] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30543. [D 20:43:06.727708] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 53/70. [D 20:43:06.734705] openib_check_cq: completed rdma wr_id 2aaaab60fc10, nic_wr_credit 30542. [D 20:43:06.734728] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 54/70. [D 20:43:06.734747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30542. [D 20:43:06.734770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30543. [D 20:43:06.734785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30544. [D 20:43:06.734810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30545. [D 20:43:06.734825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30546. [D 20:43:06.734851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30547. [D 20:43:06.734878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30548. [D 20:43:06.734894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30549. [D 20:43:06.734918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30550. [D 20:43:06.734933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30551. [D 20:43:06.734961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30552. [D 20:43:06.734989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30553. [D 20:43:06.735005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30554. [D 20:43:06.735020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30555. [D 20:43:06.735053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30556. [D 20:43:06.735078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30557. [D 20:43:06.735094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30558. [D 20:43:06.735122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30559. [D 20:43:06.735137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30560. [D 20:43:06.735162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30561. [D 20:43:06.735177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30562. [D 20:43:06.735203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30563. [D 20:43:06.735232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30564. [D 20:43:06.735248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30565. [D 20:43:06.735263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30566. [D 20:43:06.735278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30567. [D 20:43:06.735293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30568. [D 20:43:06.735308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30569. [D 20:43:06.735323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30570. [D 20:43:06.735337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30571. [D 20:43:06.735352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30572. [D 20:43:06.735367] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60da70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30573. [D 20:43:06.735438] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.735458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.735472] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:06.735495] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.735509] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.735521] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.746643] openib_check_cq: completed rdma wr_id 2aaaab60da70, nic_wr_credit 30573. [D 20:43:06.746673] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 55/70. [D 20:43:06.746734] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.746754] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.746768] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.753581] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.753599] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.753612] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.753634] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5383 [D 20:43:06.753648] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:06.753666] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 56/70. [D 20:43:06.756142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.756160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.756173] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.756195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5385 [D 20:43:06.756209] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:06.756223] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 57/70. [D 20:43:06.762719] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5385 [D 20:43:06.762802] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 58/70. [D 20:43:06.762959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 30573. [D 20:43:06.763036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 30574. [D 20:43:06.763053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30575. [D 20:43:06.763068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30576. [D 20:43:06.763083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30577. [D 20:43:06.763097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30578. [D 20:43:06.763112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30579. [D 20:43:06.763127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30580. [D 20:43:06.763142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30581. [D 20:43:06.763156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30582. [D 20:43:06.763171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30583. [D 20:43:06.763186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30584. [D 20:43:06.763201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30585. [D 20:43:06.763215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30586. [D 20:43:06.763230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30587. [D 20:43:06.763245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30588. [D 20:43:06.763259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30589. [D 20:43:06.763277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30590. [D 20:43:06.763292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30591. [D 20:43:06.763307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30592. [D 20:43:06.763322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30593. [D 20:43:06.763337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30594. [D 20:43:06.763352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30595. [D 20:43:06.763366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30596. [D 20:43:06.763381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30597. [D 20:43:06.763396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30598. [D 20:43:06.763411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30599. [D 20:43:06.763426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30600. [D 20:43:06.763441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30601. [D 20:43:06.763456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30602. [D 20:43:06.763470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30603. [D 20:43:06.763485] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30604. [D 20:43:06.764693] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5383 [D 20:43:06.764749] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 59/70. [D 20:43:06.774762] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30604. [D 20:43:06.774791] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 60/70. [D 20:43:06.774807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30604. [D 20:43:06.774822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 30605. [D 20:43:06.774837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 30606. [D 20:43:06.774852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 30607. [D 20:43:06.774867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 30608. [D 20:43:06.774882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 30609. [D 20:43:06.774896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30610. [D 20:43:06.774911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30611. [D 20:43:06.774926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30612. [D 20:43:06.774940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 30613. [D 20:43:06.774955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 30614. [D 20:43:06.774971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 30615. [D 20:43:06.774986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 30616. [D 20:43:06.775001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 30617. [D 20:43:06.775016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30618. [D 20:43:06.775031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30619. [D 20:43:06.775046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30620. [D 20:43:06.775061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 30621. [D 20:43:06.775076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 30622. [D 20:43:06.775091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 30623. [D 20:43:06.775106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 30624. [D 20:43:06.775120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 30625. [D 20:43:06.775136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30626. [D 20:43:06.775150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30627. [D 20:43:06.775165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30628. [D 20:43:06.775180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 30629. [D 20:43:06.775195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 30630. [D 20:43:06.775210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 30631. [D 20:43:06.775225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 30632. [D 20:43:06.775240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 30633. [D 20:43:06.775255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30634. [D 20:43:06.775269] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dae0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30635. [D 20:43:06.775348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.775372] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.775385] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.783662] openib_check_cq: completed rdma wr_id 2aaaab60dae0, nic_wr_credit 30635. [D 20:43:06.783688] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 0/70. [D 20:43:06.783747] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.783767] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.783779] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.796178] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.796197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.796210] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.796249] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5389 [D 20:43:06.796263] element 0: offset: 0x2aaaab036a10, size: 24 [D 20:43:06.796280] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 1/70. [D 20:43:06.802840] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5389 [D 20:43:06.802863] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 2/70. [D 20:43:06.803012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 30635. [D 20:43:06.803084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 30636. [D 20:43:06.803100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 30637. [D 20:43:06.803114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 30638. [D 20:43:06.803129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 30639. [D 20:43:06.803144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 30640. [D 20:43:06.803158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30641. [D 20:43:06.803173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30642. [D 20:43:06.803187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30643. [D 20:43:06.803202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 30644. [D 20:43:06.803217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 30645. [D 20:43:06.803231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 30646. [D 20:43:06.803246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 30647. [D 20:43:06.803260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 30648. [D 20:43:06.803275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30649. [D 20:43:06.803290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30650. [D 20:43:06.803304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30651. [D 20:43:06.803319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 30652. [D 20:43:06.803334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 30653. [D 20:43:06.803348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 30654. [D 20:43:06.803363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 30655. [D 20:43:06.803377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 30656. [D 20:43:06.803392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30657. [D 20:43:06.803407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30658. [D 20:43:06.803421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30659. [D 20:43:06.803436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 30660. [D 20:43:06.803450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 30661. [D 20:43:06.803465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 30662. [D 20:43:06.803482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 30663. [D 20:43:06.803496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 30664. [D 20:43:06.803511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30665. [D 20:43:06.803526] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30666. [D 20:43:06.813609] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30666. [D 20:43:06.813634] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 3/70. [D 20:43:06.813696] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.813715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.813728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.833531] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.833549] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.833562] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.833585] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5391 [D 20:43:06.833599] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:06.833615] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 4/70. [D 20:43:06.836848] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5391 [D 20:43:06.836925] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 5/70. [D 20:43:06.836984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30666. [D 20:43:06.837008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30667. [D 20:43:06.837023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30668. [D 20:43:06.837038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30669. [D 20:43:06.837052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30670. [D 20:43:06.837067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30671. [D 20:43:06.837082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30672. [D 20:43:06.837096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30673. [D 20:43:06.837111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30674. [D 20:43:06.837125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30675. [D 20:43:06.837140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30676. [D 20:43:06.837155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30677. [D 20:43:06.837169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30678. [D 20:43:06.837184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30679. [D 20:43:06.837199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30680. [D 20:43:06.837213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30681. [D 20:43:06.837228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30682. [D 20:43:06.837244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30683. [D 20:43:06.837258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30684. [D 20:43:06.837273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30685. [D 20:43:06.837288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30686. [D 20:43:06.837302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30687. [D 20:43:06.837317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30688. [D 20:43:06.837332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30689. [D 20:43:06.837346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30690. [D 20:43:06.837361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30691. [D 20:43:06.837376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30692. [D 20:43:06.837390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30693. [D 20:43:06.837405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30694. [D 20:43:06.837419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30695. [D 20:43:06.837434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30696. [D 20:43:06.837449] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30697. [D 20:43:06.847616] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30697. [D 20:43:06.847634] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 6/70. [D 20:43:06.847773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.847796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.847809] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.857724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.857742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.857755] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.857795] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5394 [D 20:43:06.857810] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:06.857827] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 7/70. [D 20:43:06.863716] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5394 [D 20:43:06.863794] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 8/70. [D 20:43:06.863943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30697. [D 20:43:06.863970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30698. [D 20:43:06.863986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30699. [D 20:43:06.864000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30700. [D 20:43:06.864015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30701. [D 20:43:06.864031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30702. [D 20:43:06.864047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30703. [D 20:43:06.864062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30704. [D 20:43:06.864077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30705. [D 20:43:06.864091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30706. [D 20:43:06.864106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30707. [D 20:43:06.864122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30708. [D 20:43:06.864136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30709. [D 20:43:06.864151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30710. [D 20:43:06.864166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30711. [D 20:43:06.864181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30712. [D 20:43:06.864196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30713. [D 20:43:06.864211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30714. [D 20:43:06.864226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30715. [D 20:43:06.864241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30716. [D 20:43:06.864256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30717. [D 20:43:06.864270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30718. [D 20:43:06.864285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30719. [D 20:43:06.864300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30720. [D 20:43:06.864315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30721. [D 20:43:06.864330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30722. [D 20:43:06.864345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30723. [D 20:43:06.864360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30724. [D 20:43:06.864375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30725. [D 20:43:06.864390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30726. [D 20:43:06.864404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30727. [D 20:43:06.864419] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30728. [D 20:43:06.873814] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30728. [D 20:43:06.873835] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 9/70. [D 20:43:06.873918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.873941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.873954] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.880173] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.880191] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.880204] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.880242] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5397 [D 20:43:06.880257] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:06.880276] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 10/70. [D 20:43:06.882639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.882699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.882713] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.882751] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5400 [D 20:43:06.882768] element 0: offset: 0x2aaaab036a10, size: 24 [D 20:43:06.882787] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 11/70. [D 20:43:06.886987] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5400 [D 20:43:06.887064] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 12/70. [D 20:43:06.887168] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5397 [D 20:43:06.887186] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 13/70. [D 20:43:06.887212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 30728. [D 20:43:06.887238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 30729. [D 20:43:06.887254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30730. [D 20:43:06.887268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30731. [D 20:43:06.887283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30732. [D 20:43:06.887298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30733. [D 20:43:06.887313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30734. [D 20:43:06.887327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30735. [D 20:43:06.887342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30736. [D 20:43:06.887357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30737. [D 20:43:06.887371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30738. [D 20:43:06.887386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30739. [D 20:43:06.887401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30740. [D 20:43:06.887415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30741. [D 20:43:06.887430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30742. [D 20:43:06.887445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30743. [D 20:43:06.887459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30744. [D 20:43:06.887474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30745. [D 20:43:06.887489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30746. [D 20:43:06.887503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30747. [D 20:43:06.887519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30748. [D 20:43:06.887534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30749. [D 20:43:06.887549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30750. [D 20:43:06.887564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30751. [D 20:43:06.887579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30752. [D 20:43:06.887594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30753. [D 20:43:06.887618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30754. [D 20:43:06.887634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30755. [D 20:43:06.887648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30756. [D 20:43:06.887663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30757. [D 20:43:06.887678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30758. [D 20:43:06.887693] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30759. [D 20:43:06.887711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30760. [D 20:43:06.887726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30761. [D 20:43:06.887741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30762. [D 20:43:06.887756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30763. [D 20:43:06.887770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30764. [D 20:43:06.887785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30765. [D 20:43:06.887800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30766. [D 20:43:06.887815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30767. [D 20:43:06.887830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30768. [D 20:43:06.887844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30769. [D 20:43:06.887860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30770. [D 20:43:06.887874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30771. [D 20:43:06.887889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30772. [D 20:43:06.887904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30773. [D 20:43:06.887919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30774. [D 20:43:06.887934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30775. [D 20:43:06.887994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30776. [D 20:43:06.888015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30777. [D 20:43:06.888033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30778. [D 20:43:06.888048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30779. [D 20:43:06.888063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30780. [D 20:43:06.888078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30781. [D 20:43:06.888093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30782. [D 20:43:06.888108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30783. [D 20:43:06.888123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30784. [D 20:43:06.888138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30785. [D 20:43:06.888152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30786. [D 20:43:06.888167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30787. [D 20:43:06.888182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30788. [D 20:43:06.888197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30789. [D 20:43:06.888212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30790. [D 20:43:06.888227] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dae0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30791. [D 20:43:06.898868] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30791. [D 20:43:06.898891] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 14/70. [D 20:43:06.908021] openib_check_cq: completed rdma wr_id 2aaaab60dae0, nic_wr_credit 30790. [D 20:43:06.908042] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 15/70. [D 20:43:06.908114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.908137] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.908150] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:06.908180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:06.908193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.908206] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:06.922325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.922344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.922356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:06.922394] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5405 [D 20:43:06.922409] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:06.922425] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 16/70. [D 20:43:06.924566] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.924625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.924639] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:06.924680] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5407 [D 20:43:06.924695] element 0: offset: 0x2aaaab036ee0, size: 24 [D 20:43:06.924716] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 17/70. [D 20:43:06.924760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:06.924774] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:06.924793] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:06.924813] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5409 [D 20:43:06.924827] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:06.924841] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 18/70. [D 20:43:06.932000] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5405 [D 20:43:06.932082] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 19/70. [D 20:43:06.932111] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5409 [D 20:43:06.932127] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 20/70. [D 20:43:06.932166] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5407 [D 20:43:06.932182] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 21/70. [D 20:43:06.932222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30790. [D 20:43:06.932249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30791. [D 20:43:06.932264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30792. [D 20:43:06.932278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30793. [D 20:43:06.932293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30794. [D 20:43:06.932308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30795. [D 20:43:06.932323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30796. [D 20:43:06.932337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30797. [D 20:43:06.932352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30798. [D 20:43:06.932367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30799. [D 20:43:06.932381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30800. [D 20:43:06.932396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30801. [D 20:43:06.932411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30802. [D 20:43:06.932425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30803. [D 20:43:06.932440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30804. [D 20:43:06.932455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30805. [D 20:43:06.932469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30806. [D 20:43:06.932484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30807. [D 20:43:06.932499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30808. [D 20:43:06.932514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30809. [D 20:43:06.932528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30810. [D 20:43:06.932543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30811. [D 20:43:06.932558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30812. [D 20:43:06.932573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30813. [D 20:43:06.932588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30814. [D 20:43:06.932603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30815. [D 20:43:06.932618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30816. [D 20:43:06.932632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30817. [D 20:43:06.932647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30818. [D 20:43:06.932661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30819. [D 20:43:06.932676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30820. [D 20:43:06.932690] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30821. [D 20:43:06.932707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30822. [D 20:43:06.932722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30823. [D 20:43:06.932736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 30824. [D 20:43:06.932751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 30825. [D 20:43:06.932765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 30826. [D 20:43:06.932780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 30827. [D 20:43:06.932794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 30828. [D 20:43:06.932809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30829. [D 20:43:06.932823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30830. [D 20:43:06.932838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30831. [D 20:43:06.932852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 30832. [D 20:43:06.932867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 30833. [D 20:43:06.932881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 30834. [D 20:43:06.932895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 30835. [D 20:43:06.932910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 30836. [D 20:43:06.932925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30837. [D 20:43:06.932939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30838. [D 20:43:06.932953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30839. [D 20:43:06.932968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 30840. [D 20:43:06.932983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 30841. [D 20:43:07.125962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 30842. [D 20:43:07.125987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 30843. [D 20:43:07.126002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 30844. [D 20:43:07.126017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30845. [D 20:43:07.126033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30846. [D 20:43:07.126047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30847. [D 20:43:07.126062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 30848. [D 20:43:07.126077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 30849. [D 20:43:07.126092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 30850. [D 20:43:07.126107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 30851. [D 20:43:07.126122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 30852. [D 20:43:07.126137] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dae0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30853. [D 20:43:07.126155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 30854. [D 20:43:07.126171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 30855. [D 20:43:07.126186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30856. [D 20:43:07.126200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30857. [D 20:43:07.126216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30858. [D 20:43:07.126230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30859. [D 20:43:07.126245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30860. [E 20:43:07.126265] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30861, block for 10 ms. [D 20:43:07.127678] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30860. [D 20:43:07.127702] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 22/70. [D 20:43:07.127719] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30859. [D 20:43:07.127735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30860. [D 20:43:07.127750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30861. [D 20:43:07.127764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30862. [D 20:43:07.127779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30863. [D 20:43:07.127794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30864. [D 20:43:07.127809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30865. [D 20:43:07.127824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30866. [D 20:43:07.127838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30867. [D 20:43:07.127852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30868. [D 20:43:07.127867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30869. [D 20:43:07.127881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30870. [D 20:43:07.127896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30871. [D 20:43:07.127910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30872. [D 20:43:07.127925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30873. [D 20:43:07.127939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30874. [D 20:43:07.127958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30875. [D 20:43:07.127973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30876. [D 20:43:07.127987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30877. [D 20:43:07.128002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30878. [D 20:43:07.128016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30879. [D 20:43:07.128031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30880. [D 20:43:07.128045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30881. [D 20:43:07.128059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30882. [D 20:43:07.128074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30883. [D 20:43:07.128088] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30884. [D 20:43:07.128141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.128166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.128179] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.128221] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5413 [D 20:43:07.128236] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:07.128256] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 23/70. [D 20:43:07.128415] openib_check_cq: completed rdma wr_id 2aaaab60dae0, nic_wr_credit 30884. [D 20:43:07.128434] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 24/70. [D 20:43:07.129551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.129589] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.129603] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.134284] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 30883. [D 20:43:07.134301] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 25/70. [D 20:43:07.137211] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.137226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.137239] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.137315] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.137329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.137342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:07.140402] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5413 [D 20:43:07.140468] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 26/70. [D 20:43:07.146275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30883. [D 20:43:07.146302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30884. [D 20:43:07.146317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30885. [D 20:43:07.146331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30886. [D 20:43:07.146346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30887. [D 20:43:07.146361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30888. [D 20:43:07.146375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30889. [D 20:43:07.146390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30890. [D 20:43:07.146404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30891. [D 20:43:07.146419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30892. [D 20:43:07.146433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30893. [D 20:43:07.146448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30894. [D 20:43:07.146462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30895. [D 20:43:07.146477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30896. [D 20:43:07.146492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30897. [D 20:43:07.146506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30898. [D 20:43:07.146521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30899. [D 20:43:07.146535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30900. [D 20:43:07.146550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30901. [D 20:43:07.146564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30902. [D 20:43:07.146579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30903. [D 20:43:07.146593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30904. [D 20:43:07.146608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30905. [D 20:43:07.146622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30906. [D 20:43:07.146637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 30907. [D 20:43:07.146651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 30908. [D 20:43:07.146666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 30909. [D 20:43:07.146680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 30910. [D 20:43:07.146695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 30911. [D 20:43:07.146710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 30912. [D 20:43:07.146724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 30913. [D 20:43:07.146739] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ffd0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 30914. [D 20:43:07.149214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.149238] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.149251] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:07.149293] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5417 [D 20:43:07.149308] element 0: offset: 0x2aaaab014930, size: 24 [D 20:43:07.149326] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 27/70. [D 20:43:07.149364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.149378] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.149390] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.149411] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5419 [D 20:43:07.149426] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:07.149439] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 28/70. [D 20:43:07.149542] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.149557] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.149569] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.149589] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5421 [D 20:43:07.149605] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:07.149620] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 29/70. [D 20:43:07.152177] openib_check_cq: completed rdma wr_id 2aaaab60ffd0, nic_wr_credit 30914. [D 20:43:07.152205] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 30/70. [D 20:43:07.152419] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.152440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.152453] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.160108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.160173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.160187] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.160231] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5425 [D 20:43:07.160246] element 0: offset: 0x2aaaab025ea0, size: 24 [D 20:43:07.160266] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:43:07.161123] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5417 [D 20:43:07.161166] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 32/70. [D 20:43:07.161251] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5419 [D 20:43:07.161269] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 33/70. [D 20:43:07.161311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 30914. [D 20:43:07.161336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 30915. [D 20:43:07.161351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 30916. [D 20:43:07.161366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 30917. [D 20:43:07.161380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 30918. [D 20:43:07.161395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 30919. [D 20:43:07.161410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 30920. [D 20:43:07.161425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 30921. [D 20:43:07.161440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 30922. [D 20:43:07.161454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 30923. [D 20:43:07.161470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 30924. [D 20:43:07.161484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 30925. [D 20:43:07.161499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 30926. [D 20:43:07.161514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 30927. [D 20:43:07.161529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 30928. [D 20:43:07.161544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 30929. [D 20:43:07.161558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 30930. [D 20:43:07.161573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 30931. [D 20:43:07.161588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 30932. [D 20:43:07.161603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 30933. [D 20:43:07.161618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 30934. [D 20:43:07.161633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 30935. [D 20:43:07.161647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 30936. [D 20:43:07.161662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 30937. [D 20:43:07.161677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 30938. [D 20:43:07.161692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 30939. [D 20:43:07.161706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 30940. [D 20:43:07.161721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 30941. [D 20:43:07.161736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 30942. [D 20:43:07.161751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 30943. [D 20:43:07.161766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 30944. [D 20:43:07.161780] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 30945. [D 20:43:07.161798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 30946. [D 20:43:07.161813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 30947. [D 20:43:07.161828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 30948. [D 20:43:07.161844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 30949. [D 20:43:07.161859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 30950. [D 20:43:07.161874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 30951. [D 20:43:07.161889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 30952. [D 20:43:07.161903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30953. [D 20:43:07.161918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30954. [D 20:43:07.161932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30955. [D 20:43:07.161947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 30956. [D 20:43:07.161961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 30957. [D 20:43:07.161976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 30958. [D 20:43:07.161990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 30959. [D 20:43:07.162005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 30960. [D 20:43:07.162019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30961. [D 20:43:07.162034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30962. [D 20:43:07.162048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30963. [D 20:43:07.162077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 30964. [D 20:43:07.162092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 30965. [D 20:43:07.162115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 30966. [D 20:43:07.162130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 30967. [D 20:43:07.162144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 30968. [D 20:43:07.162159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30969. [D 20:43:07.162174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30970. [D 20:43:07.162189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30971. [D 20:43:07.162203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 30972. [D 20:43:07.162227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 30973. [D 20:43:07.162250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 30974. [D 20:43:07.162272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 30975. [D 20:43:07.162296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 30976. [D 20:43:07.162311] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dae0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30977. [D 20:43:07.168295] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5425 [D 20:43:07.168374] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 34/70. [D 20:43:07.168450] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5421 [D 20:43:07.168467] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 35/70. [D 20:43:07.172964] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 30977. [D 20:43:07.172991] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 36/70. [D 20:43:07.184650] openib_check_cq: completed rdma wr_id 2aaaab60dae0, nic_wr_credit 30976. [D 20:43:07.184671] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 37/70. [D 20:43:07.184700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 30976. [D 20:43:07.184717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 30977. [D 20:43:07.184732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 30978. [D 20:43:07.184745] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.184747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 30979. [D 20:43:07.184775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.184785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 30980. [D 20:43:07.184793] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.184809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 30981. [D 20:43:07.184839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 30982. [D 20:43:07.184854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 30983. [D 20:43:07.184869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 30984. [D 20:43:07.184883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 30985. [D 20:43:07.184898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 30986. [D 20:43:07.184913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 30987. [D 20:43:07.184928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 30988. [D 20:43:07.184942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 30989. [D 20:43:07.184957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 30990. [D 20:43:07.184972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 30991. [D 20:43:07.184986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 30992. [D 20:43:07.185001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 30993. [D 20:43:07.185016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 30994. [D 20:43:07.185030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 30995. [D 20:43:07.185045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 30996. [D 20:43:07.185060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 30997. [D 20:43:07.185075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 30998. [D 20:43:07.185090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 30999. [D 20:43:07.185104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31000. [D 20:43:07.185118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31001. [D 20:43:07.185132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31002. [D 20:43:07.185147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31003. [D 20:43:07.185161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31004. [D 20:43:07.185175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31005. [D 20:43:07.185189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31006. [D 20:43:07.185203] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31007. [D 20:43:07.185219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31008. [D 20:43:07.185233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31009. [D 20:43:07.185248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31010. [D 20:43:07.185262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31011. [D 20:43:07.185276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31012. [D 20:43:07.185290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31013. [D 20:43:07.185305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31014. [D 20:43:07.185319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31015. [D 20:43:07.185333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31016. [D 20:43:07.185347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31017. [D 20:43:07.185361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31018. [D 20:43:07.185376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31019. [D 20:43:07.185390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31020. [D 20:43:07.185404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31021. [D 20:43:07.185418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31022. [D 20:43:07.185432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31023. [D 20:43:07.185446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31024. [D 20:43:07.185461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31025. [D 20:43:07.185475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31026. [D 20:43:07.185490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31027. [D 20:43:07.185505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31028. [D 20:43:07.185519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31029. [D 20:43:07.185534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31030. [D 20:43:07.185548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31031. [D 20:43:07.185563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31032. [D 20:43:07.185577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31033. [D 20:43:07.185592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31034. [D 20:43:07.185606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31035. [D 20:43:07.185622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31036. [D 20:43:07.185636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31037. [D 20:43:07.185651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31038. [D 20:43:07.185665] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ee30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31039. [D 20:43:07.185705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.185723] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.185736] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.195210] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 31039. [D 20:43:07.195235] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 38/70. [D 20:43:07.198708] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.198729] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.198742] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.198783] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5428 [D 20:43:07.198799] element 0: offset: 0x2aaaab017610, size: 24 [D 20:43:07.198816] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 39/70. [D 20:43:07.198853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.198867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.198880] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.198900] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5430 [D 20:43:07.198915] element 0: offset: 0x2aaaab01c4b0, size: 24 [D 20:43:07.198929] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 40/70. [D 20:43:07.204575] openib_check_cq: completed rdma wr_id 2aaaab60ee30, nic_wr_credit 31038. [D 20:43:07.204602] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 41/70. [D 20:43:07.204658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.204678] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.204690] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.204806] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.204821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.204833] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.207753] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5430 [D 20:43:07.207815] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 42/70. [D 20:43:07.209599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31038. [D 20:43:07.209624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31039. [D 20:43:07.209639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31040. [D 20:43:07.209654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31041. [D 20:43:07.209669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31042. [D 20:43:07.210640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31043. [D 20:43:07.210655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31044. [D 20:43:07.210670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31045. [D 20:43:07.210685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31046. [D 20:43:07.210703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31047. [D 20:43:07.210718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31048. [D 20:43:07.210732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31049. [D 20:43:07.210748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31050. [D 20:43:07.210762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31051. [D 20:43:07.210776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31052. [D 20:43:07.210795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31053. [D 20:43:07.210810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31054. [D 20:43:07.210824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31055. [D 20:43:07.210839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31056. [D 20:43:07.210854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31057. [D 20:43:07.210869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31058. [D 20:43:07.210883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31059. [D 20:43:07.210898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31060. [D 20:43:07.210912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31061. [D 20:43:07.210928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31062. [D 20:43:07.210942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31063. [D 20:43:07.210957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31064. [D 20:43:07.210971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31065. [D 20:43:07.210986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31066. [D 20:43:07.211001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31067. [D 20:43:07.211017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31068. [D 20:43:07.211032] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31069. [D 20:43:07.211664] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5428 [D 20:43:07.211741] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 43/70. [D 20:43:07.218043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.218064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.218078] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.218121] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5435 [D 20:43:07.218136] element 0: offset: 0x2aaaab01c650, size: 24 [D 20:43:07.218152] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 44/70. [D 20:43:07.218193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.218207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.218220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.218241] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5436 [D 20:43:07.218255] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:07.218270] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 45/70. [D 20:43:07.221379] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31069. [D 20:43:07.221403] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 46/70. [D 20:43:07.221435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 31069. [D 20:43:07.221450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 31070. [D 20:43:07.221465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31071. [D 20:43:07.221481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31072. [D 20:43:07.221496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31073. [D 20:43:07.221511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31074. [D 20:43:07.221527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31075. [D 20:43:07.221542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31076. [D 20:43:07.221557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31077. [D 20:43:07.221572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31078. [D 20:43:07.221587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31079. [D 20:43:07.221602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31080. [D 20:43:07.221617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31081. [D 20:43:07.221632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31082. [D 20:43:07.221647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31083. [D 20:43:07.221662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31084. [D 20:43:07.221677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31085. [D 20:43:07.221692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31086. [D 20:43:07.221708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31087. [D 20:43:07.221723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31088. [D 20:43:07.221737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31089. [D 20:43:07.221752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31090. [D 20:43:07.221767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31091. [D 20:43:07.221782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31092. [D 20:43:07.221797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31093. [D 20:43:07.221812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31094. [D 20:43:07.221827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31095. [D 20:43:07.221842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31096. [D 20:43:07.221857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31097. [D 20:43:07.221872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31098. [D 20:43:07.221887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31099. [D 20:43:07.221902] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fc10 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31100. [D 20:43:07.221961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.221983] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.221996] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.227179] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5436 [D 20:43:07.227253] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 47/70. [D 20:43:07.227975] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5435 [D 20:43:07.228006] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 48/70. [D 20:43:07.233034] openib_check_cq: completed rdma wr_id 2aaaab60fc10, nic_wr_credit 31100. [D 20:43:07.233061] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 49/70. [D 20:43:07.233146] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.233168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.233182] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.238289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31100. [D 20:43:07.238315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31101. [D 20:43:07.238329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31102. [D 20:43:07.238344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31103. [D 20:43:07.238359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31104. [D 20:43:07.238374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31105. [D 20:43:07.238398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31106. [D 20:43:07.238413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31107. [D 20:43:07.238437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31108. [D 20:43:07.238452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31109. [D 20:43:07.238475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31110. [D 20:43:07.238501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31111. [D 20:43:07.238517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31112. [D 20:43:07.238541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31113. [D 20:43:07.238556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31114. [D 20:43:07.238578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31115. [D 20:43:07.238593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31116. [D 20:43:07.238615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31117. [D 20:43:07.238644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31118. [D 20:43:07.238658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31119. [D 20:43:07.238683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31120. [D 20:43:07.238698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31121. [D 20:43:07.238713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31122. [D 20:43:07.238728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31123. [D 20:43:07.238743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31124. [D 20:43:07.238767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31125. [D 20:43:07.238782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31126. [D 20:43:07.238812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31127. [D 20:43:07.238827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31128. [D 20:43:07.238842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31129. [D 20:43:07.238857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31130. [D 20:43:07.238872] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31131. [D 20:43:07.238892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 31132. [D 20:43:07.238907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 31133. [D 20:43:07.238921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 31134. [D 20:43:07.238935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 31135. [D 20:43:07.238950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 31136. [D 20:43:07.238965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 31137. [D 20:43:07.238979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 31138. [D 20:43:07.238994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 31139. [D 20:43:07.239009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 31140. [D 20:43:07.239024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 31141. [D 20:43:07.239039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 31142. [D 20:43:07.239054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 31143. [D 20:43:07.239068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 31144. [D 20:43:07.239083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 31145. [D 20:43:07.239098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 31146. [D 20:43:07.239112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 31147. [D 20:43:07.239127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 31148. [D 20:43:07.239142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 31149. [D 20:43:07.239157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 31150. [D 20:43:07.239171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 31151. [D 20:43:07.239186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 31152. [D 20:43:07.239201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 31153. [D 20:43:07.239216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 31154. [D 20:43:07.239231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 31155. [D 20:43:07.239245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31156. [D 20:43:07.239260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31157. [D 20:43:07.239275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31158. [D 20:43:07.239290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31159. [D 20:43:07.239305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31160. [D 20:43:07.239319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31161. [D 20:43:07.239334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31162. [D 20:43:07.239349] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fa20 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31163. [D 20:43:07.247974] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.247997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.248010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.248051] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5440 [D 20:43:07.248066] element 0: offset: 0x2aaaab027990, size: 24 [D 20:43:07.248083] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 50/70. [D 20:43:07.248110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.248123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.248136] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.248156] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5442 [D 20:43:07.248170] element 0: offset: 0x2aaaab036ee0, size: 24 [D 20:43:07.248184] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 51/70. [D 20:43:07.250045] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31163. [D 20:43:07.250064] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 52/70. [D 20:43:07.261636] openib_check_cq: completed rdma wr_id 2aaaab60fa20, nic_wr_credit 31162. [D 20:43:07.261665] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 53/70. [D 20:43:07.261713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.261731] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.261744] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.261858] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.261873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.261885] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.267670] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5440 [D 20:43:07.267740] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 54/70. [D 20:43:07.267816] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5442 [D 20:43:07.267833] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 55/70. [D 20:43:07.272550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31162. [D 20:43:07.272575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31163. [D 20:43:07.272590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31164. [D 20:43:07.272605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31165. [D 20:43:07.272620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31166. [D 20:43:07.272634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31167. [D 20:43:07.272649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31168. [D 20:43:07.272664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31169. [D 20:43:07.272678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31170. [D 20:43:07.272693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31171. [D 20:43:07.272708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31172. [D 20:43:07.272722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31173. [D 20:43:07.272737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31174. [D 20:43:07.272751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31175. [D 20:43:07.272766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31176. [D 20:43:07.272781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31177. [D 20:43:07.272796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31178. [D 20:43:07.272811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31179. [D 20:43:07.272826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31180. [D 20:43:07.272840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31181. [D 20:43:07.272855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31182. [D 20:43:07.272869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31183. [D 20:43:07.272884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31184. [D 20:43:07.272898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31185. [D 20:43:07.272913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31186. [D 20:43:07.272927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31187. [D 20:43:07.272942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31188. [D 20:43:07.272956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31189. [D 20:43:07.272971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31190. [D 20:43:07.272985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31191. [D 20:43:07.273000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31192. [D 20:43:07.273014] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31193. [D 20:43:07.273030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 31194. [D 20:43:07.273045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 31195. [D 20:43:07.273060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31196. [D 20:43:07.273074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31197. [D 20:43:07.273089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31198. [D 20:43:07.273103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31199. [D 20:43:07.273118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31200. [D 20:43:07.273132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31201. [D 20:43:07.273147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31202. [D 20:43:07.273161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31203. [D 20:43:07.273176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31204. [D 20:43:07.273190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31205. [D 20:43:07.273205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31206. [D 20:43:07.273219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31207. [D 20:43:07.273234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31208. [D 20:43:07.273248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31209. [D 20:43:07.273263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31210. [D 20:43:07.273277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31211. [D 20:43:07.273292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31212. [D 20:43:07.273306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31213. [D 20:43:07.273320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31214. [D 20:43:07.273335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31215. [D 20:43:07.273350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31216. [D 20:43:07.273363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31217. [D 20:43:07.273378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31218. [D 20:43:07.273393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31219. [D 20:43:07.273407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31220. [D 20:43:07.273421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31221. [D 20:43:07.273436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31222. [D 20:43:07.273450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31223. [D 20:43:07.273465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31224. [D 20:43:07.273479] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fa20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31225. [D 20:43:07.275264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.275285] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.275299] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.275341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5447 [D 20:43:07.275356] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:07.275372] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 56/70. [D 20:43:07.275408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.275424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.275436] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.275458] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5448 [D 20:43:07.275472] element 0: offset: 0x2aaaab036a10, size: 24 [D 20:43:07.275486] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 57/70. [D 20:43:07.279417] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31225. [D 20:43:07.279444] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 58/70. [D 20:43:07.287856] openib_check_cq: completed rdma wr_id 2aaaab60fa20, nic_wr_credit 31224. [D 20:43:07.287878] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 59/70. [D 20:43:07.287932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.287957] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.287971] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.288080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.288095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.288108] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.291075] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5447 [D 20:43:07.291142] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 60/70. [D 20:43:07.293524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 31224. [D 20:43:07.293547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 31225. [D 20:43:07.293562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 31226. [D 20:43:07.293576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 31227. [D 20:43:07.293600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 31228. [D 20:43:07.293616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 31229. [D 20:43:07.293643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 31230. [D 20:43:07.293658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 31231. [D 20:43:07.293673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 31232. [D 20:43:07.293688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 31233. [D 20:43:07.293703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 31234. [D 20:43:07.293730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 31235. [D 20:43:07.293758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 31236. [D 20:43:07.293773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 31237. [D 20:43:07.293797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 31238. [D 20:43:07.293812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 31239. [D 20:43:07.293839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 31240. [D 20:43:07.293864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 31241. [D 20:43:07.293880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 31242. [D 20:43:07.293907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 31243. [D 20:43:07.293933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 31244. [D 20:43:07.293948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 31245. [D 20:43:07.293975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 31246. [D 20:43:07.294000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 31247. [D 20:43:07.294016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31248. [D 20:43:07.294279] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5448 [D 20:43:07.592498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31249. [D 20:43:07.592527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31250. [D 20:43:07.592542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31251. [D 20:43:07.592557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31252. [D 20:43:07.592575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31253. [D 20:43:07.592589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31254. [D 20:43:07.592604] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31255. [D 20:43:07.592642] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 0/70. [D 20:43:07.592714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.592736] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.592751] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.592794] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5452 [D 20:43:07.592810] element 0: offset: 0x2aaaab017610, size: 24 [D 20:43:07.592825] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 1/70. [D 20:43:07.593966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.593985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.593968] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31255. [D 20:43:07.593997] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.594033] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 2/70. [D 20:43:07.594049] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5454 [D 20:43:07.594073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31255. [D 20:43:07.594083] element 0: offset: 0x2aaaab01c4b0, size: 24 [D 20:43:07.594099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31256. [D 20:43:07.594173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31257. [D 20:43:07.594188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31258. [D 20:43:07.594202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31259. [D 20:43:07.594217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31260. [D 20:43:07.594235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31261. [D 20:43:07.594250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31262. [D 20:43:07.594264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31263. [D 20:43:07.594279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31264. [D 20:43:07.594294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31265. [D 20:43:07.594309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31266. [D 20:43:07.594323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31267. [D 20:43:07.594339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31268. [D 20:43:07.594354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31269. [D 20:43:07.594368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31270. [D 20:43:07.594383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31271. [D 20:43:07.594397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31272. [D 20:43:07.594412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31273. [D 20:43:07.594427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31274. [D 20:43:07.594441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31275. [D 20:43:07.594456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31276. [D 20:43:07.594471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31277. [D 20:43:07.594485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31278. [D 20:43:07.594500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31279. [D 20:43:07.594514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31280. [D 20:43:07.594528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31281. [D 20:43:07.594543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31282. [D 20:43:07.594558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31283. [D 20:43:07.594572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31284. [D 20:43:07.594587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31285. [D 20:43:07.594601] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f650 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31286. [D 20:43:07.594629] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 3/70. [D 20:43:07.594681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.594695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.594708] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.600046] openib_check_cq: completed rdma wr_id 2aaaab60f650, nic_wr_credit 31286. [D 20:43:07.600113] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 4/70. [D 20:43:07.603107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.603130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.603144] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.611179] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.611236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.611250] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.611295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5458 [D 20:43:07.611311] element 0: offset: 0x2aaaab038df0, size: 24 [D 20:43:07.611328] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 5/70. [D 20:43:07.611359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.611373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.611389] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.611412] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5460 [D 20:43:07.611426] element 0: offset: 0x2aaaab014930, size: 24 [D 20:43:07.611441] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 6/70. [D 20:43:07.616052] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5452 [D 20:43:07.616125] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 7/70. [D 20:43:07.616280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31286. [D 20:43:07.616319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31287. [D 20:43:07.616334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31288. [D 20:43:07.616349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31289. [D 20:43:07.616364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31290. [D 20:43:07.616379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31291. [D 20:43:07.616393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31292. [D 20:43:07.616408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31293. [D 20:43:07.616422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31294. [D 20:43:07.616437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31295. [D 20:43:07.616451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31296. [D 20:43:07.616466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31297. [D 20:43:07.616480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31298. [D 20:43:07.616495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31299. [D 20:43:07.616510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31300. [D 20:43:07.616524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31301. [D 20:43:07.616549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31302. [D 20:43:07.616573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31303. [D 20:43:07.616588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31304. [D 20:43:07.616603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31305. [D 20:43:07.616630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31306. [D 20:43:07.616654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31307. [D 20:43:07.616669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31308. [D 20:43:07.616696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31309. [D 20:43:07.616711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31310. [D 20:43:07.616737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31311. [D 20:43:07.616765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31312. [D 20:43:07.616780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31313. [D 20:43:07.616804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31314. [D 20:43:07.616819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31315. [D 20:43:07.616834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31316. [D 20:43:07.616861] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31317. [D 20:43:07.618789] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5454 [D 20:43:07.618849] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 8/70. [D 20:43:07.618912] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5458 [D 20:43:07.618929] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 9/70. [D 20:43:07.618977] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5460 [D 20:43:07.618995] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 10/70. [D 20:43:07.627973] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31317. [D 20:43:07.628000] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 11/70. [D 20:43:07.628017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31317. [D 20:43:07.628032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31318. [D 20:43:07.628047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31319. [D 20:43:07.628062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31320. [D 20:43:07.628076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31321. [D 20:43:07.628091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31322. [D 20:43:07.628105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31323. [D 20:43:07.628120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31324. [D 20:43:07.628134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31325. [D 20:43:07.628148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31326. [D 20:43:07.628163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31327. [D 20:43:07.628177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31328. [D 20:43:07.628192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31329. [D 20:43:07.628206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31330. [D 20:43:07.628234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31331. [D 20:43:07.628260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31332. [D 20:43:07.628275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31333. [D 20:43:07.628290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31334. [D 20:43:07.628305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31335. [D 20:43:07.628319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31336. [D 20:43:07.628334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31337. [D 20:43:07.628353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31338. [D 20:43:07.628367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31339. [D 20:43:07.628382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31340. [D 20:43:07.628396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31341. [D 20:43:07.628411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31342. [D 20:43:07.628425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31343. [D 20:43:07.628440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31344. [D 20:43:07.628454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31345. [D 20:43:07.628469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31346. [D 20:43:07.628483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31347. [D 20:43:07.628498] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f540 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31348. [D 20:43:07.628514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 31349. [D 20:43:07.628529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 31350. [D 20:43:07.628543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 31351. [D 20:43:07.628558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 31352. [D 20:43:07.628573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 31353. [D 20:43:07.628587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 31354. [D 20:43:07.628601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 31355. [D 20:43:07.628616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 31356. [D 20:43:07.628630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 31357. [D 20:43:07.628645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 31358. [D 20:43:07.628659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 31359. [D 20:43:07.628674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 31360. [D 20:43:07.628688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 31361. [D 20:43:07.628703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 31362. [D 20:43:07.628717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 31363. [D 20:43:07.628733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 31364. [D 20:43:07.628748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 31365. [D 20:43:07.628762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 31366. [D 20:43:07.628777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 31367. [D 20:43:07.628791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 31368. [D 20:43:07.628805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 31369. [D 20:43:07.628820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 31370. [D 20:43:07.628834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 31371. [D 20:43:07.628849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 31372. [D 20:43:07.628863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31373. [D 20:43:07.628878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31374. [D 20:43:07.628892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31375. [D 20:43:07.628907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31376. [D 20:43:07.628921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31377. [D 20:43:07.628935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31378. [D 20:43:07.628950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31379. [D 20:43:07.628964] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d790 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31380. [D 20:43:07.628980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31381. [D 20:43:07.628995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31382. [D 20:43:07.629010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31383. [D 20:43:07.629024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31384. [D 20:43:07.629038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31385. [D 20:43:07.629053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31386. [E 20:43:07.629071] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 31387, block for 10 ms. [D 20:43:07.629167] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31386. [D 20:43:07.629186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31387. [E 20:43:07.629202] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 31388, block for 10 ms. [D 20:43:07.634023] openib_check_cq: completed rdma wr_id 2aaaab60f540, nic_wr_credit 31387. [D 20:43:07.634045] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 12/70. [D 20:43:07.634060] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31386. [D 20:43:07.634076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31387. [D 20:43:07.634091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31388. [D 20:43:07.634105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31389. [D 20:43:07.634120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31390. [D 20:43:07.634135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31391. [D 20:43:07.634149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31392. [D 20:43:07.634163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31393. [D 20:43:07.634178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31394. [D 20:43:07.634192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31395. [D 20:43:07.634207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31396. [D 20:43:07.634222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31397. [D 20:43:07.634236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31398. [D 20:43:07.634251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31399. [D 20:43:07.634265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31400. [D 20:43:07.634280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31401. [D 20:43:07.634295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31402. [D 20:43:07.634309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31403. [D 20:43:07.634324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31404. [D 20:43:07.634338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31405. [D 20:43:07.634353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31406. [D 20:43:07.634368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31407. [D 20:43:07.634382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31408. [D 20:43:07.634396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31409. [D 20:43:07.634411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31410. [D 20:43:07.634426] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab62e550 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31411. [D 20:43:07.634505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.634528] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.634541] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.636574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.636589] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.636601] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:07.636639] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5463 [D 20:43:07.636657] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:07.636674] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 13/70. [D 20:43:07.639939] openib_check_cq: completed rdma wr_id 2aaaab60d790, nic_wr_credit 31411. [D 20:43:07.639970] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 14/70. [D 20:43:07.641066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.641084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.641097] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:07.645834] openib_check_cq: completed rdma wr_id 2aaaab62e550, nic_wr_credit 31410. [D 20:43:07.645859] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 15/70. [D 20:43:07.645917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.645935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.645947] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.646030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.646045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.646057] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:07.648966] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5463 [D 20:43:07.649027] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 16/70. [D 20:43:07.658111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31410. [D 20:43:07.658136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31411. [D 20:43:07.658150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31412. [D 20:43:07.658165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31413. [D 20:43:07.658179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31414. [D 20:43:07.658194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31415. [D 20:43:07.658209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31416. [D 20:43:07.658223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31417. [D 20:43:07.658238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31418. [D 20:43:07.658252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31419. [D 20:43:07.658267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31420. [D 20:43:07.658282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31421. [D 20:43:07.658296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31422. [D 20:43:07.658311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31423. [D 20:43:07.658325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31424. [D 20:43:07.658340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31425. [D 20:43:07.658355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31426. [D 20:43:07.658369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31427. [D 20:43:07.658384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31428. [D 20:43:07.658399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31429. [D 20:43:07.658414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31430. [D 20:43:07.658429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31431. [D 20:43:07.658443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31432. [D 20:43:07.658458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31433. [D 20:43:07.658473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31434. [D 20:43:07.658487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31435. [D 20:43:07.658501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31436. [D 20:43:07.658516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31437. [D 20:43:07.658530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31438. [D 20:43:07.658545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31439. [D 20:43:07.658559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31440. [D 20:43:07.658574] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31441. [D 20:43:07.661014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.661038] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.661052] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:07.661093] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5468 [D 20:43:07.661109] element 0: offset: 0x2aaaab027940, size: 24 [D 20:43:07.661126] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 17/70. [D 20:43:07.661164] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.661178] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.661191] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.661211] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5469 [D 20:43:07.661225] element 0: offset: 0x2aaaab027990, size: 24 [D 20:43:07.661239] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 18/70. [D 20:43:07.664013] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31441. [D 20:43:07.664038] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 19/70. [D 20:43:07.664191] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.664213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.664225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.668032] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5468 [D 20:43:07.668099] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 20/70. [D 20:43:07.669653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31441. [D 20:43:07.669678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 31442. [D 20:43:07.669693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 31443. [D 20:43:07.669708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 31444. [D 20:43:07.669722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 31445. [D 20:43:07.669737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 31446. [D 20:43:07.669753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31447. [D 20:43:07.669778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31448. [D 20:43:07.669793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31449. [D 20:43:07.669808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 31450. [D 20:43:07.669831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 31451. [D 20:43:07.669846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 31452. [D 20:43:07.669873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 31453. [D 20:43:07.669888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 31454. [D 20:43:07.669913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31455. [D 20:43:07.669928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31456. [D 20:43:07.669955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31457. [D 20:43:07.669970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 31458. [D 20:43:07.669996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 31459. [D 20:43:07.670023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 31460. [D 20:43:07.670038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 31461. [D 20:43:07.670062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 31462. [D 20:43:07.670077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31463. [D 20:43:07.670092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31464. [D 20:43:07.670120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31465. [D 20:43:07.670144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 31466. [D 20:43:07.670159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 31467. [D 20:43:07.670187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 31468. [D 20:43:07.670202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 31469. [D 20:43:07.670217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 31470. [D 20:43:07.670247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31471. [D 20:43:07.670230] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5469 [D 20:43:07.670275] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31472. [D 20:43:07.670834] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 21/70. [D 20:43:07.672339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.672359] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.672372] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.672416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5472 [D 20:43:07.672432] element 0: offset: 0x63c820, size: 24 [D 20:43:07.672448] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 22/70. [D 20:43:07.681404] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31472. [D 20:43:07.681429] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 23/70. [D 20:43:07.681445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31472. [D 20:43:07.681474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31473. [D 20:43:07.681502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31474. [D 20:43:07.681518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31475. [D 20:43:07.681532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31476. [D 20:43:07.681547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31477. [D 20:43:07.681561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31478. [D 20:43:07.681576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31479. [D 20:43:07.681591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31480. [D 20:43:07.681605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31481. [D 20:43:07.681620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31482. [D 20:43:07.681635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31483. [D 20:43:07.681649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31484. [D 20:43:07.681664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31485. [D 20:43:07.681678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31486. [D 20:43:07.681693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31487. [D 20:43:07.681707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31488. [D 20:43:07.681722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31489. [D 20:43:07.681737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31490. [D 20:43:07.681751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31491. [D 20:43:07.681765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31492. [D 20:43:07.681780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31493. [D 20:43:07.681795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31494. [D 20:43:07.681810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31495. [D 20:43:07.681824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31496. [D 20:43:07.681838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31497. [D 20:43:07.681853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31498. [D 20:43:07.681869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31499. [D 20:43:07.681884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31500. [D 20:43:07.681898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31501. [D 20:43:07.681913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31502. [D 20:43:07.681928] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d790 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31503. [D 20:43:07.681992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.682013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.682026] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.685093] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5472 [D 20:43:07.685166] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 24/70. [D 20:43:07.693096] openib_check_cq: completed rdma wr_id 2aaaab60d790, nic_wr_credit 31503. [D 20:43:07.693122] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 25/70. [D 20:43:07.693198] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.693220] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.693232] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:07.699240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31503. [D 20:43:07.699266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31504. [D 20:43:07.699280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31505. [D 20:43:07.699295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31506. [D 20:43:07.699309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31507. [D 20:43:07.699339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31508. [D 20:43:07.699354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31509. [D 20:43:07.699379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31510. [D 20:43:07.699405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31511. [D 20:43:07.699420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31512. [D 20:43:07.699435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31513. [D 20:43:07.699459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31514. [D 20:43:07.699485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31515. [D 20:43:07.699500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31516. [D 20:43:07.699524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31517. [D 20:43:07.699538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31518. [D 20:43:07.699552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31519. [D 20:43:07.699579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31520. [D 20:43:07.699604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31521. [D 20:43:07.699620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31522. [D 20:43:07.699647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31523. [D 20:43:07.699662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31524. [D 20:43:07.699685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31525. [D 20:43:07.699712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31526. [D 20:43:07.699736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31527. [D 20:43:07.699752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31528. [D 20:43:07.699766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31529. [D 20:43:07.699781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31530. [D 20:43:07.699795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31531. [D 20:43:07.699810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31532. [D 20:43:07.699824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31533. [D 20:43:07.699839] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31534. [D 20:43:07.708065] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.708087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.708100] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:07.708140] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5477 [D 20:43:07.708155] element 0: offset: 0x5b0030, size: 24 [D 20:43:07.708171] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 26/70. [D 20:43:07.708209] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.708223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.708236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.708256] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5478 [D 20:43:07.708270] element 0: offset: 0x691fe0, size: 24 [D 20:43:07.708285] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 27/70. [D 20:43:07.711015] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31534. [D 20:43:07.711038] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 28/70. [D 20:43:07.711229] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.711250] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.711262] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.716051] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5477 [D 20:43:07.716129] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 29/70. [D 20:43:07.716822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31534. [D 20:43:07.716846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 31535. [D 20:43:07.716861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 31536. [D 20:43:07.716876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 31537. [D 20:43:07.716892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 31538. [D 20:43:07.716907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 31539. [D 20:43:07.716921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31540. [D 20:43:07.716936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31541. [D 20:43:07.716968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31542. [D 20:43:07.716994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 31543. [D 20:43:07.717009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 31544. [D 20:43:07.717036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 31545. [D 20:43:07.717052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 31546. [D 20:43:07.717067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 31547. [D 20:43:07.717082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31548. [D 20:43:07.717110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31549. [D 20:43:07.717124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31550. [D 20:43:07.717139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 31551. [D 20:43:07.717154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 31552. [D 20:43:07.717185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 31553. [D 20:43:07.717200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 31554. [D 20:43:07.717229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 31555. [D 20:43:07.717253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31556. [D 20:43:07.717268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31557. [D 20:43:07.717296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31558. [D 20:43:07.717321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 31559. [D 20:43:07.717337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 31560. [D 20:43:07.717365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 31561. [D 20:43:07.717389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 31562. [D 20:43:07.717404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 31563. [D 20:43:07.717433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31564. [D 20:43:07.717447] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31565. [D 20:43:07.717708] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5478 [D 20:43:07.717779] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 30/70. [D 20:43:07.719483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:07.719503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.719516] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:07.719557] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5481 [D 20:43:07.719572] element 0: offset: 0x61e400, size: 24 [D 20:43:07.719589] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 31/70. [D 20:43:07.728521] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31565. [D 20:43:07.728546] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 32/70. [D 20:43:07.728569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31565. [D 20:43:07.728585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31566. [D 20:43:07.728600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31567. [D 20:43:07.728629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31568. [D 20:43:07.728653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31569. [D 20:43:07.728668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31570. [D 20:43:07.728683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31571. [D 20:43:07.728697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31572. [D 20:43:07.728713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31573. [D 20:43:07.728728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31574. [D 20:43:07.728742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31575. [D 20:43:07.728762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31576. [D 20:43:07.728777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31577. [D 20:43:07.728792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31578. [D 20:43:07.728807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31579. [D 20:43:07.728821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31580. [D 20:43:07.728836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31581. [D 20:43:07.728851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31582. [D 20:43:07.728866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31583. [D 20:43:07.728881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31584. [D 20:43:07.728896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31585. [D 20:43:07.728911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31586. [D 20:43:07.728926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31587. [D 20:43:07.728940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31588. [D 20:43:07.728956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31589. [D 20:43:07.728971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31590. [D 20:43:07.728986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31591. [D 20:43:07.729000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31592. [D 20:43:07.729015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31593. [D 20:43:07.729030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31594. [D 20:43:07.729045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31595. [D 20:43:07.729059] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d790 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31596. [D 20:43:07.729129] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.729159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.729172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:07.731815] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5481 [D 20:43:07.731870] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 33/70. [D 20:43:07.740226] openib_check_cq: completed rdma wr_id 2aaaab60d790, nic_wr_credit 31596. [D 20:43:07.740253] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 34/70. [D 20:43:07.740329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:07.740352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:07.740364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:07.746265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31596. [D 20:43:07.746290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31597. [D 20:43:07.746305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31598. [D 20:43:07.746320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31599. [D 20:43:07.746334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31600. [D 20:43:07.746349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31601. [D 20:43:07.746363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31602. [D 20:43:07.746387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31603. [D 20:43:07.746402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31604. [D 20:43:07.746425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31605. [D 20:43:07.746440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31606. [D 20:43:07.746467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31607. [D 20:43:07.746482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31608. [D 20:43:07.746506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31609. [D 20:43:07.746521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31610. [D 20:43:08.018168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31611. [D 20:43:08.018191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31612. [D 20:43:08.018206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31613. [D 20:43:08.018233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31614. [D 20:43:08.018248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31615. [D 20:43:08.018263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31616. [D 20:43:08.018278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31617. [D 20:43:08.018292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31618. [D 20:43:08.018307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31619. [D 20:43:08.018331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31620. [D 20:43:08.018895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31621. [D 20:43:08.018913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31622. [D 20:43:08.018927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31623. [D 20:43:08.018942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31624. [D 20:43:08.018969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31625. [D 20:43:08.018984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31626. [D 20:43:08.018998] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31627. [D 20:43:08.019123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.019146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.019159] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.019199] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5485 [D 20:43:08.019214] element 0: offset: 0x5b0030, size: 24 [D 20:43:08.019231] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 35/70. [D 20:43:08.019265] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.019279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.019291] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.019312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5487 [D 20:43:08.019326] element 0: offset: 0x63c820, size: 24 [D 20:43:08.019344] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 36/70. [D 20:43:08.019371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.019385] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.019397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.019416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5490 [D 20:43:08.019430] element 0: offset: 0x67edf0, size: 24 [D 20:43:08.019445] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 37/70. [D 20:43:08.021461] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31627. [D 20:43:08.021487] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 38/70. [D 20:43:08.021801] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.021824] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.021837] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.034357] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5485 [D 20:43:08.034436] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 39/70. [D 20:43:08.034507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 31627. [D 20:43:08.034527] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5487 [D 20:43:08.034536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 31628. [D 20:43:08.034559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 31629. [D 20:43:08.034574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 31630. [D 20:43:08.034590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 31631. [D 20:43:08.034604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 31632. [D 20:43:08.034619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31633. [D 20:43:08.034633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31634. [D 20:43:08.034648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31635. [D 20:43:08.034662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 31636. [D 20:43:08.034677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 31637. [D 20:43:08.034691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 31638. [D 20:43:08.034706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 31639. [D 20:43:08.034720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 31640. [D 20:43:08.034735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31641. [D 20:43:08.034749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31642. [D 20:43:08.034764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31643. [D 20:43:08.034779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 31644. [D 20:43:08.034793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 31645. [D 20:43:08.034808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 31646. [D 20:43:08.034822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 31647. [D 20:43:08.034841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 31648. [D 20:43:08.034855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31649. [D 20:43:08.034869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31650. [D 20:43:08.034884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31651. [D 20:43:08.034898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 31652. [D 20:43:08.034913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 31653. [D 20:43:08.034927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 31654. [D 20:43:08.034942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 31655. [D 20:43:08.034956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 31656. [D 20:43:08.034971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31657. [D 20:43:08.034986] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31658. [D 20:43:08.035011] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 40/70. [D 20:43:08.035039] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5490 [D 20:43:08.035055] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 41/70. [D 20:43:08.040391] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31658. [D 20:43:08.040417] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 42/70. [D 20:43:08.040434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31658. [D 20:43:08.040449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31659. [D 20:43:08.040464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31660. [D 20:43:08.040479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31661. [D 20:43:08.040494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31662. [D 20:43:08.040508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31663. [D 20:43:08.040523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31664. [D 20:43:08.040537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31665. [D 20:43:08.040552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31666. [D 20:43:08.040566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31667. [D 20:43:08.040581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31668. [D 20:43:08.040595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31669. [D 20:43:08.040610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31670. [D 20:43:08.040624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31671. [D 20:43:08.040639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31672. [D 20:43:08.040654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31673. [D 20:43:08.040668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31674. [D 20:43:08.040683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31675. [D 20:43:08.040697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31676. [D 20:43:08.040712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31677. [D 20:43:08.040727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31678. [D 20:43:08.040741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31679. [D 20:43:08.040756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31680. [D 20:43:08.040770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31681. [D 20:43:08.040785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31682. [D 20:43:08.040799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31683. [D 20:43:08.040813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31684. [D 20:43:08.040828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31685. [D 20:43:08.040842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31686. [D 20:43:08.040857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31687. [D 20:43:08.040871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31688. [D 20:43:08.040885] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f540 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31689. [D 20:43:08.040902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31690. [D 20:43:08.040917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31691. [D 20:43:08.040931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31692. [D 20:43:08.040946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31693. [D 20:43:08.040960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31694. [D 20:43:08.040975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31695. [D 20:43:08.040989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31696. [D 20:43:08.041003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31697. [D 20:43:08.041018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31698. [D 20:43:08.041032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31699. [D 20:43:08.041047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31700. [D 20:43:08.041061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31701. [D 20:43:08.041075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31702. [D 20:43:08.041090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31703. [D 20:43:08.041104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31704. [D 20:43:08.041118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31705. [D 20:43:08.041133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31706. [D 20:43:08.041148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31707. [D 20:43:08.041163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31708. [D 20:43:08.041177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31709. [D 20:43:08.041192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31710. [D 20:43:08.041206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31711. [D 20:43:08.041221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31712. [D 20:43:08.041235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31713. [D 20:43:08.041250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31714. [D 20:43:08.041264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31715. [D 20:43:08.041278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31716. [D 20:43:08.041293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31717. [D 20:43:08.041307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31718. [D 20:43:08.041322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31719. [D 20:43:08.041336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31720. [D 20:43:08.041350] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31721. [D 20:43:08.041415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.041436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.041449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.046362] openib_check_cq: completed rdma wr_id 2aaaab60f540, nic_wr_credit 31721. [D 20:43:08.046386] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 43/70. [D 20:43:08.052240] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 31720. [D 20:43:08.052262] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 44/70. [D 20:43:08.052328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.052348] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.052361] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:08.052386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.052400] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.052412] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:08.066348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.066364] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.066377] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:08.066415] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5494 [D 20:43:08.066430] element 0: offset: 0x658610, size: 24 [D 20:43:08.066447] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 45/70. [D 20:43:08.066493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.066506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.066519] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.066539] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5496 [D 20:43:08.066552] element 0: offset: 0x5b0030, size: 24 [D 20:43:08.066570] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 46/70. [D 20:43:08.071011] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5496 [D 20:43:08.071087] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 47/70. [D 20:43:08.071146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31720. [D 20:43:08.071174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31721. [D 20:43:08.071189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31722. [D 20:43:08.071204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31723. [D 20:43:08.071218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31724. [D 20:43:08.071233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31725. [D 20:43:08.071247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31726. [D 20:43:08.071261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31727. [D 20:43:08.071276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31728. [D 20:43:08.071291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31729. [D 20:43:08.071305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31730. [D 20:43:08.071320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31731. [D 20:43:08.071334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31732. [D 20:43:08.071348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31733. [D 20:43:08.071363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31734. [D 20:43:08.071377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31735. [D 20:43:08.071392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31736. [D 20:43:08.071406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31737. [D 20:43:08.071421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31738. [D 20:43:08.071435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31739. [D 20:43:08.071450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31740. [D 20:43:08.071465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31741. [D 20:43:08.071479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31742. [D 20:43:08.071493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31743. [D 20:43:08.071508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31744. [D 20:43:08.071522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31745. [D 20:43:08.071536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31746. [D 20:43:08.071551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31747. [D 20:43:08.071566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31748. [D 20:43:08.071580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31749. [D 20:43:08.071595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31750. [D 20:43:08.071609] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f8a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31751. [D 20:43:08.072890] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5494 [D 20:43:08.072956] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 48/70. [D 20:43:08.079815] openib_check_cq: completed rdma wr_id 2aaaab60f8a0, nic_wr_credit 31751. [D 20:43:08.079840] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 49/70. [D 20:43:08.079861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31751. [D 20:43:08.079876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31752. [D 20:43:08.079891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31753. [D 20:43:08.079906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31754. [D 20:43:08.079920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31755. [D 20:43:08.079935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31756. [D 20:43:08.079949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31757. [D 20:43:08.079967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31758. [D 20:43:08.079982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31759. [D 20:43:08.079996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31760. [D 20:43:08.080011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31761. [D 20:43:08.080025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31762. [D 20:43:08.080040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31763. [D 20:43:08.080054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31764. [D 20:43:08.080068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31765. [D 20:43:08.080083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31766. [D 20:43:08.080097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31767. [D 20:43:08.080111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31768. [D 20:43:08.080126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31769. [D 20:43:08.080140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31770. [D 20:43:08.080155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31771. [D 20:43:08.080169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31772. [D 20:43:08.080190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31773. [D 20:43:08.080205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31774. [D 20:43:08.080219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31775. [D 20:43:08.080234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31776. [D 20:43:08.080248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31777. [D 20:43:08.080263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31778. [D 20:43:08.080277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31779. [D 20:43:08.080291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31780. [D 20:43:08.080306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31781. [D 20:43:08.080321] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f540 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31782. [D 20:43:08.080396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.080418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.080432] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:08.091632] openib_check_cq: completed rdma wr_id 2aaaab60f540, nic_wr_credit 31782. [D 20:43:08.091657] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 50/70. [D 20:43:08.091762] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.091782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.091794] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:08.109410] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.109428] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.109440] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:08.109480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5500 [D 20:43:08.109495] element 0: offset: 0x633e90, size: 24 [D 20:43:08.109514] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 51/70. [D 20:43:08.109554] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.109568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.109580] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.109600] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5502 [D 20:43:08.109614] element 0: offset: 0x2aaaab60dbb0, size: 24 [D 20:43:08.109629] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 52/70. [D 20:43:08.115600] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5500 [D 20:43:08.115670] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 53/70. [D 20:43:08.115727] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5502 [D 20:43:08.115729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31782. [D 20:43:08.115769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31783. [D 20:43:08.115788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31784. [D 20:43:08.115807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31785. [D 20:43:08.115822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31786. [D 20:43:08.115837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31787. [D 20:43:08.115852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31788. [D 20:43:08.115867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31789. [D 20:43:08.115881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31790. [D 20:43:08.115896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31791. [D 20:43:08.115910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31792. [D 20:43:08.115925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31793. [D 20:43:08.115940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31794. [D 20:43:08.115954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31795. [D 20:43:08.115973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31796. [D 20:43:08.115988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31797. [D 20:43:08.116002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31798. [D 20:43:08.116017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31799. [D 20:43:08.116031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31800. [D 20:43:08.116046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31801. [D 20:43:08.116061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31802. [D 20:43:08.116076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31803. [D 20:43:08.116090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31804. [D 20:43:08.116105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31805. [D 20:43:08.116119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31806. [D 20:43:08.116134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31807. [D 20:43:08.116149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31808. [D 20:43:08.116163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31809. [D 20:43:08.116178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31810. [D 20:43:08.116193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31811. [D 20:43:08.116207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31812. [D 20:43:08.116222] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dcf0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31813. [D 20:43:08.116255] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 54/70. [D 20:43:08.125907] openib_check_cq: completed rdma wr_id 2aaaab60dcf0, nic_wr_credit 31813. [D 20:43:08.125933] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 55/70. [D 20:43:08.125955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31813. [D 20:43:08.125971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31814. [D 20:43:08.125986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31815. [D 20:43:08.126000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31816. [D 20:43:08.126015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31817. [D 20:43:08.126029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31818. [D 20:43:08.126044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31819. [D 20:43:08.126058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31820. [D 20:43:08.126072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31821. [D 20:43:08.126087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31822. [D 20:43:08.126101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31823. [D 20:43:08.126116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31824. [D 20:43:08.126131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31825. [D 20:43:08.126145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31826. [D 20:43:08.126159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31827. [D 20:43:08.126174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31828. [D 20:43:08.126188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31829. [D 20:43:08.126203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31830. [D 20:43:08.126217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31831. [D 20:43:08.126232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31832. [D 20:43:08.126246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31833. [D 20:43:08.126261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31834. [D 20:43:08.126276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31835. [D 20:43:08.126290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31836. [D 20:43:08.126305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31837. [D 20:43:08.126319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31838. [D 20:43:08.126333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31839. [D 20:43:08.126348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31840. [D 20:43:08.126362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31841. [D 20:43:08.126377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31842. [D 20:43:08.126392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31843. [D 20:43:08.126407] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dac0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31844. [D 20:43:08.126475] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.126496] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.126509] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:08.137605] openib_check_cq: completed rdma wr_id 2aaaab60dac0, nic_wr_credit 31844. [D 20:43:08.137630] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 56/70. [D 20:43:08.137740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.137759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.137771] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:08.152471] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.152489] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.152501] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:08.152540] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5506 [D 20:43:08.152555] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:08.152571] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 57/70. [D 20:43:08.152607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.152621] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.152634] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.152654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5508 [D 20:43:08.152668] element 0: offset: 0x2aaaab60dc00, size: 24 [D 20:43:08.152682] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 58/70. [D 20:43:08.156007] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5506 [D 20:43:08.156037] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 59/70. [D 20:43:08.156094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31844. [D 20:43:08.156111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31845. [D 20:43:08.156126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31846. [D 20:43:08.156141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31847. [D 20:43:08.156156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31848. [D 20:43:08.156170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31849. [D 20:43:08.156185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31850. [D 20:43:08.156199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31851. [D 20:43:08.156214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31852. [D 20:43:08.156229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31853. [D 20:43:08.156243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31854. [D 20:43:08.156258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31855. [D 20:43:08.156272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31856. [D 20:43:08.156287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31857. [D 20:43:08.156303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31858. [D 20:43:08.156317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31859. [D 20:43:08.156331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31860. [D 20:43:08.156346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31861. [D 20:43:08.156360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31862. [D 20:43:08.156375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31863. [D 20:43:08.156389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31864. [D 20:43:08.156404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31865. [D 20:43:08.156418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31866. [D 20:43:08.156433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31867. [D 20:43:08.156448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31868. [D 20:43:08.156462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31869. [D 20:43:08.156476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31870. [D 20:43:08.156491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31871. [D 20:43:08.156505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31872. [D 20:43:08.156520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31873. [D 20:43:08.156534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31874. [D 20:43:08.156549] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f1c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31875. [D 20:43:08.159795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.159866] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.159880] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.159924] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5511 [D 20:43:08.159939] element 0: offset: 0x2aaaab60dc40, size: 24 [D 20:43:08.159970] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 60/70. [D 20:43:08.160072] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5508 [D 20:43:08.160098] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 0/70. [D 20:43:08.163596] openib_check_cq: completed rdma wr_id 2aaaab60f1c0, nic_wr_credit 31875. [D 20:43:08.163617] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 1/70. [D 20:43:08.163653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31875. [D 20:43:08.163669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 31876. [D 20:43:08.163684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 31877. [D 20:43:08.163699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 31878. [D 20:43:08.163714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 31879. [D 20:43:08.163729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 31880. [D 20:43:08.163744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 31881. [D 20:43:08.163759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 31882. [D 20:43:08.163773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 31883. [D 20:43:08.163788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 31884. [D 20:43:08.163802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 31885. [D 20:43:08.163817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 31886. [D 20:43:08.163831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 31887. [D 20:43:08.163846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 31888. [D 20:43:08.163860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 31889. [D 20:43:08.163875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 31890. [D 20:43:08.163890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 31891. [D 20:43:08.163904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 31892. [D 20:43:08.163919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 31893. [D 20:43:08.163933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 31894. [D 20:43:08.163948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 31895. [D 20:43:08.164002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 31896. [D 20:43:08.164019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 31897. [D 20:43:08.164033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 31898. [D 20:43:08.164048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 31899. [D 20:43:08.164063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 31900. [D 20:43:08.164077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 31901. [D 20:43:08.164092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 31902. [D 20:43:08.164106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 31903. [D 20:43:08.164121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 31904. [D 20:43:08.164135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 31905. [D 20:43:08.164150] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fd90 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 31906. [D 20:43:08.164214] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.164238] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.164251] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.166863] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5511 [D 20:43:08.166920] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 2/70. [D 20:43:08.175290] openib_check_cq: completed rdma wr_id 2aaaab60fd90, nic_wr_credit 31906. [D 20:43:08.175315] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 3/70. [D 20:43:08.175439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.175461] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.175474] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:08.177808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 31906. [D 20:43:08.177827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 31907. [D 20:43:08.177842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 31908. [D 20:43:08.177856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 31909. [D 20:43:08.177872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 31910. [D 20:43:08.177886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 31911. [D 20:43:08.177901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 31912. [D 20:43:08.177915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 31913. [D 20:43:08.177930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 31914. [D 20:43:08.177944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 31915. [D 20:43:08.177959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 31916. [D 20:43:08.177973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 31917. [D 20:43:08.177988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 31918. [D 20:43:08.178002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 31919. [D 20:43:08.178017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 31920. [D 20:43:08.178032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 31921. [D 20:43:08.178046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 31922. [D 20:43:08.178061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 31923. [D 20:43:08.178075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 31924. [D 20:43:08.178090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 31925. [D 20:43:08.178104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 31926. [D 20:43:08.178119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 31927. [D 20:43:08.178133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 31928. [D 20:43:08.178148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 31929. [D 20:43:08.178162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 31930. [D 20:43:08.178178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 31931. [D 20:43:08.178192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 31932. [D 20:43:08.178207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 31933. [D 20:43:08.178221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 31934. [D 20:43:08.178236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 31935. [D 20:43:08.178250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 31936. [D 20:43:08.178264] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 31937. [D 20:43:08.178311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.178329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.178342] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.178381] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5515 [D 20:43:08.178396] element 0: offset: 0x2aaaab60dc00, size: 24 [D 20:43:08.178412] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 4/70. [D 20:43:08.180556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.180573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.180586] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.180608] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5517 [D 20:43:08.180622] element 0: offset: 0x2aaaab60dc20, size: 24 [D 20:43:08.180639] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 5/70. [D 20:43:08.189577] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 31937. [D 20:43:08.189603] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 6/70. [D 20:43:08.189735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.189755] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.189767] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.195695] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5515 [D 20:43:08.195765] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 7/70. [D 20:43:08.195822] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5517 [D 20:43:08.195840] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 8/70. [D 20:43:08.202092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 31937. [D 20:43:08.202117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 31938. [D 20:43:08.202132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 31939. [D 20:43:08.202146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 31940. [D 20:43:08.202160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 31941. [D 20:43:08.202175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 31942. [D 20:43:08.202189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 31943. [D 20:43:08.202203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 31944. [D 20:43:08.202218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 31945. [D 20:43:08.202243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 31946. [D 20:43:08.202259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 31947. [D 20:43:08.202282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 31948. [D 20:43:08.202296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 31949. [D 20:43:08.202323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 31950. [D 20:43:08.202338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 31951. [D 20:43:08.202362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 31952. [D 20:43:08.202376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 31953. [D 20:43:08.202403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 31954. [D 20:43:08.202417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 31955. [D 20:43:08.202441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 31956. [D 20:43:08.202456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 31957. [D 20:43:08.202484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 31958. [D 20:43:08.202507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 31959. [D 20:43:08.202522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 31960. [D 20:43:08.202537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31961. [D 20:43:08.202564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31962. [D 20:43:08.202589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31963. [D 20:43:08.202615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31964. [D 20:43:08.202631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31965. [D 20:43:08.202654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31966. [D 20:43:08.202680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31967. [D 20:43:08.202696] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31968. [D 20:43:08.202722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31969. [D 20:43:08.202748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31970. [D 20:43:08.202763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 31971. [D 20:43:08.202788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 31972. [D 20:43:08.202816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 31973. [D 20:43:08.202832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 31974. [D 20:43:08.202857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 31975. [D 20:43:08.202872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31976. [D 20:43:08.202900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31977. [D 20:43:08.202914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31978. [D 20:43:08.202929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 31979. [D 20:43:08.202944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 31980. [D 20:43:08.202958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 31981. [D 20:43:08.202982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 31982. [D 20:43:08.202997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 31983. [D 20:43:08.203026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31984. [D 20:43:08.203040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31985. [D 20:43:08.203055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31986. [D 20:43:08.203082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 31987. [D 20:43:08.203097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 31988. [D 20:43:08.203121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 31989. [D 20:43:08.203136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 31990. [D 20:43:08.203150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 31991. [D 20:43:08.203164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31992. [D 20:43:08.203179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31993. [D 20:43:08.203193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31994. [D 20:43:08.203207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 31995. [D 20:43:08.203230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 31996. [D 20:43:08.203245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 31997. [D 20:43:08.203259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 31998. [D 20:43:08.203273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 31999. [D 20:43:08.203288] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60da10 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32000. [D 20:43:08.204982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.205004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.205017] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.205061] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5521 [D 20:43:08.205076] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:08.205093] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 9/70. [D 20:43:08.205133] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.205149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.205162] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.205181] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5523 [D 20:43:08.205195] element 0: offset: 0x2aaaab60fc60, size: 24 [D 20:43:08.205209] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 10/70. [D 20:43:08.213785] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 32000. [D 20:43:08.213807] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 11/70. [D 20:43:08.225566] openib_check_cq: completed rdma wr_id 2aaaab60da10, nic_wr_credit 31999. [D 20:43:08.225594] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 12/70. [D 20:43:08.225660] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.225679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.225691] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.225799] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.225814] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.225827] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.230957] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5523 [D 20:43:08.231031] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 13/70. [D 20:43:08.231861] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5521 [D 20:43:08.231911] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 14/70. [D 20:43:08.236010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 31999. [D 20:43:08.236035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32000. [D 20:43:08.236050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32001. [D 20:43:08.236064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32002. [D 20:43:08.236079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32003. [D 20:43:08.236094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32004. [D 20:43:08.236108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32005. [D 20:43:08.236133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32006. [D 20:43:08.236156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32007. [D 20:43:08.236170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32008. [D 20:43:08.236196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32009. [D 20:43:08.236212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32010. [D 20:43:08.236226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32011. [D 20:43:08.236250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32012. [D 20:43:08.236276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32013. [D 20:43:08.236290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32014. [D 20:43:08.236314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32015. [D 20:43:08.236341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32016. [D 20:43:08.476131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32017. [D 20:43:08.476156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32018. [D 20:43:08.476171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32019. [D 20:43:08.476185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32020. [D 20:43:08.476199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32021. [D 20:43:08.476214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32022. [D 20:43:08.476229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32023. [D 20:43:08.476242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32024. [D 20:43:08.476261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32025. [D 20:43:08.476275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32026. [D 20:43:08.476289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32027. [D 20:43:08.476307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32028. [D 20:43:08.476321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32029. [D 20:43:08.476335] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f420 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32030. [D 20:43:08.476364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32031. [D 20:43:08.476379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32032. [D 20:43:08.476397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 32033. [D 20:43:08.476411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 32034. [D 20:43:08.476425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 32035. [D 20:43:08.476443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 32036. [D 20:43:08.476457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 32037. [D 20:43:08.476472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32038. [D 20:43:08.476487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32039. [D 20:43:08.476501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32040. [D 20:43:08.476515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 32041. [D 20:43:08.476529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 32042. [D 20:43:08.476548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 32043. [D 20:43:08.476562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 32044. [D 20:43:08.476576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 32045. [D 20:43:08.476595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32046. [D 20:43:08.476610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32047. [D 20:43:08.476624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32048. [D 20:43:08.476641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32049. [D 20:43:08.476655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32050. [D 20:43:08.476669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32051. [D 20:43:08.476686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32052. [D 20:43:08.476700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32053. [D 20:43:08.476714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32054. [D 20:43:08.476732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32055. [D 20:43:08.476746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32056. [D 20:43:08.476760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32057. [D 20:43:08.476774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32058. [D 20:43:08.476792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32059. [D 20:43:08.476805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32060. [D 20:43:08.476819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32061. [D 20:43:08.476838] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32062. [D 20:43:08.476978] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.476996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.477009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.477051] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5528 [D 20:43:08.477066] element 0: offset: 0x2aaaab617df0, size: 24 [D 20:43:08.477082] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 15/70. [D 20:43:08.478879] openib_check_cq: completed rdma wr_id 2aaaab60f420, nic_wr_credit 32062. [D 20:43:08.478899] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 16/70. [D 20:43:08.479973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.479990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.480002] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.480023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5529 [D 20:43:08.480037] element 0: offset: 0x2aaaab617e10, size: 24 [D 20:43:08.480052] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 17/70. [D 20:43:08.484775] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 32061. [D 20:43:08.484796] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 18/70. [D 20:43:08.487797] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.487812] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.487824] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.487929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.487944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.488078] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.494067] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5528 [D 20:43:08.494137] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 19/70. [D 20:43:08.495769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 32061. [D 20:43:08.495788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 32062. [D 20:43:08.495802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 32063. [D 20:43:08.495816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 32064. [D 20:43:08.495830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 32065. [D 20:43:08.495844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32066. [D 20:43:08.495858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32067. [D 20:43:08.495872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 32068. [D 20:43:08.495886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 32069. [D 20:43:08.495900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 32070. [D 20:43:08.495914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 32071. [D 20:43:08.495928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 32072. [D 20:43:08.495942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 32073. [D 20:43:08.495965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 32074. [D 20:43:08.495980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 32075. [D 20:43:08.495995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 32076. [D 20:43:08.496010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 32077. [D 20:43:08.496024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 32078. [D 20:43:08.496045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 32079. [D 20:43:08.496029] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5529 [D 20:43:08.496068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 32080. [D 20:43:08.496108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 32081. [D 20:43:08.496122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 32082. [D 20:43:08.496136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 32083. [D 20:43:08.496150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 32084. [D 20:43:08.496164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 32085. [D 20:43:08.496178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 32086. [D 20:43:08.496192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 32087. [D 20:43:08.496207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 32088. [D 20:43:08.496221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 32089. [D 20:43:08.496235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 32090. [D 20:43:08.496249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 32091. [D 20:43:08.496263] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610310 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 32092. [D 20:43:08.496293] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 20/70. [D 20:43:08.499980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.500004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.500020] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.500071] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5533 [D 20:43:08.500087] element 0: offset: 0x2aaaab617bd0, size: 24 [D 20:43:08.500104] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 21/70. [D 20:43:08.500148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.500163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.500176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.500196] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5535 [D 20:43:08.500211] element 0: offset: 0x2aaaab60f380, size: 24 [D 20:43:08.500227] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 22/70. [D 20:43:08.501655] openib_check_cq: completed rdma wr_id 2aaaab610310, nic_wr_credit 32092. [D 20:43:08.501680] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 23/70. [D 20:43:08.501697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32092. [D 20:43:08.501711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32093. [D 20:43:08.501725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32094. [D 20:43:08.501740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32095. [D 20:43:08.501754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32096. [D 20:43:08.501768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32097. [D 20:43:08.501782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32098. [D 20:43:08.501796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32099. [D 20:43:08.501810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32100. [D 20:43:08.501824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32101. [D 20:43:08.501838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32102. [D 20:43:08.501852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32103. [D 20:43:08.501866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32104. [D 20:43:08.501880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32105. [D 20:43:08.501894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32106. [D 20:43:08.501909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32107. [D 20:43:08.501923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32108. [D 20:43:08.501937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32109. [D 20:43:08.501951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32110. [D 20:43:08.501966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32111. [D 20:43:08.501980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32112. [D 20:43:08.501994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32113. [D 20:43:08.502008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32114. [D 20:43:08.502022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32115. [D 20:43:08.502036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32116. [D 20:43:08.502051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32117. [D 20:43:08.502065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32118. [D 20:43:08.502079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32119. [D 20:43:08.502093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32120. [D 20:43:08.502107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32121. [D 20:43:08.502121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32122. [D 20:43:08.502135] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617b10 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32123. [D 20:43:08.502202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.502223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.502237] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.505502] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5533 [D 20:43:08.505584] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 24/70. [D 20:43:08.508337] openib_check_cq: completed rdma wr_id 2aaaab617b10, nic_wr_credit 32123. [D 20:43:08.508361] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 25/70. [D 20:43:08.508377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32123. [D 20:43:08.508391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32124. [D 20:43:08.508405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32125. [D 20:43:08.508419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32126. [D 20:43:08.508433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32127. [D 20:43:08.508447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32128. [D 20:43:08.508461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32129. [D 20:43:08.508475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32130. [D 20:43:08.508490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32131. [D 20:43:08.508504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32132. [D 20:43:08.508517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32133. [D 20:43:08.508531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32134. [D 20:43:08.508544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32135. [D 20:43:08.508558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32136. [D 20:43:08.508572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32137. [D 20:43:08.508585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32138. [D 20:43:08.508599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32139. [D 20:43:08.508612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32140. [D 20:43:08.508626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32141. [D 20:43:08.508639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32142. [D 20:43:08.508653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32143. [D 20:43:08.508666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32144. [D 20:43:08.508680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32145. [D 20:43:08.508694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32146. [D 20:43:08.508707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32147. [D 20:43:08.508721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32148. [D 20:43:08.508734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32149. [D 20:43:08.508748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32150. [D 20:43:08.508762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32151. [D 20:43:08.508775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32152. [D 20:43:08.508789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32153. [D 20:43:08.508803] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab601930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32154. [D 20:43:08.510419] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5535 [D 20:43:08.510506] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 26/70. [D 20:43:08.510530] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.510550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.510563] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.514324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.514340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.514352] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.514391] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5539 [D 20:43:08.514406] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:08.514426] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 27/70. [D 20:43:08.516804] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.516820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.516833] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.516856] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5541 [D 20:43:08.516870] element 0: offset: 0x2aaaab60fe60, size: 24 [D 20:43:08.516885] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 28/70. [D 20:43:08.520189] openib_check_cq: completed rdma wr_id 2aaaab601930, nic_wr_credit 32154. [D 20:43:08.520218] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 29/70. [D 20:43:08.520246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32154. [D 20:43:08.520267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32155. [D 20:43:08.520283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 32156. [D 20:43:08.520301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 32157. [D 20:43:08.520316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 32158. [D 20:43:08.520331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 32159. [D 20:43:08.520347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 32160. [D 20:43:08.520363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32161. [D 20:43:08.520378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32162. [D 20:43:08.520392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32163. [D 20:43:08.520407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 32164. [D 20:43:08.520422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 32165. [D 20:43:08.520436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 32166. [D 20:43:08.520451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 32167. [D 20:43:08.520466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 32168. [D 20:43:08.520480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32169. [D 20:43:08.520495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32170. [D 20:43:08.520510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32171. [D 20:43:08.520524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32172. [D 20:43:08.520539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32173. [D 20:43:08.520554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32174. [D 20:43:08.520569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32175. [D 20:43:08.520583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32176. [D 20:43:08.520600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32177. [D 20:43:08.520614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32178. [D 20:43:08.520629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32179. [D 20:43:08.520644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32180. [D 20:43:08.520658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32181. [D 20:43:08.520673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32182. [D 20:43:08.520688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32183. [D 20:43:08.520702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32184. [D 20:43:08.520717] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab617b10 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32185. [D 20:43:08.520762] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.520781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.520794] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.527493] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5541 [D 20:43:08.527576] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 30/70. [D 20:43:08.527648] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5539 [D 20:43:08.527670] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 31/70. [D 20:43:08.531077] openib_check_cq: completed rdma wr_id 2aaaab617b10, nic_wr_credit 32185. [D 20:43:08.531103] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 32/70. [D 20:43:08.531189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.531241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.531255] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.535572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32185. [D 20:43:08.535599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32186. [D 20:43:08.535614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32187. [D 20:43:08.535629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32188. [D 20:43:08.535643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32189. [D 20:43:08.535658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32190. [D 20:43:08.535673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32191. [D 20:43:08.535688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32192. [D 20:43:08.535713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32193. [D 20:43:08.535728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32194. [D 20:43:08.535751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32195. [D 20:43:08.535766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32196. [D 20:43:08.535788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32197. [D 20:43:08.535805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32198. [D 20:43:08.535836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32199. [D 20:43:08.535861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32200. [D 20:43:08.535876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32201. [D 20:43:08.535903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32202. [D 20:43:08.535919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32203. [D 20:43:08.535943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32204. [D 20:43:08.536537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32205. [D 20:43:08.536570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32206. [D 20:43:08.536585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32207. [D 20:43:08.536599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32208. [D 20:43:08.536614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32209. [D 20:43:08.536628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32210. [D 20:43:08.536647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32211. [D 20:43:08.536661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32212. [D 20:43:08.536676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32213. [D 20:43:08.536690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32214. [D 20:43:08.536705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32215. [D 20:43:08.536719] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32216. [D 20:43:08.536737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 32217. [D 20:43:08.536752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 32218. [D 20:43:08.536767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 32219. [D 20:43:08.536782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 32220. [D 20:43:08.536797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 32221. [D 20:43:08.536811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32222. [D 20:43:08.536826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32223. [D 20:43:08.536840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 32224. [D 20:43:08.536855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 32225. [D 20:43:08.536870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 32226. [D 20:43:08.536886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 32227. [D 20:43:08.536901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 32228. [D 20:43:08.536916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 32229. [D 20:43:08.536931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 32230. [D 20:43:08.536946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 32231. [D 20:43:08.536960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 32232. [D 20:43:08.536975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 32233. [D 20:43:08.536990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 32234. [D 20:43:08.537004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 32235. [D 20:43:08.537019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 32236. [D 20:43:08.537034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 32237. [D 20:43:08.537049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 32238. [D 20:43:08.537063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 32239. [D 20:43:08.537078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 32240. [D 20:43:08.537093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 32241. [D 20:43:08.537107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 32242. [D 20:43:08.537122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 32243. [D 20:43:08.537137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 32244. [D 20:43:08.537151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 32245. [D 20:43:08.537166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 32246. [D 20:43:08.537181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 32247. [D 20:43:08.537195] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014630 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 32248. [D 20:43:08.544245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.544267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.544280] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.544325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5545 [D 20:43:08.544341] element 0: offset: 0x2aaaab60f380, size: 24 [D 20:43:08.544360] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 33/70. [D 20:43:08.544405] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.544418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.544431] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.544452] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5547 [D 20:43:08.544465] element 0: offset: 0x2aaaab617bd0, size: 24 [D 20:43:08.544483] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 34/70. [D 20:43:08.547352] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32248. [D 20:43:08.547376] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 35/70. [D 20:43:08.559043] openib_check_cq: completed rdma wr_id 2aaaab014630, nic_wr_credit 32247. [D 20:43:08.559060] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 36/70. [D 20:43:08.559115] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.559136] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.559149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.559262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.559277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.559289] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.562540] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5545 [D 20:43:08.562564] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 37/70. [D 20:43:08.568443] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5547 [D 20:43:08.568510] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 38/70. [D 20:43:08.569808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32247. [D 20:43:08.569827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32248. [D 20:43:08.569842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32249. [D 20:43:08.569857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32250. [D 20:43:08.569872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32251. [D 20:43:08.569887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32252. [D 20:43:08.569902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32253. [D 20:43:08.569916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32254. [D 20:43:08.569931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32255. [D 20:43:08.569972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32256. [D 20:43:08.570000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32257. [D 20:43:08.570015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32258. [D 20:43:08.570044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32259. [D 20:43:08.570059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32260. [D 20:43:08.570073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32261. [D 20:43:08.570126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32262. [D 20:43:08.570156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32263. [D 20:43:08.570172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32264. [D 20:43:08.570200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32265. [D 20:43:08.570215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32266. [D 20:43:08.570243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32267. [D 20:43:08.570273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32268. [D 20:43:08.570301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32269. [D 20:43:08.570316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32270. [D 20:43:08.570341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32271. [D 20:43:08.570369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32272. [D 20:43:08.570385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32273. [D 20:43:08.570409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32274. [D 20:43:08.570424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32275. [D 20:43:08.570454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32276. [D 20:43:08.570469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32277. [D 20:43:08.570498] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32278. [D 20:43:08.570530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32279. [D 20:43:08.570556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32280. [D 20:43:08.570586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 32281. [D 20:43:08.570602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 32282. [D 20:43:08.570627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 32283. [D 20:43:08.570642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 32284. [D 20:43:08.570670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 32285. [D 20:43:08.570695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32286. [D 20:43:08.570718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32287. [D 20:43:08.570733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32288. [D 20:43:08.570748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 32289. [D 20:43:08.570789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 32290. [D 20:43:08.570804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 32291. [D 20:43:08.570822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 32292. [D 20:43:08.570836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 32293. [D 20:43:08.570851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32294. [D 20:43:08.570874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32295. [D 20:43:08.570892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32296. [D 20:43:08.570907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32297. [D 20:43:08.570922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32298. [D 20:43:08.570937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32299. [D 20:43:08.570952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32300. [D 20:43:08.570967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32301. [D 20:43:08.570981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32302. [D 20:43:08.570996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32303. [D 20:43:08.571011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32304. [D 20:43:08.571026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32305. [D 20:43:08.571041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32306. [D 20:43:08.571056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32307. [D 20:43:08.571071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32308. [D 20:43:08.571086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32309. [D 20:43:08.571100] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32310. [D 20:43:08.572554] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.572617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.572631] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.572676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5552 [D 20:43:08.572691] element 0: offset: 0x2aaaab6054c0, size: 24 [D 20:43:08.572711] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 39/70. [D 20:43:08.572755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.572769] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.572781] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.572802] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5553 [D 20:43:08.572816] element 0: offset: 0x2aaaab60da80, size: 24 [D 20:43:08.572830] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 40/70. [D 20:43:08.581513] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32310. [D 20:43:08.581536] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 41/70. [D 20:43:08.593180] openib_check_cq: completed rdma wr_id 2aaaab0257b0, nic_wr_credit 32309. [D 20:43:08.593197] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 42/70. [D 20:43:08.593273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.593294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.593307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.593426] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.593441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.593453] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.596721] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5552 [D 20:43:08.596747] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 43/70. [D 20:43:08.602584] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5553 [D 20:43:08.602651] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 44/70. [D 20:43:08.604342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 32309. [D 20:43:08.604362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 32310. [D 20:43:08.604377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 32311. [D 20:43:08.604391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 32312. [D 20:43:08.604406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 32313. [D 20:43:08.604420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32314. [D 20:43:08.604435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32315. [D 20:43:08.604450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 32316. [D 20:43:08.604464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 32317. [D 20:43:08.604479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 32318. [D 20:43:08.604530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 32319. [D 20:43:08.604545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 32320. [D 20:43:08.604572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 32321. [D 20:43:08.604587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 32322. [D 20:43:08.604621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 32323. [D 20:43:08.604646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 32324. [D 20:43:08.604661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 32325. [D 20:43:08.604689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 32326. [D 20:43:08.604704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 32327. [D 20:43:08.604719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 32328. [D 20:43:08.604734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 32329. [D 20:43:08.604749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 32330. [D 20:43:08.604767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 32331. [D 20:43:08.604782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 32332. [D 20:43:08.604797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 32333. [D 20:43:08.604812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 32334. [D 20:43:08.604826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 32335. [D 20:43:08.604841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 32336. [D 20:43:08.604855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 32337. [D 20:43:08.604871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 32338. [D 20:43:08.604886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 32339. [D 20:43:08.604901] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 32340. [D 20:43:08.604919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32341. [D 20:43:08.604934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32342. [D 20:43:08.604949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32343. [D 20:43:08.604963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32344. [D 20:43:08.604978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32345. [D 20:43:08.604993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32346. [D 20:43:08.605008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32347. [D 20:43:08.605023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32348. [D 20:43:08.605038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32349. [D 20:43:08.605052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32350. [D 20:43:08.605067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32351. [D 20:43:08.605082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32352. [D 20:43:08.605097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32353. [D 20:43:08.605112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32354. [D 20:43:08.605126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32355. [D 20:43:08.605141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32356. [D 20:43:08.605156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32357. [D 20:43:08.605171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32358. [D 20:43:08.605186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32359. [D 20:43:08.605201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32360. [D 20:43:08.605215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32361. [D 20:43:08.605230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32362. [D 20:43:08.605245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32363. [D 20:43:08.605284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32364. [D 20:43:08.605299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32365. [D 20:43:08.605314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32366. [D 20:43:08.605330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32367. [D 20:43:08.605349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32368. [D 20:43:08.605368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32369. [D 20:43:08.605383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32370. [D 20:43:08.605398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32371. [D 20:43:08.605413] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014630 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32372. [D 20:43:08.607202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.607269] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.607284] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.607329] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5557 [D 20:43:08.607344] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:08.607364] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 45/70. [D 20:43:08.607407] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.607421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.607433] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.607453] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5559 [D 20:43:08.607467] element 0: offset: 0x2aaaab6100d0, size: 24 [D 20:43:08.607482] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 46/70. [D 20:43:08.616025] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32372. [D 20:43:08.616049] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 47/70. [D 20:43:08.627754] openib_check_cq: completed rdma wr_id 2aaaab014630, nic_wr_credit 32371. [D 20:43:08.627770] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 48/70. [D 20:43:08.627843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.627864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.627877] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.628004] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.628020] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.628032] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.631246] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5557 [D 20:43:08.631271] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 49/70. [D 20:43:08.637144] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5559 [D 20:43:08.637211] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 50/70. [D 20:43:08.638604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32371. [D 20:43:08.638624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32372. [D 20:43:08.638639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32373. [D 20:43:08.638654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32374. [D 20:43:08.638669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32375. [D 20:43:08.638684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32376. [D 20:43:08.638699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32377. [D 20:43:08.638713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32378. [D 20:43:08.638730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32379. [D 20:43:08.638780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32380. [D 20:43:08.638796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32381. [D 20:43:08.638826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32382. [D 20:43:08.638841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32383. [D 20:43:08.638866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32384. [D 20:43:08.638899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32385. [D 20:43:08.638926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32386. [D 20:43:08.638941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32387. [D 20:43:08.638968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32388. [D 20:43:08.638994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32389. [D 20:43:08.639009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32390. [D 20:43:08.639035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32391. [D 20:43:08.639050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32392. [D 20:43:08.639073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32393. [D 20:43:08.639088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32394. [D 20:43:08.639114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32395. [D 20:43:08.639129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32396. [D 20:43:08.639144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32397. [D 20:43:08.639173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32398. [D 20:43:08.639213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32399. [D 20:43:08.639247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32400. [D 20:43:08.639262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32401. [D 20:43:08.639277] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32402. [D 20:43:08.639309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32403. [D 20:43:08.639334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32404. [D 20:43:08.639349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 32405. [D 20:43:08.639377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 32406. [D 20:43:08.639392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 32407. [D 20:43:08.924962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 32408. [D 20:43:08.924986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 32409. [D 20:43:08.925001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32410. [D 20:43:08.925016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32411. [D 20:43:08.925045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32412. [D 20:43:08.925059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 32413. [D 20:43:08.925074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 32414. [D 20:43:08.925562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 32415. [D 20:43:08.925580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 32416. [D 20:43:08.925595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 32417. [D 20:43:08.925610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32418. [D 20:43:08.925624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32419. [D 20:43:08.925657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32420. [D 20:43:08.925671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32421. [D 20:43:08.925686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32422. [D 20:43:08.925700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32423. [D 20:43:08.925715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32424. [D 20:43:08.925730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32425. [D 20:43:08.925744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32426. [D 20:43:08.925759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32427. [D 20:43:08.925773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32428. [D 20:43:08.925788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32429. [D 20:43:08.925802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32430. [D 20:43:08.925816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32431. [D 20:43:08.925831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32432. [D 20:43:08.925845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32433. [D 20:43:08.925918] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32434. [D 20:43:08.925979] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32434. [D 20:43:08.926449] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 51/70. [D 20:43:08.926910] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.926973] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.926987] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.927033] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5563 [D 20:43:08.927048] element 0: offset: 0x2aaaab617bd0, size: 24 [D 20:43:08.927069] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 52/70. [D 20:43:08.927107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.927120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.927133] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:08.927153] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5565 [D 20:43:08.927167] element 0: offset: 0x2aaaab6054c0, size: 24 [D 20:43:08.927183] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 53/70. [D 20:43:08.930436] openib_check_cq: completed rdma wr_id 2aaaab0257b0, nic_wr_credit 32433. [D 20:43:08.930475] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 54/70. [D 20:43:08.930859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.930879] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.930893] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:08.931007] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.931022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.931034] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.936711] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5563 [D 20:43:08.936790] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 55/70. [D 20:43:08.941858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 32433. [D 20:43:08.941885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 32434. [D 20:43:08.941901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 32435. [D 20:43:08.941915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 32436. [D 20:43:08.941930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 32437. [D 20:43:08.941945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32438. [D 20:43:08.941960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32439. [D 20:43:08.941975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 32440. [D 20:43:08.941990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 32441. [D 20:43:08.942004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 32442. [D 20:43:08.942020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 32443. [D 20:43:08.942034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 32444. [D 20:43:08.942049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 32445. [D 20:43:08.942078] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5565 [D 20:43:08.942079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 32446. [D 20:43:08.942169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 32447. [D 20:43:08.942185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 32448. [D 20:43:08.942200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 32449. [D 20:43:08.942215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 32450. [D 20:43:08.942230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 32451. [D 20:43:08.942244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 32452. [D 20:43:08.942259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 32453. [D 20:43:08.942274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 32454. [D 20:43:08.942289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 32455. [D 20:43:08.942303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 32456. [D 20:43:08.942318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 32457. [D 20:43:08.942333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 32458. [D 20:43:08.942348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 32459. [D 20:43:08.942362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 32460. [D 20:43:08.942377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 32461. [D 20:43:08.942392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 32462. [D 20:43:08.942406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 32463. [D 20:43:08.942421] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 32464. [D 20:43:08.942455] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 56/70. [D 20:43:08.944505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.944526] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.944539] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.944582] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5568 [D 20:43:08.944597] element 0: offset: 0x2aaaab60a390, size: 24 [D 20:43:08.944613] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 57/70. [D 20:43:08.948041] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32464. [D 20:43:08.948085] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 58/70. [D 20:43:08.948104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32464. [D 20:43:08.948120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32465. [D 20:43:08.948135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32466. [D 20:43:08.948149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32467. [D 20:43:08.948164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32468. [D 20:43:08.948178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32469. [D 20:43:08.948193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32470. [D 20:43:08.948208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32471. [D 20:43:08.948222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32472. [D 20:43:08.948237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32473. [D 20:43:08.948252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32474. [D 20:43:08.948279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32475. [D 20:43:08.948294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32476. [D 20:43:08.948309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32477. [D 20:43:08.948324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32478. [D 20:43:08.948339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32479. [D 20:43:08.948354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32480. [D 20:43:08.948368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32481. [D 20:43:08.948384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32482. [D 20:43:08.948398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32483. [D 20:43:08.948496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32484. [D 20:43:08.948511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32485. [D 20:43:08.948526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32486. [D 20:43:08.948540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32487. [D 20:43:08.948555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32488. [D 20:43:08.948570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32489. [D 20:43:08.948585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32490. [D 20:43:08.948599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32491. [D 20:43:08.948614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32492. [D 20:43:08.948629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32493. [D 20:43:08.948644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32494. [D 20:43:08.948658] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32495. [D 20:43:08.948727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.948749] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.948762] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.952264] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5568 [D 20:43:08.952338] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 59/70. [D 20:43:08.954741] openib_check_cq: completed rdma wr_id 2aaaab0257b0, nic_wr_credit 32495. [D 20:43:08.954769] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 60/70. [D 20:43:08.954786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32495. [D 20:43:08.954801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32496. [D 20:43:08.954820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32497. [D 20:43:08.954835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32498. [D 20:43:08.954849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32499. [D 20:43:08.954864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32500. [D 20:43:08.954895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32501. [D 20:43:08.954910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32502. [D 20:43:08.954925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32503. [D 20:43:08.954939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32504. [D 20:43:08.954954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32505. [D 20:43:08.954968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32506. [D 20:43:08.954982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32507. [D 20:43:08.954997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32508. [D 20:43:08.955011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32509. [D 20:43:08.955026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32510. [D 20:43:08.955040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32511. [D 20:43:08.955055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32512. [D 20:43:08.955069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32513. [D 20:43:08.955084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32514. [D 20:43:08.955098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32515. [D 20:43:08.955112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32516. [D 20:43:08.955127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32517. [D 20:43:08.955141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32518. [D 20:43:08.955156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32519. [D 20:43:08.955170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32520. [D 20:43:08.955185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32521. [D 20:43:08.955199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32522. [D 20:43:08.955214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32523. [D 20:43:08.955228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32524. [D 20:43:08.955243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32525. [D 20:43:08.955258] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32526. [D 20:43:08.955328] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.955351] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.955364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:08.960811] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.960830] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.960844] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:08.960883] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5572 [D 20:43:08.960898] element 0: offset: 0x2aaaab612aa0, size: 24 [D 20:43:08.960915] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 0/70. [D 20:43:08.963376] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.963393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.963406] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.963429] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5574 [D 20:43:08.963443] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:08.963458] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 1/70. [D 20:43:08.965739] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32526. [D 20:43:08.965765] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 2/70. [D 20:43:08.965892] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.965913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.965926] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.972011] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5572 [D 20:43:08.972042] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 3/70. [D 20:43:08.972143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32526. [D 20:43:08.972160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 32527. [D 20:43:08.972175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 32528. [D 20:43:08.972190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 32529. [D 20:43:08.972205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 32530. [D 20:43:08.972220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 32531. [D 20:43:08.972235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32532. [D 20:43:08.972262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32533. [D 20:43:08.972277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32534. [D 20:43:08.972301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 32535. [D 20:43:08.972315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 32536. [D 20:43:08.972347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 32537. [D 20:43:08.972362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 32538. [D 20:43:08.972377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 32539. [D 20:43:08.972403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32540. [D 20:43:08.972433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32541. [D 20:43:08.972459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32542. [D 20:43:08.972482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32543. [D 20:43:08.972498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32544. [D 20:43:08.972514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32545. [D 20:43:08.972544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32546. [D 20:43:08.972568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32547. [D 20:43:08.972583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32548. [D 20:43:08.972608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32549. [D 20:43:08.972623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32550. [D 20:43:08.972637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32551. [D 20:43:08.972666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32552. [D 20:43:08.972691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32553. [D 20:43:08.972706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32554. [D 20:43:08.972729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32555. [D 20:43:08.972743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32556. [D 20:43:08.972770] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32557. [D 20:43:08.974827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:08.974894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.974908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:08.974953] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5577 [D 20:43:08.974968] element 0: offset: 0x2aaaab6100d0, size: 24 [D 20:43:08.974989] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 4/70. [D 20:43:08.975367] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5574 [D 20:43:08.975395] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 5/70. [D 20:43:08.983820] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32557. [D 20:43:08.983842] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 6/70. [D 20:43:08.983866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32557. [D 20:43:08.983882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32558. [D 20:43:08.983912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32559. [D 20:43:08.983936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32560. [D 20:43:08.983951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32561. [D 20:43:08.983965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32562. [D 20:43:08.983985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32563. [D 20:43:08.984000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32564. [D 20:43:08.984015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32565. [D 20:43:08.984030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32566. [D 20:43:08.984045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32567. [D 20:43:08.984059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32568. [D 20:43:08.984074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32569. [D 20:43:08.984088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32570. [D 20:43:08.984103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32571. [D 20:43:08.984118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32572. [D 20:43:08.984133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32573. [D 20:43:08.984148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32574. [D 20:43:08.984163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32575. [D 20:43:08.984177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32576. [D 20:43:08.984192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32577. [D 20:43:08.984207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32578. [D 20:43:08.984222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32579. [D 20:43:08.984236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32580. [D 20:43:08.984251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32581. [D 20:43:08.984266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32582. [D 20:43:08.984281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32583. [D 20:43:08.984295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32584. [D 20:43:08.984310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32585. [D 20:43:08.984325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32586. [D 20:43:08.984340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32587. [D 20:43:08.984354] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32588. [D 20:43:08.984428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.984460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.984473] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:08.987106] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5577 [D 20:43:08.987161] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 7/70. [D 20:43:08.995580] openib_check_cq: completed rdma wr_id 2aaaab0257b0, nic_wr_credit 32588. [D 20:43:08.995610] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 8/70. [D 20:43:08.995687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:08.995708] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:08.995721] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.000730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32588. [D 20:43:09.000756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32589. [D 20:43:09.000771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32590. [D 20:43:09.000786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32591. [D 20:43:09.000801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32592. [D 20:43:09.000816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32593. [D 20:43:09.000830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32594. [D 20:43:09.000845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32595. [D 20:43:09.000870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32596. [D 20:43:09.000893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32597. [D 20:43:09.000908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32598. [D 20:43:09.000936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32599. [D 20:43:09.000951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32600. [D 20:43:09.000975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32601. [D 20:43:09.000990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32602. [D 20:43:09.001017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32603. [D 20:43:09.001040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32604. [D 20:43:09.001063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32605. [D 20:43:09.001079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32606. [D 20:43:09.001105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32607. [D 20:43:09.001121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32608. [D 20:43:09.001146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32609. [D 20:43:09.001160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32610. [D 20:43:09.001187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32611. [D 20:43:09.001202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32612. [D 20:43:09.001228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32613. [D 20:43:09.001251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32614. [D 20:43:09.001267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32615. [D 20:43:09.001294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32616. [D 20:43:09.001309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32617. [D 20:43:09.001323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32618. [D 20:43:09.001338] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32619. [D 20:43:09.009158] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.009179] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.009192] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.009232] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5582 [D 20:43:09.009248] element 0: offset: 0x2aaaab60f380, size: 24 [D 20:43:09.009265] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 9/70. [D 20:43:09.009305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.009319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.009331] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.009352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5583 [D 20:43:09.009366] element 0: offset: 0x2aaaab617bd0, size: 24 [D 20:43:09.009383] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 10/70. [D 20:43:09.012486] openib_check_cq: completed rdma wr_id 2aaaab017470, nic_wr_credit 32619. [D 20:43:09.012510] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 11/70. [D 20:43:09.012659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.012681] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.012694] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.015807] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5582 [D 20:43:09.015878] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 12/70. [D 20:43:09.018949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32619. [D 20:43:09.018976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 32620. [D 20:43:09.018991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 32621. [D 20:43:09.019006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 32622. [D 20:43:09.019021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 32623. [D 20:43:09.019036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 32624. [D 20:43:09.019116] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5583 [D 20:43:09.019050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32625. [D 20:43:09.019966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32626. [D 20:43:09.020006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32627. [D 20:43:09.020021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 32628. [D 20:43:09.020036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 32629. [D 20:43:09.020051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 32630. [D 20:43:09.020070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 32631. [D 20:43:09.020085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 32632. [D 20:43:09.020100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32633. [D 20:43:09.020115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32634. [D 20:43:09.020130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32635. [D 20:43:09.020146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32636. [D 20:43:09.020161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32637. [D 20:43:09.020175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32638. [D 20:43:09.020191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32639. [D 20:43:09.020206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32640. [D 20:43:09.020221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32641. [D 20:43:09.020236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32642. [D 20:43:09.020251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32643. [D 20:43:09.020266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32644. [D 20:43:09.020281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32645. [D 20:43:09.020296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32646. [D 20:43:09.020311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32647. [D 20:43:09.020326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32648. [D 20:43:09.020341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32649. [D 20:43:09.020356] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027990 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32650. [D 20:43:09.020390] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 13/70. [D 20:43:09.021553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.021573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.021586] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.021628] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5586 [D 20:43:09.021643] element 0: offset: 0x2aaaab0148c0, size: 24 [D 20:43:09.021659] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 14/70. [D 20:43:09.030671] openib_check_cq: completed rdma wr_id 2aaaab027990, nic_wr_credit 32650. [D 20:43:09.030697] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 15/70. [D 20:43:09.030714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32650. [D 20:43:09.030729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32651. [D 20:43:09.030744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32652. [D 20:43:09.030759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32653. [D 20:43:09.030775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32654. [D 20:43:09.030789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32655. [D 20:43:09.030804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32656. [D 20:43:09.030819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32657. [D 20:43:09.030833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32658. [D 20:43:09.030848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32659. [D 20:43:09.030863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32660. [D 20:43:09.030877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32661. [D 20:43:09.030895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32662. [D 20:43:09.030910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32663. [D 20:43:09.030924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32664. [D 20:43:09.030939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32665. [D 20:43:09.030953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32666. [D 20:43:09.030968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32667. [D 20:43:09.030982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32668. [D 20:43:09.030997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32669. [D 20:43:09.031012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32670. [D 20:43:09.031026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32671. [D 20:43:09.031041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32672. [D 20:43:09.031056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32673. [D 20:43:09.031070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32674. [D 20:43:09.031085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32675. [D 20:43:09.031099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32676. [D 20:43:09.031114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32677. [D 20:43:09.031129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32678. [D 20:43:09.031143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32679. [D 20:43:09.031158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32680. [D 20:43:09.031172] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027a20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32681. [D 20:43:09.031236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.031259] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.031272] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.034509] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5586 [D 20:43:09.034581] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 16/70. [D 20:43:09.042464] openib_check_cq: completed rdma wr_id 2aaaab027a20, nic_wr_credit 32681. [D 20:43:09.042491] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 17/70. [D 20:43:09.042571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.042593] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.042606] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.047630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32681. [D 20:43:09.047651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32682. [D 20:43:09.047666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32683. [D 20:43:09.047680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32684. [D 20:43:09.047695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32685. [D 20:43:09.047722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32686. [D 20:43:09.047737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32687. [D 20:43:09.047764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32688. [D 20:43:09.047779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32689. [D 20:43:09.047794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32690. [D 20:43:09.047809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32691. [D 20:43:09.047842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32692. [D 20:43:09.047867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32693. [D 20:43:09.047883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32694. [D 20:43:09.047906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32695. [D 20:43:09.047921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32696. [D 20:43:09.047949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32697. [D 20:43:09.047964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32698. [D 20:43:09.047995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32699. [D 20:43:09.048010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32700. [D 20:43:09.048036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32701. [D 20:43:09.048064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32702. [D 20:43:09.048080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32703. [D 20:43:09.048094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32704. [D 20:43:09.048110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32705. [D 20:43:09.048140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32706. [D 20:43:09.048167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32707. [D 20:43:09.048183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32708. [D 20:43:09.048198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32709. [D 20:43:09.048213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32710. [D 20:43:09.048228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32711. [D 20:43:09.048246] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027990 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32712. [D 20:43:09.056209] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.056233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.056246] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.056284] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5591 [D 20:43:09.056300] element 0: offset: 0x2aaaab038870, size: 24 [D 20:43:09.056316] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 18/70. [D 20:43:09.056352] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.056366] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.056378] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.056399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5592 [D 20:43:09.056413] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:09.056427] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 19/70. [D 20:43:09.059396] openib_check_cq: completed rdma wr_id 2aaaab027990, nic_wr_credit 32712. [D 20:43:09.059419] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 20/70. [D 20:43:09.059597] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.059618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.059630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.063019] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5592 [D 20:43:09.063092] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 21/70. [D 20:43:09.065745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 32712. [D 20:43:09.065769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 32713. [D 20:43:09.065784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32714. [D 20:43:09.065799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32715. [D 20:43:09.065814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32716. [D 20:43:09.065830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32717. [D 20:43:09.065857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32718. [D 20:43:09.065872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32719. [D 20:43:09.065896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32720. [D 20:43:09.065911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32721. [D 20:43:09.065941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32722. [D 20:43:09.065956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32723. [D 20:43:09.065980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32724. [D 20:43:09.065996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32725. [D 20:43:09.066025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32726. [D 20:43:09.066054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32727. [D 20:43:09.066077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32728. [D 20:43:09.066093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32729. [D 20:43:09.066119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32730. [D 20:43:09.066144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32731. [D 20:43:09.066160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32732. [D 20:43:09.066182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32733. [D 20:43:09.066197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32734. [D 20:43:09.066212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32735. [D 20:43:09.066227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32736. [D 20:43:09.066263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32737. [D 20:43:09.066278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32738. [D 20:43:09.066293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32739. [D 20:43:09.066308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32740. [D 20:43:09.066326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32741. [D 20:43:09.066344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32742. [D 20:43:09.066359] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038630 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32743. [D 20:43:09.066703] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5591 [D 20:43:09.066782] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 22/70. [D 20:43:09.072894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.072915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.072928] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.072971] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5595 [D 20:43:09.072987] element 0: offset: 0x2aaaab038df0, size: 24 [D 20:43:09.073003] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 23/70. [D 20:43:09.077465] openib_check_cq: completed rdma wr_id 2aaaab038630, nic_wr_credit 32743. [D 20:43:09.077500] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 24/70. [D 20:43:09.077537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32743. [D 20:43:09.077565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 32744. [D 20:43:09.077581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 32745. [D 20:43:09.077609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 32746. [D 20:43:09.077634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 32747. [D 20:43:09.077662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 32748. [D 20:43:09.077678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32749. [D 20:43:09.077692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32750. [D 20:43:09.077707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32751. [D 20:43:09.077722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 32752. [D 20:43:09.077740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 32753. [D 20:43:09.077755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 32754. [D 20:43:09.077773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 32755. [D 20:43:09.077788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 32756. [D 20:43:09.077802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32757. [D 20:43:09.077817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32758. [D 20:43:09.077832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32759. [D 20:43:09.077847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32760. [D 20:43:09.077862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32761. [D 20:43:09.077876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32762. [D 20:43:09.077891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32763. [D 20:43:09.077906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32764. [D 20:43:09.077921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32765. [D 20:43:09.077936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32766. [D 20:43:09.077951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32767. [D 20:43:09.077966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32768. [D 20:43:09.077980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32769. [D 20:43:09.077995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32770. [D 20:43:09.078010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32771. [D 20:43:09.078025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32772. [D 20:43:09.078040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32773. [D 20:43:09.078056] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027990 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32774. [D 20:43:09.078125] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.078150] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.078163] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.081425] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5595 [D 20:43:09.081496] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 25/70. [D 20:43:09.089611] openib_check_cq: completed rdma wr_id 2aaaab027990, nic_wr_credit 32774. [D 20:43:09.089642] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 26/70. [D 20:43:09.089772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.089795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.089808] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.094915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32774. [D 20:43:09.094936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32775. [D 20:43:09.094951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32776. [D 20:43:09.094966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32777. [D 20:43:09.094980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32778. [D 20:43:09.094995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32779. [D 20:43:09.095009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32780. [D 20:43:09.095024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32781. [D 20:43:09.095038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32782. [D 20:43:09.095053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32783. [D 20:43:09.095068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32784. [D 20:43:09.095083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32785. [D 20:43:09.095097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32786. [D 20:43:09.095112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32787. [D 20:43:09.095126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32788. [D 20:43:09.095141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32789. [D 20:43:09.095155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32790. [D 20:43:09.095170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32791. [D 20:43:09.095185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32792. [D 20:43:09.095199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32793. [D 20:43:09.095214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32794. [D 20:43:09.095251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32795. [D 20:43:09.095267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32796. [D 20:43:09.095283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32797. [D 20:43:09.095297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32798. [D 20:43:09.095312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32799. [D 20:43:09.095327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32800. [D 20:43:09.095346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32801. [D 20:43:09.095361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32802. [D 20:43:09.095376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32803. [D 20:43:09.095390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32804. [D 20:43:09.095405] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038630 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32805. [D 20:43:09.100977] openib_check_cq: completed rdma wr_id 2aaaab038630, nic_wr_credit 32805. [D 20:43:09.100994] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 27/70. [D 20:43:09.101055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.101076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.101088] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:09.108886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.108904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.108917] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:09.108956] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5598 [D 20:43:09.108970] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:09.108987] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 28/70. [D 20:43:09.111461] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.111518] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.111532] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.111574] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5601 [D 20:43:09.111589] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:09.111608] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 29/70. [D 20:43:09.115601] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5598 [D 20:43:09.115677] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 30/70. [D 20:43:09.115737] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5601 [D 20:43:09.115736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32805. [D 20:43:09.115781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32806. [D 20:43:09.115796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32807. [D 20:43:09.115811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32808. [D 20:43:09.115825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32809. [D 20:43:09.115840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32810. [D 20:43:09.115856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32811. [D 20:43:09.115870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32812. [D 20:43:09.115885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32813. [D 20:43:09.115899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32814. [D 20:43:09.115914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32815. [D 20:43:09.115929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32816. [D 20:43:09.115943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32817. [D 20:43:09.115958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32818. [D 20:43:09.115977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32819. [D 20:43:09.115992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32820. [D 20:43:09.116006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32821. [D 20:43:09.116021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32822. [D 20:43:09.116036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32823. [D 20:43:09.116050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32824. [D 20:43:09.116065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32825. [D 20:43:09.116079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32826. [D 20:43:09.116094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32827. [D 20:43:09.116109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32828. [D 20:43:09.116123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32829. [D 20:43:09.116138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32830. [D 20:43:09.116152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32831. [D 20:43:09.116167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32832. [D 20:43:09.116182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32833. [D 20:43:09.116196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32834. [D 20:43:09.116211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32835. [D 20:43:09.116225] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab030750 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32836. [D 20:43:09.116254] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 31/70. [D 20:43:09.121652] openib_check_cq: completed rdma wr_id 2aaaab030750, nic_wr_credit 32836. [D 20:43:09.121673] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 32/70. [D 20:43:09.121688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32836. [D 20:43:09.121704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32837. [D 20:43:09.121720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32838. [D 20:43:09.121735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32839. [D 20:43:09.121750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32840. [D 20:43:09.121764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32841. [D 20:43:09.121780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32842. [D 20:43:09.121794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32843. [D 20:43:09.121809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32844. [D 20:43:09.121824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32845. [D 20:43:09.121839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32846. [D 20:43:09.121854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32847. [D 20:43:09.121868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32848. [D 20:43:09.121883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32849. [D 20:43:09.121898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32850. [D 20:43:09.121913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32851. [D 20:43:09.121928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32852. [D 20:43:09.121943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32853. [D 20:43:09.121958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32854. [D 20:43:09.121972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32855. [D 20:43:09.121987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32856. [D 20:43:09.122002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32857. [D 20:43:09.122017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32858. [D 20:43:09.122045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32859. [D 20:43:09.122068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32860. [D 20:43:09.122097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32861. [D 20:43:09.122112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32862. [D 20:43:09.122127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32863. [D 20:43:09.122141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32864. [D 20:43:09.122157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32865. [D 20:43:09.376782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32866. [D 20:43:09.376804] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017340 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32867. [D 20:43:09.376981] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.377005] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.377019] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.377049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.377063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.377076] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.377115] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5604 [D 20:43:09.377130] element 0: offset: 0x2aaaab027a00, size: 24 [D 20:43:09.377149] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 33/70. [D 20:43:09.377183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.377197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.377209] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.377230] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5608 [D 20:43:09.377244] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:09.377258] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 34/70. [D 20:43:09.377286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.377300] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.377313] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.377333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5610 [D 20:43:09.377341] openib_check_cq: completed rdma wr_id 2aaaab017340, nic_wr_credit 32867. [D 20:43:09.377371] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 35/70. [D 20:43:09.377347] element 0: offset: 0x2aaaab017320, size: 24 [D 20:43:09.377406] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 36/70. [D 20:43:09.377522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.377538] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.377550] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.386267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.386340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.386354] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.386399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5613 [D 20:43:09.386414] element 0: offset: 0x2aaaab0386a0, size: 24 [D 20:43:09.386434] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 37/70. [D 20:43:09.392504] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5613 [D 20:43:09.392587] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 38/70. [D 20:43:09.392667] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5610 [D 20:43:09.392680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32867. [D 20:43:09.392708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32868. [D 20:43:09.392729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32869. [D 20:43:09.392744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32870. [D 20:43:09.392759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32871. [D 20:43:09.392774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32872. [D 20:43:09.392789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32873. [D 20:43:09.392804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32874. [D 20:43:09.392830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32875. [D 20:43:09.392845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 32876. [D 20:43:09.392860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 32877. [D 20:43:09.392875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 32878. [D 20:43:09.392890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 32879. [D 20:43:09.392905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 32880. [D 20:43:09.392920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 32881. [D 20:43:09.392943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 32882. [D 20:43:09.392967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 32883. [D 20:43:09.392982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 32884. [D 20:43:09.393005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 32885. [D 20:43:09.393021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 32886. [D 20:43:09.393049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 32887. [D 20:43:09.393065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 32888. [D 20:43:09.393089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 32889. [D 20:43:09.393112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 32890. [D 20:43:09.393126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 32891. [D 20:43:09.393141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 32892. [D 20:43:09.393156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 32893. [D 20:43:09.393171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 32894. [D 20:43:09.393195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 32895. [D 20:43:09.393210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 32896. [D 20:43:09.393237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 32897. [D 20:43:09.393261] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab016e10 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 32898. [D 20:43:09.393289] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 39/70. [D 20:43:09.393319] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5604 [D 20:43:09.393335] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 40/70. [D 20:43:09.393350] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5608 [D 20:43:09.393364] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 41/70. [D 20:43:09.404364] openib_check_cq: completed rdma wr_id 2aaaab016e10, nic_wr_credit 32898. [D 20:43:09.404390] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 42/70. [D 20:43:09.404417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 32898. [D 20:43:09.404433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 32899. [D 20:43:09.404447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 32900. [D 20:43:09.404462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 32901. [D 20:43:09.404477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 32902. [D 20:43:09.404492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 32903. [D 20:43:09.404507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 32904. [D 20:43:09.404522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 32905. [D 20:43:09.404537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 32906. [D 20:43:09.404552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 32907. [D 20:43:09.404566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 32908. [D 20:43:09.404581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 32909. [D 20:43:09.404596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 32910. [D 20:43:09.404621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 32911. [D 20:43:09.404636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 32912. [D 20:43:09.404658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 32913. [D 20:43:09.404673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 32914. [D 20:43:09.404688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 32915. [D 20:43:09.404703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 32916. [D 20:43:09.404718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 32917. [D 20:43:09.404733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 32918. [D 20:43:09.404747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 32919. [D 20:43:09.404763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 32920. [D 20:43:09.404777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 32921. [D 20:43:09.404792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 32922. [D 20:43:09.404807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 32923. [D 20:43:09.404822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 32924. [D 20:43:09.404837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 32925. [D 20:43:09.404852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 32926. [D 20:43:09.404868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 32927. [D 20:43:09.404882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 32928. [D 20:43:09.404897] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab017290 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 32929. [D 20:43:09.404914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32930. [D 20:43:09.404929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32931. [D 20:43:09.404944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 32932. [D 20:43:09.404958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 32933. [D 20:43:09.404973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 32934. [D 20:43:09.404988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 32935. [D 20:43:09.405003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 32936. [D 20:43:09.405018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32937. [D 20:43:09.405032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32938. [D 20:43:09.405047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32939. [D 20:43:09.405062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 32940. [D 20:43:09.405077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 32941. [D 20:43:09.405091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 32942. [D 20:43:09.405106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 32943. [D 20:43:09.405121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 32944. [D 20:43:09.405135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32945. [D 20:43:09.405150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32946. [D 20:43:09.405165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32947. [D 20:43:09.405180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32948. [D 20:43:09.405195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32949. [D 20:43:09.405210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32950. [D 20:43:09.405224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32951. [D 20:43:09.405239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32952. [D 20:43:09.405254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32953. [D 20:43:09.405269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32954. [D 20:43:09.405284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32955. [D 20:43:09.405299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32956. [D 20:43:09.405313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32957. [D 20:43:09.405328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32958. [D 20:43:09.405342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32959. [D 20:43:09.405357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32960. [D 20:43:09.405372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0254f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32961. [D 20:43:09.405387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 32962. [D 20:43:09.405402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 32963. [D 20:43:09.405417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 32964. [D 20:43:09.405431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 32965. [D 20:43:09.405446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 32966. [D 20:43:09.405460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32967. [E 20:43:09.405480] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 32968, block for 10 ms. [D 20:43:09.405515] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 32967. [D 20:43:09.405532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32968. [E 20:43:09.405548] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 32969, block for 10 ms. [D 20:43:09.410453] openib_check_cq: completed rdma wr_id 2aaaab017290, nic_wr_credit 32968. [D 20:43:09.410475] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 43/70. [D 20:43:09.410490] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 32967. [D 20:43:09.410505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 32968. [D 20:43:09.410520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 32969. [D 20:43:09.410534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 32970. [D 20:43:09.410549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 32971. [D 20:43:09.410564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 32972. [D 20:43:09.410578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 32973. [D 20:43:09.410592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 32974. [D 20:43:09.410607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 32975. [D 20:43:09.410621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 32976. [D 20:43:09.410636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 32977. [D 20:43:09.410650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 32978. [D 20:43:09.410666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 32979. [D 20:43:09.410681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 32980. [D 20:43:09.410696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 32981. [D 20:43:09.410711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 32982. [D 20:43:09.410725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 32983. [D 20:43:09.410740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 32984. [D 20:43:09.410755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 32985. [D 20:43:09.410769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 32986. [D 20:43:09.410784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 32987. [D 20:43:09.410798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 32988. [D 20:43:09.410813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 32989. [D 20:43:09.410828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 32990. [D 20:43:09.410842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 32991. [D 20:43:09.410857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038970 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 32992. [D 20:43:09.410931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.410956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.410969] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.413037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.413054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.413066] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.413105] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5616 [D 20:43:09.413120] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:09.413138] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 44/70. [D 20:43:09.416287] openib_check_cq: completed rdma wr_id 2aaaab0254f0, nic_wr_credit 32992. [D 20:43:09.416312] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 45/70. [D 20:43:09.417417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.417437] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.417450] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.422180] openib_check_cq: completed rdma wr_id 2aaaab038970, nic_wr_credit 32991. [D 20:43:09.422205] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 46/70. [D 20:43:09.422259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.422278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.422290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.422374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.422389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.422401] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.425349] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5616 [D 20:43:09.425410] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 47/70. [D 20:43:09.433270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 32991. [D 20:43:09.433297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 32992. [D 20:43:09.433312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 32993. [D 20:43:09.433327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 32994. [D 20:43:09.433342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 32995. [D 20:43:09.433356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 32996. [D 20:43:09.433371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 32997. [D 20:43:09.433385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 32998. [D 20:43:09.433400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 32999. [D 20:43:09.433415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33000. [D 20:43:09.433429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33001. [D 20:43:09.433444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33002. [D 20:43:09.433459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33003. [D 20:43:09.433473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33004. [D 20:43:09.433488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33005. [D 20:43:09.433502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33006. [D 20:43:09.433517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33007. [D 20:43:09.433531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33008. [D 20:43:09.433546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33009. [D 20:43:09.433561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33010. [D 20:43:09.433575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33011. [D 20:43:09.433590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33012. [D 20:43:09.433604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33013. [D 20:43:09.433619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33014. [D 20:43:09.433634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33015. [D 20:43:09.433648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33016. [D 20:43:09.433663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33017. [D 20:43:09.433678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33018. [D 20:43:09.433692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33019. [D 20:43:09.433707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33020. [D 20:43:09.433727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33021. [D 20:43:09.433742] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33022. [D 20:43:09.436184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.436210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.436223] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.436264] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5621 [D 20:43:09.436279] element 0: offset: 0x2aaaab02f520, size: 24 [D 20:43:09.436296] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 48/70. [D 20:43:09.436329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.436343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.436355] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.436377] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5623 [D 20:43:09.436391] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:09.436405] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 49/70. [D 20:43:09.436437] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.436451] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.436463] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.436484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5626 [D 20:43:09.436498] element 0: offset: 0x2aaaab014740, size: 24 [D 20:43:09.436513] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 50/70. [D 20:43:09.439171] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33022. [D 20:43:09.439196] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 51/70. [D 20:43:09.439368] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.439388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.439400] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.444018] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5623 [D 20:43:09.444047] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 52/70. [D 20:43:09.444810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33022. [D 20:43:09.444828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33023. [D 20:43:09.444843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 33024. [D 20:43:09.444857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 33025. [D 20:43:09.444873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 33026. [D 20:43:09.444888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 33027. [D 20:43:09.444902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 33028. [D 20:43:09.444917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33029. [D 20:43:09.444932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33030. [D 20:43:09.444948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33031. [D 20:43:09.444963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 33032. [D 20:43:09.444977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 33033. [D 20:43:09.444992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 33034. [D 20:43:09.445008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 33035. [D 20:43:09.445023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 33036. [D 20:43:09.445038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33037. [D 20:43:09.445053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33038. [D 20:43:09.445068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33039. [D 20:43:09.445083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33040. [D 20:43:09.445098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33041. [D 20:43:09.445113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33042. [D 20:43:09.445127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33043. [D 20:43:09.445143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33044. [D 20:43:09.445158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33045. [D 20:43:09.445184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33046. [D 20:43:09.445200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33047. [D 20:43:09.445214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33048. [D 20:43:09.445229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33049. [D 20:43:09.445244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33050. [D 20:43:09.445259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33051. [D 20:43:09.445274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33052. [D 20:43:09.445289] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0171d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33053. [D 20:43:09.447482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.447548] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.447562] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.447607] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5628 [D 20:43:09.447622] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:09.447641] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 53/70. [D 20:43:09.448022] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5626 [D 20:43:09.448051] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 54/70. [D 20:43:09.454744] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5621 [D 20:43:09.454828] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 55/70. [D 20:43:09.455139] openib_check_cq: completed rdma wr_id 2aaaab0171d0, nic_wr_credit 33053. [D 20:43:09.455160] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 56/70. [D 20:43:09.455227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 33053. [D 20:43:09.455244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 33054. [D 20:43:09.455260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 33055. [D 20:43:09.455276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 33056. [D 20:43:09.455291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 33057. [D 20:43:09.455306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 33058. [D 20:43:09.455321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 33059. [D 20:43:09.455336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 33060. [D 20:43:09.455351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 33061. [D 20:43:09.455366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 33062. [D 20:43:09.455381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 33063. [D 20:43:09.455396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 33064. [D 20:43:09.455411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 33065. [D 20:43:09.455426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 33066. [D 20:43:09.455441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 33067. [D 20:43:09.455456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 33068. [D 20:43:09.455471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 33069. [D 20:43:09.455486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 33070. [D 20:43:09.455501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 33071. [D 20:43:09.455516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 33072. [D 20:43:09.455532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 33073. [D 20:43:09.455546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 33074. [D 20:43:09.455562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 33075. [D 20:43:09.455577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 33076. [D 20:43:09.455592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 33077. [D 20:43:09.455607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 33078. [D 20:43:09.455622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 33079. [D 20:43:09.455637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 33080. [D 20:43:09.455652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 33081. [D 20:43:09.455667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 33082. [D 20:43:09.455682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 33083. [D 20:43:09.455697] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027610 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 33084. [D 20:43:09.455717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33085. [D 20:43:09.455732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33086. [D 20:43:09.455746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33087. [D 20:43:09.455762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33088. [D 20:43:09.455777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33089. [D 20:43:09.455791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33090. [D 20:43:09.455806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33091. [D 20:43:09.455821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33092. [D 20:43:09.455836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33093. [D 20:43:09.455851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33094. [D 20:43:09.455866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33095. [D 20:43:09.455881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33096. [D 20:43:09.455896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33097. [D 20:43:09.455910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33098. [D 20:43:09.455925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33099. [D 20:43:09.455940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33100. [D 20:43:09.455955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33101. [D 20:43:09.455970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33102. [D 20:43:09.455993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33103. [D 20:43:09.456007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33104. [D 20:43:09.456022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33105. [D 20:43:09.456037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33106. [D 20:43:09.456052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33107. [D 20:43:09.456067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33108. [D 20:43:09.456082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33109. [D 20:43:09.456097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33110. [D 20:43:09.456112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33111. [D 20:43:09.456127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33112. [D 20:43:09.456141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33113. [D 20:43:09.456157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33114. [D 20:43:09.456172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33115. [D 20:43:09.456187] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33116. [D 20:43:09.456273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.456339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.456352] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.459696] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5628 [D 20:43:09.459721] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 57/70. [D 20:43:09.467009] openib_check_cq: completed rdma wr_id 2aaaab027610, nic_wr_credit 33116. [D 20:43:09.467031] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 58/70. [D 20:43:09.478771] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33115. [D 20:43:09.478793] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 59/70. [D 20:43:09.478819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33115. [D 20:43:09.478835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33116. [D 20:43:09.478850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33117. [D 20:43:09.478865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33118. [D 20:43:09.478885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33119. [D 20:43:09.478867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.478910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33120. [D 20:43:09.478949] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.478953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33121. [D 20:43:09.478972] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.478990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33122. [D 20:43:09.479020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33123. [D 20:43:09.479035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33124. [D 20:43:09.479050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33125. [D 20:43:09.479065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33126. [D 20:43:09.479080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33127. [D 20:43:09.479095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33128. [D 20:43:09.479110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33129. [D 20:43:09.479125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33130. [D 20:43:09.479140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33131. [D 20:43:09.479154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33132. [D 20:43:09.479170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33133. [D 20:43:09.479185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33134. [D 20:43:09.479200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33135. [D 20:43:09.479215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33136. [D 20:43:09.479230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33137. [D 20:43:09.479244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33138. [D 20:43:09.479259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33139. [D 20:43:09.479274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33140. [D 20:43:09.479289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33141. [D 20:43:09.479304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33142. [D 20:43:09.479318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33143. [D 20:43:09.479347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33144. [D 20:43:09.479361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33145. [D 20:43:09.479376] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038c10 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33146. [D 20:43:09.479424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.479442] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.479455] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.479932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.479946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.479958] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.480008] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5631 [D 20:43:09.480024] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:09.480102] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 60/70. [D 20:43:09.485882] openib_check_cq: completed rdma wr_id 2aaaab038c10, nic_wr_credit 33146. [D 20:43:09.485908] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 0/70. [D 20:43:09.486012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.486032] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.486045] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.492842] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5631 [D 20:43:09.492867] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 1/70. [D 20:43:09.493015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33146. [D 20:43:09.493086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33147. [D 20:43:09.493102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 33148. [D 20:43:09.493117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 33149. [D 20:43:09.493132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 33150. [D 20:43:09.493147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 33151. [D 20:43:09.493162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 33152. [D 20:43:09.493178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33153. [D 20:43:09.493193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33154. [D 20:43:09.493208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33155. [D 20:43:09.493222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 33156. [D 20:43:09.493238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 33157. [D 20:43:09.493252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 33158. [D 20:43:09.493267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 33159. [D 20:43:09.493282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 33160. [D 20:43:09.493297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33161. [D 20:43:09.493312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33162. [D 20:43:09.493326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33163. [D 20:43:09.493341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33164. [D 20:43:09.493356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33165. [D 20:43:09.493371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33166. [D 20:43:09.493386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33167. [D 20:43:09.493401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33168. [D 20:43:09.493416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33169. [D 20:43:09.493430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33170. [D 20:43:09.493445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33171. [D 20:43:09.493460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33172. [D 20:43:09.493475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33173. [D 20:43:09.493490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33174. [D 20:43:09.493505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33175. [D 20:43:09.493519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33176. [D 20:43:09.493534] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001f70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33177. [D 20:43:09.494237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.494256] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.494268] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.494290] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5636 [D 20:43:09.494305] element 0: offset: 0x2aaaab0386a0, size: 24 [D 20:43:09.494319] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 2/70. [D 20:43:09.494351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.494367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.494380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.494400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5637 [D 20:43:09.494414] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:09.494437] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 3/70. [D 20:43:09.504860] openib_check_cq: completed rdma wr_id 2aaaab001f70, nic_wr_credit 33177. [D 20:43:09.504889] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 4/70. [D 20:43:09.505005] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.505026] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.505038] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.510956] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5636 [D 20:43:09.511031] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 5/70. [D 20:43:09.511110] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5637 [D 20:43:09.511128] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 6/70. [D 20:43:09.514744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 33177. [D 20:43:09.514770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 33178. [D 20:43:09.514785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 33179. [D 20:43:09.514800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 33180. [D 20:43:09.514815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 33181. [D 20:43:09.514829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 33182. [D 20:43:09.514844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 33183. [D 20:43:09.514870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 33184. [D 20:43:09.514885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 33185. [D 20:43:09.514908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 33186. [D 20:43:09.514926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 33187. [D 20:43:09.514949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 33188. [D 20:43:09.514964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 33189. [D 20:43:09.514993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 33190. [D 20:43:09.515018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 33191. [D 20:43:09.515033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 33192. [D 20:43:09.515056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 33193. [D 20:43:09.515071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 33194. [D 20:43:09.515086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 33195. [D 20:43:09.515101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 33196. [D 20:43:09.515131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 33197. [D 20:43:09.515157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 33198. [D 20:43:09.515172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 33199. [D 20:43:09.515194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 33200. [D 20:43:09.515209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 33201. [D 20:43:09.515224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 33202. [D 20:43:09.515252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 33203. [D 20:43:09.515276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 33204. [D 20:43:09.515290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 33205. [D 20:43:09.515313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 33206. [D 20:43:09.515328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 33207. [D 20:43:09.515343] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038d60 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 33208. [D 20:43:09.515376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 33209. [D 20:43:09.515392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 33210. [D 20:43:09.515416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33211. [D 20:43:09.515430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33212. [D 20:43:09.515459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33213. [D 20:43:09.515481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33214. [D 20:43:09.515497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33215. [D 20:43:09.515520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33216. [D 20:43:09.515535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33217. [D 20:43:09.515562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33218. [D 20:43:09.515587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33219. [D 20:43:09.515602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33220. [D 20:43:09.515624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33221. [D 20:43:09.515639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33222. [D 20:43:09.515653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33223. [D 20:43:09.515690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33224. [D 20:43:09.515705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33225. [D 20:43:09.515720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33226. [D 20:43:09.821430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33227. [D 20:43:09.821460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33228. [D 20:43:09.821476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33229. [D 20:43:09.821490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33230. [D 20:43:09.821505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33231. [D 20:43:09.821519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33232. [D 20:43:09.821534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33233. [D 20:43:09.821548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33234. [D 20:43:09.821563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33235. [D 20:43:09.821577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33236. [D 20:43:09.821592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33237. [D 20:43:09.821607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33238. [D 20:43:09.821621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33239. [D 20:43:09.821635] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33240. [D 20:43:09.821657] openib_check_cq: completed rdma wr_id 2aaaab038d60, nic_wr_credit 33240. [D 20:43:09.821674] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 7/70. [D 20:43:09.821736] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.821760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.821774] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.821816] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5641 [D 20:43:09.821831] element 0: offset: 0x2aaaab0173c0, size: 24 [D 20:43:09.821848] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 8/70. [D 20:43:09.821881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.821895] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.821908] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:09.821928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5643 [D 20:43:09.821942] element 0: offset: 0x2aaaab030800, size: 24 [D 20:43:09.821956] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 9/70. [D 20:43:09.824225] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33239. [D 20:43:09.824245] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 10/70. [D 20:43:09.824296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.824310] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.824323] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:09.827309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.827325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.827337] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.833337] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5641 [D 20:43:09.833413] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 11/70. [D 20:43:09.835020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33239. [D 20:43:09.835042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33240. [D 20:43:09.835056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33241. [D 20:43:09.835071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33242. [D 20:43:09.835085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33243. [D 20:43:09.835099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33244. [D 20:43:09.835113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33245. [D 20:43:09.835127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33246. [D 20:43:09.835141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33247. [D 20:43:09.835155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33248. [D 20:43:09.835169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33249. [D 20:43:09.835184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33250. [D 20:43:09.835198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33251. [D 20:43:09.835212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33252. [D 20:43:09.835226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33253. [D 20:43:09.835240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33254. [D 20:43:09.835255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33255. [D 20:43:09.835269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33256. [D 20:43:09.835365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33257. [D 20:43:09.835381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33258. [D 20:43:09.835397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33259. [D 20:43:09.835411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33260. [D 20:43:09.835425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33261. [D 20:43:09.835439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33262. [D 20:43:09.835454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33263. [D 20:43:09.835468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33264. [D 20:43:09.835482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33265. [D 20:43:09.835496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33266. [D 20:43:09.835510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33267. [D 20:43:09.835524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33268. [D 20:43:09.835540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33269. [D 20:43:09.835559] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33270. [D 20:43:09.840878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.840898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.840911] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.840952] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5647 [D 20:43:09.840967] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:09.840984] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 12/70. [D 20:43:09.841021] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33270. [D 20:43:09.841038] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 13/70. [D 20:43:09.841161] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.841263] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.841279] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.844307] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5643 [D 20:43:09.844325] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 14/70. [D 20:43:09.846603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33270. [D 20:43:09.846620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33271. [D 20:43:09.846634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 33272. [D 20:43:09.846649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 33273. [D 20:43:09.846663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 33274. [D 20:43:09.846677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 33275. [D 20:43:09.846691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 33276. [D 20:43:09.846706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33277. [D 20:43:09.846720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33278. [D 20:43:09.846734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33279. [D 20:43:09.846748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 33280. [D 20:43:09.846763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 33281. [D 20:43:09.846777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 33282. [D 20:43:09.846791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 33283. [D 20:43:09.846805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 33284. [D 20:43:09.846819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33285. [D 20:43:09.846833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33286. [D 20:43:09.846847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33287. [D 20:43:09.846861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33288. [D 20:43:09.846876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33289. [D 20:43:09.846890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33290. [D 20:43:09.846905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33291. [D 20:43:09.846919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33292. [D 20:43:09.846933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33293. [D 20:43:09.846948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33294. [D 20:43:09.846962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33295. [D 20:43:09.846977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33296. [D 20:43:09.846991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33297. [D 20:43:09.847005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33298. [D 20:43:09.847019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33299. [D 20:43:09.847033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33300. [D 20:43:09.847048] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab004250 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33301. [D 20:43:09.847732] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5647 [D 20:43:09.847749] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 15/70. [D 20:43:09.849271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.849288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.849300] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.849323] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5649 [D 20:43:09.849337] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:09.849351] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 16/70. [D 20:43:09.858338] openib_check_cq: completed rdma wr_id 2aaaab004250, nic_wr_credit 33301. [D 20:43:09.858433] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 17/70. [D 20:43:09.858456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 33301. [D 20:43:09.858473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 33302. [D 20:43:09.858487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 33303. [D 20:43:09.858501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 33304. [D 20:43:09.858515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 33305. [D 20:43:09.858529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 33306. [D 20:43:09.858544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 33307. [D 20:43:09.858558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 33308. [D 20:43:09.858572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 33309. [D 20:43:09.858586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 33310. [D 20:43:09.858602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 33311. [D 20:43:09.858616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 33312. [D 20:43:09.858631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 33313. [D 20:43:09.858645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 33314. [D 20:43:09.858659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 33315. [D 20:43:09.858674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 33316. [D 20:43:09.858688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 33317. [D 20:43:09.858702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 33318. [D 20:43:09.858716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 33319. [D 20:43:09.858731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 33320. [D 20:43:09.858745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 33321. [D 20:43:09.858759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 33322. [D 20:43:09.858773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 33323. [D 20:43:09.858787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 33324. [D 20:43:09.858801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 33325. [D 20:43:09.858816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 33326. [D 20:43:09.858829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 33327. [D 20:43:09.858844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 33328. [D 20:43:09.858858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 33329. [D 20:43:09.858872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 33330. [D 20:43:09.858886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 33331. [D 20:43:09.858900] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 33332. [D 20:43:09.858959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.858979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.858992] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.862134] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5649 [D 20:43:09.862202] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 18/70. [D 20:43:09.864435] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33332. [D 20:43:09.864470] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 19/70. [D 20:43:09.864487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33332. [D 20:43:09.864515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33333. [D 20:43:09.864530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33334. [D 20:43:09.864556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33335. [D 20:43:09.864583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33336. [D 20:43:09.864598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33337. [D 20:43:09.864613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33338. [D 20:43:09.864627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33339. [D 20:43:09.864660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33340. [D 20:43:09.864674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33341. [D 20:43:09.864689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33342. [D 20:43:09.864721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33343. [D 20:43:09.864736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33344. [D 20:43:09.864751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33345. [D 20:43:09.864774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33346. [D 20:43:09.864789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33347. [D 20:43:09.864803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33348. [D 20:43:09.864818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33349. [D 20:43:09.864832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33350. [D 20:43:09.864862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33351. [D 20:43:09.864877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33352. [D 20:43:09.864892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33353. [D 20:43:09.864906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33354. [D 20:43:09.864921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33355. [D 20:43:09.864938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33356. [D 20:43:09.864953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33357. [D 20:43:09.864967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33358. [D 20:43:09.864981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33359. [D 20:43:09.864995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33360. [D 20:43:09.865010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33361. [D 20:43:09.865024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33362. [D 20:43:09.865038] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33363. [D 20:43:09.865109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.865132] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.865145] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.870650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.870669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.870682] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.870720] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5652 [D 20:43:09.870735] element 0: offset: 0x2aaaab0255b0, size: 24 [D 20:43:09.870752] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 20/70. [D 20:43:09.873309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.873327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.873340] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.873362] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5656 [D 20:43:09.873377] element 0: offset: 0x2aaaab027a00, size: 24 [D 20:43:09.873392] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 21/70. [D 20:43:09.876194] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33363. [D 20:43:09.876218] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 22/70. [D 20:43:09.876362] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.876383] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.876396] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.880057] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5652 [D 20:43:09.880124] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 23/70. [D 20:43:09.882304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33363. [D 20:43:09.882326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33364. [D 20:43:09.882342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33365. [D 20:43:09.882357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33366. [D 20:43:09.882372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33367. [D 20:43:09.882386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33368. [D 20:43:09.882401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33369. [D 20:43:09.882417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33370. [D 20:43:09.882444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33371. [D 20:43:09.882467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33372. [D 20:43:09.882482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33373. [D 20:43:09.882510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33374. [D 20:43:09.882526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33375. [D 20:43:09.882550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33376. [D 20:43:09.882567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33377. [D 20:43:09.882595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33378. [D 20:43:09.882610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33379. [D 20:43:09.882637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33380. [D 20:43:09.882665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33381. [D 20:43:09.882690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33382. [D 20:43:09.882707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33383. [D 20:43:09.882730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33384. [D 20:43:09.882745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33385. [D 20:43:09.882773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33386. [D 20:43:09.882798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33387. [D 20:43:09.882814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33388. [D 20:43:09.882839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33389. [D 20:43:09.882855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33390. [D 20:43:09.882882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33391. [D 20:43:09.882906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33392. [D 20:43:09.882917] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5656 [D 20:43:09.882921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33393. [D 20:43:09.883425] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33394. [D 20:43:09.883502] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 24/70. [D 20:43:09.885001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.885021] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.885035] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.885076] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5658 [D 20:43:09.885091] element 0: offset: 0x2aaaab0386a0, size: 24 [D 20:43:09.885108] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 25/70. [D 20:43:09.893993] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33394. [D 20:43:09.894019] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 26/70. [D 20:43:09.894047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33394. [D 20:43:09.894063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 33395. [D 20:43:09.894078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 33396. [D 20:43:09.894103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 33397. [D 20:43:09.894127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 33398. [D 20:43:09.894142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 33399. [D 20:43:09.894156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33400. [D 20:43:09.894172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33401. [D 20:43:09.894187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33402. [D 20:43:09.894201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 33403. [D 20:43:09.894216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 33404. [D 20:43:09.894231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 33405. [D 20:43:09.894245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 33406. [D 20:43:09.894260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 33407. [D 20:43:09.894275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33408. [D 20:43:09.894289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33409. [D 20:43:09.894304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33410. [D 20:43:09.894318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33411. [D 20:43:09.894333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33412. [D 20:43:09.894348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33413. [D 20:43:09.894362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33414. [D 20:43:09.894377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33415. [D 20:43:09.894392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33416. [D 20:43:09.894406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33417. [D 20:43:09.894421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33418. [D 20:43:09.894435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33419. [D 20:43:09.894450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33420. [D 20:43:09.894464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33421. [D 20:43:09.894479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33422. [D 20:43:09.894494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33423. [D 20:43:09.894508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33424. [D 20:43:09.894523] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33425. [D 20:43:09.894588] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.894622] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.894635] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.897369] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5658 [D 20:43:09.897441] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 27/70. [D 20:43:09.905723] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 33425. [D 20:43:09.905750] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 28/70. [D 20:43:09.905830] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.905852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.905865] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.911203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 33425. [D 20:43:09.911229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 33426. [D 20:43:09.911243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33427. [D 20:43:09.911258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33428. [D 20:43:09.911273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33429. [D 20:43:09.911287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33430. [D 20:43:09.911302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33431. [D 20:43:09.911316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33432. [D 20:43:09.911341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33433. [D 20:43:09.911363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33434. [D 20:43:09.911378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33435. [D 20:43:09.911405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33436. [D 20:43:09.911420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33437. [D 20:43:09.911444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33438. [D 20:43:09.911459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33439. [D 20:43:09.911485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33440. [D 20:43:09.911500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33441. [D 20:43:09.911531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33442. [D 20:43:09.911547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33443. [D 20:43:09.911561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33444. [D 20:43:09.911588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33445. [D 20:43:09.911612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33446. [D 20:43:09.911626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33447. [D 20:43:09.911649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33448. [D 20:43:09.911663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33449. [D 20:43:09.911700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33450. [D 20:43:09.911715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33451. [D 20:43:09.911740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33452. [D 20:43:09.911755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33453. [D 20:43:09.911783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33454. [D 20:43:09.911798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33455. [D 20:43:09.911812] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33456. [D 20:43:09.919905] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.919928] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.919941] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.919986] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5662 [D 20:43:09.920001] element 0: offset: 0x2aaaab038cf0, size: 24 [D 20:43:09.920018] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 29/70. [D 20:43:09.920056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.920070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.920082] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.920102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5665 [D 20:43:09.920117] element 0: offset: 0x2aaaab033370, size: 24 [D 20:43:09.920133] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 30/70. [D 20:43:09.923021] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33456. [D 20:43:09.923045] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 31/70. [D 20:43:09.923180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.923201] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.923214] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:09.928155] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5662 [D 20:43:09.928235] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 32/70. [D 20:43:09.929174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33456. [D 20:43:09.929200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33457. [D 20:43:09.929215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33458. [D 20:43:09.929229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33459. [D 20:43:09.929244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33460. [D 20:43:09.929259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33461. [D 20:43:09.929285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33462. [D 20:43:09.929299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33463. [D 20:43:09.929327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33464. [D 20:43:09.929351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33465. [D 20:43:09.929366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33466. [D 20:43:09.929381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33467. [D 20:43:09.929409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33468. [D 20:43:09.929435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33469. [D 20:43:09.929464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33470. [D 20:43:09.929437] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5665 [D 20:43:09.929479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33471. [D 20:43:09.930006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33472. [D 20:43:09.930021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33473. [D 20:43:09.930050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33474. [D 20:43:09.930074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33475. [D 20:43:09.930089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33476. [D 20:43:09.930103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33477. [D 20:43:09.930130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33478. [D 20:43:09.930154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33479. [D 20:43:09.930169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33480. [D 20:43:09.930183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33481. [D 20:43:09.930198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33482. [D 20:43:09.930212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33483. [D 20:43:09.930227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33484. [D 20:43:09.930241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33485. [D 20:43:09.930256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33486. [D 20:43:09.930270] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33487. [D 20:43:09.930300] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 33/70. [D 20:43:09.940939] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 33487. [D 20:43:09.940964] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 34/70. [D 20:43:09.940996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33487. [D 20:43:09.941020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 33488. [D 20:43:09.941036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 33489. [D 20:43:09.941050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 33490. [D 20:43:09.941069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 33491. [D 20:43:09.941083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 33492. [D 20:43:09.941098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33493. [D 20:43:09.941114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33494. [D 20:43:09.941129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33495. [D 20:43:09.941143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 33496. [D 20:43:09.941158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 33497. [D 20:43:09.941176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 33498. [D 20:43:09.941191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 33499. [D 20:43:09.941205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 33500. [D 20:43:09.941220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33501. [D 20:43:09.941234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33502. [D 20:43:09.941249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33503. [D 20:43:09.941263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33504. [D 20:43:09.941278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33505. [D 20:43:09.941292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33506. [D 20:43:09.941307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33507. [D 20:43:09.941321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33508. [D 20:43:09.941336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33509. [D 20:43:09.941350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33510. [D 20:43:09.941365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33511. [D 20:43:09.941379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33512. [D 20:43:09.941394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33513. [D 20:43:09.941409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33514. [D 20:43:09.941423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33515. [D 20:43:09.941438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33516. [D 20:43:09.941452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33517. [D 20:43:09.941466] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33518. [D 20:43:09.941545] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.941568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.941582] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:09.952587] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 33518. [D 20:43:09.952612] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 35/70. [D 20:43:09.952675] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:09.952697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.952711] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:09.967942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.967961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.967979] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:09.968018] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5669 [D 20:43:09.968033] element 0: offset: 0x2aaaab027a00, size: 24 [D 20:43:09.968050] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 36/70. [D 20:43:09.968092] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.968106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.968118] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:09.968138] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5672 [D 20:43:09.968152] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:09.968168] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 37/70. [D 20:43:09.968194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:09.968209] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:09.968221] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:09.968242] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5673 [D 20:43:09.968256] element 0: offset: 0x2aaaab0255b0, size: 24 [D 20:43:09.968272] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 38/70. [D 20:43:09.972048] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5669 [D 20:43:09.972127] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 39/70. [D 20:43:09.972211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 33518. [D 20:43:09.972282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 33519. [D 20:43:09.972297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33520. [D 20:43:09.972312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33521. [D 20:43:09.972327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33522. [D 20:43:09.972342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33523. [D 20:43:09.972357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33524. [D 20:43:09.972371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33525. [D 20:43:09.972386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33526. [D 20:43:09.972400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33527. [D 20:43:09.972415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33528. [D 20:43:09.972430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33529. [D 20:43:09.972445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33530. [D 20:43:09.972459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33531. [D 20:43:09.972474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33532. [D 20:43:09.972488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33533. [D 20:43:09.972503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33534. [D 20:43:09.972523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33535. [D 20:43:09.972538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33536. [D 20:43:09.972552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33537. [D 20:43:09.972567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33538. [D 20:43:09.972582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33539. [D 20:43:09.972596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33540. [D 20:43:09.972611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33541. [D 20:43:09.972626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33542. [D 20:43:09.972640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33543. [D 20:43:09.972655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33544. [D 20:43:09.972669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33545. [D 20:43:09.972684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33546. [D 20:43:09.972699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33547. [D 20:43:09.972713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33548. [D 20:43:09.972728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c640 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33549. [D 20:43:09.974667] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5672 [D 20:43:09.974731] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 40/70. [D 20:43:09.978993] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5673 [D 20:43:09.979018] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 41/70. [D 20:43:09.981651] openib_check_cq: completed rdma wr_id 2aaaab02c640, nic_wr_credit 33549. [D 20:43:09.981724] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 42/70. [D 20:43:09.981746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33549. [D 20:43:09.981762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 33550. [D 20:43:09.981777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 33551. [D 20:43:09.981791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 33552. [D 20:43:09.981806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 33553. [D 20:43:09.981820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 33554. [D 20:43:09.981835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33555. [D 20:43:09.981849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33556. [D 20:43:09.981864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33557. [D 20:43:09.981878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 33558. [D 20:43:09.981895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 33559. [D 20:43:09.981909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 33560. [D 20:43:09.981923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 33561. [D 20:43:09.981938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 33562. [D 20:43:09.981953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33563. [D 20:43:09.981967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33564. [D 20:43:09.981981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33565. [D 20:43:09.981996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 33566. [D 20:43:09.982010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 33567. [D 20:43:09.982025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 33568. [D 20:43:09.982040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 33569. [D 20:43:09.982054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 33570. [D 20:43:09.982068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33571. [D 20:43:09.982083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33572. [D 20:43:09.982097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33573. [D 20:43:09.982111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 33574. [D 20:43:09.982126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 33575. [D 20:43:09.982141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 33576. [D 20:43:09.982155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 33577. [D 20:43:09.982170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 33578. [D 20:43:09.982184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33579. [D 20:43:09.982198] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33580. [D 20:43:09.982215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33581. [D 20:43:09.982230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33582. [D 20:43:09.982245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 33583. [D 20:43:09.982259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 33584. [D 20:43:09.982274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 33585. [D 20:43:09.982288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 33586. [D 20:43:09.982303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 33587. [D 20:43:10.268216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33588. [D 20:43:10.268237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33589. [D 20:43:10.268252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33590. [D 20:43:10.268267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 33591. [D 20:43:10.268281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 33592. [D 20:43:10.268296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 33593. [D 20:43:10.268311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 33594. [D 20:43:10.268325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 33595. [D 20:43:10.268340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33596. [D 20:43:10.268955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33597. [D 20:43:10.268987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33598. [D 20:43:10.269003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33599. [D 20:43:10.269026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33600. [D 20:43:10.269041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33601. [D 20:43:10.269055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33602. [D 20:43:10.269069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33603. [D 20:43:10.269084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33604. [D 20:43:10.269098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33605. [D 20:43:10.269113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33606. [D 20:43:10.269127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33607. [D 20:43:10.269142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33608. [D 20:43:10.269156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33609. [D 20:43:10.269171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33610. [D 20:43:10.269770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33611. [D 20:43:10.269786] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33612. [D 20:43:10.269803] openib_check_cq: completed rdma wr_id 2aaaab0146b0, nic_wr_credit 33612. [D 20:43:10.269819] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 43/70. [D 20:43:10.269991] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.270016] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.270029] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.270060] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.270074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.270086] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:10.270125] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5676 [D 20:43:10.270140] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:10.270159] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 44/70. [D 20:43:10.270193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.270206] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.270219] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:10.270240] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5679 [D 20:43:10.270254] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:10.270268] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 45/70. [D 20:43:10.272973] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 33611. [D 20:43:10.272998] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 46/70. [D 20:43:10.273052] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.273072] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.273084] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:10.273199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.273214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.273226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.281009] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5676 [D 20:43:10.281089] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 47/70. [D 20:43:10.283516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 33611. [D 20:43:10.283592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 33612. [D 20:43:10.283607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33613. [D 20:43:10.283622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33614. [D 20:43:10.283637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33615. [D 20:43:10.283651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33616. [D 20:43:10.283665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33617. [D 20:43:10.283679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33618. [D 20:43:10.283694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33619. [D 20:43:10.283708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33620. [D 20:43:10.283722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33621. [D 20:43:10.283736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33622. [D 20:43:10.283750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33623. [D 20:43:10.283764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33624. [D 20:43:10.283779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33625. [D 20:43:10.283793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33626. [D 20:43:10.283807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33627. [D 20:43:10.283822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33628. [D 20:43:10.283837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33629. [D 20:43:10.283852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33630. [D 20:43:10.283867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33631. [D 20:43:10.283882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33632. [D 20:43:10.283896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33633. [D 20:43:10.283911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33634. [D 20:43:10.283925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33635. [D 20:43:10.283940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33636. [D 20:43:10.283955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33637. [D 20:43:10.283970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33638. [D 20:43:10.283992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33639. [D 20:43:10.284006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33640. [D 20:43:10.284020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33641. [D 20:43:10.284035] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c640 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33642. [D 20:43:10.286392] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.286414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.286428] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:10.286469] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5684 [D 20:43:10.286484] element 0: offset: 0x2aaaab0173c0, size: 24 [D 20:43:10.286501] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 48/70. [D 20:43:10.286541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.286555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.286567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:10.286588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5685 [D 20:43:10.286602] element 0: offset: 0x2aaaab0386a0, size: 24 [D 20:43:10.286616] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 49/70. [D 20:43:10.288929] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5679 [D 20:43:10.288950] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 50/70. [D 20:43:10.289875] openib_check_cq: completed rdma wr_id 2aaaab02c640, nic_wr_credit 33642. [D 20:43:10.290042] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 51/70. [D 20:43:10.290114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 33642. [D 20:43:10.290845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 33643. [D 20:43:10.290986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 33644. [D 20:43:10.291527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 33645. [D 20:43:10.291544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 33646. [D 20:43:10.291558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 33647. [D 20:43:10.291572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 33648. [D 20:43:10.291587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 33649. [D 20:43:10.291601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 33650. [D 20:43:10.291615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 33651. [D 20:43:10.291629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 33652. [D 20:43:10.291643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 33653. [D 20:43:10.291667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 33654. [D 20:43:10.291681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 33655. [D 20:43:10.291696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 33656. [D 20:43:10.291710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 33657. [D 20:43:10.291724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 33658. [D 20:43:10.291738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 33659. [D 20:43:10.291752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 33660. [D 20:43:10.291765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 33661. [D 20:43:10.291779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 33662. [D 20:43:10.291794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 33663. [D 20:43:10.291808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 33664. [D 20:43:10.291822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 33665. [D 20:43:10.291836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 33666. [D 20:43:10.291850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 33667. [D 20:43:10.291864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 33668. [D 20:43:10.291878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 33669. [D 20:43:10.291892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 33670. [D 20:43:10.291906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 33671. [D 20:43:10.291920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 33672. [D 20:43:10.291934] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab01eb90 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 33673. [D 20:43:10.292064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.292080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.292092] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:10.302398] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5684 [D 20:43:10.302477] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 52/70. [D 20:43:10.302535] openib_check_cq: completed rdma wr_id 2aaaab01eb90, nic_wr_credit 33673. [D 20:43:10.302554] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 53/70. [D 20:43:10.302623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33673. [D 20:43:10.302639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 33674. [D 20:43:10.302653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 33675. [D 20:43:10.302667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 33676. [D 20:43:10.302681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 33677. [D 20:43:10.302695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 33678. [D 20:43:10.302709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33679. [D 20:43:10.302723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33680. [D 20:43:10.302737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33681. [D 20:43:10.302751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 33682. [D 20:43:10.302765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 33683. [D 20:43:10.302779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 33684. [D 20:43:10.302793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 33685. [D 20:43:10.302807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 33686. [D 20:43:10.302821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33687. [D 20:43:10.302835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33688. [D 20:43:10.302849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33689. [D 20:43:10.302863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 33690. [D 20:43:10.302877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 33691. [D 20:43:10.302891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 33692. [D 20:43:10.302905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 33693. [D 20:43:10.302919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 33694. [D 20:43:10.302933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33695. [D 20:43:10.302947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33696. [D 20:43:10.302961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33697. [D 20:43:10.302975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 33698. [D 20:43:10.302989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 33699. [D 20:43:10.303004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 33700. [D 20:43:10.303018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 33701. [D 20:43:10.303032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 33702. [D 20:43:10.303046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33703. [D 20:43:10.303060] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c640 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33704. [D 20:43:10.304084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.304158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.304172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.305499] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5685 [D 20:43:10.305556] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 54/70. [D 20:43:10.312011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.312033] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.312047] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:10.312092] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5688 [D 20:43:10.312108] element 0: offset: 0x2aaaab027a00, size: 24 [D 20:43:10.312124] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 55/70. [D 20:43:10.313172] openib_check_cq: completed rdma wr_id 2aaaab02c640, nic_wr_credit 33704. [D 20:43:10.313191] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 56/70. [D 20:43:10.313209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33704. [D 20:43:10.313224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33705. [D 20:43:10.313239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 33706. [D 20:43:10.313253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 33707. [D 20:43:10.313268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 33708. [D 20:43:10.313282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 33709. [D 20:43:10.313296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 33710. [D 20:43:10.313310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33711. [D 20:43:10.313325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33712. [D 20:43:10.313339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33713. [D 20:43:10.313353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 33714. [D 20:43:10.313367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 33715. [D 20:43:10.313382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 33716. [D 20:43:10.313396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 33717. [D 20:43:10.313410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 33718. [D 20:43:10.313424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33719. [D 20:43:10.313441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33720. [D 20:43:10.313455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33721. [D 20:43:10.313470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33722. [D 20:43:10.313484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33723. [D 20:43:10.313499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33724. [D 20:43:10.313513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33725. [D 20:43:10.313527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33726. [D 20:43:10.313541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33727. [D 20:43:10.313556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33728. [D 20:43:10.313570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33729. [D 20:43:10.313584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33730. [D 20:43:10.313599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33731. [D 20:43:10.313613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33732. [D 20:43:10.313638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33733. [D 20:43:10.313652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33734. [D 20:43:10.313676] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c330 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33735. [D 20:43:10.316936] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.316961] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.316974] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.319487] openib_check_cq: completed rdma wr_id 2aaaab02c330, nic_wr_credit 33735. [D 20:43:10.319565] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 57/70. [D 20:43:10.319688] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.319709] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.319722] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.323333] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5688 [D 20:43:10.323384] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 58/70. [D 20:43:10.325341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33735. [D 20:43:10.325362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33736. [D 20:43:10.325376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33737. [D 20:43:10.325395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33738. [D 20:43:10.325410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33739. [D 20:43:10.325424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33740. [D 20:43:10.325439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33741. [D 20:43:10.325455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33742. [D 20:43:10.325469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33743. [D 20:43:10.325484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33744. [D 20:43:10.325498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33745. [D 20:43:10.325513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33746. [D 20:43:10.325527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33747. [D 20:43:10.325541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33748. [D 20:43:10.325555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33749. [D 20:43:10.325570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33750. [D 20:43:10.325584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33751. [D 20:43:10.325598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33752. [D 20:43:10.325613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33753. [D 20:43:10.325627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33754. [D 20:43:10.325641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33755. [D 20:43:10.325655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33756. [D 20:43:10.325669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33757. [D 20:43:10.325684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33758. [D 20:43:10.325698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33759. [D 20:43:10.325712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33760. [D 20:43:10.325726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33761. [D 20:43:10.325741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33762. [D 20:43:10.325755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33763. [D 20:43:10.325769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33764. [D 20:43:10.325783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33765. [D 20:43:10.325798] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c640 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33766. [D 20:43:10.328180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.328202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.328215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.328253] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5691 [D 20:43:10.328267] element 0: offset: 0x2aaaab0255b0, size: 24 [D 20:43:10.328286] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 59/70. [D 20:43:10.331657] openib_check_cq: completed rdma wr_id 2aaaab02c640, nic_wr_credit 33766. [D 20:43:10.331683] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 60/70. [D 20:43:10.331787] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.331808] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.331821] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.334711] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5691 [D 20:43:10.334861] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 0/70. [D 20:43:10.338391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33766. [D 20:43:10.338409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33767. [D 20:43:10.338424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33768. [D 20:43:10.338438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33769. [D 20:43:10.338453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33770. [D 20:43:10.338468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33771. [D 20:43:10.338482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33772. [D 20:43:10.338497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33773. [D 20:43:10.338511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33774. [D 20:43:10.338526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33775. [D 20:43:10.338540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33776. [D 20:43:10.338555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33777. [D 20:43:10.338570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33778. [D 20:43:10.338584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33779. [D 20:43:10.338599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33780. [D 20:43:10.338613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33781. [D 20:43:10.338628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33782. [D 20:43:10.338642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33783. [D 20:43:10.338657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33784. [D 20:43:10.338672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33785. [D 20:43:10.338686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33786. [D 20:43:10.338701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33787. [D 20:43:10.338715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33788. [D 20:43:10.338730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33789. [D 20:43:10.338745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33790. [D 20:43:10.338759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33791. [D 20:43:10.338775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33792. [D 20:43:10.338789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33793. [D 20:43:10.338804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33794. [D 20:43:10.338818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33795. [D 20:43:10.338833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33796. [D 20:43:10.338848] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33797. [D 20:43:10.341180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.341231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.341245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.341290] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5694 [D 20:43:10.341305] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:10.341326] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 1/70. [D 20:43:10.344633] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33797. [D 20:43:10.344657] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 2/70. [D 20:43:10.344769] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.344790] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.344803] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.350716] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5694 [D 20:43:10.350781] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 3/70. [D 20:43:10.350867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33797. [D 20:43:10.350887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33798. [D 20:43:10.350901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33799. [D 20:43:10.350916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33800. [D 20:43:10.350930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33801. [D 20:43:10.350944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33802. [D 20:43:10.350959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33803. [D 20:43:10.350979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33804. [D 20:43:10.350993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33805. [D 20:43:10.351007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33806. [D 20:43:10.351021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33807. [D 20:43:10.351035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33808. [D 20:43:10.351050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33809. [D 20:43:10.351064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33810. [D 20:43:10.351078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33811. [D 20:43:10.351094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33812. [D 20:43:10.351109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33813. [D 20:43:10.351123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33814. [D 20:43:10.351138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33815. [D 20:43:10.351153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33816. [D 20:43:10.351168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33817. [D 20:43:10.351183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33818. [D 20:43:10.351198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33819. [D 20:43:10.351212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33820. [D 20:43:10.351227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33821. [D 20:43:10.351242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33822. [D 20:43:10.351256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33823. [D 20:43:10.351271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33824. [D 20:43:10.351286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33825. [D 20:43:10.351301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33826. [D 20:43:10.351315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33827. [D 20:43:10.351330] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33828. [D 20:43:10.353438] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.353461] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.353474] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.353499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5697 [D 20:43:10.353513] element 0: offset: 0x2aaaab0386a0, size: 24 [D 20:43:10.353529] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 4/70. [D 20:43:10.357380] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33828. [D 20:43:10.357406] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 5/70. [D 20:43:10.357510] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.357531] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.357544] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.360594] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5697 [D 20:43:10.360615] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 6/70. [D 20:43:10.364026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33828. [D 20:43:10.364044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33829. [D 20:43:10.364059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33830. [D 20:43:10.364073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33831. [D 20:43:10.364089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33832. [D 20:43:10.364103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33833. [D 20:43:10.364118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33834. [D 20:43:10.364132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33835. [D 20:43:10.364147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33836. [D 20:43:10.364162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33837. [D 20:43:10.364176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33838. [D 20:43:10.364191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33839. [D 20:43:10.364206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33840. [D 20:43:10.364220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33841. [D 20:43:10.364235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33842. [D 20:43:10.364250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33843. [D 20:43:10.364264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33844. [D 20:43:10.364279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33845. [D 20:43:10.364294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33846. [D 20:43:10.364308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33847. [D 20:43:10.364323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33848. [D 20:43:10.364338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33849. [D 20:43:10.364352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33850. [D 20:43:10.364367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33851. [D 20:43:10.364382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33852. [D 20:43:10.364396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33853. [D 20:43:10.364411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33854. [D 20:43:10.364426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33855. [D 20:43:10.364440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33856. [D 20:43:10.364455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33857. [D 20:43:10.364470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33858. [D 20:43:10.364484] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33859. [D 20:43:10.366723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.366772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.366786] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.366831] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5700 [D 20:43:10.366846] element 0: offset: 0x2aaaab017180, size: 24 [D 20:43:10.366866] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 7/70. [D 20:43:10.370347] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33859. [D 20:43:10.370368] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 8/70. [D 20:43:10.370481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.370503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.370516] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.374949] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5700 [D 20:43:10.374973] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 9/70. [D 20:43:10.376465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33859. [D 20:43:10.376483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33860. [D 20:43:10.376498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33861. [D 20:43:10.376513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33862. [D 20:43:10.376528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33863. [D 20:43:10.376542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33864. [D 20:43:10.376557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33865. [D 20:43:10.376572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33866. [D 20:43:10.376586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33867. [D 20:43:10.376601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33868. [D 20:43:10.376616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33869. [D 20:43:10.376631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33870. [D 20:43:10.376645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33871. [D 20:43:10.376660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33872. [D 20:43:10.376674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33873. [D 20:43:10.376689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33874. [D 20:43:10.376704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33875. [D 20:43:10.376718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33876. [D 20:43:10.376733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33877. [D 20:43:10.376748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33878. [D 20:43:10.376763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33879. [D 20:43:10.376778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33880. [D 20:43:10.376792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33881. [D 20:43:10.376808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33882. [D 20:43:10.376822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33883. [D 20:43:10.376836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33884. [D 20:43:10.376850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33885. [D 20:43:10.376865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33886. [D 20:43:10.376879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33887. [D 20:43:10.376893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33888. [D 20:43:10.376907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33889. [D 20:43:10.376922] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33890. [D 20:43:10.379128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.379184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.379198] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.379243] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5703 [D 20:43:10.379258] element 0: offset: 0x2aaaab0307c0, size: 24 [D 20:43:10.379279] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 10/70. [D 20:43:10.382916] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33890. [D 20:43:10.382937] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 11/70. [D 20:43:10.383051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.383073] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.383086] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.386023] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5703 [D 20:43:10.386106] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 12/70. [D 20:43:10.389456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33890. [D 20:43:10.389473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33891. [D 20:43:10.389488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33892. [D 20:43:10.389502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33893. [D 20:43:10.389517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33894. [D 20:43:10.389532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33895. [D 20:43:10.389546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33896. [D 20:43:10.389561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33897. [D 20:43:10.389575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33898. [D 20:43:10.389590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33899. [D 20:43:10.389604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33900. [D 20:43:10.389619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33901. [D 20:43:10.389634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33902. [D 20:43:10.389649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33903. [D 20:43:10.389664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33904. [D 20:43:10.389678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33905. [D 20:43:10.389693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33906. [D 20:43:10.389707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33907. [D 20:43:10.389722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33908. [D 20:43:10.389736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33909. [D 20:43:10.389751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33910. [D 20:43:10.389765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33911. [D 20:43:10.389780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33912. [D 20:43:10.389794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33913. [D 20:43:10.389809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33914. [D 20:43:10.389823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33915. [D 20:43:10.389838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33916. [D 20:43:10.389852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33917. [D 20:43:10.389867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33918. [D 20:43:10.389881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33919. [D 20:43:10.389896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33920. [D 20:43:10.389910] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33921. [D 20:43:10.392221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.392275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.392289] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.392334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5706 [D 20:43:10.392350] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:10.392370] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 13/70. [D 20:43:10.395722] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33921. [D 20:43:10.395749] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 14/70. [D 20:43:10.395862] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.395883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.395896] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.398832] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5706 [D 20:43:10.398893] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 15/70. [D 20:43:10.401756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33921. [D 20:43:10.401783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33922. [D 20:43:10.401798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33923. [D 20:43:10.401813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33924. [D 20:43:10.401827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33925. [D 20:43:10.401842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33926. [D 20:43:10.401856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33927. [D 20:43:10.401871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33928. [D 20:43:10.401885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33929. [D 20:43:10.401900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33930. [D 20:43:10.401914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33931. [D 20:43:10.401929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33932. [D 20:43:10.401944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33933. [D 20:43:10.401958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33934. [D 20:43:10.401972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33935. [D 20:43:10.401987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33936. [D 20:43:10.402001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33937. [D 20:43:10.402016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 33938. [D 20:43:10.402031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 33939. [D 20:43:10.402045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 33940. [D 20:43:10.402060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 33941. [D 20:43:10.402075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 33942. [D 20:43:10.402089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 33943. [D 20:43:10.402104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 33944. [D 20:43:10.402118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 33945. [D 20:43:10.402133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 33946. [D 20:43:10.402147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 33947. [D 20:43:10.402162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 33948. [D 20:43:10.402176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 33949. [D 20:43:10.402191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 33950. [D 20:43:10.402210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 33951. [D 20:43:10.402225] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 33952. [D 20:43:10.404451] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.404475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.404489] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.404531] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5709 [D 20:43:10.404546] element 0: offset: 0x658610, size: 24 [D 20:43:10.404563] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 16/70. [D 20:43:10.407919] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33952. [D 20:43:10.407946] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 17/70. [D 20:43:10.408066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.408087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.408100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.411080] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5709 [D 20:43:10.411148] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 18/70. [D 20:43:10.414595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33952. [D 20:43:10.414620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33953. [D 20:43:10.414635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 33954. [D 20:43:10.414649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 33955. [D 20:43:10.414664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 33956. [D 20:43:10.414678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 33957. [D 20:43:10.414693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 33958. [D 20:43:10.414708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33959. [D 20:43:10.414722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33960. [D 20:43:10.414737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33961. [D 20:43:10.414751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 33962. [D 20:43:10.414766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 33963. [D 20:43:10.414780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 33964. [D 20:43:10.414795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 33965. [D 20:43:10.414810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 33966. [D 20:43:10.414824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33967. [D 20:43:10.414838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33968. [D 20:43:10.414853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33969. [D 20:43:10.414867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 33970. [D 20:43:10.414883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 33971. [D 20:43:10.414897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 33972. [D 20:43:10.414911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 33973. [D 20:43:10.414926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 33974. [D 20:43:10.414940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33975. [D 20:43:10.414954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33976. [D 20:43:10.414969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33977. [D 20:43:10.414987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 33978. [D 20:43:10.415001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 33979. [D 20:43:10.415016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 33980. [D 20:43:10.415030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 33981. [D 20:43:10.415045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 33982. [D 20:43:10.415060] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33983. [D 20:43:10.417306] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.417330] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.417344] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.417385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5712 [D 20:43:10.417400] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.417418] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 19/70. [D 20:43:10.420486] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 33983. [D 20:43:10.420512] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 20/70. [D 20:43:10.420628] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.420649] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.420661] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.423663] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5712 [D 20:43:10.423730] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 21/70. [D 20:43:10.426453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 33983. [D 20:43:10.426478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 33984. [D 20:43:10.426493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 33985. [D 20:43:10.426507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 33986. [D 20:43:10.426522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 33987. [D 20:43:10.426837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 33988. [D 20:43:10.426866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 33989. [D 20:43:10.426881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 33990. [D 20:43:10.426909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 33991. [D 20:43:10.426934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 33992. [D 20:43:10.426956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 33993. [D 20:43:10.426970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 33994. [D 20:43:10.426988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 33995. [D 20:43:10.427002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 33996. [D 20:43:10.427017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 33997. [D 20:43:10.427031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 33998. [D 20:43:10.427046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 33999. [D 20:43:10.427061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34000. [D 20:43:10.427075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34001. [D 20:43:10.427090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34002. [D 20:43:10.427104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34003. [D 20:43:10.427119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34004. [D 20:43:10.427133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34005. [D 20:43:10.427148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34006. [D 20:43:10.427162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34007. [D 20:43:10.427177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34008. [D 20:43:10.427191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34009. [D 20:43:10.427206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34010. [D 20:43:10.427220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34011. [D 20:43:10.427235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34012. [D 20:43:10.427249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34013. [D 20:43:10.427264] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34014. [D 20:43:10.429436] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.429460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.429474] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.429551] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5716 [D 20:43:10.429566] element 0: offset: 0x691fe0, size: 24 [D 20:43:10.429583] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 22/70. [D 20:43:10.429623] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.429637] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.429649] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:10.438150] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34014. [D 20:43:10.719936] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 23/70. [D 20:43:10.720353] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5718 [D 20:43:10.720377] element 0: offset: 0x658610, size: 24 [D 20:43:10.720393] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 24/70. [D 20:43:10.720488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.720503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.720516] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:10.720538] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5722 [D 20:43:10.720552] element 0: offset: 0x6301d0, size: 24 [D 20:43:10.720566] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 25/70. [D 20:43:10.720605] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.720619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.720631] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:10.728366] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.728431] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.728446] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:10.728487] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5724 [D 20:43:10.728503] element 0: offset: 0x661610, size: 24 [D 20:43:10.728523] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 26/70. [D 20:43:10.729906] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5716 [D 20:43:10.729963] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 27/70. [D 20:43:10.730022] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5718 [D 20:43:10.730041] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 28/70. [D 20:43:10.730096] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5722 [D 20:43:10.730114] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 29/70. [D 20:43:10.730777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34014. [D 20:43:10.730812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34015. [D 20:43:10.730827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 34016. [D 20:43:10.730842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 34017. [D 20:43:10.730856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 34018. [D 20:43:10.730871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 34019. [D 20:43:10.730885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 34020. [D 20:43:10.730900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34021. [D 20:43:10.730914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34022. [D 20:43:10.730929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34023. [D 20:43:10.730943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 34024. [D 20:43:10.730957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 34025. [D 20:43:10.730972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 34026. [D 20:43:10.730986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 34027. [D 20:43:10.731004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 34028. [D 20:43:10.731019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34029. [D 20:43:10.731034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34030. [D 20:43:10.731048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34031. [D 20:43:10.731063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 34032. [D 20:43:10.731077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 34033. [D 20:43:10.731092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 34034. [D 20:43:10.731106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 34035. [D 20:43:10.731120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 34036. [D 20:43:10.731135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34037. [D 20:43:10.731149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34038. [D 20:43:10.731164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34039. [D 20:43:10.731178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 34040. [D 20:43:10.731192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 34041. [D 20:43:10.731206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 34042. [D 20:43:10.731221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 34043. [D 20:43:10.731235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 34044. [D 20:43:10.731249] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34045. [D 20:43:10.731266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34046. [D 20:43:10.731281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34047. [D 20:43:10.731295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34048. [D 20:43:10.731309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34049. [D 20:43:10.731324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34050. [D 20:43:10.731338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34051. [D 20:43:10.731352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34052. [D 20:43:10.731367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34053. [D 20:43:10.731381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34054. [D 20:43:10.731395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34055. [D 20:43:10.731410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34056. [D 20:43:10.731424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34057. [D 20:43:10.731439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34058. [D 20:43:10.731454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34059. [D 20:43:10.731468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34060. [D 20:43:10.731483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34061. [D 20:43:10.731497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34062. [D 20:43:10.731512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34063. [D 20:43:10.731527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34064. [D 20:43:10.731542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34065. [D 20:43:10.731556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34066. [D 20:43:10.731571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34067. [D 20:43:10.731585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34068. [D 20:43:10.731600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34069. [D 20:43:10.731614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34070. [D 20:43:10.731629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34071. [D 20:43:10.731643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34072. [D 20:43:10.731658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34073. [D 20:43:10.731673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34074. [D 20:43:10.731687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34075. [D 20:43:10.731702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34076. [D 20:43:10.731716] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c330 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34077. [D 20:43:10.731733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34078. [D 20:43:10.731748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34079. [D 20:43:10.731762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34080. [D 20:43:10.731777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34081. [D 20:43:10.731792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34082. [D 20:43:10.731806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34083. [D 20:43:10.731821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34084. [E 20:43:10.731841] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 34085, block for 10 ms. [D 20:43:10.733200] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5724 [D 20:43:10.738166] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34084. [D 20:43:10.738193] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 30/70. [D 20:43:10.738208] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34083. [D 20:43:10.738223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34084. [D 20:43:10.738238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34085. [D 20:43:10.738252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34086. [D 20:43:10.738266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34087. [D 20:43:10.738281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34088. [D 20:43:10.738295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34089. [D 20:43:10.738309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34090. [D 20:43:10.738323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34091. [D 20:43:10.738338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34092. [D 20:43:10.738352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34093. [D 20:43:10.738366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34094. [D 20:43:10.738380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34095. [D 20:43:10.738395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34096. [D 20:43:10.738409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34097. [D 20:43:10.738423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34098. [D 20:43:10.738437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34099. [D 20:43:10.738452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34100. [D 20:43:10.738466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34101. [D 20:43:10.738480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34102. [D 20:43:10.738494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34103. [D 20:43:10.738508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34104. [D 20:43:10.738522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34105. [D 20:43:10.738537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34106. [D 20:43:10.738551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34107. [D 20:43:10.738565] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab011990 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34108. [D 20:43:10.738600] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 31/70. [D 20:43:10.748397] openib_check_cq: completed rdma wr_id 2aaaab02c330, nic_wr_credit 34108. [D 20:43:10.748424] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 32/70. [D 20:43:10.752039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.752062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.752075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:10.754274] openib_check_cq: completed rdma wr_id 2aaaab011990, nic_wr_credit 34107. [D 20:43:10.754295] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 33/70. [D 20:43:10.754347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.754368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.754380] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.754406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.754419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.754432] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.754903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 34107. [D 20:43:10.754923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 34108. [D 20:43:10.754938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34109. [D 20:43:10.754953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34110. [D 20:43:10.754967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34111. [D 20:43:10.754982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34112. [D 20:43:10.755000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34113. [D 20:43:10.755014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34114. [D 20:43:10.755028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34115. [D 20:43:10.755043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34116. [D 20:43:10.755057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34117. [D 20:43:10.755071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34118. [D 20:43:10.755086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34119. [D 20:43:10.755100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34120. [D 20:43:10.755114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34121. [D 20:43:10.755129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34122. [D 20:43:10.755143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34123. [D 20:43:10.755157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34124. [D 20:43:10.755171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34125. [D 20:43:10.755186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34126. [D 20:43:10.755200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34127. [D 20:43:10.755214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34128. [D 20:43:10.755229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34129. [D 20:43:10.755244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34130. [D 20:43:10.755259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34131. [D 20:43:10.755273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34132. [D 20:43:10.755288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34133. [D 20:43:10.755302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34134. [D 20:43:10.755317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34135. [D 20:43:10.755332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34136. [D 20:43:10.755346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34137. [D 20:43:10.755361] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0196d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34138. [D 20:43:10.760817] openib_check_cq: completed rdma wr_id 2aaaab0196d0, nic_wr_credit 34138. [D 20:43:10.760838] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 34/70. [D 20:43:10.760899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.760919] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.760932] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:10.771422] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.771440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.771453] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:10.771490] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5729 [D 20:43:10.771506] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.771525] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 35/70. [D 20:43:10.774054] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.774112] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.774126] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.774168] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5732 [D 20:43:10.774183] element 0: offset: 0x661630, size: 24 [D 20:43:10.774203] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 36/70. [D 20:43:10.774248] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.774262] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.774274] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:10.774294] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5735 [D 20:43:10.774308] element 0: offset: 0x658610, size: 24 [D 20:43:10.774325] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 37/70. [D 20:43:10.774355] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.774369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.774381] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:10.774403] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5736 [D 20:43:10.774417] element 0: offset: 0x2aaaab617bd0, size: 24 [D 20:43:10.774434] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 38/70. [D 20:43:10.780969] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5732 [D 20:43:10.781063] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 39/70. [D 20:43:10.781148] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5735 [D 20:43:10.781166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34138. [D 20:43:10.781247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34139. [D 20:43:10.781266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34140. [D 20:43:10.781281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34141. [D 20:43:10.781296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34142. [D 20:43:10.781310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34143. [D 20:43:10.781324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34144. [D 20:43:10.781339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34145. [D 20:43:10.781353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34146. [D 20:43:10.781367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34147. [D 20:43:10.781382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34148. [D 20:43:10.781425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34149. [D 20:43:10.781440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34150. [D 20:43:10.781454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34151. [D 20:43:10.781469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34152. [D 20:43:10.781483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34153. [D 20:43:10.781497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34154. [D 20:43:10.781522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34155. [D 20:43:10.781536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34156. [D 20:43:10.781559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34157. [D 20:43:10.781574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34158. [D 20:43:10.781612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34159. [D 20:43:10.781642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34160. [D 20:43:10.781665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34161. [D 20:43:10.781680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34162. [D 20:43:10.781694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34163. [D 20:43:10.781708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34164. [D 20:43:10.781723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34165. [D 20:43:10.781755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34166. [D 20:43:10.781779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34167. [D 20:43:10.781794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34168. [D 20:43:10.781823] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34169. [D 20:43:10.781867] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 40/70. [D 20:43:10.788012] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5736 [D 20:43:10.788032] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 41/70. [D 20:43:10.788856] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5729 [D 20:43:10.788874] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 42/70. [D 20:43:10.792769] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34169. [D 20:43:10.792846] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 43/70. [D 20:43:10.792868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34169. [D 20:43:10.792885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34170. [D 20:43:10.792900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34171. [D 20:43:10.792914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34172. [D 20:43:10.792929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34173. [D 20:43:10.792944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34174. [D 20:43:10.792958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34175. [D 20:43:10.792973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34176. [D 20:43:10.792988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34177. [D 20:43:10.793002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34178. [D 20:43:10.793017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34179. [D 20:43:10.793032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34180. [D 20:43:10.793046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34181. [D 20:43:10.793061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34182. [D 20:43:10.793076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34183. [D 20:43:10.793091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34184. [D 20:43:10.793118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34185. [D 20:43:10.793141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34186. [D 20:43:10.793156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34187. [D 20:43:10.793179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34188. [D 20:43:10.793194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34189. [D 20:43:10.793222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34190. [D 20:43:10.793237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34191. [D 20:43:10.793261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34192. [D 20:43:10.793286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34193. [D 20:43:10.793301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34194. [D 20:43:10.793316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34195. [D 20:43:10.793330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34196. [D 20:43:10.793363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34197. [D 20:43:10.793387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34198. [D 20:43:10.793402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34199. [D 20:43:10.793425] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34200. [D 20:43:10.793444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 34201. [D 20:43:10.793472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 34202. [D 20:43:10.793496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34203. [D 20:43:10.793511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34204. [D 20:43:10.793540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34205. [D 20:43:10.793555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34206. [D 20:43:10.793591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34207. [D 20:43:10.793606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34208. [D 20:43:10.793630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34209. [D 20:43:10.793646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34210. [D 20:43:10.793673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34211. [D 20:43:10.793688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34212. [D 20:43:10.793713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34213. [D 20:43:10.793728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34214. [D 20:43:10.793751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34215. [D 20:43:10.793777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34216. [D 20:43:10.793803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34217. [D 20:43:10.793818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34218. [D 20:43:10.793833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34219. [D 20:43:10.793856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34220. [D 20:43:10.793871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34221. [D 20:43:10.793886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34222. [D 20:43:10.793914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34223. [D 20:43:10.793930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34224. [D 20:43:10.793944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34225. [D 20:43:10.793967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34226. [D 20:43:10.793990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34227. [D 20:43:10.794005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34228. [D 20:43:10.794020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34229. [D 20:43:10.794034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34230. [D 20:43:10.794049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34231. [D 20:43:10.794063] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab011990 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34232. [D 20:43:10.794089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34233. [D 20:43:10.794104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34234. [D 20:43:10.794119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 34235. [D 20:43:10.794134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 34236. [D 20:43:10.794148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 34237. [D 20:43:10.794163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 34238. [E 20:43:10.794182] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 34239, block for 10 ms. [D 20:43:10.794709] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 34238. [D 20:43:10.794731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 34239. [E 20:43:10.794748] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 34240, block for 10 ms. [D 20:43:10.804439] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 34239. [D 20:43:10.804460] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 44/70. [D 20:43:10.804475] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 34238. [D 20:43:10.804491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34239. [D 20:43:10.804506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34240. [D 20:43:10.804521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34241. [D 20:43:10.804535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 34242. [D 20:43:10.804550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 34243. [D 20:43:10.804565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 34244. [D 20:43:10.804581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 34245. [D 20:43:10.804596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 34246. [D 20:43:10.804610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34247. [D 20:43:10.804625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34248. [D 20:43:10.804640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34249. [D 20:43:10.804655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 34250. [D 20:43:10.804670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 34251. [D 20:43:10.804685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 34252. [D 20:43:10.804699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 34253. [D 20:43:10.804714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 34254. [D 20:43:10.804729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34255. [D 20:43:10.804744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34256. [D 20:43:10.804759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34257. [D 20:43:10.804774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 34258. [D 20:43:10.804789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 34259. [D 20:43:10.804803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 34260. [D 20:43:10.804818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 34261. [D 20:43:10.804833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 34262. [D 20:43:10.804848] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab011ac0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34263. [D 20:43:10.804924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.804946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.804960] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:10.816228] openib_check_cq: completed rdma wr_id 2aaaab011990, nic_wr_credit 34263. [D 20:43:10.816252] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 45/70. [D 20:43:10.817570] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.817590] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.817603] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:10.822365] openib_check_cq: completed rdma wr_id 2aaaab011ac0, nic_wr_credit 34262. [D 20:43:10.822385] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 46/70. [D 20:43:10.822429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.822448] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.822461] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:10.822488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.822502] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.822514] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:10.828058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.828077] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.828090] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:10.828129] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5739 [D 20:43:10.828144] element 0: offset: 0x2aaaab6104c0, size: 24 [D 20:43:10.828160] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 47/70. [D 20:43:10.831279] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5739 [D 20:43:10.831356] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 48/70. [D 20:43:10.833572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34262. [D 20:43:10.833597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34263. [D 20:43:10.833612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34264. [D 20:43:10.833626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34265. [D 20:43:10.833641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34266. [D 20:43:10.833656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34267. [D 20:43:10.833671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34268. [D 20:43:10.833686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34269. [D 20:43:10.833700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34270. [D 20:43:10.833715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34271. [D 20:43:10.833730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34272. [D 20:43:10.833745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34273. [D 20:43:10.833759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34274. [D 20:43:10.833774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34275. [D 20:43:10.833789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34276. [D 20:43:10.833816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34277. [D 20:43:10.833831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34278. [D 20:43:10.833857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34279. [D 20:43:10.833879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34280. [D 20:43:10.833895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34281. [D 20:43:10.833909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34282. [D 20:43:10.833942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34283. [D 20:43:10.833967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34284. [D 20:43:10.833981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34285. [D 20:43:10.834006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34286. [D 20:43:10.834038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34287. [D 20:43:10.834064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34288. [D 20:43:10.834079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34289. [D 20:43:10.834094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34290. [D 20:43:10.834135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34291. [D 20:43:10.834159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34292. [D 20:43:10.834174] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34293. [D 20:43:10.845164] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34293. [D 20:43:10.845182] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 49/70. [D 20:43:10.845313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.845336] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.845349] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:10.854113] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.854131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.854144] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:10.854184] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5742 [D 20:43:10.854199] element 0: offset: 0x2aaaab6125f0, size: 24 [D 20:43:10.854216] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 50/70. [D 20:43:10.857483] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5742 [D 20:43:10.857562] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 51/70. [D 20:43:10.857621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 34293. [D 20:43:10.857645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 34294. [D 20:43:10.857659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34295. [D 20:43:10.857674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34296. [D 20:43:10.857689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34297. [D 20:43:10.857704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34298. [D 20:43:10.857719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34299. [D 20:43:10.857734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34300. [D 20:43:10.857748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34301. [D 20:43:10.857764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34302. [D 20:43:10.857778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34303. [D 20:43:10.857793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34304. [D 20:43:10.857808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34305. [D 20:43:10.857823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34306. [D 20:43:10.857839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34307. [D 20:43:10.857854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34308. [D 20:43:10.857869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34309. [D 20:43:10.857883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34310. [D 20:43:10.857899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34311. [D 20:43:10.857913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34312. [D 20:43:10.857928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34313. [D 20:43:10.857943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34314. [D 20:43:10.857958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34315. [D 20:43:10.857973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34316. [D 20:43:10.857988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34317. [D 20:43:10.858003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34318. [D 20:43:10.858018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34319. [D 20:43:10.858032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34320. [D 20:43:10.858047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34321. [D 20:43:10.858062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34322. [D 20:43:10.858077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34323. [D 20:43:10.858092] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34324. [D 20:43:10.867891] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34324. [D 20:43:10.867913] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 52/70. [D 20:43:10.868046] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:10.868069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.868083] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:10.885074] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.885093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.885106] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:10.885146] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5746 [D 20:43:10.885160] element 0: offset: 0x2aaaab60a560, size: 24 [D 20:43:10.885177] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 53/70. [D 20:43:10.885217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:10.885231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:10.885244] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:10.885264] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5749 [D 20:43:10.885278] element 0: offset: 0x2aaaab60a580, size: 24 [D 20:43:10.885293] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 54/70. [D 20:43:10.892077] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5749 [D 20:43:10.892168] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 55/70. [D 20:43:10.892409] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5746 [D 20:43:10.892433] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 56/70. [D 20:43:10.892476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34324. [D 20:43:10.892495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 34325. [D 20:43:10.892509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 34326. [D 20:43:10.892524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 34327. [D 20:43:10.892539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 34328. [D 20:43:10.892554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 34329. [D 20:43:10.892569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34330. [D 20:43:10.892583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34331. [D 20:43:10.892598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34332. [D 20:43:10.892613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 34333. [D 20:43:10.892628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 34334. [D 20:43:10.892642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 34335. [D 20:43:10.892657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 34336. [D 20:43:10.892672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 34337. [D 20:43:10.892686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34338. [D 20:43:10.892701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34339. [D 20:43:10.892716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34340. [D 20:43:10.892731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 34341. [D 20:43:10.892745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 34342. [D 20:43:10.892760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 34343. [D 20:43:10.892775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 34344. [D 20:43:10.892790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 34345. [D 20:43:10.892804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34346. [D 20:43:10.892819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34347. [D 20:43:10.892834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34348. [D 20:43:10.892849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 34349. [D 20:43:10.892863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 34350. [D 20:43:10.892878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 34351. [D 20:43:10.892894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 34352. [D 20:43:10.892909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 34353. [D 20:43:10.892924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34354. [D 20:43:10.892938] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab030980 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34355. [D 20:43:10.892956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 34356. [D 20:43:10.892971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 34357. [D 20:43:10.892985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34358. [D 20:43:10.893000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34359. [D 20:43:10.893014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34360. [D 20:43:10.893029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34361. [D 20:43:10.893044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34362. [D 20:43:10.893058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34363. [D 20:43:10.893073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34364. [D 20:43:10.893087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34365. [D 20:43:10.893102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34366. [D 20:43:10.893116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34367. [D 20:43:10.893131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34368. [D 20:43:10.893146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34369. [D 20:43:10.893160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34370. [D 20:43:10.893175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34371. [D 20:43:10.893189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34372. [D 20:43:10.893204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34373. [D 20:43:10.893219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34374. [D 20:43:10.893233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34375. [D 20:43:10.893248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34376. [D 20:43:10.893262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34377. [D 20:43:10.893277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34378. [D 20:43:10.893292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34379. [D 20:43:10.893306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34380. [D 20:43:11.155998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34381. [D 20:43:11.156020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34382. [D 20:43:11.156049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34383. [D 20:43:11.156064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34384. [D 20:43:11.156079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34385. [D 20:43:11.156094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34386. [D 20:43:11.156108] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c330 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34387. [D 20:43:11.156685] openib_check_cq: completed rdma wr_id 2aaaab030980, nic_wr_credit 34387. [D 20:43:11.156705] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 57/70. [D 20:43:11.156960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.157027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.157042] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.157087] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5751 [D 20:43:11.157103] element 0: offset: 0x2aaaab0255b0, size: 24 [D 20:43:11.157123] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 58/70. [D 20:43:11.157162] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.157176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.157188] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.157210] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5754 [D 20:43:11.157224] element 0: offset: 0x2aaaab0042d0, size: 24 [D 20:43:11.157239] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 59/70. [D 20:43:11.157470] openib_check_cq: completed rdma wr_id 2aaaab02c330, nic_wr_credit 34386. [D 20:43:11.157496] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 60/70. [D 20:43:11.157563] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.157583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.157596] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.157714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.157729] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.157742] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.161551] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5754 [D 20:43:11.161612] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 0/70. [D 20:43:11.161673] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5751 [D 20:43:11.161693] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 1/70. [D 20:43:11.168688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34386. [D 20:43:11.168713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34387. [D 20:43:11.168728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34388. [D 20:43:11.168741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34389. [D 20:43:11.168756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34390. [D 20:43:11.168770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34391. [D 20:43:11.168784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34392. [D 20:43:11.168799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34393. [D 20:43:11.168813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34394. [D 20:43:11.168827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34395. [D 20:43:11.168841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34396. [D 20:43:11.168855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34397. [D 20:43:11.168869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34398. [D 20:43:11.168883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34399. [D 20:43:11.168897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34400. [D 20:43:11.168911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34401. [D 20:43:11.168925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34402. [D 20:43:11.168939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34403. [D 20:43:11.168953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34404. [D 20:43:11.168967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34405. [D 20:43:11.168981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34406. [D 20:43:11.168995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34407. [D 20:43:11.169009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34408. [D 20:43:11.169023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34409. [D 20:43:11.169037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34410. [D 20:43:11.169051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34411. [D 20:43:11.169065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34412. [D 20:43:11.169079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34413. [D 20:43:11.169093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34414. [D 20:43:11.169107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34415. [D 20:43:11.169121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34416. [D 20:43:11.169135] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab030980 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34417. [D 20:43:11.169153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34418. [D 20:43:11.169167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34419. [D 20:43:11.169181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34420. [D 20:43:11.169195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34421. [D 20:43:11.169210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34422. [D 20:43:11.169225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34423. [D 20:43:11.169238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34424. [D 20:43:11.169252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34425. [D 20:43:11.169267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34426. [D 20:43:11.169281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34427. [D 20:43:11.169295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34428. [D 20:43:11.169309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34429. [D 20:43:11.169323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34430. [D 20:43:11.169337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34431. [D 20:43:11.169350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34432. [D 20:43:11.169365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34433. [D 20:43:11.169379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34434. [D 20:43:11.169393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34435. [D 20:43:11.169407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34436. [D 20:43:11.169421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34437. [D 20:43:11.169435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34438. [D 20:43:11.169449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34439. [D 20:43:11.169463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34440. [D 20:43:11.169477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34441. [D 20:43:11.169491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34442. [D 20:43:11.169505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34443. [D 20:43:11.169519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34444. [D 20:43:11.169533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34445. [D 20:43:11.169547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34446. [D 20:43:11.169561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34447. [D 20:43:11.169575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34448. [D 20:43:11.169589] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34449. [D 20:43:11.172038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.172101] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.172117] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.172164] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5758 [D 20:43:11.172180] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:11.172201] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 2/70. [D 20:43:11.172238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.172253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.172266] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.172288] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5761 [D 20:43:11.172303] element 0: offset: 0x2aaaab002040, size: 24 [D 20:43:11.172320] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 3/70. [D 20:43:11.174988] openib_check_cq: completed rdma wr_id 2aaaab030980, nic_wr_credit 34449. [D 20:43:11.175013] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 4/70. [D 20:43:11.186331] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 34448. [D 20:43:11.186352] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 5/70. [D 20:43:11.186431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.186457] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.186471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.186595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.186610] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.186623] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.192592] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5758 [D 20:43:11.192661] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 6/70. [D 20:43:11.195968] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5761 [D 20:43:11.195995] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 7/70. [D 20:43:11.196403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 34448. [D 20:43:11.196459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 34449. [D 20:43:11.196475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34450. [D 20:43:11.196491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34451. [D 20:43:11.196505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34452. [D 20:43:11.196520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34453. [D 20:43:11.196535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34454. [D 20:43:11.196550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34455. [D 20:43:11.196564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34456. [D 20:43:11.196579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34457. [D 20:43:11.196594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34458. [D 20:43:11.196608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34459. [D 20:43:11.196623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34460. [D 20:43:11.196638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34461. [D 20:43:11.196652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34462. [D 20:43:11.196668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34463. [D 20:43:11.196682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34464. [D 20:43:11.196697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34465. [D 20:43:11.196712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34466. [D 20:43:11.196727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34467. [D 20:43:11.196741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34468. [D 20:43:11.196756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34469. [D 20:43:11.196771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34470. [D 20:43:11.196786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34471. [D 20:43:11.196800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34472. [D 20:43:11.196815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34473. [D 20:43:11.196830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34474. [D 20:43:11.196845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34475. [D 20:43:11.196859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34476. [D 20:43:11.196874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34477. [D 20:43:11.196889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34478. [D 20:43:11.196903] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34479. [D 20:43:11.196922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34480. [D 20:43:11.196938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 34481. [D 20:43:11.196952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 34482. [D 20:43:11.196967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 34483. [D 20:43:11.196982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 34484. [D 20:43:11.196997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 34485. [D 20:43:11.197011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34486. [D 20:43:11.197026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34487. [D 20:43:11.197041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34488. [D 20:43:11.197055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 34489. [D 20:43:11.197070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 34490. [D 20:43:11.197085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 34491. [D 20:43:11.197101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 34492. [D 20:43:11.197116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 34493. [D 20:43:11.197130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34494. [D 20:43:11.197145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34495. [D 20:43:11.197159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34496. [D 20:43:11.197174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 34497. [D 20:43:11.197189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 34498. [D 20:43:11.198395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 34499. [D 20:43:11.198411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 34500. [D 20:43:11.198426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 34501. [D 20:43:11.198440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34502. [D 20:43:11.198459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34503. [D 20:43:11.198474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34504. [D 20:43:11.198488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 34505. [D 20:43:11.198503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 34506. [D 20:43:11.198518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 34507. [D 20:43:11.198532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 34508. [D 20:43:11.198547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 34509. [D 20:43:11.198562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34510. [D 20:43:11.198576] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34511. [D 20:43:11.200222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.200247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.200261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.200309] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5764 [D 20:43:11.200324] element 0: offset: 0x2aaaab0174c0, size: 24 [D 20:43:11.200341] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 8/70. [D 20:43:11.200386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.200399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.200412] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.200432] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5766 [D 20:43:11.200446] element 0: offset: 0x2aaaab0275f0, size: 24 [D 20:43:11.200462] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 9/70. [D 20:43:11.202705] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 34511. [D 20:43:11.202731] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 10/70. [D 20:43:11.214360] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 34510. [D 20:43:11.214399] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 11/70. [D 20:43:11.214480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.214503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.214516] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.214645] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.214660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.214673] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.217684] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5764 [D 20:43:11.217760] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 12/70. [D 20:43:11.220253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34510. [D 20:43:11.220279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34511. [D 20:43:11.220294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34512. [D 20:43:11.220308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34513. [D 20:43:11.220322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34514. [D 20:43:11.220336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34515. [D 20:43:11.220350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34516. [D 20:43:11.220364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34517. [D 20:43:11.220378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34518. [D 20:43:11.220392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34519. [D 20:43:11.220406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34520. [D 20:43:11.220420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34521. [D 20:43:11.220434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34522. [D 20:43:11.220448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34523. [D 20:43:11.220462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34524. [D 20:43:11.220476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34525. [D 20:43:11.220491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34526. [D 20:43:11.220505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34527. [D 20:43:11.220519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34528. [D 20:43:11.220534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34529. [D 20:43:11.220548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34530. [D 20:43:11.220562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34531. [D 20:43:11.220576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34532. [D 20:43:11.220591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34533. [D 20:43:11.220607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34534. [D 20:43:11.220621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34535. [D 20:43:11.220635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34536. [D 20:43:11.220649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34537. [D 20:43:11.220663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34538. [D 20:43:11.220677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34539. [D 20:43:11.220690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34540. [D 20:43:11.220704] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34541. [D 20:43:11.224364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.224429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.224444] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.224491] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5769 [D 20:43:11.224506] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.224527] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 13/70. [D 20:43:11.224532] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5766 [D 20:43:11.224670] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 14/70. [D 20:43:11.231628] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34541. [D 20:43:11.231657] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 15/70. [D 20:43:11.234749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.234766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.234780] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.236481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34541. [D 20:43:11.236504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34542. [D 20:43:11.236519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34543. [D 20:43:11.236534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34544. [D 20:43:11.236549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34545. [D 20:43:11.236563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34546. [D 20:43:11.236590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34547. [D 20:43:11.236604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34548. [D 20:43:11.236628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34549. [D 20:43:11.236643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34550. [D 20:43:11.236671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34551. [D 20:43:11.236696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34552. [D 20:43:11.236711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34553. [D 20:43:11.236741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34554. [D 20:43:11.236766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34555. [D 20:43:11.236789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34556. [D 20:43:11.236804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34557. [D 20:43:11.236832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34558. [D 20:43:11.236858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34559. [D 20:43:11.236874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34560. [D 20:43:11.236888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34561. [D 20:43:11.236916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34562. [D 20:43:11.236932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34563. [D 20:43:11.236946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34564. [D 20:43:11.236961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34565. [D 20:43:11.236975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34566. [D 20:43:11.237000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34567. [D 20:43:11.237015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34568. [D 20:43:11.237029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34569. [D 20:43:11.237044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34570. [D 20:43:11.237058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34571. [D 20:43:11.237073] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34572. [D 20:43:11.237651] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5769 [D 20:43:11.237731] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 16/70. [D 20:43:11.247273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.247296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.247309] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.247334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5774 [D 20:43:11.247349] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.247364] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 17/70. [D 20:43:11.247388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.247402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.247415] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.247436] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5775 [D 20:43:11.247450] element 0: offset: 0x66e6c0, size: 24 [D 20:43:11.247465] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 18/70. [D 20:43:11.248253] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 34572. [D 20:43:11.248273] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 19/70. [D 20:43:11.248301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 34572. [D 20:43:11.248318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 34573. [D 20:43:11.248333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34574. [D 20:43:11.248348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34575. [D 20:43:11.248362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34576. [D 20:43:11.248377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34577. [D 20:43:11.248392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34578. [D 20:43:11.248406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34579. [D 20:43:11.248421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34580. [D 20:43:11.248436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34581. [D 20:43:11.248450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34582. [D 20:43:11.248465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34583. [D 20:43:11.248480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34584. [D 20:43:11.248494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34585. [D 20:43:11.248509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34586. [D 20:43:11.248524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34587. [D 20:43:11.248538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34588. [D 20:43:11.248553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34589. [D 20:43:11.248567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34590. [D 20:43:11.248582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34591. [D 20:43:11.248597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34592. [D 20:43:11.248611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34593. [D 20:43:11.248626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34594. [D 20:43:11.248641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34595. [D 20:43:11.248655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34596. [D 20:43:11.248670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34597. [D 20:43:11.248684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34598. [D 20:43:11.248699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34599. [D 20:43:11.248714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34600. [D 20:43:11.248728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34601. [D 20:43:11.248743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34602. [D 20:43:11.248758] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34603. [D 20:43:11.251810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.251828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.251841] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.255502] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34603. [D 20:43:11.255584] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 20/70. [D 20:43:11.256008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.256076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.256091] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.258607] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5775 [D 20:43:11.258635] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 21/70. [D 20:43:11.258682] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5774 [D 20:43:11.258697] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 22/70. [D 20:43:11.261486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34603. [D 20:43:11.261504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34604. [D 20:43:11.261518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34605. [D 20:43:11.261532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34606. [D 20:43:11.261546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34607. [D 20:43:11.261560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34608. [D 20:43:11.261574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34609. [D 20:43:11.261588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34610. [D 20:43:11.261602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34611. [D 20:43:11.261616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34612. [D 20:43:11.261630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34613. [D 20:43:11.261644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34614. [D 20:43:11.261658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34615. [D 20:43:11.261672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34616. [D 20:43:11.261686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34617. [D 20:43:11.261700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34618. [D 20:43:11.261714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34619. [D 20:43:11.261728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34620. [D 20:43:11.261742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34621. [D 20:43:11.261756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34622. [D 20:43:11.261772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34623. [D 20:43:11.261786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34624. [D 20:43:11.261800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34625. [D 20:43:11.261814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34626. [D 20:43:11.261828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34627. [D 20:43:11.261842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34628. [D 20:43:11.261856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34629. [D 20:43:11.261869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34630. [D 20:43:11.261883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34631. [D 20:43:11.261897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34632. [D 20:43:11.261911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34633. [D 20:43:11.261925] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34634. [D 20:43:11.261942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34635. [D 20:43:11.261957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 34636. [D 20:43:11.261970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 34637. [D 20:43:11.261984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 34638. [D 20:43:11.262000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 34639. [D 20:43:11.262014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 34640. [D 20:43:11.262027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34641. [D 20:43:11.262041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34642. [D 20:43:11.262055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34643. [D 20:43:11.262069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 34644. [D 20:43:11.262083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 34645. [D 20:43:11.262097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 34646. [D 20:43:11.262111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 34647. [D 20:43:11.262124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 34648. [D 20:43:11.262138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34649. [D 20:43:11.262152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34650. [D 20:43:11.262166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34651. [D 20:43:11.262181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 34652. [D 20:43:11.262195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 34653. [D 20:43:11.262209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 34654. [D 20:43:11.262223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 34655. [D 20:43:11.262236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 34656. [D 20:43:11.262250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34657. [D 20:43:11.262264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34658. [D 20:43:11.262278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34659. [D 20:43:11.262292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 34660. [D 20:43:11.262306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 34661. [D 20:43:11.262320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 34662. [D 20:43:11.262334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 34663. [D 20:43:11.262348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 34664. [D 20:43:11.262362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34665. [D 20:43:11.262376] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34666. [D 20:43:11.262431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.262454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.262468] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.262510] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5778 [D 20:43:11.262526] element 0: offset: 0x620d50, size: 24 [D 20:43:11.262547] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 23/70. [D 20:43:11.264268] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.264287] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.264301] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.264324] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5781 [D 20:43:11.264340] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.264356] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 24/70. [D 20:43:11.267439] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34666. [D 20:43:11.267460] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 25/70. [D 20:43:11.275044] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 34665. [D 20:43:11.275073] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 26/70. [D 20:43:11.278051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.278068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.278081] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.278189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.278205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.278218] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.281510] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5778 [D 20:43:11.281582] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 27/70. [D 20:43:11.282148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34665. [D 20:43:11.282226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34666. [D 20:43:11.282241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34667. [D 20:43:11.282255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34668. [D 20:43:11.282270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34669. [D 20:43:11.282285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34670. [D 20:43:11.282299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34671. [D 20:43:11.282314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34672. [D 20:43:11.282328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34673. [D 20:43:11.282343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34674. [D 20:43:11.282357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34675. [D 20:43:11.282372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34676. [D 20:43:11.282387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34677. [D 20:43:11.282401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34678. [D 20:43:11.282416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34679. [D 20:43:11.282430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34680. [D 20:43:11.282445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34681. [D 20:43:11.282459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34682. [D 20:43:11.282474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34683. [D 20:43:11.282488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34684. [D 20:43:11.282520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34685. [D 20:43:11.282539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34686. [D 20:43:11.282554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34687. [D 20:43:11.282568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34688. [D 20:43:11.282583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34689. [D 20:43:11.282608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34690. [D 20:43:11.282623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34691. [D 20:43:11.282651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34692. [D 20:43:11.282666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34693. [D 20:43:11.282682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34694. [D 20:43:11.282697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34695. [D 20:43:11.282711] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34696. [D 20:43:11.282790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.282815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.282828] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.282870] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5784 [D 20:43:11.282885] element 0: offset: 0x620d00, size: 24 [D 20:43:11.282903] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 28/70. [D 20:43:11.282951] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5781 [D 20:43:11.282969] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 29/70. [D 20:43:11.293977] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34696. [D 20:43:11.294005] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 30/70. [D 20:43:11.294022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 34696. [D 20:43:11.294037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 34697. [D 20:43:11.294052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34698. [D 20:43:11.294067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34699. [D 20:43:11.294081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34700. [D 20:43:11.294096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34701. [D 20:43:11.294110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34702. [D 20:43:11.294125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34703. [D 20:43:11.294139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34704. [D 20:43:11.294154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34705. [D 20:43:11.294168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34706. [D 20:43:11.294183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34707. [D 20:43:11.294198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34708. [D 20:43:11.294212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34709. [D 20:43:11.294227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34710. [D 20:43:11.294241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34711. [D 20:43:11.294256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34712. [D 20:43:11.294270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34713. [D 20:43:11.294285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34714. [D 20:43:11.294299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34715. [D 20:43:11.294315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34716. [D 20:43:11.294330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34717. [D 20:43:11.294344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34718. [D 20:43:11.294358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34719. [D 20:43:11.294373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34720. [D 20:43:11.294387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34721. [D 20:43:11.294402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34722. [D 20:43:11.294416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34723. [D 20:43:11.294431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34724. [D 20:43:11.294445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34725. [D 20:43:11.294459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34726. [D 20:43:11.294474] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34727. [D 20:43:11.294542] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.294563] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.294576] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.297712] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5784 [D 20:43:11.297784] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 31/70. [D 20:43:11.303674] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 34727. [D 20:43:11.303698] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 32/70. [D 20:43:11.303782] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.303804] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.303816] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:11.306962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34727. [D 20:43:11.306984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34728. [D 20:43:11.306998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34729. [D 20:43:11.307012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34730. [D 20:43:11.307030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34731. [D 20:43:11.307045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34732. [D 20:43:11.307060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34733. [D 20:43:11.307074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34734. [D 20:43:11.307101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34735. [D 20:43:11.307115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34736. [D 20:43:11.307142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34737. [D 20:43:11.307158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34738. [D 20:43:11.307184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34739. [D 20:43:11.307199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34740. [D 20:43:11.307213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34741. [D 20:43:11.307245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34742. [D 20:43:11.307271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34743. [D 20:43:11.307285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34744. [D 20:43:11.307312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34745. [D 20:43:11.307327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34746. [D 20:43:11.307350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34747. [D 20:43:11.307376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34748. [D 20:43:11.307391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34749. [D 20:43:11.307416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34750. [D 20:43:11.307431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34751. [D 20:43:11.307446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34752. [D 20:43:11.307460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34753. [D 20:43:11.307488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34754. [D 20:43:11.307503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34755. [D 20:43:11.307530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34756. [D 20:43:11.307554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34757. [D 20:43:11.307569] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34758. [D 20:43:11.307648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.307670] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.307684] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:11.307723] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5787 [D 20:43:11.307738] element 0: offset: 0x61fa00, size: 24 [D 20:43:11.307755] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 33/70. [D 20:43:11.315783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.315802] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.315815] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.315838] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5791 [D 20:43:11.315852] element 0: offset: 0x658610, size: 24 [D 20:43:11.315868] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 34/70. [D 20:43:11.318683] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34758. [D 20:43:11.318707] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 35/70. [D 20:43:11.322636] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.322699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.322713] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.322816] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5791 [D 20:43:11.322843] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 36/70. [D 20:43:11.322877] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5787 [D 20:43:11.322928] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 37/70. [D 20:43:11.324186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34758. [D 20:43:11.324257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 34759. [D 20:43:11.324272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 34760. [D 20:43:11.324287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 34761. [D 20:43:11.324301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 34762. [D 20:43:11.324328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 34763. [D 20:43:11.324343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34764. [D 20:43:11.324370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34765. [D 20:43:11.324385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34766. [D 20:43:11.324411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 34767. [D 20:43:11.324426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 34768. [D 20:43:11.324450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 34769. [D 20:43:11.324464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 34770. [D 20:43:11.324495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 34771. [D 20:43:11.324522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34772. [D 20:43:11.324536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34773. [D 20:43:11.324562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34774. [D 20:43:11.324576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 34775. [D 20:43:11.324601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 34776. [D 20:43:11.324615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 34777. [D 20:43:11.324642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 34778. [D 20:43:11.324668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 34779. [D 20:43:11.324683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34780. [D 20:43:11.324707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34781. [D 20:43:11.324722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34782. [D 20:43:11.611170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 34783. [D 20:43:11.611221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 34784. [D 20:43:11.611694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 34785. [D 20:43:11.611727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 34786. [D 20:43:11.611741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 34787. [D 20:43:11.611756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34788. [D 20:43:11.611770] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34789. [D 20:43:11.611808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34790. [D 20:43:11.611823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34791. [D 20:43:11.611838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34792. [D 20:43:11.611852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34793. [D 20:43:11.611867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34794. [D 20:43:11.611881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34795. [D 20:43:11.611895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34796. [D 20:43:11.611909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34797. [D 20:43:11.611924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34798. [D 20:43:11.611938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34799. [D 20:43:11.611952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34800. [D 20:43:11.611966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34801. [D 20:43:11.612084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34802. [D 20:43:11.612102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34803. [D 20:43:11.612116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34804. [D 20:43:11.612588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34805. [D 20:43:11.612605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34806. [D 20:43:11.612619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34807. [D 20:43:11.612650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34808. [D 20:43:11.612664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34809. [D 20:43:11.612679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34810. [D 20:43:11.612693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34811. [D 20:43:11.612710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34812. [D 20:43:11.612724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34813. [D 20:43:11.612738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34814. [D 20:43:11.612753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34815. [D 20:43:11.612767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34816. [D 20:43:11.612782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34817. [D 20:43:11.612796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34818. [D 20:43:11.612810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34819. [D 20:43:11.612824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34820. [D 20:43:11.612839] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34821. [D 20:43:11.612859] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34821. [D 20:43:11.612876] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 38/70. [D 20:43:11.613067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.613091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.613104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.613144] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5793 [D 20:43:11.613159] element 0: offset: 0x6301d0, size: 24 [D 20:43:11.613176] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 39/70. [D 20:43:11.613209] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.613222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.613235] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.613256] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5796 [D 20:43:11.613270] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.613284] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 40/70. [D 20:43:11.618655] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 34820. [D 20:43:11.618681] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 41/70. [D 20:43:11.618960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.618982] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.618995] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.619105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.619120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.619133] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.622545] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5793 [D 20:43:11.622614] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 42/70. [D 20:43:11.624222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 34820. [D 20:43:11.624297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 34821. [D 20:43:11.624313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34822. [D 20:43:11.624328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34823. [D 20:43:11.624342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34824. [D 20:43:11.624358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34825. [D 20:43:11.624375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34826. [D 20:43:11.624390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34827. [D 20:43:11.624405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34828. [D 20:43:11.624420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34829. [D 20:43:11.624434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34830. [D 20:43:11.624449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34831. [D 20:43:11.624463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34832. [D 20:43:11.624478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34833. [D 20:43:11.624492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34834. [D 20:43:11.624507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34835. [D 20:43:11.624521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34836. [D 20:43:11.624539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34837. [D 20:43:11.624554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34838. [D 20:43:11.624569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34839. [D 20:43:11.624583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34840. [D 20:43:11.624598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34841. [D 20:43:11.624612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34842. [D 20:43:11.624664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34843. [D 20:43:11.624678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34844. [D 20:43:11.624693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34845. [D 20:43:11.624707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34846. [D 20:43:11.624722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34847. [D 20:43:11.624736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34848. [D 20:43:11.624750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34849. [D 20:43:11.624765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34850. [D 20:43:11.624779] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34851. [D 20:43:11.628102] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5796 [D 20:43:11.628130] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 43/70. [D 20:43:11.630195] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34851. [D 20:43:11.630220] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 44/70. [D 20:43:11.630237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34851. [D 20:43:11.630256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34852. [D 20:43:11.630272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34853. [D 20:43:11.630311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34854. [D 20:43:11.630326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34855. [D 20:43:11.630341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34856. [D 20:43:11.630355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34857. [D 20:43:11.630373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34858. [D 20:43:11.630388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34859. [D 20:43:11.630402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34860. [D 20:43:11.630417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34861. [D 20:43:11.630431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34862. [D 20:43:11.630445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34863. [D 20:43:11.630460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34864. [D 20:43:11.630474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34865. [D 20:43:11.630489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34866. [D 20:43:11.630503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34867. [D 20:43:11.630518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34868. [D 20:43:11.630532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34869. [D 20:43:11.630546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34870. [D 20:43:11.630561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34871. [D 20:43:11.630575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34872. [D 20:43:11.630590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34873. [D 20:43:11.630604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34874. [D 20:43:11.630618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 34875. [D 20:43:11.630633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 34876. [D 20:43:11.630647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 34877. [D 20:43:11.630662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 34878. [D 20:43:11.630729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 34879. [D 20:43:11.630749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 34880. [D 20:43:11.630786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 34881. [D 20:43:11.630800] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 34882. [D 20:43:11.634124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.634167] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.634182] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:11.636173] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 34882. [D 20:43:11.636192] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 45/70. [D 20:43:11.639352] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.639369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.639382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:11.639425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5801 [D 20:43:11.639440] element 0: offset: 0x620d50, size: 24 [D 20:43:11.639456] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 46/70. [D 20:43:11.639483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.639502] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.639515] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.639535] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5802 [D 20:43:11.639550] element 0: offset: 0x636280, size: 24 [D 20:43:11.639564] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 47/70. [D 20:43:11.639587] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.639602] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.639615] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.644118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.644137] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.644163] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.644185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5805 [D 20:43:11.644200] element 0: offset: 0x6301d0, size: 24 [D 20:43:11.647631] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 48/70. [D 20:43:11.647667] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.647681] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.647695] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.647724] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5808 [D 20:43:11.647739] element 0: offset: 0x61fa00, size: 24 [D 20:43:11.647754] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 49/70. [D 20:43:11.650327] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 5801 [D 20:43:11.650408] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 50/70. [D 20:43:11.650551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34882. [D 20:43:11.650575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 34883. [D 20:43:11.650590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 34884. [D 20:43:11.650604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 34885. [D 20:43:11.650619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 34886. [D 20:43:11.650642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 34887. [D 20:43:11.650656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34888. [D 20:43:11.650671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34889. [D 20:43:11.650685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34890. [D 20:43:11.650700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 34891. [D 20:43:11.650714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 34892. [D 20:43:11.650728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 34893. [D 20:43:11.650743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 34894. [D 20:43:11.650757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 34895. [D 20:43:11.650774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34896. [D 20:43:11.650789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34897. [D 20:43:11.650803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34898. [D 20:43:11.650822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 34899. [D 20:43:11.650836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 34900. [D 20:43:11.650851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 34901. [D 20:43:11.650869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 34902. [D 20:43:11.650884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 34903. [D 20:43:11.650898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34904. [D 20:43:11.650916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34905. [D 20:43:11.650930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34906. [D 20:43:11.650944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 34907. [D 20:43:11.650963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 34908. [D 20:43:11.650977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 34909. [D 20:43:11.650992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 34910. [D 20:43:11.651009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 34911. [D 20:43:11.651024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34912. [D 20:43:11.651038] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34913. [D 20:43:11.652466] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5802 [D 20:43:11.652492] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 51/70. [D 20:43:11.660076] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5805 [D 20:43:11.660098] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 52/70. [D 20:43:11.660984] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5808 [D 20:43:11.661001] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 53/70. [D 20:43:11.662213] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 34913. [D 20:43:11.662289] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 54/70. [D 20:43:11.662312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34913. [D 20:43:11.662328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34914. [D 20:43:11.662343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34915. [D 20:43:11.662357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34916. [D 20:43:11.662371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34917. [D 20:43:11.662386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34918. [D 20:43:11.662400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34919. [D 20:43:11.662415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34920. [D 20:43:11.662429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34921. [D 20:43:11.662443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34922. [D 20:43:11.662458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34923. [D 20:43:11.662472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34924. [D 20:43:11.662487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34925. [D 20:43:11.662501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34926. [D 20:43:11.662516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34927. [D 20:43:11.662530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34928. [D 20:43:11.662545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34929. [D 20:43:11.662559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34930. [D 20:43:11.662574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34931. [D 20:43:11.662588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34932. [D 20:43:11.662602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34933. [D 20:43:11.662617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34934. [D 20:43:11.662631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34935. [D 20:43:11.662645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34936. [D 20:43:11.662660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34937. [D 20:43:11.662674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34938. [D 20:43:11.662689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34939. [D 20:43:11.662703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34940. [D 20:43:11.662719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34941. [D 20:43:11.662734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34942. [D 20:43:11.662748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34943. [D 20:43:11.662763] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02c330 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34944. [D 20:43:11.662780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 34945. [D 20:43:11.662795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 34946. [D 20:43:11.662809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 34947. [D 20:43:11.662823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 34948. [D 20:43:11.662837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 34949. [D 20:43:11.662851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 34950. [D 20:43:11.662865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 34951. [D 20:43:11.662879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 34952. [D 20:43:11.662893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 34953. [D 20:43:11.662907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 34954. [D 20:43:11.662921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 34955. [D 20:43:11.662935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 34956. [D 20:43:11.662949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 34957. [D 20:43:11.662963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 34958. [D 20:43:11.662977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 34959. [D 20:43:11.662991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 34960. [D 20:43:11.663005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 34961. [D 20:43:11.663019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 34962. [D 20:43:11.663033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 34963. [D 20:43:11.663054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 34964. [D 20:43:11.663069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 34965. [D 20:43:11.663083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 34966. [D 20:43:11.663097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 34967. [D 20:43:11.663111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 34968. [D 20:43:11.663125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 34969. [D 20:43:11.663140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 34970. [D 20:43:11.663154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 34971. [D 20:43:11.663168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 34972. [D 20:43:11.663182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 34973. [D 20:43:11.663197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 34974. [D 20:43:11.663211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 34975. [D 20:43:11.663225] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab016e10 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 34976. [D 20:43:11.663240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 34977. [D 20:43:11.663255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 34978. [D 20:43:11.663269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 34979. [D 20:43:11.663283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 34980. [D 20:43:11.663297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 34981. [D 20:43:11.663312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34982. [E 20:43:11.663330] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 34983, block for 10 ms. [D 20:43:11.663363] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 34982. [D 20:43:11.663379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34983. [E 20:43:11.663395] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 34984, block for 10 ms. [D 20:43:11.672452] openib_check_cq: completed rdma wr_id 2aaaab02c330, nic_wr_credit 34983. [D 20:43:11.672475] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 55/70. [D 20:43:11.672489] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 34982. [D 20:43:11.672504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 34983. [D 20:43:11.672518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 34984. [D 20:43:11.672533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 34985. [D 20:43:11.672547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 34986. [D 20:43:11.672561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 34987. [D 20:43:11.672576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 34988. [D 20:43:11.672590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 34989. [D 20:43:11.672604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 34990. [D 20:43:11.672618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 34991. [D 20:43:11.672633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 34992. [D 20:43:11.672648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 34993. [D 20:43:11.672663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 34994. [D 20:43:11.672677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 34995. [D 20:43:11.672692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 34996. [D 20:43:11.672706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 34997. [D 20:43:11.672720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 34998. [D 20:43:11.672735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 34999. [D 20:43:11.672749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35000. [D 20:43:11.672763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35001. [D 20:43:11.672777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35002. [D 20:43:11.672791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35003. [D 20:43:11.672806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35004. [D 20:43:11.672820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35005. [D 20:43:11.672834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35006. [D 20:43:11.672848] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001d40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35007. [D 20:43:11.675958] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.675976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.675989] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.679712] openib_check_cq: completed rdma wr_id 2aaaab016e10, nic_wr_credit 35007. [D 20:43:11.679733] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 56/70. [D 20:43:11.685069] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.685085] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.685097] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.690187] openib_check_cq: completed rdma wr_id 2aaaab001d40, nic_wr_credit 35006. [D 20:43:11.690207] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 57/70. [D 20:43:11.692183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.692207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.692220] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:11.692247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.692260] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.692273] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:11.694391] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.694409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.694422] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:11.694461] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5811 [D 20:43:11.694476] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.694493] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 58/70. [D 20:43:11.697862] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5811 [D 20:43:11.697941] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 59/70. [D 20:43:11.705278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 35006. [D 20:43:11.705300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 35007. [D 20:43:11.705315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 35008. [D 20:43:11.705329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 35009. [D 20:43:11.705343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 35010. [D 20:43:11.705358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 35011. [D 20:43:11.705372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 35012. [D 20:43:11.705386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 35013. [D 20:43:11.705401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 35014. [D 20:43:11.705415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 35015. [D 20:43:11.705429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 35016. [D 20:43:11.705444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 35017. [D 20:43:11.705458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 35018. [D 20:43:11.705472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 35019. [D 20:43:11.705499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 35020. [D 20:43:11.705514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 35021. [D 20:43:11.705541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 35022. [D 20:43:11.705555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 35023. [D 20:43:11.705571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 35024. [D 20:43:11.705603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 35025. [D 20:43:11.705628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 35026. [D 20:43:11.705659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 35027. [D 20:43:11.705674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 35028. [D 20:43:11.705702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 35029. [D 20:43:11.705730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 35030. [D 20:43:11.705745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 35031. [D 20:43:11.705771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 35032. [D 20:43:11.705786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 35033. [D 20:43:11.705800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 35034. [D 20:43:11.705830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 35035. [D 20:43:11.705855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 35036. [D 20:43:11.705870] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 35037. [D 20:43:11.708107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.708131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.708145] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:11.708187] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5817 [D 20:43:11.708202] element 0: offset: 0x636280, size: 24 [D 20:43:11.708219] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 60/70. [D 20:43:11.708267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.708282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.708294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.708315] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5818 [D 20:43:11.708329] element 0: offset: 0x620d50, size: 24 [D 20:43:11.708343] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 0/70. [D 20:43:11.710442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.710460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.710472] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.710495] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5820 [D 20:43:11.710509] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.710524] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 1/70. [D 20:43:11.716841] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35037. [D 20:43:11.716863] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 2/70. [D 20:43:11.717044] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.717065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.717079] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.723663] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5818 [D 20:43:11.723745] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 3/70. [D 20:43:11.723899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 35037. [D 20:43:11.723975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 35038. [D 20:43:11.723990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35039. [D 20:43:11.724016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35040. [D 20:43:11.724031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35041. [D 20:43:11.724045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35042. [D 20:43:11.724060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35043. [D 20:43:11.724074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35044. [D 20:43:11.724088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35045. [D 20:43:11.724102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35046. [D 20:43:11.724117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35047. [D 20:43:11.724131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35048. [D 20:43:11.724147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35049. [D 20:43:11.724162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35050. [D 20:43:11.724176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35051. [D 20:43:11.724191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35052. [D 20:43:11.724206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35053. [D 20:43:11.724220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35054. [D 20:43:11.724234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35055. [D 20:43:11.724249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35056. [D 20:43:11.724263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35057. [D 20:43:11.724277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35058. [D 20:43:11.724291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35059. [D 20:43:11.724306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35060. [D 20:43:11.724320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35061. [D 20:43:11.724334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35062. [D 20:43:11.724348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35063. [D 20:43:11.724362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35064. [D 20:43:11.724376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35065. [D 20:43:11.724391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35066. [D 20:43:11.724405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35067. [D 20:43:11.724419] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35068. [D 20:43:11.724641] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5817 [D 20:43:11.724691] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 4/70. [D 20:43:11.724769] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5820 [D 20:43:11.724787] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 5/70. [D 20:43:11.725380] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.725400] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.725413] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.725456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5823 [D 20:43:11.725470] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.725487] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 6/70. [D 20:43:11.735554] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35068. [D 20:43:11.735584] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 7/70. [D 20:43:11.735601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35068. [D 20:43:11.735616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 35069. [D 20:43:11.735631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 35070. [D 20:43:11.735646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 35071. [D 20:43:11.735660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 35072. [D 20:43:11.735675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 35073. [D 20:43:11.735689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35074. [D 20:43:11.735704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35075. [D 20:43:11.735718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35076. [D 20:43:11.735733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 35077. [D 20:43:11.735747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 35078. [D 20:43:11.735762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 35079. [D 20:43:11.735776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 35080. [D 20:43:11.735791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 35081. [D 20:43:11.735805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35082. [D 20:43:11.735820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35083. [D 20:43:11.735834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35084. [D 20:43:11.735849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 35085. [D 20:43:11.735863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 35086. [D 20:43:11.735878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 35087. [D 20:43:11.735892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 35088. [D 20:43:11.735906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 35089. [D 20:43:11.735921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35090. [D 20:43:11.735936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35091. [D 20:43:11.735950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35092. [D 20:43:11.735965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 35093. [D 20:43:11.735979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 35094. [D 20:43:11.735994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 35095. [D 20:43:11.736012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 35096. [D 20:43:11.736026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 35097. [D 20:43:11.736041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35098. [D 20:43:11.736056] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35099. [D 20:43:11.736072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35100. [D 20:43:11.736087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35101. [D 20:43:11.736102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35102. [D 20:43:11.736116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35103. [D 20:43:11.736131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35104. [D 20:43:11.736155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35105. [D 20:43:11.736170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35106. [D 20:43:11.736192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35107. [D 20:43:11.736207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35108. [D 20:43:11.736221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35109. [D 20:43:11.736235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35110. [D 20:43:11.736250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35111. [D 20:43:11.736264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35112. [D 20:43:11.736279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35113. [D 20:43:11.736293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35114. [D 20:43:11.736308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35115. [D 20:43:11.736322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35116. [D 20:43:11.736336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35117. [D 20:43:11.736351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35118. [D 20:43:11.736365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35119. [D 20:43:11.736380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35120. [D 20:43:11.736395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35121. [D 20:43:11.736409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35122. [D 20:43:11.736424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35123. [D 20:43:11.736438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35124. [D 20:43:11.736452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35125. [D 20:43:11.736467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35126. [D 20:43:11.736482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35127. [D 20:43:11.736497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35128. [D 20:43:11.736511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35129. [D 20:43:11.736525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35130. [D 20:43:11.736540] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014570 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35131. [D 20:43:11.736606] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.736628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.736640] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.742741] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5823 [D 20:43:11.742763] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 8/70. [D 20:43:11.747253] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 35131. [D 20:43:11.747328] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 9/70. [D 20:43:11.753684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.753706] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.753718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:11.753741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5826 [D 20:43:11.753755] element 0: offset: 0x636060, size: 24 [D 20:43:11.753771] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 10/70. [D 20:43:11.758880] openib_check_cq: completed rdma wr_id 2aaaab014570, nic_wr_credit 35130. [D 20:43:11.758905] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 11/70. [D 20:43:11.758940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 35130. [D 20:43:11.758956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 35131. [D 20:43:11.758959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.758976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 35132. [D 20:43:11.758997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.759015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 35133. [D 20:43:11.759030] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:11.759049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 35134. [D 20:43:11.759073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 35135. [D 20:43:11.759089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 35136. [D 20:43:11.759104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 35137. [D 20:43:11.759119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 35138. [D 20:43:11.759133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 35139. [D 20:43:11.759148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 35140. [D 20:43:11.759163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 35141. [D 20:43:11.759177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 35142. [D 20:43:11.759192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 35143. [D 20:43:11.759207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 35144. [D 20:43:11.759228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 35145. [D 20:43:11.759243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 35146. [D 20:43:11.759258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 35147. [D 20:43:11.759272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 35148. [D 20:43:11.759287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 35149. [D 20:43:11.759302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 35150. [D 20:43:11.759316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 35151. [D 20:43:11.759331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 35152. [D 20:43:11.759346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 35153. [D 20:43:11.759360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 35154. [D 20:43:11.759375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 35155. [D 20:43:11.759389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 35156. [D 20:43:11.759404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 35157. [D 20:43:11.759418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 35158. [D 20:43:11.759433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 35159. [D 20:43:11.759448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 35160. [D 20:43:11.759462] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 35161. [D 20:43:11.759511] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.759534] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.759546] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.762451] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5826 [D 20:43:11.762517] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 12/70. [D 20:43:11.767285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.767304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.767318] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.767359] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5829 [D 20:43:11.767374] element 0: offset: 0x6301d0, size: 24 [D 20:43:11.767391] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 13/70. [D 20:43:11.770634] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35161. [D 20:43:11.770658] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 14/70. [D 20:43:11.770775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.770796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.770809] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.773812] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5829 [D 20:43:11.773880] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 15/70. [D 20:43:11.774333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35161. [D 20:43:11.774357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35162. [D 20:43:11.774372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35163. [D 20:43:11.774387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35164. [D 20:43:11.774401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35165. [D 20:43:11.774415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35166. [D 20:43:11.774430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35167. [D 20:43:11.774444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35168. [D 20:43:11.774458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35169. [D 20:43:11.774473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35170. [D 20:43:11.774487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35171. [D 20:43:11.774502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35172. [D 20:43:11.774516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35173. [D 20:43:11.774530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35174. [D 20:43:11.774545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35175. [D 20:43:11.774559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35176. [D 20:43:11.774573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35177. [D 20:43:11.774588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35178. [D 20:43:11.774602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35179. [D 20:43:11.774617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35180. [D 20:43:11.774631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35181. [D 20:43:11.774646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35182. [D 20:43:11.774660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35183. [D 20:43:11.774674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35184. [D 20:43:11.774689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35185. [D 20:43:11.774703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35186. [D 20:43:11.774718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35187. [D 20:43:11.774732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35188. [D 20:43:11.774746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35189. [D 20:43:11.774761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35190. [D 20:43:11.774775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35191. [D 20:43:11.774790] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35192. [D 20:43:11.774806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35193. [D 20:43:11.774821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35194. [D 20:43:11.774835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35195. [D 20:43:11.774849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35196. [D 20:43:11.774864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35197. [D 20:43:11.774878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35198. [D 20:43:11.774892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35199. [D 20:43:11.774907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35200. [D 20:43:11.774921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35201. [D 20:43:11.774936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35202. [D 20:43:11.774950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35203. [D 20:43:11.774964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35204. [D 20:43:11.774979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35205. [D 20:43:11.774993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35206. [D 20:43:11.775007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35207. [D 20:43:11.775022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35208. [D 20:43:11.775036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35209. [D 20:43:11.775055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35210. [D 20:43:11.775070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35211. [D 20:43:11.775084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35212. [D 20:43:11.775098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35213. [D 20:43:11.775113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35214. [D 20:43:11.775127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35215. [D 20:43:11.775141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35216. [D 20:43:11.775155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35217. [D 20:43:11.775170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35218. [D 20:43:11.775184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35219. [D 20:43:11.775198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35220. [D 20:43:11.775213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35221. [D 20:43:11.775228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35222. [D 20:43:11.775242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35223. [D 20:43:11.775257] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35224. [D 20:43:11.781630] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 35224. [D 20:43:11.781647] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 16/70. [D 20:43:11.782991] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.783015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.783028] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:11.783069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5832 [D 20:43:11.783085] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.783184] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 17/70. [D 20:43:11.792881] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35223. [D 20:43:11.792905] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 18/70. [D 20:43:11.792960] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.792981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.792993] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:11.793078] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.793093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.793105] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:11.799018] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5832 [D 20:43:11.799044] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 19/70. [D 20:43:11.799125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35223. [D 20:43:11.799186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35224. [D 20:43:11.799201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35225. [D 20:43:11.799216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35226. [D 20:43:11.799231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35227. [D 20:43:11.799267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35228. [D 20:43:11.799293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35229. [D 20:43:11.799309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35230. [D 20:43:11.799337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35231. [D 20:43:11.799352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35232. [D 20:43:11.799374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35233. [D 20:43:11.799389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35234. [D 20:43:11.799417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35235. [D 20:43:11.799442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35236. [D 20:43:11.799457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35237. [D 20:43:11.799488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35238. [D 20:43:11.799513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35239. [D 20:43:11.799528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35240. [D 20:43:11.799543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35241. [D 20:43:11.799569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35242. [D 20:43:11.799619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35243. [D 20:43:11.799634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35244. [D 20:43:11.799649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35245. [D 20:43:11.799685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35246. [D 20:43:11.799701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35247. [D 20:43:11.799715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35248. [D 20:43:11.799730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35249. [D 20:43:11.799744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35250. [D 20:43:11.799759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35251. [D 20:43:11.799777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35252. [D 20:43:11.799791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35253. [D 20:43:11.799805] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35254. [D 20:43:11.807638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:11.807660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.807673] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:11.807695] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5835 [D 20:43:11.807709] element 0: offset: 0x620d50, size: 24 [D 20:43:11.807727] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 20/70. [D 20:43:11.811040] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35254. [D 20:43:11.811069] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 21/70. [D 20:43:11.811170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:11.811190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:11.811203] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:11.814440] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5835 [D 20:43:11.814518] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 22/70. [D 20:43:11.819754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35254. [D 20:43:11.819777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35255. [D 20:43:11.819791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35256. [D 20:43:11.819806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35257. [D 20:43:12.054493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35258. [D 20:43:12.054520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35259. [D 20:43:12.054960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35260. [D 20:43:12.054976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35261. [D 20:43:12.054991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35262. [D 20:43:12.055006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35263. [D 20:43:12.055020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35264. [D 20:43:12.055038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35265. [D 20:43:12.055054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35266. [D 20:43:12.055071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35267. [D 20:43:12.055085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35268. [D 20:43:12.055099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35269. [D 20:43:12.055114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35270. [D 20:43:12.055128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35271. [D 20:43:12.055158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35272. [D 20:43:12.055173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35273. [D 20:43:12.055188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35274. [D 20:43:12.055202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35275. [D 20:43:12.055216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35276. [D 20:43:12.055231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35277. [D 20:43:12.055340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35278. [D 20:43:12.055801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35279. [D 20:43:12.055818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35280. [D 20:43:12.055833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35281. [D 20:43:12.055847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35282. [D 20:43:12.055862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35283. [D 20:43:12.055881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35284. [D 20:43:12.055908] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35285. [D 20:43:12.056260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.056286] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.056300] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.056343] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5839 [D 20:43:12.056358] element 0: offset: 0x658610, size: 24 [D 20:43:12.056377] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 23/70. [D 20:43:12.056413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.056427] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.056440] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.056461] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5841 [D 20:43:12.056476] element 0: offset: 0x636060, size: 24 [D 20:43:12.056490] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 24/70. [D 20:43:12.056517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.056531] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.056546] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:12.056566] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5844 [D 20:43:12.056580] element 0: offset: 0x6301d0, size: 24 [D 20:43:12.056594] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 25/70. [D 20:43:12.059930] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35285. [D 20:43:12.059957] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 26/70. [D 20:43:12.060151] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.060171] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.060184] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:12.066368] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5839 [D 20:43:12.066443] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 27/70. [D 20:43:12.066501] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5841 [D 20:43:12.066508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35285. [D 20:43:12.066547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 35286. [D 20:43:12.066562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 35287. [D 20:43:12.066576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 35288. [D 20:43:12.066591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 35289. [D 20:43:12.066605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 35290. [D 20:43:12.066619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35291. [D 20:43:12.066633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35292. [D 20:43:12.066647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35293. [D 20:43:12.066661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 35294. [D 20:43:12.066675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 35295. [D 20:43:12.066690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 35296. [D 20:43:12.066704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 35297. [D 20:43:12.066718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 35298. [D 20:43:12.066732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35299. [D 20:43:12.066746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35300. [D 20:43:12.066761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35301. [D 20:43:12.066775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 35302. [D 20:43:12.066789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 35303. [D 20:43:12.066803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 35304. [D 20:43:12.066817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 35305. [D 20:43:12.066832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 35306. [D 20:43:12.066846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35307. [D 20:43:12.066860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35308. [D 20:43:12.066874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35309. [D 20:43:12.066888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 35310. [D 20:43:12.066902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 35311. [D 20:43:12.066917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 35312. [D 20:43:12.066931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 35313. [D 20:43:12.066945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 35314. [D 20:43:12.066959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35315. [D 20:43:12.066973] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35316. [D 20:43:12.066999] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 28/70. [D 20:43:12.071632] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.071650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.071663] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:12.071709] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5847 [D 20:43:12.071723] element 0: offset: 0x636280, size: 24 [D 20:43:12.071739] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 29/70. [D 20:43:12.071788] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 188096, tag: 5844 [D 20:43:12.071804] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 30/70. [D 20:43:12.072433] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35316. [D 20:43:12.072455] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 31/70. [D 20:43:12.072471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35316. [D 20:43:12.072487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35317. [D 20:43:12.072501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35318. [D 20:43:12.072520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35319. [D 20:43:12.072533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35320. [D 20:43:12.072547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35321. [D 20:43:12.072562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35322. [D 20:43:12.072576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35323. [D 20:43:12.072590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35324. [D 20:43:12.072604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35325. [D 20:43:12.072620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35326. [D 20:43:12.072634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35327. [D 20:43:12.072648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35328. [D 20:43:12.072666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35329. [D 20:43:12.072680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35330. [D 20:43:12.072693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35331. [D 20:43:12.072707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35332. [D 20:43:12.072721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35333. [D 20:43:12.072735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35334. [D 20:43:12.072749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35335. [D 20:43:12.072763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35336. [D 20:43:12.072776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35337. [D 20:43:12.072790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35338. [D 20:43:12.072804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35339. [D 20:43:12.072822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35340. [D 20:43:12.072836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35341. [D 20:43:12.072850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35342. [D 20:43:12.072868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35343. [D 20:43:12.072882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35344. [D 20:43:12.072896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35345. [D 20:43:12.072913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35346. [D 20:43:12.072927] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35347. [D 20:43:12.072943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 35348. [D 20:43:12.072961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 35349. [D 20:43:12.072975] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab01c3a0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 35350. [D 20:43:12.076172] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.076189] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.076202] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:12.078696] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 35350. [D 20:43:12.078715] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 32/70. [D 20:43:12.079724] openib_check_cq: completed rdma wr_id 2aaaab01c3a0, nic_wr_credit 35349. [D 20:43:12.079739] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 33/70. [D 20:43:12.080008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.080023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.080035] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.080056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.080069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.080082] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.083130] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5847 [D 20:43:12.083150] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 34/70. [D 20:43:12.085011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35349. [D 20:43:12.085027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35350. [D 20:43:12.085042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35351. [D 20:43:12.085055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35352. [D 20:43:12.085069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35353. [D 20:43:12.085083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35354. [D 20:43:12.085097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35355. [D 20:43:12.085111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35356. [D 20:43:12.085125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35357. [D 20:43:12.085139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35358. [D 20:43:12.085153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35359. [D 20:43:12.085167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35360. [D 20:43:12.085181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35361. [D 20:43:12.085195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35362. [D 20:43:12.085209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35363. [D 20:43:12.085223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35364. [D 20:43:12.085237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35365. [D 20:43:12.085250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35366. [D 20:43:12.085264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35367. [D 20:43:12.085278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35368. [D 20:43:12.085292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35369. [D 20:43:12.085307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35370. [D 20:43:12.085321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35371. [D 20:43:12.085335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35372. [D 20:43:12.085349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35373. [D 20:43:12.085363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35374. [D 20:43:12.085377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35375. [D 20:43:12.085391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35376. [D 20:43:12.085406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35377. [D 20:43:12.085419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35378. [D 20:43:12.085434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35379. [D 20:43:12.085448] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35380. [D 20:43:12.086477] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.086492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.086504] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.086526] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5851 [D 20:43:12.086540] element 0: offset: 0x620d50, size: 24 [D 20:43:12.086554] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 35/70. [D 20:43:12.089728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.089745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.089757] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.089778] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5854 [D 20:43:12.089792] element 0: offset: 0x61fa00, size: 24 [D 20:43:12.089806] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 36/70. [D 20:43:12.090946] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35380. [D 20:43:12.090961] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 37/70. [D 20:43:12.094039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.094055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.094067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:12.094088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5856 [D 20:43:12.094102] element 0: offset: 0x691fe0, size: 24 [D 20:43:12.094115] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 38/70. [D 20:43:12.094198] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.094213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.094225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:12.096034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.096050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.096063] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.098388] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5851 [D 20:43:12.098437] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 39/70. [D 20:43:12.099694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35380. [D 20:43:12.099719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 35381. [D 20:43:12.099733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 35382. [D 20:43:12.099748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 35383. [D 20:43:12.099762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 35384. [D 20:43:12.099776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 35385. [D 20:43:12.099789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35386. [D 20:43:12.099803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35387. [D 20:43:12.099817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35388. [D 20:43:12.099831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 35389. [D 20:43:12.099845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 35390. [D 20:43:12.099859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 35391. [D 20:43:12.099873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 35392. [D 20:43:12.099887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 35393. [D 20:43:12.099900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35394. [D 20:43:12.099914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35395. [D 20:43:12.099928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35396. [D 20:43:12.099942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 35397. [D 20:43:12.099956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 35398. [D 20:43:12.099970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 35399. [D 20:43:12.099984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 35400. [D 20:43:12.100011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 35401. [D 20:43:12.100025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35402. [D 20:43:12.100039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35403. [D 20:43:12.100053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35404. [D 20:43:12.100067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 35405. [D 20:43:12.100081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 35406. [D 20:43:12.100095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 35407. [D 20:43:12.100110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 35408. [D 20:43:12.100124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 35409. [D 20:43:12.100139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35410. [D 20:43:12.100154] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35411. [D 20:43:12.102505] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5854 [D 20:43:12.102590] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 40/70. [D 20:43:12.102609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.102629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.102642] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.102680] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5859 [D 20:43:12.102695] element 0: offset: 0x658610, size: 24 [D 20:43:12.102711] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 41/70. [D 20:43:12.111365] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35411. [D 20:43:12.111396] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 42/70. [D 20:43:12.111416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35411. [D 20:43:12.111432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35412. [D 20:43:12.111447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35413. [D 20:43:12.111461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35414. [D 20:43:12.111476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35415. [D 20:43:12.111491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35416. [D 20:43:12.111505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35417. [D 20:43:12.111520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35418. [D 20:43:12.111535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35419. [D 20:43:12.111549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35420. [D 20:43:12.111564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35421. [D 20:43:12.111579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35422. [D 20:43:12.111594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35423. [D 20:43:12.111608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35424. [D 20:43:12.111623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35425. [D 20:43:12.111638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35426. [D 20:43:12.111652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35427. [D 20:43:12.111667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35428. [D 20:43:12.111682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35429. [D 20:43:12.111697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35430. [D 20:43:12.111711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35431. [D 20:43:12.111728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35432. [D 20:43:12.111742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35433. [D 20:43:12.111757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35434. [D 20:43:12.111772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35435. [D 20:43:12.111787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35436. [D 20:43:12.111801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35437. [D 20:43:12.111816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35438. [D 20:43:12.111831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35439. [D 20:43:12.111846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35440. [D 20:43:12.111860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35441. [D 20:43:12.111875] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35442. [D 20:43:12.111944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.111965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.111977] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.118657] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5859 [D 20:43:12.118727] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 43/70. [D 20:43:12.123075] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 35442. [D 20:43:12.123101] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 44/70. [D 20:43:12.123141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35442. [D 20:43:12.123157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35443. [D 20:43:12.123172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35444. [D 20:43:12.123187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35445. [D 20:43:12.123201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35446. [D 20:43:12.123216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35447. [D 20:43:12.123231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35448. [D 20:43:12.123246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35449. [D 20:43:12.123261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35450. [D 20:43:12.123275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35451. [D 20:43:12.123290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35452. [D 20:43:12.123305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35453. [D 20:43:12.123320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35454. [D 20:43:12.123335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35455. [D 20:43:12.123351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35456. [D 20:43:12.123366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35457. [D 20:43:12.123381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35458. [D 20:43:12.123396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35459. [D 20:43:12.123411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35460. [D 20:43:12.123425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35461. [D 20:43:12.123440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35462. [D 20:43:12.123455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35463. [D 20:43:12.123470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35464. [D 20:43:12.123484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35465. [D 20:43:12.123499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35466. [D 20:43:12.123514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35467. [D 20:43:12.123529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35468. [D 20:43:12.123544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35469. [D 20:43:12.123558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35470. [D 20:43:12.123573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35471. [D 20:43:12.123588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35472. [D 20:43:12.123603] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35473. [D 20:43:12.123657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.123677] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.123689] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.128719] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.128735] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.128748] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.128771] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5863 [D 20:43:12.128785] element 0: offset: 0x628740, size: 24 [D 20:43:12.128803] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 45/70. [D 20:43:12.131206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.131221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.131233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.131253] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5865 [D 20:43:12.131267] element 0: offset: 0x5b0030, size: 24 [D 20:43:12.131281] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 46/70. [D 20:43:12.132095] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35473. [D 20:43:12.132121] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 47/70. [D 20:43:12.132238] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.132257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.132270] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.138862] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5863 [D 20:43:12.138990] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 48/70. [D 20:43:12.139134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35473. [D 20:43:12.139154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 35474. [D 20:43:12.139172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 35475. [D 20:43:12.139186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 35476. [D 20:43:12.139202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 35477. [D 20:43:12.139216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 35478. [D 20:43:12.139231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35479. [D 20:43:12.139246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35480. [D 20:43:12.139260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35481. [D 20:43:12.139275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 35482. [D 20:43:12.139290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 35483. [D 20:43:12.139305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 35484. [D 20:43:12.139319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 35485. [D 20:43:12.139335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 35486. [D 20:43:12.139349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35487. [D 20:43:12.139364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35488. [D 20:43:12.139379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35489. [D 20:43:12.139393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 35490. [D 20:43:12.139408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 35491. [D 20:43:12.139423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 35492. [D 20:43:12.139438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 35493. [D 20:43:12.139453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 35494. [D 20:43:12.139467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35495. [D 20:43:12.139483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35496. [D 20:43:12.139497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35497. [D 20:43:12.139512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 35498. [D 20:43:12.139526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 35499. [D 20:43:12.139541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 35500. [D 20:43:12.139558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 35501. [D 20:43:12.139573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 35502. [D 20:43:12.139588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35503. [D 20:43:12.139603] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35504. [D 20:43:12.140464] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.140533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.140548] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.140591] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5868 [D 20:43:12.140606] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.140626] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 49/70. [D 20:43:12.140756] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5865 [D 20:43:12.140789] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 50/70. [D 20:43:12.150140] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35504. [D 20:43:12.150164] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 51/70. [D 20:43:12.150180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35504. [D 20:43:12.150196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35505. [D 20:43:12.150211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35506. [D 20:43:12.150226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35507. [D 20:43:12.150241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35508. [D 20:43:12.150255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35509. [D 20:43:12.150270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35510. [D 20:43:12.150285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35511. [D 20:43:12.150300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35512. [D 20:43:12.150315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35513. [D 20:43:12.150330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35514. [D 20:43:12.150345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35515. [D 20:43:12.150359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35516. [D 20:43:12.150374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35517. [D 20:43:12.150389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35518. [D 20:43:12.150404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35519. [D 20:43:12.150419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35520. [D 20:43:12.150434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35521. [D 20:43:12.150449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35522. [D 20:43:12.150465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35523. [D 20:43:12.150479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35524. [D 20:43:12.150494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35525. [D 20:43:12.150509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35526. [D 20:43:12.150524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35527. [D 20:43:12.150538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35528. [D 20:43:12.150553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35529. [D 20:43:12.150568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35530. [D 20:43:12.150583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35531. [D 20:43:12.150597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35532. [D 20:43:12.150612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35533. [D 20:43:12.150627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35534. [D 20:43:12.150642] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35535. [D 20:43:12.150709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.150730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.150743] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.155941] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5868 [D 20:43:12.155963] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 52/70. [D 20:43:12.157923] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 35535. [D 20:43:12.157939] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 53/70. [D 20:43:12.157967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35535. [D 20:43:12.157982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35536. [D 20:43:12.157997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 35537. [D 20:43:12.158012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 35538. [D 20:43:12.158027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 35539. [D 20:43:12.158041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 35540. [D 20:43:12.158056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 35541. [D 20:43:12.158071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35542. [D 20:43:12.158086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35543. [D 20:43:12.158100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35544. [D 20:43:12.158115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 35545. [D 20:43:12.158130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 35546. [D 20:43:12.158146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 35547. [D 20:43:12.158161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 35548. [D 20:43:12.158176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 35549. [D 20:43:12.158191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35550. [D 20:43:12.158205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35551. [D 20:43:12.158220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35552. [D 20:43:12.158234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 35553. [D 20:43:12.158249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 35554. [D 20:43:12.158263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 35555. [D 20:43:12.158278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 35556. [D 20:43:12.158293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 35557. [D 20:43:12.158307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35558. [D 20:43:12.158322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35559. [D 20:43:12.158336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35560. [D 20:43:12.158351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 35561. [D 20:43:12.158365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 35562. [D 20:43:12.158380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 35563. [D 20:43:12.158394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 35564. [D 20:43:12.158409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 35565. [D 20:43:12.158424] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35566. [D 20:43:12.158505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.158571] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.158585] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.165974] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.165991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.166004] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.166047] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5871 [D 20:43:12.166063] element 0: offset: 0x2aaaab60dd50, size: 24 [D 20:43:12.166082] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 54/70. [D 20:43:12.167892] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35566. [D 20:43:12.167917] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 55/70. [D 20:43:12.168035] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.168056] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.168069] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.171513] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5871 [D 20:43:12.171538] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 56/70. [D 20:43:12.173530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35566. [D 20:43:12.173547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35567. [D 20:43:12.173562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35568. [D 20:43:12.173577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35569. [D 20:43:12.173591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35570. [D 20:43:12.173606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35571. [D 20:43:12.173620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35572. [D 20:43:12.173634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35573. [D 20:43:12.173649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35574. [D 20:43:12.173664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35575. [D 20:43:12.173678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35576. [D 20:43:12.173705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35577. [D 20:43:12.173720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35578. [D 20:43:12.173743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35579. [D 20:43:12.173758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35580. [D 20:43:12.173794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35581. [D 20:43:12.173809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35582. [D 20:43:12.173824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35583. [D 20:43:12.173855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35584. [D 20:43:12.173870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35585. [D 20:43:12.173884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35586. [D 20:43:12.173910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35587. [D 20:43:12.173924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35588. [D 20:43:12.173951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35589. [D 20:43:12.173965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35590. [D 20:43:12.173980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35591. [D 20:43:12.173995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35592. [D 20:43:12.174010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35593. [D 20:43:12.174027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35594. [D 20:43:12.174055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35595. [D 20:43:12.174071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35596. [D 20:43:12.174085] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f4a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35597. [D 20:43:12.185148] openib_check_cq: completed rdma wr_id 2aaaab02f4a0, nic_wr_credit 35597. [D 20:43:12.185166] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 57/70. [D 20:43:12.185290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.185352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.185366] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:12.196709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.196728] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.196741] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:12.196782] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5875 [D 20:43:12.196797] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.196816] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 58/70. [D 20:43:12.199276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.199332] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.199345] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.199386] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5877 [D 20:43:12.199401] element 0: offset: 0x2aaaab60db30, size: 24 [D 20:43:12.199497] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 59/70. [D 20:43:12.203491] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5875 [D 20:43:12.203516] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 60/70. [D 20:43:12.203542] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5877 [D 20:43:12.203566] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 0/70. [D 20:43:12.203596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35597. [D 20:43:12.203613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 35598. [D 20:43:12.203627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 35599. [D 20:43:12.203642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 35600. [D 20:43:12.203656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 35601. [D 20:43:12.203671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 35602. [D 20:43:12.203686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35603. [D 20:43:12.203700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35604. [D 20:43:12.203715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35605. [D 20:43:12.203729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 35606. [D 20:43:12.203744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 35607. [D 20:43:12.203758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 35608. [D 20:43:12.203773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 35609. [D 20:43:12.203787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 35610. [D 20:43:12.494552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35611. [D 20:43:12.494576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35612. [D 20:43:12.494590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35613. [D 20:43:12.494605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 35614. [D 20:43:12.494629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 35615. [D 20:43:12.494644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 35616. [D 20:43:12.494659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 35617. [D 20:43:12.495291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 35618. [D 20:43:12.495322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35619. [D 20:43:12.495337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35620. [D 20:43:12.495351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35621. [D 20:43:12.495366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 35622. [D 20:43:12.495380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 35623. [D 20:43:12.495394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 35624. [D 20:43:12.495409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 35625. [D 20:43:12.495423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 35626. [D 20:43:12.495437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35627. [D 20:43:12.495451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014a60 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35628. [D 20:43:12.495469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35629. [D 20:43:12.495484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35630. [D 20:43:12.496112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35631. [D 20:43:12.496130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35632. [D 20:43:12.496145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35633. [D 20:43:12.496159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35634. [D 20:43:12.496173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35635. [D 20:43:12.496188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35636. [D 20:43:12.496202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35637. [D 20:43:12.496216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35638. [D 20:43:12.496231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35639. [D 20:43:12.496245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35640. [D 20:43:12.496259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35641. [D 20:43:12.496273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35642. [D 20:43:12.496288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35643. [D 20:43:12.496777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35644. [D 20:43:12.496816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35645. [D 20:43:12.496831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35646. [D 20:43:12.496845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35647. [D 20:43:12.496859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35648. [D 20:43:12.496874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35649. [D 20:43:12.496901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35650. [D 20:43:12.496916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35651. [D 20:43:12.496930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35652. [D 20:43:12.496944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35653. [D 20:43:12.496958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35654. [D 20:43:12.496972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35655. [D 20:43:12.496987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35656. [D 20:43:12.497001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35657. [D 20:43:12.497015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35658. [D 20:43:12.497029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35659. [D 20:43:12.497044] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab01eb00 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35660. [D 20:43:12.497208] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.497275] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.497289] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.497334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5880 [D 20:43:12.497349] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:12.497369] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 1/70. [D 20:43:12.498028] openib_check_cq: completed rdma wr_id 2aaaab014a60, nic_wr_credit 35660. [D 20:43:12.498052] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 2/70. [D 20:43:12.503921] openib_check_cq: completed rdma wr_id 2aaaab01eb00, nic_wr_credit 35659. [D 20:43:12.503941] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 3/70. [D 20:43:12.504103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.504126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.504139] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.504217] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.504232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.504245] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.507633] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5880 [D 20:43:12.507658] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 4/70. [D 20:43:12.509609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35659. [D 20:43:12.509629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35660. [D 20:43:12.509644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35661. [D 20:43:12.509658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35662. [D 20:43:12.509673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35663. [D 20:43:12.509687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35664. [D 20:43:12.509701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35665. [D 20:43:12.509716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35666. [D 20:43:12.509730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35667. [D 20:43:12.509744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35668. [D 20:43:12.509759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35669. [D 20:43:12.509773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35670. [D 20:43:12.509787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35671. [D 20:43:12.509802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35672. [D 20:43:12.509816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35673. [D 20:43:12.509831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35674. [D 20:43:12.509845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35675. [D 20:43:12.509859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35676. [D 20:43:12.509874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35677. [D 20:43:12.509888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35678. [D 20:43:12.509902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35679. [D 20:43:12.509917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35680. [D 20:43:12.509931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35681. [D 20:43:12.509945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35682. [D 20:43:12.509960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35683. [D 20:43:12.509974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35684. [D 20:43:12.509989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35685. [D 20:43:12.510003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35686. [D 20:43:12.510018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35687. [D 20:43:12.510032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35688. [D 20:43:12.510047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35689. [D 20:43:12.510061] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35690. [D 20:43:12.515558] openib_check_cq: completed rdma wr_id 2aaaab014b40, nic_wr_credit 35690. [D 20:43:12.515578] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 5/70. [D 20:43:12.515869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.515925] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.515938] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:12.520725] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.520745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.520758] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:12.520798] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5885 [D 20:43:12.520813] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.520833] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 6/70. [D 20:43:12.520869] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.520888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.520901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.520922] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5886 [D 20:43:12.520936] element 0: offset: 0x2aaaab60db30, size: 24 [D 20:43:12.520951] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 7/70. [D 20:43:12.527140] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.527204] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.527218] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.527261] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5889 [D 20:43:12.527276] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:12.527300] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 8/70. [D 20:43:12.531000] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5885 [D 20:43:12.531027] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 9/70. [D 20:43:12.531044] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5886 [D 20:43:12.531063] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 10/70. [D 20:43:12.531078] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5889 [D 20:43:12.531093] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 11/70. [D 20:43:12.531571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35690. [D 20:43:12.531592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 35691. [D 20:43:12.531607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 35692. [D 20:43:12.531621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 35693. [D 20:43:12.531636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 35694. [D 20:43:12.531650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 35695. [D 20:43:12.531665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35696. [D 20:43:12.531679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35697. [D 20:43:12.531693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35698. [D 20:43:12.531707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 35699. [D 20:43:12.531722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 35700. [D 20:43:12.531736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 35701. [D 20:43:12.531750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 35702. [D 20:43:12.531764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 35703. [D 20:43:12.531779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35704. [D 20:43:12.531793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35705. [D 20:43:12.531807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35706. [D 20:43:12.531821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 35707. [D 20:43:12.531836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 35708. [D 20:43:12.531850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 35709. [D 20:43:12.531865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 35710. [D 20:43:12.531879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 35711. [D 20:43:12.531893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35712. [D 20:43:12.531907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35713. [D 20:43:12.531921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35714. [D 20:43:12.531936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 35715. [D 20:43:12.531950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 35716. [D 20:43:12.531964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 35717. [D 20:43:12.531978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 35718. [D 20:43:12.531992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 35719. [D 20:43:12.532011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35720. [D 20:43:12.532026] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab01e9c0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35721. [D 20:43:12.532042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35722. [D 20:43:12.532057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35723. [D 20:43:12.532072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35724. [D 20:43:12.532088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35725. [D 20:43:12.532102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35726. [D 20:43:12.532116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35727. [D 20:43:12.532130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35728. [D 20:43:12.532145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35729. [D 20:43:12.532159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35730. [D 20:43:12.532173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35731. [D 20:43:12.532187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35732. [D 20:43:12.532201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35733. [D 20:43:12.532216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35734. [D 20:43:12.532230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35735. [D 20:43:12.532244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35736. [D 20:43:12.532258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35737. [D 20:43:12.532272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35738. [D 20:43:12.532287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35739. [D 20:43:12.532301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35740. [D 20:43:12.532315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35741. [D 20:43:12.532329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35742. [D 20:43:12.532343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35743. [D 20:43:12.532358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35744. [D 20:43:12.532372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35745. [D 20:43:12.532386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35746. [D 20:43:12.532400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35747. [D 20:43:12.532414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35748. [D 20:43:12.532428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35749. [D 20:43:12.532443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35750. [D 20:43:12.532457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35751. [D 20:43:12.532471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35752. [D 20:43:12.532485] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab01e610 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35753. [D 20:43:12.532502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35754. [D 20:43:12.532517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35755. [D 20:43:12.532531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35756. [D 20:43:12.532545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35757. [D 20:43:12.532560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35758. [D 20:43:12.532574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35759. [D 20:43:12.532588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35760. [E 20:43:12.532607] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 35761, block for 10 ms. [D 20:43:12.543137] openib_check_cq: completed rdma wr_id 2aaaab01e9c0, nic_wr_credit 35760. [D 20:43:12.543160] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 12/70. [D 20:43:12.543175] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35759. [D 20:43:12.543191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35760. [D 20:43:12.543205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35761. [D 20:43:12.543219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35762. [D 20:43:12.543234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35763. [D 20:43:12.543248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35764. [D 20:43:12.543262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35765. [D 20:43:12.543277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35766. [D 20:43:12.543291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35767. [D 20:43:12.543305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35768. [D 20:43:12.543319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35769. [D 20:43:12.543334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35770. [D 20:43:12.543348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35771. [D 20:43:12.543362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35772. [D 20:43:12.543377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35773. [D 20:43:12.543391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35774. [D 20:43:12.543405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35775. [D 20:43:12.543420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35776. [D 20:43:12.543434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35777. [D 20:43:12.543448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35778. [D 20:43:12.543463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35779. [D 20:43:12.543477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35780. [D 20:43:12.543491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35781. [D 20:43:12.543506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35782. [D 20:43:12.543520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35783. [D 20:43:12.543534] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029fa0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35784. [D 20:43:12.554679] openib_check_cq: completed rdma wr_id 2aaaab01e610, nic_wr_credit 35784. [D 20:43:12.554701] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 13/70. [D 20:43:12.556927] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.556991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.557004] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.563521] openib_check_cq: completed rdma wr_id 2aaaab029fa0, nic_wr_credit 35783. [D 20:43:12.563547] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 14/70. [D 20:43:12.563598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.563617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.563629] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.563654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.563667] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.563680] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:12.579480] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.579497] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.579510] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:12.579550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5895 [D 20:43:12.579566] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:12.579585] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 15/70. [D 20:43:12.579624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.579639] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.579651] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.579673] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5896 [D 20:43:12.579688] element 0: offset: 0x2aaaab01afe0, size: 24 [D 20:43:12.579702] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 16/70. [D 20:43:12.585599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.585665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.585679] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.585722] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5898 [D 20:43:12.585737] element 0: offset: 0x628740, size: 24 [D 20:43:12.585757] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 17/70. [D 20:43:12.589136] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 5895 [D 20:43:12.589166] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 18/70. [D 20:43:12.589183] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5896 [D 20:43:12.589199] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 19/70. [D 20:43:12.589324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35783. [D 20:43:12.589343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 35784. [D 20:43:12.589358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 35785. [D 20:43:12.589374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 35786. [D 20:43:12.589389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 35787. [D 20:43:12.589403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 35788. [D 20:43:12.589418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35789. [D 20:43:12.589433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35790. [D 20:43:12.589447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35791. [D 20:43:12.589462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 35792. [D 20:43:12.589476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 35793. [D 20:43:12.589491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 35794. [D 20:43:12.589505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 35795. [D 20:43:12.589520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 35796. [D 20:43:12.589534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35797. [D 20:43:12.589549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35798. [D 20:43:12.589564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35799. [D 20:43:12.589578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 35800. [D 20:43:12.589593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 35801. [D 20:43:12.589607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 35802. [D 20:43:12.589622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 35803. [D 20:43:12.589636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 35804. [D 20:43:12.589650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35805. [D 20:43:12.589665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35806. [D 20:43:12.589679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35807. [D 20:43:12.589694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 35808. [D 20:43:12.589708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 35809. [D 20:43:12.589723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 35810. [D 20:43:12.589737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 35811. [D 20:43:12.589752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 35812. [D 20:43:12.589766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35813. [D 20:43:12.589781] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35814. [D 20:43:12.589798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35815. [D 20:43:12.589813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35816. [D 20:43:12.589828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35817. [D 20:43:12.589842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35818. [D 20:43:12.589857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35819. [D 20:43:12.589871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35820. [D 20:43:12.589885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35821. [D 20:43:12.589899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35822. [D 20:43:12.589914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35823. [D 20:43:12.589928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35824. [D 20:43:12.589943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35825. [D 20:43:12.589957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35826. [D 20:43:12.589971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35827. [D 20:43:12.589985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35828. [D 20:43:12.590000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35829. [D 20:43:12.590014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35830. [D 20:43:12.590028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35831. [D 20:43:12.590043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35832. [D 20:43:12.590057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35833. [D 20:43:12.590071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35834. [D 20:43:12.590086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35835. [D 20:43:12.590100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35836. [D 20:43:12.590114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35837. [D 20:43:12.590129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35838. [D 20:43:12.590143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35839. [D 20:43:12.590157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35840. [D 20:43:12.590171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35841. [D 20:43:12.590186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35842. [D 20:43:12.590200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35843. [D 20:43:12.590216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35844. [D 20:43:12.590230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35845. [D 20:43:12.590245] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35846. [D 20:43:12.592368] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5898 [D 20:43:12.593470] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 20/70. [D 20:43:12.600931] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 35846. [D 20:43:12.600953] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 21/70. [D 20:43:12.612503] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 35845. [D 20:43:12.612524] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 22/70. [D 20:43:12.612548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35845. [D 20:43:12.612563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35846. [D 20:43:12.612578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35847. [D 20:43:12.612592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35848. [D 20:43:12.612607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35849. [D 20:43:12.612621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35850. [D 20:43:12.612635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35851. [D 20:43:12.612650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35852. [D 20:43:12.612664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35853. [D 20:43:12.612679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35854. [D 20:43:12.612693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35855. [D 20:43:12.612708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35856. [D 20:43:12.612722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35857. [D 20:43:12.612737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35858. [D 20:43:12.612751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35859. [D 20:43:12.612766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35860. [D 20:43:12.612780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35861. [D 20:43:12.612795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35862. [D 20:43:12.612809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35863. [D 20:43:12.612824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35864. [D 20:43:12.612838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35865. [D 20:43:12.612853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35866. [D 20:43:12.612868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35867. [D 20:43:12.612883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35868. [D 20:43:12.612897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35869. [D 20:43:12.612912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35870. [D 20:43:12.612926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35871. [D 20:43:12.612941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35872. [D 20:43:12.612956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35873. [D 20:43:12.612970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35874. [D 20:43:12.612985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35875. [D 20:43:12.612999] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025b40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35876. [D 20:43:12.616033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.616050] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.616064] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.616088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.616102] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.616116] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.623204] openib_check_cq: completed rdma wr_id 2aaaab025b40, nic_wr_credit 35876. [D 20:43:12.623223] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 23/70. [D 20:43:12.624459] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.624526] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.624540] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.624585] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5901 [D 20:43:12.624600] element 0: offset: 0x636060, size: 24 [D 20:43:12.624620] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 24/70. [D 20:43:12.624673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.624687] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.624700] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.627654] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5901 [D 20:43:12.627676] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 25/70. [D 20:43:12.627810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35876. [D 20:43:12.627827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35877. [D 20:43:12.627841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35878. [D 20:43:12.627856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35879. [D 20:43:12.627870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35880. [D 20:43:12.627885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35881. [D 20:43:12.627899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35882. [D 20:43:12.627913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35883. [D 20:43:12.627929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35884. [D 20:43:12.627943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35885. [D 20:43:12.627957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35886. [D 20:43:12.627972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35887. [D 20:43:12.627986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35888. [D 20:43:12.628001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35889. [D 20:43:12.628018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35890. [D 20:43:12.628032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35891. [D 20:43:12.628046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35892. [D 20:43:12.628060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35893. [D 20:43:12.628075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35894. [D 20:43:12.628089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35895. [D 20:43:12.628103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35896. [D 20:43:12.628117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35897. [D 20:43:12.628131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35898. [D 20:43:12.628146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35899. [D 20:43:12.628160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35900. [D 20:43:12.628174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35901. [D 20:43:12.628188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35902. [D 20:43:12.628202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35903. [D 20:43:12.628216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35904. [D 20:43:12.628231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35905. [D 20:43:12.628245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35906. [D 20:43:12.628259] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35907. [D 20:43:12.634239] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 35907. [D 20:43:12.634261] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 26/70. [D 20:43:12.634401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.634454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.634467] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:12.635738] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.635757] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.635770] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:12.635814] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5906 [D 20:43:12.635830] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.635849] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 27/70. [D 20:43:12.635890] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.635904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.635917] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.635942] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5907 [D 20:43:12.635956] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:12.635970] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 28/70. [D 20:43:12.639310] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5906 [D 20:43:12.639338] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 29/70. [D 20:43:12.639471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35907. [D 20:43:12.639488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 35908. [D 20:43:12.639503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 35909. [D 20:43:12.639517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 35910. [D 20:43:12.639532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 35911. [D 20:43:12.639546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 35912. [D 20:43:12.639561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35913. [D 20:43:12.639576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35914. [D 20:43:12.639590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35915. [D 20:43:12.639605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 35916. [D 20:43:12.639619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 35917. [D 20:43:12.639634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 35918. [D 20:43:12.639649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 35919. [D 20:43:12.639663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 35920. [D 20:43:12.639678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35921. [D 20:43:12.639692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35922. [D 20:43:12.639707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35923. [D 20:43:12.639721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 35924. [D 20:43:12.639736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 35925. [D 20:43:12.639763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 35926. [D 20:43:12.639786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 35927. [D 20:43:12.639801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 35928. [D 20:43:12.639816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35929. [D 20:43:12.639831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35930. [D 20:43:12.639846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35931. [D 20:43:12.639860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 35932. [D 20:43:12.639875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 35933. [D 20:43:12.639889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 35934. [D 20:43:12.639904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 35935. [D 20:43:12.639919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 35936. [D 20:43:12.639933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35937. [D 20:43:12.639948] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35938. [D 20:43:12.642469] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5907 [D 20:43:12.642557] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 30/70. [D 20:43:12.645520] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 35938. [D 20:43:12.645545] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 31/70. [D 20:43:12.645628] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.645650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.645664] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.648750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 35938. [D 20:43:12.648771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 35939. [D 20:43:12.648785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 35940. [D 20:43:12.648800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 35941. [D 20:43:12.648814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 35942. [D 20:43:12.648829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 35943. [D 20:43:12.648843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 35944. [D 20:43:12.648858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 35945. [D 20:43:12.648872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 35946. [D 20:43:12.649406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 35947. [D 20:43:12.649425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 35948. [D 20:43:12.649440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 35949. [D 20:43:12.649454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 35950. [D 20:43:12.649469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 35951. [D 20:43:12.649483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 35952. [D 20:43:12.649497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 35953. [D 20:43:12.649513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 35954. [D 20:43:12.649527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 35955. [D 20:43:12.649542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 35956. [D 20:43:12.649556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 35957. [D 20:43:12.649570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 35958. [D 20:43:12.649585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 35959. [D 20:43:12.649599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 35960. [D 20:43:12.649613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 35961. [D 20:43:12.649628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 35962. [D 20:43:12.649642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 35963. [D 20:43:12.649656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 35964. [D 20:43:12.649671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 35965. [D 20:43:12.649685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 35966. [D 20:43:12.649699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 35967. [D 20:43:12.649714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 35968. [D 20:43:12.649728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0255b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 35969. [D 20:43:12.660625] openib_check_cq: completed rdma wr_id 2aaaab0255b0, nic_wr_credit 35969. [D 20:43:12.660642] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 32/70. [D 20:43:12.660700] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.660721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.660734] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:12.668521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.668540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.668553] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:12.668592] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5910 [D 20:43:12.668607] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.668624] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 33/70. [D 20:43:12.671660] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5910 [D 20:43:12.671728] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 34/70. [D 20:43:12.671789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35969. [D 20:43:12.671816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35970. [D 20:43:12.671847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 35971. [D 20:43:12.671862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 35972. [D 20:43:12.671876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 35973. [D 20:43:12.945459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 35974. [D 20:43:12.945509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 35975. [D 20:43:12.945541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35976. [D 20:43:12.945556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35977. [D 20:43:12.945571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35978. [D 20:43:12.945586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 35979. [D 20:43:12.945612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 35980. [D 20:43:12.945627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 35981. [D 20:43:12.945642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 35982. [D 20:43:12.945656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 35983. [D 20:43:12.945671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35984. [D 20:43:12.945686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35985. [D 20:43:12.945701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35986. [D 20:43:12.945715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 35987. [D 20:43:12.945786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 35988. [D 20:43:12.945832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 35989. [D 20:43:12.946308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 35990. [D 20:43:12.946325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 35991. [D 20:43:12.946340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35992. [D 20:43:12.946355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35993. [D 20:43:12.946373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35994. [D 20:43:12.946398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 35995. [D 20:43:12.946414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 35996. [D 20:43:12.946429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 35997. [D 20:43:12.946443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 35998. [D 20:43:12.946458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 35999. [D 20:43:12.946473] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36000. [D 20:43:12.946730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.946784] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.946799] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.946843] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5914 [D 20:43:12.946858] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:12.946879] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 35/70. [D 20:43:12.946918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.946932] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.946945] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.946966] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5916 [D 20:43:12.946980] element 0: offset: 0x2aaaab6127b0, size: 24 [D 20:43:12.946995] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 36/70. [D 20:43:12.950469] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36000. [D 20:43:12.950497] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 37/70. [D 20:43:12.950950] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.950971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.950984] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.956113] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5914 [D 20:43:12.956142] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 38/70. [D 20:43:12.956200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36000. [D 20:43:12.956217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 36001. [D 20:43:12.956232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 36002. [D 20:43:12.956247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 36003. [D 20:43:12.956262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 36004. [D 20:43:12.956277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 36005. [D 20:43:12.956292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36006. [D 20:43:12.956307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36007. [D 20:43:12.956322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36008. [D 20:43:12.956337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 36009. [D 20:43:12.956352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 36010. [D 20:43:12.956367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 36011. [D 20:43:12.956382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 36012. [D 20:43:12.956397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 36013. [D 20:43:12.956411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36014. [D 20:43:12.956427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36015. [D 20:43:12.956442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36016. [D 20:43:12.956456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 36017. [D 20:43:12.956471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 36018. [D 20:43:12.956486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 36019. [D 20:43:12.956503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 36020. [D 20:43:12.956518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 36021. [D 20:43:12.956533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36022. [D 20:43:12.956548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36023. [D 20:43:12.956562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36024. [D 20:43:12.956577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 36025. [D 20:43:12.956592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 36026. [D 20:43:12.956607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 36027. [D 20:43:12.956622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 36028. [D 20:43:12.956637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 36029. [D 20:43:12.956651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36030. [D 20:43:12.956667] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36031. [D 20:43:12.958496] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.958558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.958573] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:12.958617] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5919 [D 20:43:12.958633] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.958653] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 39/70. [D 20:43:12.958708] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5916 [D 20:43:12.958734] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 40/70. [D 20:43:12.962080] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36031. [D 20:43:12.962101] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 41/70. [D 20:43:12.962118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 36031. [D 20:43:12.962133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 36032. [D 20:43:12.962148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 36033. [D 20:43:12.962162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 36034. [D 20:43:12.962178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 36035. [D 20:43:12.962192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 36036. [D 20:43:12.962207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 36037. [D 20:43:12.962222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 36038. [D 20:43:12.962236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 36039. [D 20:43:12.962251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 36040. [D 20:43:12.962266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 36041. [D 20:43:12.962281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 36042. [D 20:43:12.962297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 36043. [D 20:43:12.962311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 36044. [D 20:43:12.962326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 36045. [D 20:43:12.962341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 36046. [D 20:43:12.962356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 36047. [D 20:43:12.962370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 36048. [D 20:43:12.962385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 36049. [D 20:43:12.962400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 36050. [D 20:43:12.962414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 36051. [D 20:43:12.962429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 36052. [D 20:43:12.962444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 36053. [D 20:43:12.962458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 36054. [D 20:43:12.962473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 36055. [D 20:43:12.962487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 36056. [D 20:43:12.962502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 36057. [D 20:43:12.962516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 36058. [D 20:43:12.962531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 36059. [D 20:43:12.962546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 36060. [D 20:43:12.962560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 36061. [D 20:43:12.962575] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001a60 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 36062. [D 20:43:12.962637] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.962658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.962671] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:12.968047] openib_check_cq: completed rdma wr_id 2aaaab001a60, nic_wr_credit 36062. [D 20:43:12.968074] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 42/70. [D 20:43:12.968174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.968233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.968247] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.971600] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5919 [D 20:43:12.971629] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 43/70. [D 20:43:12.976290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36062. [D 20:43:12.976312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36063. [D 20:43:12.976328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 36064. [D 20:43:12.976343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 36065. [D 20:43:12.976362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 36066. [D 20:43:12.976377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 36067. [D 20:43:12.976391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 36068. [D 20:43:12.976408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36069. [D 20:43:12.976423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36070. [D 20:43:12.976437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36071. [D 20:43:12.976453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 36072. [D 20:43:12.976468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 36073. [D 20:43:12.976483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 36074. [D 20:43:12.976499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 36075. [D 20:43:12.976514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 36076. [D 20:43:12.976529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36077. [D 20:43:12.976544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36078. [D 20:43:12.976559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36079. [D 20:43:12.976597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 36080. [D 20:43:12.976612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 36081. [D 20:43:12.976627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 36082. [D 20:43:12.976643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 36083. [D 20:43:12.976658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 36084. [D 20:43:12.976673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36085. [D 20:43:12.976689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36086. [D 20:43:12.976703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36087. [D 20:43:12.976718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 36088. [D 20:43:12.976734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 36089. [D 20:43:12.976748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 36090. [D 20:43:12.976763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 36091. [D 20:43:12.976778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 36092. [D 20:43:12.976799] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36093. [D 20:43:12.978972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.978995] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.979009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.979050] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5922 [D 20:43:12.979065] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:12.979085] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 44/70. [D 20:43:12.982739] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36093. [D 20:43:12.982765] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 45/70. [D 20:43:12.982872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.982894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.982907] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:12.985966] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5922 [D 20:43:12.985991] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 46/70. [D 20:43:12.988045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36093. [D 20:43:12.988065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36094. [D 20:43:12.988080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36095. [D 20:43:12.988095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36096. [D 20:43:12.988110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36097. [D 20:43:12.988124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36098. [D 20:43:12.988139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36099. [D 20:43:12.988154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36100. [D 20:43:12.988169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36101. [D 20:43:12.988714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36102. [D 20:43:12.988737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36103. [D 20:43:12.988756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36104. [D 20:43:12.988771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36105. [D 20:43:12.988785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36106. [D 20:43:12.988800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36107. [D 20:43:12.988815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36108. [D 20:43:12.988830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36109. [D 20:43:12.988844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36110. [D 20:43:12.988859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36111. [D 20:43:12.988874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36112. [D 20:43:12.988889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36113. [D 20:43:12.988904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36114. [D 20:43:12.988919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36115. [D 20:43:12.988934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36116. [D 20:43:12.988949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36117. [D 20:43:12.988964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36118. [D 20:43:12.988979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36119. [D 20:43:12.988994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36120. [D 20:43:12.989009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36121. [D 20:43:12.989024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36122. [D 20:43:12.989039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36123. [D 20:43:12.989054] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36124. [D 20:43:12.990698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:12.990756] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.990770] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:12.990815] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5925 [D 20:43:12.990830] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:12.990851] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 47/70. [D 20:43:12.999705] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36124. [D 20:43:12.999731] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 48/70. [D 20:43:12.999843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:12.999863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:12.999876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.002841] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5925 [D 20:43:13.002871] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 49/70. [D 20:43:13.005869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36124. [D 20:43:13.005891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36125. [D 20:43:13.005906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 36126. [D 20:43:13.005921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 36127. [D 20:43:13.005936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 36128. [D 20:43:13.005951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 36129. [D 20:43:13.005966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 36130. [D 20:43:13.005980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36131. [D 20:43:13.006083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36132. [D 20:43:13.006549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36133. [D 20:43:13.006565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 36134. [D 20:43:13.006579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 36135. [D 20:43:13.006594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 36136. [D 20:43:13.006609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 36137. [D 20:43:13.006623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 36138. [D 20:43:13.006638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36139. [D 20:43:13.006653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36140. [D 20:43:13.006667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36141. [D 20:43:13.006682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 36142. [D 20:43:13.006697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 36143. [D 20:43:13.006712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 36144. [D 20:43:13.006726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 36145. [D 20:43:13.006741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 36146. [D 20:43:13.006756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36147. [D 20:43:13.006770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36148. [D 20:43:13.006785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36149. [D 20:43:13.006800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 36150. [D 20:43:13.006815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 36151. [D 20:43:13.006829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 36152. [D 20:43:13.006844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 36153. [D 20:43:13.006858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 36154. [D 20:43:13.006873] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36155. [D 20:43:13.008619] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.008672] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.008687] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.008729] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5928 [D 20:43:13.008744] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:13.008766] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 50/70. [D 20:43:13.017721] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36155. [D 20:43:13.017746] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 51/70. [D 20:43:13.017857] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.017878] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.017894] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.021090] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5928 [D 20:43:13.021113] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 52/70. [D 20:43:13.023165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36155. [D 20:43:13.023183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36156. [D 20:43:13.023198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36157. [D 20:43:13.023213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36158. [D 20:43:13.023228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36159. [D 20:43:13.023243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36160. [D 20:43:13.023258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36161. [D 20:43:13.023273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36162. [D 20:43:13.023288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36163. [D 20:43:13.023315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36164. [D 20:43:13.023343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36165. [D 20:43:13.023358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36166. [D 20:43:13.023389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36167. [D 20:43:13.023413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36168. [D 20:43:13.023440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36169. [D 20:43:13.023456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36170. [D 20:43:13.023484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36171. [D 20:43:13.023499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36172. [D 20:43:13.023514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36173. [D 20:43:13.023538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36174. [D 20:43:13.023564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36175. [D 20:43:13.023579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36176. [D 20:43:13.023609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36177. [D 20:43:13.023637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36178. [D 20:43:13.023665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36179. [D 20:43:13.023681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36180. [D 20:43:13.023706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36181. [D 20:43:13.023721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36182. [D 20:43:13.023750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36183. [D 20:43:13.023765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36184. [D 20:43:13.023780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36185. [D 20:43:13.023795] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36186. [D 20:43:13.025836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.025903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.025916] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.025961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5931 [D 20:43:13.025976] element 0: offset: 0x2aaaab639010, size: 24 [D 20:43:13.025997] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 53/70. [D 20:43:13.034817] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36186. [D 20:43:13.034841] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 54/70. [D 20:43:13.034959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.034980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.034993] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.038248] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5931 [D 20:43:13.038271] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 55/70. [D 20:43:13.041068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36186. [D 20:43:13.041085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36187. [D 20:43:13.041101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 36188. [D 20:43:13.041115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 36189. [D 20:43:13.041130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 36190. [D 20:43:13.041145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 36191. [D 20:43:13.041159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 36192. [D 20:43:13.041174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36193. [D 20:43:13.041189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36194. [D 20:43:13.041215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36195. [D 20:43:13.041231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 36196. [D 20:43:13.041258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 36197. [D 20:43:13.041273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 36198. [D 20:43:13.041302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 36199. [D 20:43:13.041317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 36200. [D 20:43:13.041342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36201. [D 20:43:13.041379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36202. [D 20:43:13.041395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36203. [D 20:43:13.041419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 36204. [D 20:43:13.041434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 36205. [D 20:43:13.041461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 36206. [D 20:43:13.041477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 36207. [D 20:43:13.041505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 36208. [D 20:43:13.041533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36209. [D 20:43:13.041560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36210. [D 20:43:13.041576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36211. [D 20:43:13.041604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 36212. [D 20:43:13.041619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 36213. [D 20:43:13.041646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 36214. [D 20:43:13.041672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 36215. [D 20:43:13.041687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 36216. [D 20:43:13.041702] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36217. [D 20:43:13.043775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.043843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.043857] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.043901] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5934 [D 20:43:13.043917] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:13.043937] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 56/70. [D 20:43:13.052901] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36217. [D 20:43:13.052926] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 57/70. [D 20:43:13.053045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.053065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.053078] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.056337] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5934 [D 20:43:13.056358] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 58/70. [D 20:43:13.058233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36217. [D 20:43:13.058252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36218. [D 20:43:13.058267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36219. [D 20:43:13.058281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36220. [D 20:43:13.058296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36221. [D 20:43:13.058311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36222. [D 20:43:13.058327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36223. [D 20:43:13.058342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36224. [D 20:43:13.058356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36225. [D 20:43:13.058384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36226. [D 20:43:13.058411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36227. [D 20:43:13.058426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36228. [D 20:43:13.058457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36229. [D 20:43:13.058472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36230. [D 20:43:13.058496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36231. [D 20:43:13.058512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36232. [D 20:43:13.058541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36233. [D 20:43:13.058573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36234. [D 20:43:13.058603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36235. [D 20:43:13.058618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36236. [D 20:43:13.058643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36237. [D 20:43:13.058671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36238. [D 20:43:13.058686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36239. [D 20:43:13.058713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36240. [D 20:43:13.058741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36241. [D 20:43:13.058756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36242. [D 20:43:13.058770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36243. [D 20:43:13.058785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36244. [D 20:43:13.058819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36245. [D 20:43:13.058834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36246. [D 20:43:13.058849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36247. [D 20:43:13.058864] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36248. [D 20:43:13.069890] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36248. [D 20:43:13.069909] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 59/70. [D 20:43:13.070000] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.070061] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.070075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.078758] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.078777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.078789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.078830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5937 [D 20:43:13.078845] element 0: offset: 0x2aaaab635c60, size: 24 [D 20:43:13.078864] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 60/70. [D 20:43:13.082233] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5937 [D 20:43:13.082257] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 0/70. [D 20:43:13.082311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36248. [D 20:43:13.082328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36249. [D 20:43:13.082342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36250. [D 20:43:13.082357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36251. [D 20:43:13.082372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36252. [D 20:43:13.082387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36253. [D 20:43:13.082402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36254. [D 20:43:13.082417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36255. [D 20:43:13.082432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36256. [D 20:43:13.082446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36257. [D 20:43:13.082461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36258. [D 20:43:13.082476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36259. [D 20:43:13.082490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36260. [D 20:43:13.082505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36261. [D 20:43:13.082520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36262. [D 20:43:13.082534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36263. [D 20:43:13.082549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36264. [D 20:43:13.082564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36265. [D 20:43:13.082578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36266. [D 20:43:13.082593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36267. [D 20:43:13.082608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36268. [D 20:43:13.082622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36269. [D 20:43:13.082637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36270. [D 20:43:13.082651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36271. [D 20:43:13.082666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36272. [D 20:43:13.082682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36273. [D 20:43:13.082697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36274. [D 20:43:13.082711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36275. [D 20:43:13.082726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36276. [D 20:43:13.082741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36277. [D 20:43:13.082756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36278. [D 20:43:13.082771] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36279. [D 20:43:13.090733] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36279. [D 20:43:13.090752] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 1/70. [D 20:43:13.090893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.090956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.090970] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.102846] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.102866] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.102879] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.102919] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5942 [D 20:43:13.102934] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:13.102955] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 2/70. [D 20:43:13.103006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.103020] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.103033] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.103054] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5943 [D 20:43:13.103068] element 0: offset: 0x2aaaab60c870, size: 24 [D 20:43:13.103086] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 3/70. [D 20:43:13.108073] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5942 [D 20:43:13.108100] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 4/70. [D 20:43:13.108150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36279. [D 20:43:13.108168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36280. [D 20:43:13.108183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36281. [D 20:43:13.108198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36282. [D 20:43:13.108213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36283. [D 20:43:13.108229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36284. [D 20:43:13.108244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36285. [D 20:43:13.108259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36286. [D 20:43:13.108273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36287. [D 20:43:13.108288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36288. [D 20:43:13.108303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36289. [D 20:43:13.108319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36290. [D 20:43:13.108334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36291. [D 20:43:13.108349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36292. [D 20:43:13.108364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36293. [D 20:43:13.108379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36294. [D 20:43:13.108394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36295. [D 20:43:13.108408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36296. [D 20:43:13.108423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36297. [D 20:43:13.108438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36298. [D 20:43:13.108453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36299. [D 20:43:13.108468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36300. [D 20:43:13.108483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36301. [D 20:43:13.108497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36302. [D 20:43:13.108512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36303. [D 20:43:13.108527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36304. [D 20:43:13.108542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36305. [D 20:43:13.108557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36306. [D 20:43:13.108571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36307. [D 20:43:13.108587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36308. [D 20:43:13.108601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36309. [D 20:43:13.108616] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36310. [D 20:43:13.111696] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5943 [D 20:43:13.111714] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 5/70. [D 20:43:13.116213] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36310. [D 20:43:13.116234] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 6/70. [D 20:43:13.116250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36310. [D 20:43:13.116265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36311. [D 20:43:13.116280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36312. [D 20:43:13.116295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36313. [D 20:43:13.116310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36314. [D 20:43:13.116326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36315. [D 20:43:13.116340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36316. [D 20:43:13.116355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36317. [D 20:43:13.116370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36318. [D 20:43:13.116385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36319. [D 20:43:13.116400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36320. [D 20:43:13.116415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36321. [D 20:43:13.116429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36322. [D 20:43:13.116444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36323. [D 20:43:13.116459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36324. [D 20:43:13.116474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36325. [D 20:43:13.116489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36326. [D 20:43:13.116504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36327. [D 20:43:13.116519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36328. [D 20:43:13.116534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36329. [D 20:43:13.116549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36330. [D 20:43:13.116564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36331. [D 20:43:13.116579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36332. [D 20:43:13.116593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36333. [D 20:43:13.116608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36334. [D 20:43:13.116623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36335. [D 20:43:13.116638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36336. [D 20:43:13.116653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36337. [D 20:43:13.116668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36338. [D 20:43:13.116683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36339. [D 20:43:13.116697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36340. [D 20:43:13.116712] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0255b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36341. [D 20:43:13.116794] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.116858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.116872] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.127922] openib_check_cq: completed rdma wr_id 2aaaab0255b0, nic_wr_credit 36341. [D 20:43:13.127948] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 7/70. [D 20:43:13.128060] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.128079] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.128092] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.141905] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.141923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.141936] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.141976] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5947 [D 20:43:13.141991] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:13.142011] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 8/70. [D 20:43:13.142053] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.142068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.142081] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.142102] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5950 [D 20:43:13.142116] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:13.142130] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 9/70. [D 20:43:13.148075] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5947 [D 20:43:13.148102] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 10/70. [D 20:43:13.148155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36341. [D 20:43:13.148173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36342. [D 20:43:13.148188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36343. [D 20:43:13.148204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36344. [D 20:43:13.148220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36345. [D 20:43:13.148234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36346. [D 20:43:13.148249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36347. [D 20:43:13.148264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36348. [D 20:43:13.148279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36349. [D 20:43:13.148293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36350. [D 20:43:13.148308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36351. [D 20:43:13.148323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36352. [D 20:43:13.148338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36353. [D 20:43:13.148353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36354. [D 20:43:13.148367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36355. [D 20:43:13.148382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36356. [D 20:43:13.148397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36357. [D 20:43:13.148412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36358. [D 20:43:13.148426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36359. [D 20:43:13.148442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36360. [D 20:43:13.148457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36361. [D 20:43:13.148472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36362. [D 20:43:13.148487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36363. [D 20:43:13.148501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36364. [D 20:43:13.148516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36365. [D 20:43:13.148531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36366. [D 20:43:13.148546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36367. [D 20:43:13.148560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36368. [D 20:43:13.148575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36369. [D 20:43:13.148590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36370. [D 20:43:13.148605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36371. [D 20:43:13.148619] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36372. [D 20:43:13.151808] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5950 [D 20:43:13.151826] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 11/70. [D 20:43:13.159170] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36372. [D 20:43:13.159191] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 12/70. [D 20:43:13.159210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36372. [D 20:43:13.159225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36373. [D 20:43:13.159241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36374. [D 20:43:13.159255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36375. [D 20:43:13.159270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36376. [D 20:43:13.159285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36377. [D 20:43:13.159300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36378. [D 20:43:13.159315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36379. [D 20:43:13.159330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36380. [D 20:43:13.159344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36381. [D 20:43:13.159360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36382. [D 20:43:13.159375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36383. [D 20:43:13.159389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36384. [D 20:43:13.159405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36385. [D 20:43:13.159420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36386. [D 20:43:13.159435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36387. [D 20:43:13.159450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36388. [D 20:43:13.159464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36389. [D 20:43:13.159479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36390. [D 20:43:13.159494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36391. [D 20:43:13.159508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36392. [D 20:43:13.159523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36393. [D 20:43:13.159538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36394. [D 20:43:13.159552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36395. [D 20:43:13.159567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36396. [D 20:43:13.159582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36397. [D 20:43:13.159596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36398. [D 20:43:13.159611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36399. [D 20:43:13.159626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36400. [D 20:43:13.159640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36401. [D 20:43:13.159655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36402. [D 20:43:13.159670] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029f70 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36403. [D 20:43:13.159756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.159820] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.159834] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.165762] openib_check_cq: completed rdma wr_id 2aaaab029f70, nic_wr_credit 36403. [D 20:43:13.165786] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 13/70. [D 20:43:13.165844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.165863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.165876] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.169117] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.169135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.169147] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.169187] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5952 [D 20:43:13.169202] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:13.169221] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 14/70. [D 20:43:13.172269] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 686016, tag: 5952 [D 20:43:13.172292] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 15/70. [D 20:43:13.172435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36403. [D 20:43:13.368823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36404. [D 20:43:13.368845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36405. [D 20:43:13.368860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36406. [D 20:43:13.368875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36407. [D 20:43:13.368890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36408. [D 20:43:13.368904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36409. [D 20:43:13.368919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36410. [D 20:43:13.368934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36411. [D 20:43:13.368948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36412. [D 20:43:13.368963] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36413. [D 20:43:13.369783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.369839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.369853] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.369894] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5955 [D 20:43:13.369909] element 0: offset: 0x2aaaab025e70, size: 24 [D 20:43:13.369929] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 16/70. [D 20:43:13.369965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.369979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.369991] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:13.370013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5959 [D 20:43:13.370027] element 0: offset: 0x2aaaab025e90, size: 24 [D 20:43:13.370041] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 17/70. [D 20:43:13.370739] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 36413. [D 20:43:13.370764] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 18/70. [D 20:43:13.370899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.370919] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.370932] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:13.376598] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.376667] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.376681] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:13.376725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5961 [D 20:43:13.376740] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:13.376759] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 19/70. [D 20:43:13.378034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.378078] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.378092] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:13.380117] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5955 [D 20:43:13.380146] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 20/70. [D 20:43:13.380164] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5959 [D 20:43:13.380185] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 21/70. [D 20:43:13.380240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 36413. [D 20:43:13.380259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 36414. [D 20:43:13.380274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 36415. [D 20:43:13.380289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 36416. [D 20:43:13.380304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 36417. [D 20:43:13.380319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 36418. [D 20:43:13.380334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 36419. [D 20:43:13.380352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 36420. [D 20:43:13.380367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 36421. [D 20:43:13.380382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 36422. [D 20:43:13.380396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 36423. [D 20:43:13.380411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 36424. [D 20:43:13.380426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 36425. [D 20:43:13.380441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 36426. [D 20:43:13.380459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 36427. [D 20:43:13.380474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 36428. [D 20:43:13.380489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 36429. [D 20:43:13.380503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 36430. [D 20:43:13.380518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 36431. [D 20:43:13.380630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 36432. [D 20:43:13.380649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 36433. [D 20:43:13.380675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 36434. [D 20:43:13.380690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 36435. [D 20:43:13.380705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 36436. [D 20:43:13.380720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 36437. [D 20:43:13.380817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 36438. [D 20:43:13.380832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 36439. [D 20:43:13.380847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 36440. [D 20:43:13.380861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 36441. [D 20:43:13.380876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 36442. [D 20:43:13.380891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 36443. [D 20:43:13.380906] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 36444. [D 20:43:13.380923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36445. [D 20:43:13.380938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36446. [D 20:43:13.380953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36447. [D 20:43:13.380968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36448. [D 20:43:13.380983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36449. [D 20:43:13.380998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36450. [D 20:43:13.381012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36451. [D 20:43:13.381027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36452. [D 20:43:13.381042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36453. [D 20:43:13.381057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36454. [D 20:43:13.381072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36455. [D 20:43:13.381086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36456. [D 20:43:13.381103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36457. [D 20:43:13.381117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36458. [D 20:43:13.381132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36459. [D 20:43:13.381147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36460. [D 20:43:13.381162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36461. [D 20:43:13.381177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36462. [D 20:43:13.381193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36463. [D 20:43:13.381208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36464. [D 20:43:13.381223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36465. [D 20:43:13.381239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36466. [D 20:43:13.381253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36467. [D 20:43:13.381268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36468. [D 20:43:13.381285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36469. [D 20:43:13.381300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36470. [D 20:43:13.381314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36471. [D 20:43:13.381331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36472. [D 20:43:13.381346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36473. [D 20:43:13.381361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36474. [D 20:43:13.381377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36475. [D 20:43:13.381392] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029c00 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36476. [D 20:43:13.386134] openib_check_cq: completed rdma wr_id 2aaaab0257a0, nic_wr_credit 36476. [D 20:43:13.386156] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 22/70. [D 20:43:13.391976] openib_check_cq: completed rdma wr_id 2aaaab029c00, nic_wr_credit 36475. [D 20:43:13.391996] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 23/70. [D 20:43:13.394980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.394998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.395013] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.395038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.395052] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.395066] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.408081] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.408105] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.408119] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.408154] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5965 [D 20:43:13.408169] element 0: offset: 0x2aaaab0256a0, size: 24 [D 20:43:13.408188] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 24/70. [D 20:43:13.408219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.408233] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.408245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.408266] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5968 [D 20:43:13.408280] element 0: offset: 0x2aaaab025e90, size: 24 [D 20:43:13.408296] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 25/70. [D 20:43:13.412055] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5965 [D 20:43:13.412083] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 26/70. [D 20:43:13.412133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36475. [D 20:43:13.412151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36476. [D 20:43:13.412166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36477. [D 20:43:13.412181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36478. [D 20:43:13.412196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36479. [D 20:43:13.412211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36480. [D 20:43:13.412226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36481. [D 20:43:13.412241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36482. [D 20:43:13.412255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36483. [D 20:43:13.412270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36484. [D 20:43:13.412285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36485. [D 20:43:13.412300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36486. [D 20:43:13.412315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36487. [D 20:43:13.412329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36488. [D 20:43:13.412344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36489. [D 20:43:13.412359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36490. [D 20:43:13.412373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36491. [D 20:43:13.412388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36492. [D 20:43:13.412403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36493. [D 20:43:13.412417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36494. [D 20:43:13.412432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36495. [D 20:43:13.412447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36496. [D 20:43:13.412462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36497. [D 20:43:13.412476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36498. [D 20:43:13.412491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36499. [D 20:43:13.412505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36500. [D 20:43:13.412520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36501. [D 20:43:13.412535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36502. [D 20:43:13.412549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36503. [D 20:43:13.412564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36504. [D 20:43:13.412578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36505. [D 20:43:13.412593] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36506. [D 20:43:13.415800] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5968 [D 20:43:13.415818] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 27/70. [D 20:43:13.420967] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36506. [D 20:43:13.420988] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 28/70. [D 20:43:13.421017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36506. [D 20:43:13.421032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36507. [D 20:43:13.421047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36508. [D 20:43:13.421061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36509. [D 20:43:13.421076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36510. [D 20:43:13.421092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36511. [D 20:43:13.421106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36512. [D 20:43:13.421121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36513. [D 20:43:13.421136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36514. [D 20:43:13.421151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36515. [D 20:43:13.421166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36516. [D 20:43:13.421181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36517. [D 20:43:13.421196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36518. [D 20:43:13.421211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36519. [D 20:43:13.421225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36520. [D 20:43:13.421240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36521. [D 20:43:13.421255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36522. [D 20:43:13.421270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36523. [D 20:43:13.421285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36524. [D 20:43:13.421300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36525. [D 20:43:13.421314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36526. [D 20:43:13.421329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36527. [D 20:43:13.421344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36528. [D 20:43:13.421359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36529. [D 20:43:13.421374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36530. [D 20:43:13.421388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36531. [D 20:43:13.421403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36532. [D 20:43:13.421418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36533. [D 20:43:13.421433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36534. [D 20:43:13.421448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36535. [D 20:43:13.421463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36536. [D 20:43:13.421478] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025b20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36537. [D 20:43:13.421565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.421627] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.421641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.429929] openib_check_cq: completed rdma wr_id 2aaaab025b20, nic_wr_credit 36537. [D 20:43:13.429955] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 29/70. [D 20:43:13.430015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.430035] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.430047] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.435476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.435494] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.435506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.435546] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5970 [D 20:43:13.435562] element 0: offset: 0x628740, size: 24 [D 20:43:13.435581] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 30/70. [D 20:43:13.438756] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5970 [D 20:43:13.438788] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 31/70. [D 20:43:13.438838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36537. [D 20:43:13.438856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36538. [D 20:43:13.438871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36539. [D 20:43:13.438885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36540. [D 20:43:13.438900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36541. [D 20:43:13.438915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36542. [D 20:43:13.438929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36543. [D 20:43:13.438944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36544. [D 20:43:13.438959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36545. [D 20:43:13.438974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36546. [D 20:43:13.438988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36547. [D 20:43:13.439003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36548. [D 20:43:13.439018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36549. [D 20:43:13.439032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36550. [D 20:43:13.439047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36551. [D 20:43:13.439061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36552. [D 20:43:13.439076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36553. [D 20:43:13.439090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36554. [D 20:43:13.439105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36555. [D 20:43:13.439120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36556. [D 20:43:13.439135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36557. [D 20:43:13.439152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36558. [D 20:43:13.439168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36559. [D 20:43:13.439183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36560. [D 20:43:13.439198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36561. [D 20:43:13.439213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36562. [D 20:43:13.439227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36563. [D 20:43:13.439242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36564. [D 20:43:13.439256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36565. [D 20:43:13.439271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36566. [D 20:43:13.439286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36567. [D 20:43:13.439300] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36568. [D 20:43:13.449445] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36568. [D 20:43:13.449467] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 32/70. [D 20:43:13.449612] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.449674] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.449687] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.462669] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.462688] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.462701] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.462741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5973 [D 20:43:13.462756] element 0: offset: 0x628740, size: 24 [D 20:43:13.462776] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 33/70. [D 20:43:13.465256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.465318] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.465331] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.465370] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5977 [D 20:43:13.465385] element 0: offset: 0x642790, size: 24 [D 20:43:13.465404] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 34/70. [D 20:43:13.469213] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5973 [D 20:43:13.469238] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 35/70. [D 20:43:13.469257] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5977 [D 20:43:13.469278] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 36/70. [D 20:43:13.469307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36568. [D 20:43:13.469323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36569. [D 20:43:13.469338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36570. [D 20:43:13.469352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36571. [D 20:43:13.469367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36572. [D 20:43:13.469382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36573. [D 20:43:13.469397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36574. [D 20:43:13.469413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36575. [D 20:43:13.469427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36576. [D 20:43:13.469442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36577. [D 20:43:13.469457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36578. [D 20:43:13.469471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36579. [D 20:43:13.469486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36580. [D 20:43:13.469501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36581. [D 20:43:13.469516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36582. [D 20:43:13.469530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36583. [D 20:43:13.469545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36584. [D 20:43:13.469559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36585. [D 20:43:13.469574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36586. [D 20:43:13.469589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36587. [D 20:43:13.469604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36588. [D 20:43:13.469618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36589. [D 20:43:13.469633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36590. [D 20:43:13.469647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36591. [D 20:43:13.469662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36592. [D 20:43:13.469677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36593. [D 20:43:13.469692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36594. [D 20:43:13.469706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36595. [D 20:43:13.469721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36596. [D 20:43:13.469735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36597. [D 20:43:13.469750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36598. [D 20:43:13.469765] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36599. [D 20:43:13.469781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36600. [D 20:43:13.469796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36601. [D 20:43:13.469811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36602. [D 20:43:13.469826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36603. [D 20:43:13.469841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36604. [D 20:43:13.469856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36605. [D 20:43:13.469870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36606. [D 20:43:13.469885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36607. [D 20:43:13.469899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36608. [D 20:43:13.469914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36609. [D 20:43:13.469929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36610. [D 20:43:13.469943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36611. [D 20:43:13.469958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36612. [D 20:43:13.469972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36613. [D 20:43:13.469987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36614. [D 20:43:13.470001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36615. [D 20:43:13.470016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36616. [D 20:43:13.470030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36617. [D 20:43:13.470045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36618. [D 20:43:13.470060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36619. [D 20:43:13.470074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36620. [D 20:43:13.470089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36621. [D 20:43:13.470103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36622. [D 20:43:13.470118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36623. [D 20:43:13.470132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36624. [D 20:43:13.470147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36625. [D 20:43:13.470161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36626. [D 20:43:13.470176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36627. [D 20:43:13.470191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36628. [D 20:43:13.470205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36629. [D 20:43:13.470220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36630. [D 20:43:13.470255] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038470 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36631. [D 20:43:13.479229] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36631. [D 20:43:13.479251] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 37/70. [D 20:43:13.490756] openib_check_cq: completed rdma wr_id 2aaaab038470, nic_wr_credit 36630. [D 20:43:13.490778] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 38/70. [D 20:43:13.490856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.490918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.490932] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.490964] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.490977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.490989] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.504623] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.504640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.504653] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.504692] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5980 [D 20:43:13.504708] element 0: offset: 0x642790, size: 24 [D 20:43:13.504727] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 39/70. [D 20:43:13.504771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.504785] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.504798] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.504820] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5983 [D 20:43:13.504834] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:13.504849] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 40/70. [D 20:43:13.508209] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 5980 [D 20:43:13.508238] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 41/70. [D 20:43:13.508289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36630. [D 20:43:13.508306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36631. [D 20:43:13.508321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36632. [D 20:43:13.508336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36633. [D 20:43:13.508351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36634. [D 20:43:13.508366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36635. [D 20:43:13.508381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36636. [D 20:43:13.508395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36637. [D 20:43:13.508411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36638. [D 20:43:13.508425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36639. [D 20:43:13.508440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36640. [D 20:43:13.508455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36641. [D 20:43:13.508469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36642. [D 20:43:13.508484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36643. [D 20:43:13.508499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36644. [D 20:43:13.508514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36645. [D 20:43:13.508529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36646. [D 20:43:13.508544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36647. [D 20:43:13.508559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36648. [D 20:43:13.508573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36649. [D 20:43:13.508588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36650. [D 20:43:13.508603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36651. [D 20:43:13.508618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36652. [D 20:43:13.508633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36653. [D 20:43:13.508647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36654. [D 20:43:13.508662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36655. [D 20:43:13.508676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36656. [D 20:43:13.508691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36657. [D 20:43:13.508706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36658. [D 20:43:13.508721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36659. [D 20:43:13.508735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36660. [D 20:43:13.508750] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab011b00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36661. [D 20:43:13.511869] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5983 [D 20:43:13.511897] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 42/70. [D 20:43:13.516833] openib_check_cq: completed rdma wr_id 2aaaab011b00, nic_wr_credit 36661. [D 20:43:13.516854] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 43/70. [D 20:43:13.516882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36661. [D 20:43:13.516897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36662. [D 20:43:13.516912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36663. [D 20:43:13.516927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36664. [D 20:43:13.516942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36665. [D 20:43:13.516956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36666. [D 20:43:13.516971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36667. [D 20:43:13.516986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36668. [D 20:43:13.517000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36669. [D 20:43:13.517015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36670. [D 20:43:13.517031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36671. [D 20:43:13.517046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36672. [D 20:43:13.517061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36673. [D 20:43:13.517076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36674. [D 20:43:13.517091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36675. [D 20:43:13.517106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36676. [D 20:43:13.517121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36677. [D 20:43:13.517136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36678. [D 20:43:13.517151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36679. [D 20:43:13.517166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36680. [D 20:43:13.517181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36681. [D 20:43:13.517196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36682. [D 20:43:13.517211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36683. [D 20:43:13.517226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36684. [D 20:43:13.517240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36685. [D 20:43:13.517256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36686. [D 20:43:13.517270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36687. [D 20:43:13.517285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36688. [D 20:43:13.517301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36689. [D 20:43:13.517315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36690. [D 20:43:13.517330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36691. [D 20:43:13.517345] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001d00 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36692. [D 20:43:13.517432] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.517493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.517506] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.525970] openib_check_cq: completed rdma wr_id 2aaaab001d00, nic_wr_credit 36692. [D 20:43:13.525996] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 44/70. [D 20:43:13.526055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.526074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.526087] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:13.531253] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.531268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.531281] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:13.531320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5985 [D 20:43:13.531337] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:13.531358] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 45/70. [D 20:43:13.534582] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5985 [D 20:43:13.534618] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 46/70. [D 20:43:13.539892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 36692. [D 20:43:13.539915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 36693. [D 20:43:13.539930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36694. [D 20:43:13.539945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36695. [D 20:43:13.539960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36696. [D 20:43:13.539975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36697. [D 20:43:13.539990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36698. [D 20:43:13.540129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36699. [D 20:43:13.540161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36700. [D 20:43:13.540176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36701. [D 20:43:13.540201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36702. [D 20:43:13.540227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36703. [D 20:43:13.540243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36704. [D 20:43:13.540266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36705. [D 20:43:13.540281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36706. [D 20:43:13.540307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36707. [D 20:43:13.540322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36708. [D 20:43:13.540348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36709. [D 20:43:13.540375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36710. [D 20:43:13.540390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36711. [D 20:43:13.540415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36712. [D 20:43:13.540441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36713. [D 20:43:13.540457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36714. [D 20:43:13.540472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36715. [D 20:43:13.540487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36716. [D 20:43:13.540502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36717. [D 20:43:13.540520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36718. [D 20:43:13.828735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36719. [D 20:43:13.828759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36720. [D 20:43:13.828774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36721. [D 20:43:13.828789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36722. [D 20:43:13.828804] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36723. [D 20:43:13.828871] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.828937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.828951] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.828996] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5989 [D 20:43:13.829012] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:13.829033] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 47/70. [D 20:43:13.829864] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36723. [D 20:43:13.829889] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 48/70. [D 20:43:13.829993] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.830012] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.830025] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.832980] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5989 [D 20:43:13.833040] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 49/70. [D 20:43:13.835307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36723. [D 20:43:13.835333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36724. [D 20:43:13.835348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36725. [D 20:43:13.835363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36726. [D 20:43:13.835378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36727. [D 20:43:13.835393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36728. [D 20:43:13.835407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36729. [D 20:43:13.835422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36730. [D 20:43:13.835437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36731. [D 20:43:13.835451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36732. [D 20:43:13.835466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36733. [D 20:43:13.835481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36734. [D 20:43:13.835495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36735. [D 20:43:13.835510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36736. [D 20:43:13.835525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36737. [D 20:43:13.835539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36738. [D 20:43:13.835554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36739. [D 20:43:13.835569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36740. [D 20:43:13.835584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36741. [D 20:43:13.835598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36742. [D 20:43:13.835613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36743. [D 20:43:13.835627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36744. [D 20:43:13.835642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36745. [D 20:43:13.835656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36746. [D 20:43:13.835671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36747. [D 20:43:13.835686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36748. [D 20:43:13.835700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36749. [D 20:43:13.835715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36750. [D 20:43:13.835730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36751. [D 20:43:13.835744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36752. [D 20:43:13.835759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36753. [D 20:43:13.835773] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36754. [D 20:43:13.838018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.838043] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.838056] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.838098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5991 [D 20:43:13.838113] element 0: offset: 0x2aaaab035830, size: 24 [D 20:43:13.838129] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 50/70. [D 20:43:13.841275] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36754. [D 20:43:13.841303] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 51/70. [D 20:43:13.841423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.841444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.841457] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.847916] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5991 [D 20:43:13.847990] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 52/70. [D 20:43:13.848147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36754. [D 20:43:13.848174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36755. [D 20:43:13.848189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36756. [D 20:43:13.848204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36757. [D 20:43:13.848218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36758. [D 20:43:13.848233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36759. [D 20:43:13.848248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36760. [D 20:43:13.848263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36761. [D 20:43:13.848278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36762. [D 20:43:13.848293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36763. [D 20:43:13.848308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36764. [D 20:43:13.848323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36765. [D 20:43:13.848337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36766. [D 20:43:13.848352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36767. [D 20:43:13.848367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36768. [D 20:43:13.848382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36769. [D 20:43:13.848397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36770. [D 20:43:13.848412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36771. [D 20:43:13.848427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36772. [D 20:43:13.848442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36773. [D 20:43:13.848456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36774. [D 20:43:13.848472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36775. [D 20:43:13.848486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36776. [D 20:43:13.848501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36777. [D 20:43:13.848516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36778. [D 20:43:13.848531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36779. [D 20:43:13.848546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36780. [D 20:43:13.848561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36781. [D 20:43:13.848575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36782. [D 20:43:13.848591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36783. [D 20:43:13.848605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36784. [D 20:43:13.848620] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36785. [D 20:43:13.849241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.849261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.849274] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.849317] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5995 [D 20:43:13.849333] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:13.849352] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 53/70. [D 20:43:13.858474] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36785. [D 20:43:13.858500] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 54/70. [D 20:43:13.861695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.861715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.861729] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.864987] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5995 [D 20:43:13.865066] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 55/70. [D 20:43:13.865212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36785. [D 20:43:13.865238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 36786. [D 20:43:13.865253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 36787. [D 20:43:13.865268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 36788. [D 20:43:13.865283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 36789. [D 20:43:13.865297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 36790. [D 20:43:13.865312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36791. [D 20:43:13.865327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36792. [D 20:43:13.865341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36793. [D 20:43:13.865356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 36794. [D 20:43:13.865371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 36795. [D 20:43:13.865385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 36796. [D 20:43:13.865400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 36797. [D 20:43:13.865414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 36798. [D 20:43:13.865429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36799. [D 20:43:13.865444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36800. [D 20:43:13.865458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36801. [D 20:43:13.865473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 36802. [D 20:43:13.865487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 36803. [D 20:43:13.865502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 36804. [D 20:43:13.865517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 36805. [D 20:43:13.865532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 36806. [D 20:43:13.865546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36807. [D 20:43:13.865561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36808. [D 20:43:13.865576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36809. [D 20:43:13.865590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 36810. [D 20:43:13.865605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 36811. [D 20:43:13.865619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 36812. [D 20:43:13.865634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 36813. [D 20:43:13.865649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 36814. [D 20:43:13.865663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36815. [D 20:43:13.865678] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0357a0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36816. [D 20:43:13.868131] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:13.868154] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.868167] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:13.868210] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 5997 [D 20:43:13.868225] element 0: offset: 0x2aaaab0256a0, size: 24 [D 20:43:13.868242] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 56/70. [D 20:43:13.875774] openib_check_cq: completed rdma wr_id 2aaaab0357a0, nic_wr_credit 36816. [D 20:43:13.875803] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 57/70. [D 20:43:13.875932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.875956] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.875970] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:13.879034] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 5997 [D 20:43:13.879100] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 58/70. [D 20:43:13.881155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36816. [D 20:43:13.881180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36817. [D 20:43:13.881196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 36818. [D 20:43:13.881211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 36819. [D 20:43:13.881226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 36820. [D 20:43:13.881241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 36821. [D 20:43:13.881256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 36822. [D 20:43:13.881281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36823. [D 20:43:13.881296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36824. [D 20:43:13.881319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36825. [D 20:43:13.881346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 36826. [D 20:43:13.881362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 36827. [D 20:43:13.881386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 36828. [D 20:43:13.881401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 36829. [D 20:43:13.881429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 36830. [D 20:43:13.881445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36831. [D 20:43:13.881471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36832. [D 20:43:13.881498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36833. [D 20:43:13.881513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 36834. [D 20:43:13.881538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 36835. [D 20:43:13.881561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 36836. [D 20:43:13.881576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 36837. [D 20:43:13.881605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 36838. [D 20:43:13.881629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36839. [D 20:43:13.881644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36840. [D 20:43:13.881671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36841. [D 20:43:13.881686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 36842. [D 20:43:13.881711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 36843. [D 20:43:13.881726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 36844. [D 20:43:13.881742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 36845. [D 20:43:13.881757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 36846. [D 20:43:13.881771] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0270d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36847. [D 20:43:13.892962] openib_check_cq: completed rdma wr_id 2aaaab0270d0, nic_wr_credit 36847. [D 20:43:13.892980] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 59/70. [D 20:43:13.893059] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:13.893081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:13.893095] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.010740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.010759] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.010772] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.010810] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6001 [D 20:43:14.010826] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:14.010843] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 60/70. [D 20:43:14.014208] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6001 [D 20:43:14.014287] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 0/70. [D 20:43:14.014346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36847. [D 20:43:14.014370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 36848. [D 20:43:14.014386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 36849. [D 20:43:14.014401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 36850. [D 20:43:14.014416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 36851. [D 20:43:14.014430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 36852. [D 20:43:14.014445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36853. [D 20:43:14.014460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36854. [D 20:43:14.014475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36855. [D 20:43:14.014490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 36856. [D 20:43:14.014505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 36857. [D 20:43:14.014519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 36858. [D 20:43:14.014534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 36859. [D 20:43:14.014549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 36860. [D 20:43:14.014564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36861. [D 20:43:14.014579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36862. [D 20:43:14.014593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36863. [D 20:43:14.014608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 36864. [D 20:43:14.014624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 36865. [D 20:43:14.014638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 36866. [D 20:43:14.014653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 36867. [D 20:43:14.014667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 36868. [D 20:43:14.014682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36869. [D 20:43:14.014697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36870. [D 20:43:14.014711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36871. [D 20:43:14.014726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 36872. [D 20:43:14.014740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 36873. [D 20:43:14.014755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 36874. [D 20:43:14.014769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 36875. [D 20:43:14.014784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 36876. [D 20:43:14.014798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36877. [D 20:43:14.014813] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025b20 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36878. [D 20:43:14.023169] openib_check_cq: completed rdma wr_id 2aaaab025b20, nic_wr_credit 36878. [D 20:43:14.023191] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 1/70. [D 20:43:14.023327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.023350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.023364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.034279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.034298] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.034310] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.034350] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6004 [D 20:43:14.034366] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:14.034382] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 2/70. [D 20:43:14.034421] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.034434] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.034447] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.034467] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6007 [D 20:43:14.034481] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:14.034497] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 3/70. [D 20:43:14.040102] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6004 [D 20:43:14.040184] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 4/70. [D 20:43:14.040240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36878. [D 20:43:14.040267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36879. [D 20:43:14.040282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 36880. [D 20:43:14.040297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 36881. [D 20:43:14.040314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 36882. [D 20:43:14.040329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 36883. [D 20:43:14.040344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 36884. [D 20:43:14.040359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36885. [D 20:43:14.040375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36886. [D 20:43:14.040390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36887. [D 20:43:14.040405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 36888. [D 20:43:14.040420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 36889. [D 20:43:14.040435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 36890. [D 20:43:14.040450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 36891. [D 20:43:14.040465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 36892. [D 20:43:14.040481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36893. [D 20:43:14.040496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36894. [D 20:43:14.040511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36895. [D 20:43:14.040527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 36896. [D 20:43:14.040542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 36897. [D 20:43:14.040557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 36898. [D 20:43:14.040572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 36899. [D 20:43:14.040588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 36900. [D 20:43:14.040603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36901. [D 20:43:14.040618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36902. [D 20:43:14.040633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36903. [D 20:43:14.040648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 36904. [D 20:43:14.040663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 36905. [D 20:43:14.040678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 36906. [D 20:43:14.040693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 36907. [D 20:43:14.040708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 36908. [D 20:43:14.040724] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029270 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36909. [D 20:43:14.040837] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6007 [D 20:43:14.040870] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 5/70. [D 20:43:14.049096] openib_check_cq: completed rdma wr_id 2aaaab029270, nic_wr_credit 36909. [D 20:43:14.049123] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 6/70. [D 20:43:14.049139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36909. [D 20:43:14.049154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 36910. [D 20:43:14.049169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 36911. [D 20:43:14.049184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 36912. [D 20:43:14.049199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 36913. [D 20:43:14.049213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 36914. [D 20:43:14.049228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36915. [D 20:43:14.049243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36916. [D 20:43:14.049258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36917. [D 20:43:14.049272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 36918. [D 20:43:14.049287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 36919. [D 20:43:14.049302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 36920. [D 20:43:14.049317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 36921. [D 20:43:14.049331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 36922. [D 20:43:14.049346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36923. [D 20:43:14.049361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36924. [D 20:43:14.049376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36925. [D 20:43:14.049390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 36926. [D 20:43:14.049405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 36927. [D 20:43:14.049420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 36928. [D 20:43:14.049434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 36929. [D 20:43:14.049449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 36930. [D 20:43:14.049464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36931. [D 20:43:14.049479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36932. [D 20:43:14.049493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36933. [D 20:43:14.049508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 36934. [D 20:43:14.049523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 36935. [D 20:43:14.049538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 36936. [D 20:43:14.049554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 36937. [D 20:43:14.049568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 36938. [D 20:43:14.049583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36939. [D 20:43:14.049598] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36940. [D 20:43:14.049670] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.049693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.049707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.060918] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 36940. [D 20:43:14.060943] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 7/70. [D 20:43:14.061055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.061074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.061087] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.076660] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.076679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.076692] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.076733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6010 [D 20:43:14.076749] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:14.076769] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 8/70. [D 20:43:14.076806] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.076821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.076834] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.076855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6013 [D 20:43:14.076869] element 0: offset: 0x2aaaab635c60, size: 24 [D 20:43:14.076884] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 9/70. [D 20:43:14.082881] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6010 [D 20:43:14.082963] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 10/70. [D 20:43:14.083023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36940. [D 20:43:14.083045] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6013 [D 20:43:14.083050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36941. [D 20:43:14.083086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 36942. [D 20:43:14.083101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 36943. [D 20:43:14.083116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 36944. [D 20:43:14.083130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 36945. [D 20:43:14.083145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 36946. [D 20:43:14.083160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36947. [D 20:43:14.083175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36948. [D 20:43:14.083193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36949. [D 20:43:14.083208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 36950. [D 20:43:14.083222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 36951. [D 20:43:14.083238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 36952. [D 20:43:14.083253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 36953. [D 20:43:14.083268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 36954. [D 20:43:14.083283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36955. [D 20:43:14.083297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36956. [D 20:43:14.083312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36957. [D 20:43:14.083327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 36958. [D 20:43:14.083342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 36959. [D 20:43:14.083356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 36960. [D 20:43:14.083371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 36961. [D 20:43:14.083386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 36962. [D 20:43:14.083401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36963. [D 20:43:14.083415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36964. [D 20:43:14.083430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36965. [D 20:43:14.083444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 36966. [D 20:43:14.083459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 36967. [D 20:43:14.083474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 36968. [D 20:43:14.083489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 36969. [D 20:43:14.083503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 36970. [D 20:43:14.083518] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36971. [D 20:43:14.083544] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 11/70. [D 20:43:14.093521] openib_check_cq: completed rdma wr_id 2aaaab038470, nic_wr_credit 36971. [D 20:43:14.093548] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 12/70. [D 20:43:14.093564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36971. [D 20:43:14.093579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 36972. [D 20:43:14.093594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 36973. [D 20:43:14.093609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 36974. [D 20:43:14.093623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 36975. [D 20:43:14.093638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 36976. [D 20:43:14.093652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36977. [D 20:43:14.093668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36978. [D 20:43:14.093683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36979. [D 20:43:14.093698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 36980. [D 20:43:14.093712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 36981. [D 20:43:14.093728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 36982. [D 20:43:14.093742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 36983. [D 20:43:14.093757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 36984. [D 20:43:14.093771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36985. [D 20:43:14.093786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36986. [D 20:43:14.093800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36987. [D 20:43:14.093815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 36988. [D 20:43:14.093830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 36989. [D 20:43:14.093844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 36990. [D 20:43:14.093859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 36991. [D 20:43:14.093873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 36992. [D 20:43:14.093888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36993. [D 20:43:14.093903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36994. [D 20:43:14.093918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36995. [D 20:43:14.093932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 36996. [D 20:43:14.093947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 36997. [D 20:43:14.093961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 36998. [D 20:43:14.093976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 36999. [D 20:43:14.093990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37000. [D 20:43:14.094005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37001. [D 20:43:14.094020] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37002. [D 20:43:14.094094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.094115] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.094128] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.103961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.103981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.103993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.104037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6015 [D 20:43:14.104055] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:14.104076] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 13/70. [D 20:43:14.105292] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37002. [D 20:43:14.105316] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 14/70. [D 20:43:14.105424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.105443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.105455] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.108885] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6015 [D 20:43:14.108962] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 15/70. [D 20:43:14.111969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37002. [D 20:43:14.111994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37003. [D 20:43:14.112009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37004. [D 20:43:14.112027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37005. [D 20:43:14.112042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37006. [D 20:43:14.112057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37007. [D 20:43:14.112072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37008. [D 20:43:14.112086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37009. [D 20:43:14.112113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37010. [D 20:43:14.112139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37011. [D 20:43:14.112154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37012. [D 20:43:14.112184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37013. [D 20:43:14.112199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37014. [D 20:43:14.112214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37015. [D 20:43:14.112229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37016. [D 20:43:14.112262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37017. [D 20:43:14.112287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37018. [D 20:43:14.112303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37019. [D 20:43:14.112325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37020. [D 20:43:14.112340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37021. [D 20:43:14.112365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37022. [D 20:43:14.112394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37023. [D 20:43:14.112408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37024. [D 20:43:14.112424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37025. [D 20:43:14.112460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37026. [D 20:43:14.112476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37027. [D 20:43:14.112500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37028. [D 20:43:14.112515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37029. [D 20:43:14.112545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37030. [D 20:43:14.112569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37031. [D 20:43:14.112584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37032. [D 20:43:14.112600] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0342c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37033. [D 20:43:14.114571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.114594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.114608] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.114650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6019 [D 20:43:14.114665] element 0: offset: 0x2aaaab6103d0, size: 24 [D 20:43:14.114682] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 16/70. [D 20:43:14.123756] openib_check_cq: completed rdma wr_id 2aaaab0342c0, nic_wr_credit 37033. [D 20:43:14.123780] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 17/70. [D 20:43:14.123903] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.123924] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.123937] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.127005] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6019 [D 20:43:14.127083] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 18/70. [D 20:43:14.128963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 37033. [D 20:43:14.128985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37034. [D 20:43:14.129001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37035. [D 20:43:14.129015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37036. [D 20:43:14.129030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37037. [D 20:43:14.129045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37038. [D 20:43:14.129072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37039. [D 20:43:14.129087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37040. [D 20:43:14.129112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37041. [D 20:43:14.129127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37042. [D 20:43:14.129153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37043. [D 20:43:14.129182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37044. [D 20:43:14.129198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37045. [D 20:43:14.129225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37046. [D 20:43:14.129252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37047. [D 20:43:14.129268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37048. [D 20:43:14.129293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37049. [D 20:43:14.129308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37050. [D 20:43:14.129337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37051. [D 20:43:14.129363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37052. [D 20:43:14.129379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37053. [D 20:43:14.129405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37054. [D 20:43:14.129421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37055. [D 20:43:14.129448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37056. [D 20:43:14.129475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37057. [D 20:43:14.129490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37058. [D 20:43:14.129505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37059. [D 20:43:14.129520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37060. [D 20:43:14.129534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37061. [D 20:43:14.129553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37062. [D 20:43:14.129568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37063. [D 20:43:14.129583] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37064. [D 20:43:14.131660] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.131684] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.131698] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.131740] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6021 [D 20:43:14.131755] element 0: offset: 0x2aaaab612800, size: 24 [D 20:43:14.131772] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 19/70. [D 20:43:14.140834] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37064. [D 20:43:14.140859] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 20/70. [D 20:43:14.141033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.141054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.141067] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.144255] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6021 [D 20:43:14.144328] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 21/70. [D 20:43:14.146403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37064. [D 20:43:14.146425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37065. [D 20:43:14.146441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37066. [D 20:43:14.146456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37067. [D 20:43:14.146471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37068. [D 20:43:14.146486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37069. [D 20:43:14.146501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37070. [D 20:43:14.146515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37071. [D 20:43:14.146542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37072. [D 20:43:14.146557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37073. [D 20:43:14.146583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37074. [D 20:43:14.146615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37075. [D 20:43:14.146632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37076. [D 20:43:14.146655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37077. [D 20:43:14.146669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37078. [D 20:43:14.146697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37079. [D 20:43:14.146711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37080. [D 20:43:14.146739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37081. [D 20:43:14.146767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37082. [D 20:43:14.146791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37083. [D 20:43:14.146807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37084. [D 20:43:14.146836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37085. [D 20:43:14.146851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37086. [D 20:43:14.146876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37087. [D 20:43:14.146903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37088. [D 20:43:14.146918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37089. [D 20:43:14.146943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37090. [D 20:43:14.146970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37091. [D 20:43:14.146986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37092. [D 20:43:14.147001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37093. [D 20:43:14.147016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37094. [D 20:43:14.147032] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0342c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37095. [D 20:43:14.149070] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.149094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.149107] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.149149] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6025 [D 20:43:14.149164] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:14.149182] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 22/70. [D 20:43:14.158216] openib_check_cq: completed rdma wr_id 2aaaab0342c0, nic_wr_credit 37095. [D 20:43:14.158241] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 23/70. [D 20:43:14.158358] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.158379] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.158392] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.161493] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6025 [D 20:43:14.161571] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 24/70. [D 20:43:14.163447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 37095. [D 20:43:14.163470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37096. [D 20:43:14.163485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37097. [D 20:43:14.163499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37098. [D 20:43:14.163514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37099. [D 20:43:14.163529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37100. [D 20:43:14.163556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37101. [D 20:43:14.163571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37102. [D 20:43:14.163596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37103. [D 20:43:14.163621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37104. [D 20:43:14.163637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37105. [D 20:43:14.163665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37106. [D 20:43:14.163680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37107. [D 20:43:14.163707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37108. [D 20:43:14.163735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37109. [D 20:43:14.163750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37110. [D 20:43:14.163775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37111. [D 20:43:14.163805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37112. [D 20:43:14.163831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37113. [D 20:43:14.163847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37114. [D 20:43:14.163875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37115. [D 20:43:14.163899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37116. [D 20:43:14.163914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37117. [D 20:43:14.163929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37118. [D 20:43:14.163966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37119. [D 20:43:14.163981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37120. [D 20:43:14.163996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37121. [D 20:43:14.164010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37122. [D 20:43:14.164029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37123. [D 20:43:14.164044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37124. [D 20:43:14.164059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37125. [D 20:43:14.164074] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37126. [D 20:43:14.166105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.166128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.166142] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.166185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6027 [D 20:43:14.166199] element 0: offset: 0x2aaaab60c870, size: 24 [D 20:43:14.166216] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 25/70. [D 20:43:14.175325] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37126. [D 20:43:14.175350] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 26/70. [D 20:43:14.175518] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.175539] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.175551] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.178752] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6027 [D 20:43:14.178826] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 27/70. [D 20:43:14.180820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37126. [D 20:43:14.180842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37127. [D 20:43:14.180857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37128. [D 20:43:14.180872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37129. [D 20:43:14.180887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37130. [D 20:43:14.180901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37131. [D 20:43:14.180928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37132. [D 20:43:14.180954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37133. [D 20:43:14.180970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37134. [D 20:43:14.180995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37135. [D 20:43:14.181010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37136. [D 20:43:14.181044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37137. [D 20:43:14.181070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37138. [D 20:43:14.181085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37139. [D 20:43:14.181112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37140. [D 20:43:14.181127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37141. [D 20:43:14.181153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37142. [D 20:43:14.181182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37143. [D 20:43:14.181197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37144. [D 20:43:14.181221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37145. [D 20:43:14.181248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37146. [D 20:43:14.181263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37147. [D 20:43:14.181289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37148. [D 20:43:14.181316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37149. [D 20:43:14.181331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37150. [D 20:43:14.181346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37151. [D 20:43:14.181361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37152. [D 20:43:14.181375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37153. [D 20:43:14.181396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37154. [D 20:43:14.181411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37155. [D 20:43:14.181426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37156. [D 20:43:14.181440] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0342c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37157. [D 20:43:14.183447] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.183470] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.183484] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.183525] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6031 [D 20:43:14.183541] element 0: offset: 0x2aaaab6178b0, size: 24 [D 20:43:14.183557] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 28/70. [D 20:43:14.192628] openib_check_cq: completed rdma wr_id 2aaaab0342c0, nic_wr_credit 37157. [D 20:43:14.192653] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 29/70. [D 20:43:14.192820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.192841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.192855] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.195790] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6031 [D 20:43:14.195857] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 30/70. [D 20:43:14.197741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37157. [D 20:43:14.197763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37158. [D 20:43:14.197778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37159. [D 20:43:14.197793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37160. [D 20:43:14.197807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37161. [D 20:43:14.197822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37162. [D 20:43:14.197848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37163. [D 20:43:14.197863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37164. [D 20:43:14.197888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37165. [D 20:43:14.197903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37166. [D 20:43:14.197929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37167. [D 20:43:14.197944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37168. [D 20:43:14.197973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37169. [D 20:43:14.197989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37170. [D 20:43:14.198016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37171. [D 20:43:14.198045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37172. [D 20:43:14.198061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37173. [D 20:43:14.198087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37174. [D 20:43:14.198102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37175. [D 20:43:14.198119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37176. [D 20:43:14.198149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37177. [D 20:43:14.198164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37178. [D 20:43:14.198178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37179. [D 20:43:14.198193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37180. [D 20:43:14.198208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37181. [D 20:43:14.198228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37182. [D 20:43:14.198243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37183. [D 20:43:14.198258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37184. [D 20:43:14.284034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37185. [D 20:43:14.284061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37186. [D 20:43:14.284077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37187. [D 20:43:14.284091] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37188. [D 20:43:14.285032] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37188. [D 20:43:14.285054] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 31/70. [D 20:43:14.288261] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.288325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.288337] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.288379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6033 [D 20:43:14.288394] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:14.288410] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 32/70. [D 20:43:14.288452] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.288466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.288479] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.296078] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.296107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.296122] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.296166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6037 [D 20:43:14.296183] element 0: offset: 0x2aaaab60c870, size: 24 [D 20:43:14.296202] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 33/70. [D 20:43:14.299267] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6037 [D 20:43:14.299337] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 34/70. [D 20:43:14.299405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37188. [D 20:43:14.299474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37189. [D 20:43:14.299489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37190. [D 20:43:14.299504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37191. [D 20:43:14.299518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37192. [D 20:43:14.299533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37193. [D 20:43:14.299547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37194. [D 20:43:14.299562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37195. [D 20:43:14.299576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37196. [D 20:43:14.299590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37197. [D 20:43:14.299605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37198. [D 20:43:14.299619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37199. [D 20:43:14.299633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37200. [D 20:43:14.299648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37201. [D 20:43:14.299663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37202. [D 20:43:14.299677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37203. [D 20:43:14.299691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37204. [D 20:43:14.299706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37205. [D 20:43:14.299720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37206. [D 20:43:14.299735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37207. [D 20:43:14.299749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37208. [D 20:43:14.299763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37209. [D 20:43:14.299778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37210. [D 20:43:14.299792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37211. [D 20:43:14.299806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37212. [D 20:43:14.299821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37213. [D 20:43:14.299835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37214. [D 20:43:14.299849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37215. [D 20:43:14.299864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37216. [D 20:43:14.299878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37217. [D 20:43:14.299892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37218. [D 20:43:14.299907] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0342c0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37219. [D 20:43:14.304054] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6033 [D 20:43:14.304084] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 35/70. [D 20:43:14.310396] openib_check_cq: completed rdma wr_id 2aaaab0342c0, nic_wr_credit 37219. [D 20:43:14.310418] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 36/70. [D 20:43:14.310437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37219. [D 20:43:14.310453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37220. [D 20:43:14.310469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37221. [D 20:43:14.310484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37222. [D 20:43:14.310498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37223. [D 20:43:14.310513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37224. [D 20:43:14.310528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37225. [D 20:43:14.310543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37226. [D 20:43:14.310558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37227. [D 20:43:14.310573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37228. [D 20:43:14.310588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37229. [D 20:43:14.310603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37230. [D 20:43:14.310617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37231. [D 20:43:14.310632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37232. [D 20:43:14.310647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37233. [D 20:43:14.310661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37234. [D 20:43:14.310676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37235. [D 20:43:14.310691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37236. [D 20:43:14.310705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37237. [D 20:43:14.310720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37238. [D 20:43:14.310734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37239. [D 20:43:14.310749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37240. [D 20:43:14.310764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37241. [D 20:43:14.310778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37242. [D 20:43:14.310793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37243. [D 20:43:14.310808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37244. [D 20:43:14.310822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37245. [D 20:43:14.310837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37246. [D 20:43:14.310852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37247. [D 20:43:14.310866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37248. [D 20:43:14.310881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37249. [D 20:43:14.310895] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37250. [D 20:43:14.312342] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.312389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.312402] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.317145] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37250. [D 20:43:14.317169] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 37/70. [D 20:43:14.317227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.317248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.317260] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.328592] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.328610] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.328623] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.328662] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6041 [D 20:43:14.328678] element 0: offset: 0x2aaaab6178b0, size: 24 [D 20:43:14.328696] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 38/70. [D 20:43:14.328740] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.328754] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.328766] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.328787] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6042 [D 20:43:14.328800] element 0: offset: 0x2aaaab617bb0, size: 24 [D 20:43:14.328815] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 39/70. [D 20:43:14.335833] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6041 [D 20:43:14.335859] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 40/70. [D 20:43:14.335880] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6042 [D 20:43:14.335896] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 41/70. [D 20:43:14.336003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 37250. [D 20:43:14.336025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37251. [D 20:43:14.336042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37252. [D 20:43:14.336056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37253. [D 20:43:14.336071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37254. [D 20:43:14.336086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37255. [D 20:43:14.336101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37256. [D 20:43:14.336115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37257. [D 20:43:14.336130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37258. [D 20:43:14.336145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37259. [D 20:43:14.336159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37260. [D 20:43:14.336174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37261. [D 20:43:14.336189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37262. [D 20:43:14.336204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37263. [D 20:43:14.336218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37264. [D 20:43:14.336233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37265. [D 20:43:14.336248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37266. [D 20:43:14.336262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37267. [D 20:43:14.336277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37268. [D 20:43:14.336291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37269. [D 20:43:14.336307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37270. [D 20:43:14.336322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37271. [D 20:43:14.336337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37272. [D 20:43:14.336351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37273. [D 20:43:14.336366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37274. [D 20:43:14.336381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37275. [D 20:43:14.336395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37276. [D 20:43:14.336410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37277. [D 20:43:14.336425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37278. [D 20:43:14.336439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37279. [D 20:43:14.336454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37280. [D 20:43:14.336469] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab038470 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37281. [D 20:43:14.336485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37282. [D 20:43:14.336500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37283. [D 20:43:14.336515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37284. [D 20:43:14.336529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37285. [D 20:43:14.336544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37286. [D 20:43:14.336559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37287. [D 20:43:14.336573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37288. [D 20:43:14.336588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37289. [D 20:43:14.336603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37290. [D 20:43:14.336617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37291. [D 20:43:14.336632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37292. [D 20:43:14.336647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37293. [D 20:43:14.336661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37294. [D 20:43:14.336676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37295. [D 20:43:14.336691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37296. [D 20:43:14.336705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37297. [D 20:43:14.336720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37298. [D 20:43:14.336736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37299. [D 20:43:14.336750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37300. [D 20:43:14.336765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37301. [D 20:43:14.336780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37302. [D 20:43:14.336795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37303. [D 20:43:14.336810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37304. [D 20:43:14.336824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37305. [D 20:43:14.336839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37306. [D 20:43:14.336853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37307. [D 20:43:14.336869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37308. [D 20:43:14.336883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37309. [D 20:43:14.336898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37310. [D 20:43:14.336913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37311. [D 20:43:14.336927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37312. [D 20:43:14.336942] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034190 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37313. [D 20:43:14.347652] openib_check_cq: completed rdma wr_id 2aaaab038470, nic_wr_credit 37313. [D 20:43:14.347671] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 42/70. [D 20:43:14.357040] openib_check_cq: completed rdma wr_id 2aaaab034190, nic_wr_credit 37312. [D 20:43:14.357062] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 43/70. [D 20:43:14.357144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.357208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.357221] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.357247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.357261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.357273] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.374406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.374424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.374437] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.374477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6045 [D 20:43:14.374493] element 0: offset: 0x2aaaab60c870, size: 24 [D 20:43:14.374513] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 44/70. [D 20:43:14.377586] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6045 [D 20:43:14.377660] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 45/70. [D 20:43:14.377722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 37312. [D 20:43:14.377749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 37313. [D 20:43:14.377765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 37314. [D 20:43:14.377788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 37315. [D 20:43:14.377805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 37316. [D 20:43:14.377820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 37317. [D 20:43:14.377834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 37318. [D 20:43:14.377849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37319. [D 20:43:14.377864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37320. [D 20:43:14.377879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37321. [D 20:43:14.377893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 37322. [D 20:43:14.377908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 37323. [D 20:43:14.377922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 37324. [D 20:43:14.377937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 37325. [D 20:43:14.377952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 37326. [D 20:43:14.377967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37327. [D 20:43:14.377981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37328. [D 20:43:14.377996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37329. [D 20:43:14.378011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 37330. [D 20:43:14.378026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 37331. [D 20:43:14.378040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 37332. [D 20:43:14.378055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 37333. [D 20:43:14.378069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 37334. [D 20:43:14.378084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37335. [D 20:43:14.378099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37336. [D 20:43:14.378114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37337. [D 20:43:14.378128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 37338. [D 20:43:14.378143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 37339. [D 20:43:14.378158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 37340. [D 20:43:14.378172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 37341. [D 20:43:14.378187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 37342. [D 20:43:14.378202] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37343. [D 20:43:14.388207] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37343. [D 20:43:14.388229] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 46/70. [D 20:43:14.388360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.388382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.388395] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.489045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.489063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.489075] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.489112] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6049 [D 20:43:14.489127] element 0: offset: 0x2aaaab60d0e0, size: 24 [D 20:43:14.489144] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 47/70. [D 20:43:14.492293] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6049 [D 20:43:14.492367] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 48/70. [D 20:43:14.492562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37343. [D 20:43:14.492630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37344. [D 20:43:14.492646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37345. [D 20:43:14.492661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37346. [D 20:43:14.492676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37347. [D 20:43:14.492695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37348. [D 20:43:14.492718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37349. [D 20:43:14.492733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37350. [D 20:43:14.492748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37351. [D 20:43:14.492763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37352. [D 20:43:14.492777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37353. [D 20:43:14.492792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37354. [D 20:43:14.492807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37355. [D 20:43:14.492822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37356. [D 20:43:14.492836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37357. [D 20:43:14.492851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37358. [D 20:43:14.492866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37359. [D 20:43:14.492881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37360. [D 20:43:14.492895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37361. [D 20:43:14.492910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37362. [D 20:43:14.492925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37363. [D 20:43:14.492940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37364. [D 20:43:14.492955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37365. [D 20:43:14.492970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37366. [D 20:43:14.492985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37367. [D 20:43:14.492999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37368. [D 20:43:14.493014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37369. [D 20:43:14.493029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37370. [D 20:43:14.493044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37371. [D 20:43:14.493058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37372. [D 20:43:14.493073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37373. [D 20:43:14.493087] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37374. [D 20:43:14.503099] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37374. [D 20:43:14.503121] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 49/70. [D 20:43:14.503200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.503223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.503237] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.511103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.511120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.511133] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.511169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6052 [D 20:43:14.511184] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:14.511202] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 50/70. [D 20:43:14.514299] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6052 [D 20:43:14.514372] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 51/70. [D 20:43:14.514430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37374. [D 20:43:14.514467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37375. [D 20:43:14.514482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37376. [D 20:43:14.514496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37377. [D 20:43:14.514511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37378. [D 20:43:14.514526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37379. [D 20:43:14.514540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37380. [D 20:43:14.514555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37381. [D 20:43:14.514569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37382. [D 20:43:14.514584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37383. [D 20:43:14.514598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37384. [D 20:43:14.514614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37385. [D 20:43:14.514628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37386. [D 20:43:14.514643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37387. [D 20:43:14.514657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37388. [D 20:43:14.514672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37389. [D 20:43:14.514687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37390. [D 20:43:14.514701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37391. [D 20:43:14.514716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37392. [D 20:43:14.514731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37393. [D 20:43:14.514745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37394. [D 20:43:14.514760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37395. [D 20:43:14.514774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37396. [D 20:43:14.514789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37397. [D 20:43:14.514804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37398. [D 20:43:14.514818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37399. [D 20:43:14.514833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37400. [D 20:43:14.514847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37401. [D 20:43:14.514862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37402. [D 20:43:14.514877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37403. [D 20:43:14.514891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37404. [D 20:43:14.514906] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37405. [D 20:43:14.524564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.524588] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.524601] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.524641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6054 [D 20:43:14.524656] element 0: offset: 0x2aaaab6178b0, size: 24 [D 20:43:14.524673] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 52/70. [D 20:43:14.524778] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37405. [D 20:43:14.524803] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 53/70. [D 20:43:14.524920] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.524940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.524952] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.525372] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 262144, tag: 6054 [D 20:43:14.525393] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 54/70. [D 20:43:14.525530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37405. [D 20:43:14.525556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37406. [D 20:43:14.525570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37407. [D 20:43:14.525585] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37408. [D 20:43:14.526918] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37408. [D 20:43:14.526940] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 55/70. [D 20:43:14.527000] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.527019] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.527032] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.535063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.535080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.535092] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.535117] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6059 [D 20:43:14.535131] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:14.535146] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 56/70. [D 20:43:14.535179] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.535193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.535205] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:14.535226] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6060 [D 20:43:14.535240] element 0: offset: 0x2aaaab60c870, size: 24 [D 20:43:14.535255] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 57/70. [D 20:43:14.535338] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.535354] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.535366] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:14.538354] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6059 [D 20:43:14.538426] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 58/70. [D 20:43:14.538702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37408. [D 20:43:14.538729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37409. [D 20:43:14.538743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37410. [D 20:43:14.538758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37411. [D 20:43:14.538773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37412. [D 20:43:14.538787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37413. [D 20:43:14.538802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37414. [D 20:43:14.538817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37415. [D 20:43:14.538832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37416. [D 20:43:14.538846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37417. [D 20:43:14.538861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37418. [D 20:43:14.538875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37419. [D 20:43:14.538890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37420. [D 20:43:14.538906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37421. [D 20:43:14.538921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37422. [D 20:43:14.538936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37423. [D 20:43:14.538950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37424. [D 20:43:14.538965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37425. [D 20:43:14.538980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37426. [D 20:43:14.538994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37427. [D 20:43:14.539009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37428. [D 20:43:14.539024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37429. [D 20:43:14.539038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37430. [D 20:43:14.539053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37431. [D 20:43:14.539067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37432. [D 20:43:14.539082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37433. [D 20:43:14.539097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37434. [D 20:43:14.539112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37435. [D 20:43:14.539126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37436. [D 20:43:14.539141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37437. [D 20:43:14.539155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37438. [D 20:43:14.539170] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37439. [D 20:43:14.548938] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37439. [D 20:43:14.548960] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 59/70. [D 20:43:14.549045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.549068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.549081] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.558223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.558241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.558254] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.558293] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6064 [D 20:43:14.558308] element 0: offset: 0x2aaaab60da50, size: 24 [D 20:43:14.558325] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 60/70. [D 20:43:14.561384] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6064 [D 20:43:14.561452] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 0/70. [D 20:43:14.561727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37439. [D 20:43:14.561755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37440. [D 20:43:14.561790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37441. [D 20:43:14.561805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37442. [D 20:43:14.561820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37443. [D 20:43:14.561835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37444. [D 20:43:14.561850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37445. [D 20:43:14.561865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37446. [D 20:43:14.561879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37447. [D 20:43:14.561894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37448. [D 20:43:14.561917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37449. [D 20:43:14.561933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37450. [D 20:43:14.561947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37451. [D 20:43:14.561963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37452. [D 20:43:14.561977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37453. [D 20:43:14.561992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37454. [D 20:43:14.562006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37455. [D 20:43:14.562021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37456. [D 20:43:14.562036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37457. [D 20:43:14.562051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37458. [D 20:43:14.562066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37459. [D 20:43:14.562081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37460. [D 20:43:14.562095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37461. [D 20:43:14.562110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37462. [D 20:43:14.562125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37463. [D 20:43:14.562140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37464. [D 20:43:14.562154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37465. [D 20:43:14.562169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37466. [D 20:43:14.562184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37467. [D 20:43:14.562199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37468. [D 20:43:14.562214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37469. [D 20:43:14.562229] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37470. [D 20:43:14.572677] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37470. [D 20:43:14.572700] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 1/70. [D 20:43:14.572784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.572806] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.572820] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.580976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.580993] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.581005] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.581042] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6067 [D 20:43:14.581057] element 0: offset: 0x2aaaab615400, size: 24 [D 20:43:14.581073] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 2/70. [D 20:43:14.584146] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6067 [D 20:43:14.584213] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 3/70. [D 20:43:14.584270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37470. [D 20:43:14.584308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37471. [D 20:43:14.584324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37472. [D 20:43:14.584338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37473. [D 20:43:14.584353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37474. [D 20:43:14.584368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37475. [D 20:43:14.584383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37476. [D 20:43:14.584398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37477. [D 20:43:14.584413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37478. [D 20:43:14.584427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37479. [D 20:43:14.584442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37480. [D 20:43:14.584456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37481. [D 20:43:14.584471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37482. [D 20:43:14.584486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37483. [D 20:43:14.584501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37484. [D 20:43:14.584515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37485. [D 20:43:14.584530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37486. [D 20:43:14.584545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37487. [D 20:43:14.584560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37488. [D 20:43:14.584575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37489. [D 20:43:14.584591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37490. [D 20:43:14.584606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37491. [D 20:43:14.584620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37492. [D 20:43:14.584635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37493. [D 20:43:14.584650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37494. [D 20:43:14.584665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37495. [D 20:43:14.584680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37496. [D 20:43:14.584695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37497. [D 20:43:14.584709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37498. [D 20:43:14.584724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37499. [D 20:43:14.584739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37500. [D 20:43:14.584753] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37501. [D 20:43:14.594873] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37501. [D 20:43:14.594896] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 4/70. [D 20:43:14.595025] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.595048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.595060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.604280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.604299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.604312] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.604347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6070 [D 20:43:14.604362] element 0: offset: 0x2aaaab60d0e0, size: 24 [D 20:43:14.604378] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 5/70. [D 20:43:14.608125] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6070 [D 20:43:14.608200] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 6/70. [D 20:43:14.608341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37501. [D 20:43:14.608365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37502. [D 20:43:14.608380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37503. [D 20:43:14.608395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37504. [D 20:43:14.608410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37505. [D 20:43:14.608424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37506. [D 20:43:14.608439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37507. [D 20:43:14.608454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37508. [D 20:43:14.608469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37509. [D 20:43:14.608484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37510. [D 20:43:14.608499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37511. [D 20:43:14.608514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37512. [D 20:43:14.608529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37513. [D 20:43:14.608543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37514. [D 20:43:14.608558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37515. [D 20:43:14.608573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37516. [D 20:43:14.608587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37517. [D 20:43:14.608602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37518. [D 20:43:14.608617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37519. [D 20:43:14.608631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37520. [D 20:43:14.608646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37521. [D 20:43:14.608661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37522. [D 20:43:14.608676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37523. [D 20:43:14.608690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37524. [D 20:43:14.608705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37525. [D 20:43:14.608719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37526. [D 20:43:14.608734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37527. [D 20:43:14.608749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37528. [D 20:43:14.608764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37529. [D 20:43:14.608778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37530. [D 20:43:14.608793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37531. [D 20:43:14.608808] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37532. [D 20:43:14.618663] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37532. [D 20:43:14.618685] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 7/70. [D 20:43:14.618768] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.618790] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.618803] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.626807] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.626826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.626838] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.626876] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6073 [D 20:43:14.626891] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:14.736936] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 8/70. [D 20:43:14.739991] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6073 [D 20:43:14.740079] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 9/70. [D 20:43:14.740141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 37532. [D 20:43:14.740167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37533. [D 20:43:14.740753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37534. [D 20:43:14.740772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37535. [D 20:43:14.740787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37536. [D 20:43:14.740802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37537. [D 20:43:14.740829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37538. [D 20:43:14.740844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37539. [D 20:43:14.740859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37540. [D 20:43:14.740873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37541. [D 20:43:14.740888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37542. [D 20:43:14.740903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37543. [D 20:43:14.740917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37544. [D 20:43:14.740932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37545. [D 20:43:14.740946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37546. [D 20:43:14.740961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37547. [D 20:43:14.740976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37548. [D 20:43:14.740990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37549. [D 20:43:14.741005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37550. [D 20:43:14.741615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37551. [D 20:43:14.741643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37552. [D 20:43:14.741658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37553. [D 20:43:14.741673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37554. [D 20:43:14.741688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37555. [D 20:43:14.741702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37556. [D 20:43:14.741717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37557. [D 20:43:14.741732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37558. [D 20:43:14.741746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37559. [D 20:43:14.741761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37560. [D 20:43:14.742340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37561. [D 20:43:14.742357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37562. [D 20:43:14.742372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37563. [D 20:43:14.746473] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37563. [D 20:43:14.746494] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 10/70. [D 20:43:14.746716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.746741] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.746754] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.754759] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.754777] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.754789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.754828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6076 [D 20:43:14.754843] element 0: offset: 0x2aaaab6178b0, size: 24 [D 20:43:14.754859] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 11/70. [D 20:43:14.757999] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6076 [D 20:43:14.758075] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 12/70. [D 20:43:14.758390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37563. [D 20:43:14.758416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37564. [D 20:43:14.758431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37565. [D 20:43:14.758446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37566. [D 20:43:14.758464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37567. [D 20:43:14.758479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37568. [D 20:43:14.758551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37569. [D 20:43:14.758568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37570. [D 20:43:14.758829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37571. [D 20:43:14.758846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37572. [D 20:43:14.758861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37573. [D 20:43:14.758876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37574. [D 20:43:14.758890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37575. [D 20:43:14.758911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37576. [D 20:43:14.758925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37577. [D 20:43:14.758940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37578. [D 20:43:14.758968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37579. [D 20:43:14.758983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37580. [D 20:43:14.758997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37581. [D 20:43:14.759012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37582. [D 20:43:14.759027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37583. [D 20:43:14.759041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37584. [D 20:43:14.759056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37585. [D 20:43:14.759070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37586. [D 20:43:14.759097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37587. [D 20:43:14.759112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37588. [D 20:43:14.759126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37589. [D 20:43:14.759141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37590. [D 20:43:14.759230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37591. [D 20:43:14.759261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37592. [D 20:43:14.759718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37593. [D 20:43:14.759735] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37594. [D 20:43:14.769164] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37594. [D 20:43:14.769188] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 13/70. [D 20:43:14.769271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.769294] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.769307] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.900944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.900965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.900978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.901016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6079 [D 20:43:14.901031] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:14.901048] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 14/70. [D 20:43:14.904199] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6079 [D 20:43:14.904275] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 15/70. [D 20:43:14.904335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37594. [D 20:43:14.904361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37595. [D 20:43:14.904377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37596. [D 20:43:14.904395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37597. [D 20:43:14.904413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37598. [D 20:43:14.904432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37599. [D 20:43:14.904449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37600. [D 20:43:14.904467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37601. [D 20:43:14.904485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37602. [D 20:43:14.904503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37603. [D 20:43:14.904520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37604. [D 20:43:14.904538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37605. [D 20:43:14.904556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37606. [D 20:43:14.904574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37607. [D 20:43:14.904589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37608. [D 20:43:14.904608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37609. [D 20:43:14.904626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37610. [D 20:43:14.904641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37611. [D 20:43:14.904656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37612. [D 20:43:14.904671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37613. [D 20:43:14.904686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37614. [D 20:43:14.904700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37615. [D 20:43:14.904715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37616. [D 20:43:14.904730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37617. [D 20:43:14.904744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37618. [D 20:43:14.904759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37619. [D 20:43:14.904773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37620. [D 20:43:14.904788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37621. [D 20:43:14.904802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37622. [D 20:43:14.904817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37623. [D 20:43:14.904831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37624. [D 20:43:14.904846] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37625. [D 20:43:14.915055] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37625. [D 20:43:14.915076] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 16/70. [D 20:43:14.915207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.915231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.915245] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.924026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.924044] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.924057] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.924095] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6082 [D 20:43:14.924109] element 0: offset: 0x2aaaab60da50, size: 24 [D 20:43:14.924126] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 17/70. [D 20:43:14.927745] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6082 [D 20:43:14.927824] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 18/70. [D 20:43:14.927970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37625. [D 20:43:14.927995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37626. [D 20:43:14.928010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37627. [D 20:43:14.928025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37628. [D 20:43:14.928042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37629. [D 20:43:14.928057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37630. [D 20:43:14.928074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37631. [D 20:43:14.928089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37632. [D 20:43:14.928103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37633. [D 20:43:14.928118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37634. [D 20:43:14.928133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37635. [D 20:43:14.928148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37636. [D 20:43:14.928162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37637. [D 20:43:14.928177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37638. [D 20:43:14.928191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37639. [D 20:43:14.928206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37640. [D 20:43:14.928221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37641. [D 20:43:14.928235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37642. [D 20:43:14.928250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37643. [D 20:43:14.928265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37644. [D 20:43:14.928280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37645. [D 20:43:14.928294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37646. [D 20:43:14.928309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37647. [D 20:43:14.928324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37648. [D 20:43:14.928338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37649. [D 20:43:14.928353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37650. [D 20:43:14.928368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37651. [D 20:43:14.928382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37652. [D 20:43:14.928397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37653. [D 20:43:14.928412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37654. [D 20:43:14.928426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37655. [D 20:43:14.928441] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37656. [D 20:43:14.938186] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37656. [D 20:43:14.938208] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 19/70. [D 20:43:14.938290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.938312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.938325] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.946280] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.946298] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.946311] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.946349] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6085 [D 20:43:14.946364] element 0: offset: 0x2aaaab60d0e0, size: 24 [D 20:43:14.946381] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 20/70. [D 20:43:14.949542] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6085 [D 20:43:14.949615] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 21/70. [D 20:43:14.949669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37656. [D 20:43:14.949695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37657. [D 20:43:14.949710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37658. [D 20:43:14.949724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37659. [D 20:43:14.949739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37660. [D 20:43:14.949753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37661. [D 20:43:14.949768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37662. [D 20:43:14.949782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37663. [D 20:43:14.949797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37664. [D 20:43:14.949811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37665. [D 20:43:14.949826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37666. [D 20:43:14.949840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37667. [D 20:43:14.949855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37668. [D 20:43:14.949869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37669. [D 20:43:14.949884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37670. [D 20:43:14.949898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37671. [D 20:43:14.949913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37672. [D 20:43:14.949927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37673. [D 20:43:14.949942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37674. [D 20:43:14.949956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37675. [D 20:43:14.949971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37676. [D 20:43:14.949986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37677. [D 20:43:14.950000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37678. [D 20:43:14.950015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37679. [D 20:43:14.950029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37680. [D 20:43:14.950045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37681. [D 20:43:14.950060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37682. [D 20:43:14.950075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37683. [D 20:43:14.950089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37684. [D 20:43:14.950104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37685. [D 20:43:14.950118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37686. [D 20:43:14.950133] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37687. [D 20:43:14.960388] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37687. [D 20:43:14.960410] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 22/70. [D 20:43:14.960539] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.960561] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.960574] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.969537] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.969554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.969567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.969604] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6088 [D 20:43:14.969619] element 0: offset: 0x2aaaab615430, size: 24 [D 20:43:14.969636] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 23/70. [D 20:43:14.972752] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6088 [D 20:43:14.972825] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 24/70. [D 20:43:14.973052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37687. [D 20:43:14.973106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37688. [D 20:43:14.973121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37689. [D 20:43:14.973137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37690. [D 20:43:14.973151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37691. [D 20:43:14.973166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37692. [D 20:43:14.973180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37693. [D 20:43:14.973195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37694. [D 20:43:14.973209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37695. [D 20:43:14.973232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37696. [D 20:43:14.973247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37697. [D 20:43:14.973262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37698. [D 20:43:14.973276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37699. [D 20:43:14.973291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37700. [D 20:43:14.973306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37701. [D 20:43:14.973321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37702. [D 20:43:14.973335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37703. [D 20:43:14.973349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37704. [D 20:43:14.973364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37705. [D 20:43:14.973378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37706. [D 20:43:14.973393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37707. [D 20:43:14.973407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37708. [D 20:43:14.973421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37709. [D 20:43:14.973435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37710. [D 20:43:14.973450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37711. [D 20:43:14.973465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37712. [D 20:43:14.973479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37713. [D 20:43:14.973493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37714. [D 20:43:14.973508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37715. [D 20:43:14.973522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37716. [D 20:43:14.973536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37717. [D 20:43:14.973551] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37718. [D 20:43:14.983749] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37718. [D 20:43:14.983771] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 25/70. [D 20:43:14.983852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:14.983875] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.983888] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:14.991918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:14.991936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:14.991949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:14.991988] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6091 [D 20:43:14.992003] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:14.992028] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 26/70. [D 20:43:14.995071] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6091 [D 20:43:14.995143] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 27/70. [D 20:43:14.995201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37718. [D 20:43:14.995235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37719. [D 20:43:14.995254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37720. [D 20:43:14.995271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37721. [D 20:43:14.995285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37722. [D 20:43:14.995300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37723. [D 20:43:14.995315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37724. [D 20:43:14.995329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37725. [D 20:43:14.995344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37726. [D 20:43:14.995358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37727. [D 20:43:14.995373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37728. [D 20:43:14.995387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37729. [D 20:43:14.995402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37730. [D 20:43:14.995416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37731. [D 20:43:14.995431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37732. [D 20:43:14.995445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37733. [D 20:43:14.995460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37734. [D 20:43:14.995474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37735. [D 20:43:14.995489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37736. [D 20:43:14.995503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37737. [D 20:43:14.995518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37738. [D 20:43:14.995532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37739. [D 20:43:14.995547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37740. [D 20:43:14.995561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37741. [D 20:43:14.995576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37742. [D 20:43:14.995590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37743. [D 20:43:14.995605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37744. [D 20:43:14.995619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37745. [D 20:43:14.995633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37746. [D 20:43:14.995648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37747. [D 20:43:14.995662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37748. [D 20:43:14.995677] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37749. [D 20:43:15.005875] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37749. [D 20:43:15.005897] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 28/70. [D 20:43:15.006028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.006051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.006065] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.015087] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.015106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.015119] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.015157] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6094 [D 20:43:15.015172] element 0: offset: 0x2aaaab617970, size: 24 [D 20:43:15.015189] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 29/70. [D 20:43:15.019003] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6094 [D 20:43:15.019081] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 30/70. [D 20:43:15.019228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37749. [D 20:43:15.019255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37750. [D 20:43:15.019270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37751. [D 20:43:15.019285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37752. [D 20:43:15.019299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37753. [D 20:43:15.019314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37754. [D 20:43:15.019329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37755. [D 20:43:15.019343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37756. [D 20:43:15.019358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37757. [D 20:43:15.019372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37758. [D 20:43:15.019387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37759. [D 20:43:15.019402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37760. [D 20:43:15.019416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37761. [D 20:43:15.019431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37762. [D 20:43:15.019445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37763. [D 20:43:15.019460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37764. [D 20:43:15.019475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37765. [D 20:43:15.019489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37766. [D 20:43:15.019504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37767. [D 20:43:15.019518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37768. [D 20:43:15.019533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37769. [D 20:43:15.019549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37770. [D 20:43:15.019564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37771. [D 20:43:15.019579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37772. [D 20:43:15.019593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37773. [D 20:43:15.019608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37774. [D 20:43:15.019622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37775. [D 20:43:15.019637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37776. [D 20:43:15.019651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37777. [D 20:43:15.019666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37778. [D 20:43:15.019681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37779. [D 20:43:15.019695] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37780. [D 20:43:15.029288] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37780. [D 20:43:15.029310] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 31/70. [D 20:43:15.029394] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.029417] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.029430] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.037423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.037441] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.037454] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.037493] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6097 [D 20:43:15.037508] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:15.037525] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 32/70. [D 20:43:15.040627] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6097 [D 20:43:15.040700] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 33/70. [D 20:43:15.040755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37780. [D 20:43:15.040792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37781. [D 20:43:15.040808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37782. [D 20:43:15.040823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37783. [D 20:43:15.040838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37784. [D 20:43:15.040853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37785. [D 20:43:15.040868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37786. [D 20:43:15.040882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37787. [D 20:43:15.040897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37788. [D 20:43:15.040912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37789. [D 20:43:15.040928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37790. [D 20:43:15.040942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37791. [D 20:43:15.040957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37792. [D 20:43:15.040971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37793. [D 20:43:15.040986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37794. [D 20:43:15.041001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37795. [D 20:43:15.041015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37796. [D 20:43:15.041030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37797. [D 20:43:15.041044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37798. [D 20:43:15.041059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37799. [D 20:43:15.041074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37800. [D 20:43:15.041088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37801. [D 20:43:15.041103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37802. [D 20:43:15.041117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37803. [D 20:43:15.041132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37804. [D 20:43:15.041146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37805. [D 20:43:15.041161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37806. [D 20:43:15.041176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37807. [D 20:43:15.041190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37808. [D 20:43:15.041205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37809. [D 20:43:15.041220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37810. [D 20:43:15.041234] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37811. [D 20:43:15.051353] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37811. [D 20:43:15.051375] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 34/70. [D 20:43:15.051508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.051531] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.051544] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.060657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.060676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.060689] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.060727] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6100 [D 20:43:15.060743] element 0: offset: 0x2aaaab60da50, size: 24 [D 20:43:15.060760] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 35/70. [D 20:43:15.064555] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6100 [D 20:43:15.064632] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 36/70. [D 20:43:15.064776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37811. [D 20:43:15.064800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37812. [D 20:43:15.064815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37813. [D 20:43:15.064829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37814. [D 20:43:15.064844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37815. [D 20:43:15.064859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37816. [D 20:43:15.064873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37817. [D 20:43:15.064888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37818. [D 20:43:15.064903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37819. [D 20:43:15.064917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37820. [D 20:43:15.064932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 37821. [D 20:43:15.064946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 37822. [D 20:43:15.064961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 37823. [D 20:43:15.064975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 37824. [D 20:43:15.064990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37825. [D 20:43:15.065004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37826. [D 20:43:15.065019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37827. [D 20:43:15.065034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 37828. [D 20:43:15.065048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 37829. [D 20:43:15.065063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 37830. [D 20:43:15.065078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 37831. [D 20:43:15.065092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 37832. [D 20:43:15.065107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37833. [D 20:43:15.065121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37834. [D 20:43:15.065136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37835. [D 20:43:15.065151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 37836. [D 20:43:15.065165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 37837. [D 20:43:15.065180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 37838. [D 20:43:15.065194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 37839. [D 20:43:15.065210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 37840. [D 20:43:15.065224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37841. [D 20:43:15.065239] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b10 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37842. [D 20:43:15.075054] openib_check_cq: completed rdma wr_id 2aaaab014b10, nic_wr_credit 37842. [D 20:43:15.075076] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 37/70. [D 20:43:15.075158] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.075180] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.075194] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.209649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.209671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.209685] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.209723] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6103 [D 20:43:15.209739] element 0: offset: 0x2aaaab615430, size: 24 [D 20:43:15.209756] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 38/70. [D 20:43:15.211000] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 655360, tag: 6103 [D 20:43:15.211065] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 39/70. [D 20:43:15.211126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 37842. [D 20:43:15.211211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 37843. [D 20:43:15.211228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 37844. [D 20:43:15.211243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 37845. [D 20:43:15.211261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 37846. [D 20:43:15.211279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 37847. [D 20:43:15.211293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37848. [D 20:43:15.211356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37849. [D 20:43:15.211373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37850. [D 20:43:15.211388] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 37851. [D 20:43:15.213335] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37851. [D 20:43:15.213361] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 40/70. [D 20:43:15.213548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.213573] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.213586] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.220351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.220371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.220384] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.220422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6106 [D 20:43:15.220438] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:15.220455] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 41/70. [D 20:43:15.220649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.220668] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.220681] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.245313] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.245333] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.245346] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.245452] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6108 [D 20:43:15.245467] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:15.245483] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 42/70. [D 20:43:15.245552] BMI_post_recv: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6108 [D 20:43:15.245608] openib_post_sr: 10.1.4.240:43806 bh 14 len 48 wr 43/70. [D 20:43:15.247010] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6108 [D 20:43:15.247032] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:15.247050] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 44/70. [D 20:43:15.247410] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.247429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.247442] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.378600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.378620] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.378633] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.378656] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6114 [D 20:43:15.378671] element 0: offset: 0x2aaaab60d1a0, size: 24 [D 20:43:15.378688] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 45/70. [D 20:43:15.381844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.381910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.381924] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:15.381973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.381987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.382000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.382029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6119 [D 20:43:15.382044] element 0: offset: 0x2aaaab638d80, size: 24 [D 20:43:15.382066] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 46/70. [D 20:43:15.382334] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6116 [D 20:43:15.382352] element 0: offset: 0x2aaaab617a30, size: 24 [D 20:43:15.382370] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 47/70. [D 20:43:15.382465] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6116 [D 20:43:15.382489] openib_post_sr: 10.1.4.240:43806 bh 19 len 48 wr 48/70. [D 20:43:15.383297] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.383331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.383345] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.383378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6120 [D 20:43:15.383392] element 0: offset: 0x2aaaab615430, size: 24 [D 20:43:15.383409] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 49/70. [D 20:43:15.388174] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6116 [D 20:43:15.388202] element 0: offset: 0x2aaaab617a30, size: 24 [D 20:43:15.388221] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 50/70. [D 20:43:15.391467] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.391487] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.391502] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.391765] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6114 [D 20:43:15.391792] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 51/70. [D 20:43:15.391810] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6119 [D 20:43:15.391825] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 52/70. [D 20:43:15.391841] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6120 [D 20:43:15.391855] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 53/70. [D 20:43:15.392028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 37851. [D 20:43:15.392052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 37852. [D 20:43:15.392067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 37853. [D 20:43:15.392081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 37854. [D 20:43:15.392096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 37855. [D 20:43:15.392112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 37856. [D 20:43:15.392149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 37857. [D 20:43:15.392164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 37858. [D 20:43:15.392184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 37859. [D 20:43:15.392198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 37860. [D 20:43:15.392214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 37861. [D 20:43:15.392228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 37862. [D 20:43:15.392243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 37863. [D 20:43:15.392257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 37864. [D 20:43:15.392272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 37865. [D 20:43:15.392287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 37866. [D 20:43:15.392302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 37867. [D 20:43:15.392316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 37868. [D 20:43:15.392331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 37869. [D 20:43:15.392348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 37870. [D 20:43:15.392363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 37871. [D 20:43:15.392393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 37872. [D 20:43:15.392407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 37873. [D 20:43:15.392422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 37874. [D 20:43:15.392437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 37875. [D 20:43:15.392452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 37876. [D 20:43:15.392467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 37877. [D 20:43:15.392481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 37878. [D 20:43:15.392496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 37879. [D 20:43:15.392511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 37880. [D 20:43:15.392526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 37881. [D 20:43:15.392541] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0270d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 37882. [D 20:43:15.392558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 37883. [D 20:43:15.392573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 37884. [D 20:43:15.392589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 37885. [D 20:43:15.392607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 37886. [D 20:43:15.392624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 37887. [D 20:43:15.392638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 37888. [D 20:43:15.392653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 37889. [D 20:43:15.392668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 37890. [D 20:43:15.392682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 37891. [D 20:43:15.392697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 37892. [D 20:43:15.392711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 37893. [D 20:43:15.392726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 37894. [D 20:43:15.392741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 37895. [D 20:43:15.392756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 37896. [D 20:43:15.392770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 37897. [D 20:43:15.392786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 37898. [D 20:43:15.392840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 37899. [D 20:43:15.392855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 37900. [D 20:43:15.392869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 37901. [D 20:43:15.392884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 37902. [D 20:43:15.392899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 37903. [D 20:43:15.392924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 37904. [D 20:43:15.392939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 37905. [D 20:43:15.392962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 37906. [D 20:43:15.392976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 37907. [D 20:43:15.392991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 37908. [D 20:43:15.393010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 37909. [D 20:43:15.393035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 37910. [D 20:43:15.393050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 37911. [D 20:43:15.393130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 37912. [D 20:43:15.393150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 37913. [D 20:43:15.393167] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0149e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 37914. [D 20:43:15.393185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 37915. [D 20:43:15.393200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 37916. [D 20:43:15.393219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 37917. [D 20:43:15.393235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 37918. [D 20:43:15.393249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 37919. [D 20:43:15.393264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 37920. [D 20:43:15.393279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 37921. [E 20:43:15.393298] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 37922, block for 10 ms. [D 20:43:15.393521] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 37921. [E 20:43:15.393548] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 37922, block for 10 ms. [D 20:43:15.403894] openib_check_cq: completed rdma wr_id 2aaaab0270d0, nic_wr_credit 37921. [D 20:43:15.403920] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 54/70. [D 20:43:15.403937] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 37920. [D 20:43:15.403952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 37921. [D 20:43:15.403969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 37922. [D 20:43:15.403993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 37923. [D 20:43:15.404008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 37924. [D 20:43:15.404023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 37925. [D 20:43:15.404051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 37926. [D 20:43:15.404078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 37927. [D 20:43:15.404093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 37928. [D 20:43:15.404107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 37929. [D 20:43:15.404122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 37930. [D 20:43:15.404136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 37931. [D 20:43:15.404163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 37932. [D 20:43:15.404178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 37933. [D 20:43:15.404197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 37934. [D 20:43:15.404215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 37935. [D 20:43:15.404232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 37936. [D 20:43:15.404248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 37937. [D 20:43:15.404266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 37938. [D 20:43:15.404284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 37939. [D 20:43:15.404302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 37940. [D 20:43:15.404319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 37941. [D 20:43:15.404337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 37942. [D 20:43:15.404355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 37943. [D 20:43:15.404373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 37944. [D 20:43:15.404391] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02a030 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 37945. [D 20:43:15.407532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.407552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.407569] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.407696] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6123 [D 20:43:15.407715] element 0: offset: 0x2aaaab60da50, size: 24 [D 20:43:15.407735] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 55/70. [D 20:43:15.413238] openib_check_cq: completed rdma wr_id 2aaaab0149e0, nic_wr_credit 37945. [D 20:43:15.413262] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 56/70. [D 20:43:15.416220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.416282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.416296] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.419090] openib_check_cq: completed rdma wr_id 2aaaab02a030, nic_wr_credit 37944. [D 20:43:15.419113] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 57/70. [D 20:43:15.419163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.419183] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.419196] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.419248] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6123 [D 20:43:15.419296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.419311] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.419323] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:15.420201] openib_post_sr: 10.1.4.240:43806 bh 9 len 48 wr 58/70. [D 20:43:15.432500] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6123 [D 20:43:15.432523] element 0: offset: 0x2aaaab60da50, size: 24 [D 20:43:15.432541] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 59/70. [D 20:43:15.432714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.432730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.432746] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.432871] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.432887] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.432901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.432936] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6128 [D 20:43:15.432950] element 0: offset: 0x2aaaab60d1a0, size: 24 [D 20:43:15.432966] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 60/70. [D 20:43:15.432998] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.433013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.433026] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:15.433049] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6131 [D 20:43:15.433063] element 0: offset: 0x2aaaab025c30, size: 24 [D 20:43:15.433081] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 0/70. [D 20:43:15.433163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.433179] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.433191] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.433212] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6132 [D 20:43:15.433227] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:15.433242] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 1/70. [D 20:43:15.436354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.436420] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.436435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.436480] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6135 [D 20:43:15.436495] element 0: offset: 0x2aaaab038790, size: 24 [D 20:43:15.436515] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 2/70. [D 20:43:15.440941] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6131 [D 20:43:15.441006] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 3/70. [D 20:43:15.441072] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6132 [D 20:43:15.441091] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 4/70. [D 20:43:15.441178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 37944. [D 20:43:15.441280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 37945. [D 20:43:15.441297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 37946. [D 20:43:15.441316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 37947. [D 20:43:15.441330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 37948. [D 20:43:15.441345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 37949. [D 20:43:15.441359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 37950. [D 20:43:15.441374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 37951. [D 20:43:15.441388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 37952. [D 20:43:15.441403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 37953. [D 20:43:15.441419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 37954. [D 20:43:15.441434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 37955. [D 20:43:15.441449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 37956. [D 20:43:15.441463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 37957. [D 20:43:15.441478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 37958. [D 20:43:15.441492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 37959. [D 20:43:15.441507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 37960. [D 20:43:15.441522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 37961. [D 20:43:15.441536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 37962. [D 20:43:15.441551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 37963. [D 20:43:15.441566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 37964. [D 20:43:15.441580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 37965. [D 20:43:15.441595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 37966. [D 20:43:15.441609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 37967. [D 20:43:15.441624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 37968. [D 20:43:15.441639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 37969. [D 20:43:15.441653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 37970. [D 20:43:15.441668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 37971. [D 20:43:15.441682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 37972. [D 20:43:15.441697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 37973. [D 20:43:15.441721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 37974. [D 20:43:15.441736] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034310 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 37975. [D 20:43:15.441764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 37976. [D 20:43:15.441779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 37977. [D 20:43:15.441808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 37978. [D 20:43:15.441833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 37979. [D 20:43:15.441848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 37980. [D 20:43:15.441875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 37981. [D 20:43:15.441890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 37982. [D 20:43:15.441915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 37983. [D 20:43:15.441939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 37984. [D 20:43:15.441953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 37985. [D 20:43:15.441981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 37986. [D 20:43:15.442006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 37987. [D 20:43:15.442021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 37988. [D 20:43:15.442044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 37989. [D 20:43:15.442058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 37990. [D 20:43:15.442073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 37991. [D 20:43:15.442109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 37992. [D 20:43:15.442124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 37993. [D 20:43:15.442150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 37994. [D 20:43:15.442164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 37995. [D 20:43:15.442190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 37996. [D 20:43:15.442206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 37997. [D 20:43:15.442230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 37998. [D 20:43:15.442253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 37999. [D 20:43:15.442268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38000. [D 20:43:15.442296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38001. [D 20:43:15.442311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38002. [D 20:43:15.442325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38003. [D 20:43:15.442340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38004. [D 20:43:15.442355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38005. [D 20:43:15.442373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38006. [D 20:43:15.442387] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38007. [D 20:43:15.448114] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6128 [D 20:43:15.448141] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 5/70. [D 20:43:15.448604] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6135 [D 20:43:15.448623] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 6/70. [D 20:43:15.452916] openib_check_cq: completed rdma wr_id 2aaaab034310, nic_wr_credit 38007. [D 20:43:15.452981] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 7/70. [D 20:43:15.464510] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 38006. [D 20:43:15.464529] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 8/70. [D 20:43:15.464563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38006. [D 20:43:15.464580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38007. [D 20:43:15.464595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38008. [D 20:43:15.464610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38009. [D 20:43:15.464625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38010. [D 20:43:15.464639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38011. [D 20:43:15.464654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38012. [D 20:43:15.464668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38013. [D 20:43:15.464683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38014. [D 20:43:15.464697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38015. [D 20:43:15.464712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38016. [D 20:43:15.464727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38017. [D 20:43:15.464742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38018. [D 20:43:15.464756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38019. [D 20:43:15.464771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38020. [D 20:43:15.464785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38021. [D 20:43:15.464800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38022. [D 20:43:15.464815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38023. [D 20:43:15.464829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38024. [D 20:43:15.464844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38025. [D 20:43:15.464859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38026. [D 20:43:15.464873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38027. [D 20:43:15.464888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38028. [D 20:43:15.464902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38029. [D 20:43:15.464917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38030. [D 20:43:15.464932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38031. [D 20:43:15.464960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38032. [D 20:43:15.464986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38033. [D 20:43:15.465015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38034. [D 20:43:15.465030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38035. [D 20:43:15.465057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38036. [D 20:43:15.465082] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38037. [D 20:43:15.465099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38038. [D 20:43:15.465129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38039. [D 20:43:15.465144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38040. [D 20:43:15.465169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38041. [D 20:43:15.465193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38042. [D 20:43:15.465208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38043. [D 20:43:15.465234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38044. [D 20:43:15.465249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38045. [D 20:43:15.465264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38046. [D 20:43:15.465289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38047. [D 20:43:15.465304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38048. [D 20:43:15.465331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38049. [D 20:43:15.465359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38050. [D 20:43:15.465384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38051. [D 20:43:15.465400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38052. [D 20:43:15.465423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38053. [D 20:43:15.465442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38054. [D 20:43:15.465468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38055. [D 20:43:15.465492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38056. [D 20:43:15.465516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38057. [D 20:43:15.465530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38058. [D 20:43:15.465545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38059. [D 20:43:15.465560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38060. [D 20:43:15.465574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38061. [D 20:43:15.465593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38062. [D 20:43:15.465609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38063. [D 20:43:15.465624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38064. [D 20:43:15.465639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38065. [D 20:43:15.465653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38066. [D 20:43:15.465668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38067. [D 20:43:15.465682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38068. [D 20:43:15.465697] openib_post_sr_rdmaw: ibv_post_send wr_id 659830 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38069. [D 20:43:15.468072] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.468089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.468102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.468125] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.468139] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.468152] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.477309] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 38069. [D 20:43:15.477329] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 9/70. [D 20:43:15.480105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.480130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.480143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.480185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6140 [D 20:43:15.480200] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:15.480217] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 10/70. [D 20:43:15.480251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.480265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.480277] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.480298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6141 [D 20:43:15.480312] element 0: offset: 0x2aaaab025c30, size: 24 [D 20:43:15.480337] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 11/70. [D 20:43:15.484200] openib_check_cq: completed rdma wr_id 659830, nic_wr_credit 38068. [D 20:43:15.484224] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 12/70. [D 20:43:15.484294] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.484315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.484328] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.484448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.484463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.484476] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.487544] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6140 [D 20:43:15.487624] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 13/70. [D 20:43:15.490542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38068. [D 20:43:15.490640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38069. [D 20:43:15.490671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38070. [D 20:43:15.490687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38071. [D 20:43:15.490711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38072. [D 20:43:15.490744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38073. [D 20:43:15.490760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38074. [D 20:43:15.490784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38075. [D 20:43:15.490807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38076. [D 20:43:15.490821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38077. [D 20:43:15.490836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38078. [D 20:43:15.490850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38079. [D 20:43:15.490865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38080. [D 20:43:15.490880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38081. [D 20:43:15.490899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38082. [D 20:43:15.490913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38083. [D 20:43:15.490928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38084. [D 20:43:15.490942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38085. [D 20:43:15.490957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38086. [D 20:43:15.490972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38087. [D 20:43:15.490986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38088. [D 20:43:15.491001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38089. [D 20:43:15.491017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38090. [D 20:43:15.491026] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6141 [D 20:43:15.491032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38091. [D 20:43:15.491070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38092. [D 20:43:15.491085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38093. [D 20:43:15.491100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38094. [D 20:43:15.491114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38095. [D 20:43:15.491129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38096. [D 20:43:15.491144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38097. [D 20:43:15.491158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38098. [D 20:43:15.491173] openib_post_sr_rdmaw: ibv_post_send wr_id 62c340 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38099. [D 20:43:15.491202] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 14/70. [D 20:43:15.499015] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.499036] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.499049] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.499097] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6145 [D 20:43:15.499112] element 0: offset: 0x2aaaab001c00, size: 24 [D 20:43:15.499130] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 15/70. [D 20:43:15.499167] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.499181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.499194] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.499214] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6147 [D 20:43:15.499229] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:15.499243] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 16/70. [D 20:43:15.502410] openib_check_cq: completed rdma wr_id 62c340, nic_wr_credit 38099. [D 20:43:15.502436] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 17/70. [D 20:43:15.502475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38099. [D 20:43:15.502491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38100. [D 20:43:15.502506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38101. [D 20:43:15.502521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38102. [D 20:43:15.502536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38103. [D 20:43:15.502551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38104. [D 20:43:15.502566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38105. [D 20:43:15.502581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38106. [D 20:43:15.502596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38107. [D 20:43:15.502611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38108. [D 20:43:15.502626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38109. [D 20:43:15.502641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38110. [D 20:43:15.502656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38111. [D 20:43:15.502670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38112. [D 20:43:15.502686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38113. [D 20:43:15.502700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38114. [D 20:43:15.502715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38115. [D 20:43:15.502730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38116. [D 20:43:15.502745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38117. [D 20:43:15.502760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38118. [D 20:43:15.502775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38119. [D 20:43:15.502790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38120. [D 20:43:15.502806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38121. [D 20:43:15.502821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38122. [D 20:43:15.502835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38123. [D 20:43:15.502850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38124. [D 20:43:15.502864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38125. [D 20:43:15.502879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38126. [D 20:43:15.502893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38127. [D 20:43:15.502907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38128. [D 20:43:15.502922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38129. [D 20:43:15.502936] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38130. [D 20:43:15.503000] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.503031] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.503044] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.508091] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6145 [D 20:43:15.508175] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 18/70. [D 20:43:15.509274] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6147 [D 20:43:15.509324] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 19/70. [D 20:43:15.513300] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38130. [D 20:43:15.513328] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 20/70. [D 20:43:15.513415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.513438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.513451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.517621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38130. [D 20:43:15.517647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38131. [D 20:43:15.517661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38132. [D 20:43:15.517676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38133. [D 20:43:15.517691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38134. [D 20:43:15.517716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38135. [D 20:43:15.517730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38136. [D 20:43:15.517745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38137. [D 20:43:15.517759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38138. [D 20:43:15.517774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38139. [D 20:43:15.517788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38140. [D 20:43:15.517803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38141. [D 20:43:15.517818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38142. [D 20:43:15.517833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38143. [D 20:43:15.517847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38144. [D 20:43:15.517862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38145. [D 20:43:15.517876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38146. [D 20:43:15.517891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38147. [D 20:43:15.517905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38148. [D 20:43:15.517932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38149. [D 20:43:15.517956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38150. [D 20:43:15.517970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38151. [D 20:43:15.517984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38152. [D 20:43:15.518013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38153. [D 20:43:15.518027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38154. [D 20:43:15.518041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38155. [D 20:43:15.518056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38156. [D 20:43:15.518070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38157. [D 20:43:15.518088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38158. [D 20:43:15.518102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38159. [D 20:43:15.518117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38160. [D 20:43:15.518131] openib_post_sr_rdmaw: ibv_post_send wr_id 62c340 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38161. [D 20:43:15.518148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38162. [D 20:43:15.518162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38163. [D 20:43:15.518176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38164. [D 20:43:15.518191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38165. [D 20:43:15.518205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38166. [D 20:43:15.518219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38167. [D 20:43:15.518234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38168. [D 20:43:15.518248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38169. [D 20:43:15.518262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38170. [D 20:43:15.518277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38171. [D 20:43:15.518292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38172. [D 20:43:15.518306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38173. [D 20:43:15.518321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38174. [D 20:43:15.518344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38175. [D 20:43:15.518358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38176. [D 20:43:15.518384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38177. [D 20:43:15.518399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38178. [D 20:43:15.518413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38179. [D 20:43:15.518440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38180. [D 20:43:15.518455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38181. [D 20:43:15.518482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38182. [D 20:43:15.518496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38183. [D 20:43:15.518520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38184. [D 20:43:15.518535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38185. [D 20:43:15.518562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38186. [D 20:43:15.518577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38187. [D 20:43:15.518602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38188. [D 20:43:15.518629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38189. [D 20:43:15.518643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38190. [D 20:43:15.518657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38191. [D 20:43:15.518671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38192. [D 20:43:15.518686] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38193. [D 20:43:15.525716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.525738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.525751] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.525790] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6152 [D 20:43:15.525805] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:15.525821] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 21/70. [D 20:43:15.525859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.525873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.525885] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.525906] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6153 [D 20:43:15.525922] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:15.525938] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 22/70. [D 20:43:15.529341] openib_check_cq: completed rdma wr_id 62c340, nic_wr_credit 38193. [D 20:43:15.529364] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 23/70. [D 20:43:15.540917] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 38192. [D 20:43:15.540934] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 24/70. [D 20:43:15.540984] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.541005] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.541018] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.541134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.541149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.541161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.544501] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6152 [D 20:43:15.544577] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 25/70. [D 20:43:15.546495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38192. [D 20:43:15.546516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38193. [D 20:43:15.546531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38194. [D 20:43:15.546546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38195. [D 20:43:15.546561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38196. [D 20:43:15.546589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38197. [D 20:43:15.546603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38198. [D 20:43:15.546626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38199. [D 20:43:15.546641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38200. [D 20:43:15.546665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38201. [D 20:43:15.546693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38202. [D 20:43:15.546708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38203. [D 20:43:15.546732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38204. [D 20:43:15.546747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38205. [D 20:43:15.546771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38206. [D 20:43:15.546793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38207. [D 20:43:15.546809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38208. [D 20:43:15.546838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38209. [D 20:43:15.546862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38210. [D 20:43:15.546878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38211. [D 20:43:15.546893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38212. [D 20:43:15.546917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38213. [D 20:43:15.546945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38214. [D 20:43:15.546969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38215. [D 20:43:15.546985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38216. [D 20:43:15.547008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38217. [D 20:43:15.547023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38218. [D 20:43:15.547037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38219. [D 20:43:15.547052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38220. [D 20:43:15.547083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38221. [D 20:43:15.547098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38222. [D 20:43:15.547122] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38223. [D 20:43:15.547585] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6153 [D 20:43:15.547649] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 26/70. [D 20:43:15.555676] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.555698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.555712] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.555758] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6157 [D 20:43:15.555774] element 0: offset: 0x2aaaab038850, size: 24 [D 20:43:15.555791] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 27/70. [D 20:43:15.555832] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.555846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.555858] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.555880] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6159 [D 20:43:15.555894] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:15.555909] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 28/70. [D 20:43:15.558282] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38223. [D 20:43:15.558307] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 29/70. [D 20:43:15.558346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38223. [D 20:43:15.558361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38224. [D 20:43:15.558376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38225. [D 20:43:15.558390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38226. [D 20:43:15.558404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38227. [D 20:43:15.558419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38228. [D 20:43:15.558433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38229. [D 20:43:15.558447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38230. [D 20:43:15.558461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38231. [D 20:43:15.558477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38232. [D 20:43:15.558492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38233. [D 20:43:15.558507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38234. [D 20:43:15.558521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38235. [D 20:43:15.558536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38236. [D 20:43:15.558551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38237. [D 20:43:15.558566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38238. [D 20:43:15.558580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38239. [D 20:43:15.558595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38240. [D 20:43:15.558609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38241. [D 20:43:15.558624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38242. [D 20:43:15.558639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38243. [D 20:43:15.558654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38244. [D 20:43:15.558668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38245. [D 20:43:15.558683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38246. [D 20:43:15.558698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38247. [D 20:43:15.558713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38248. [D 20:43:15.558727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38249. [D 20:43:15.558742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38250. [D 20:43:15.558756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38251. [D 20:43:15.558771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38252. [D 20:43:15.558786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38253. [D 20:43:15.558801] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38254. [D 20:43:15.558857] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.558876] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.558889] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.564083] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6157 [D 20:43:15.564167] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 30/70. [D 20:43:15.565325] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6159 [D 20:43:15.565372] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 31/70. [D 20:43:15.569939] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 38254. [D 20:43:15.569965] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 32/70. [D 20:43:15.570049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.570073] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.570087] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.575143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38254. [D 20:43:15.575169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38255. [D 20:43:15.575183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38256. [D 20:43:15.575198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38257. [D 20:43:15.575212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38258. [D 20:43:15.575227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38259. [D 20:43:15.575241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38260. [D 20:43:15.575256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38261. [D 20:43:15.575270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38262. [D 20:43:15.575288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38263. [D 20:43:15.575302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38264. [D 20:43:15.575317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38265. [D 20:43:15.575331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38266. [D 20:43:15.575345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38267. [D 20:43:15.575360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38268. [D 20:43:15.575374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38269. [D 20:43:15.575389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38270. [D 20:43:15.575403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38271. [D 20:43:15.575418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38272. [D 20:43:15.575432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38273. [D 20:43:15.575447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38274. [D 20:43:15.575461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38275. [D 20:43:15.575476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38276. [D 20:43:15.575490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38277. [D 20:43:15.575505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38278. [D 20:43:15.575519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38279. [D 20:43:15.575534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38280. [D 20:43:15.575548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38281. [D 20:43:15.575564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38282. [D 20:43:15.575578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38283. [D 20:43:15.575593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38284. [D 20:43:15.575607] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38285. [D 20:43:15.575624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38286. [D 20:43:15.575639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38287. [D 20:43:15.575654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38288. [D 20:43:15.575668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38289. [D 20:43:15.575683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38290. [D 20:43:15.575697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38291. [D 20:43:15.575712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38292. [D 20:43:15.575726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38293. [D 20:43:15.575741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38294. [D 20:43:15.575756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38295. [D 20:43:15.575770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38296. [D 20:43:15.575785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38297. [D 20:43:15.575799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38298. [D 20:43:15.575814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38299. [D 20:43:15.575829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38300. [D 20:43:15.575843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38301. [D 20:43:15.575858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38302. [D 20:43:15.575872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38303. [D 20:43:15.575887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38304. [D 20:43:15.575902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38305. [D 20:43:15.575916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38306. [D 20:43:15.575931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38307. [D 20:43:15.575946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38308. [D 20:43:15.575960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38309. [D 20:43:15.575975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38310. [D 20:43:15.636903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38311. [D 20:43:15.636996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38312. [D 20:43:15.637539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38313. [D 20:43:15.637556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38314. [D 20:43:15.637585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38315. [D 20:43:15.637600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38316. [D 20:43:15.637614] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38317. [D 20:43:15.637633] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 38317. [D 20:43:15.637648] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 33/70. [D 20:43:15.637944] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.637968] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.637982] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.638021] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6164 [D 20:43:15.638037] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:15.638054] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 34/70. [D 20:43:15.638089] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.638103] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.638116] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.638137] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6165 [D 20:43:15.638151] element 0: offset: 0x2aaaab027120, size: 24 [D 20:43:15.638167] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 35/70. [D 20:43:15.638644] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 38316. [D 20:43:15.638669] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 36/70. [D 20:43:15.638726] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.638745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.638758] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.638871] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.638886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.638899] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.645978] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6164 [D 20:43:15.646057] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 37/70. [D 20:43:15.646231] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6165 [D 20:43:15.646249] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 38/70. [D 20:43:15.650894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38316. [D 20:43:15.650919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38317. [D 20:43:15.650934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38318. [D 20:43:15.650949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38319. [D 20:43:15.650963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38320. [D 20:43:15.650978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38321. [D 20:43:15.650993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38322. [D 20:43:15.651007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38323. [D 20:43:15.651022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38324. [D 20:43:15.651036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38325. [D 20:43:15.651051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38326. [D 20:43:15.651066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38327. [D 20:43:15.651080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38328. [D 20:43:15.651095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38329. [D 20:43:15.651109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38330. [D 20:43:15.651124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38331. [D 20:43:15.651138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38332. [D 20:43:15.651153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38333. [D 20:43:15.651168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38334. [D 20:43:15.651182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38335. [D 20:43:15.651197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38336. [D 20:43:15.651211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38337. [D 20:43:15.651226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38338. [D 20:43:15.651240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38339. [D 20:43:15.651255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38340. [D 20:43:15.651269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38341. [D 20:43:15.651288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38342. [D 20:43:15.651302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38343. [D 20:43:15.651317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38344. [D 20:43:15.651331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38345. [D 20:43:15.651346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38346. [D 20:43:15.651360] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38347. [D 20:43:15.651377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38348. [D 20:43:15.651391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38349. [D 20:43:15.651406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38350. [D 20:43:15.651421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38351. [D 20:43:15.651436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38352. [D 20:43:15.651451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38353. [D 20:43:15.651466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38354. [D 20:43:15.651481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38355. [D 20:43:15.651495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38356. [D 20:43:15.651510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38357. [D 20:43:15.651525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38358. [D 20:43:15.651540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38359. [D 20:43:15.651554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38360. [D 20:43:15.651569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38361. [D 20:43:15.651583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38362. [D 20:43:15.651598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38363. [D 20:43:15.651613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38364. [D 20:43:15.651628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38365. [D 20:43:15.651642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38366. [D 20:43:15.651657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38367. [D 20:43:15.651671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38368. [D 20:43:15.651686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38369. [D 20:43:15.651701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38370. [D 20:43:15.651716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38371. [D 20:43:15.651730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38372. [D 20:43:15.651745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38373. [D 20:43:15.651759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38374. [D 20:43:15.651774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38375. [D 20:43:15.651789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38376. [D 20:43:15.651803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38377. [D 20:43:15.651818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38378. [D 20:43:15.651833] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38379. [D 20:43:15.653251] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.653276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.653289] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.653333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6169 [D 20:43:15.653348] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:15.653365] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 39/70. [D 20:43:15.653404] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.653418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.653430] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.653451] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6171 [D 20:43:15.653466] element 0: offset: 0x2aaaab030cb0, size: 24 [D 20:43:15.653482] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 40/70. [D 20:43:15.656811] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38379. [D 20:43:15.656833] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 41/70. [D 20:43:15.664932] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 38378. [D 20:43:15.664952] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 42/70. [D 20:43:15.667983] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.667999] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.668012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.668122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.668142] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.668155] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.672082] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6169 [D 20:43:15.672117] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 43/70. [D 20:43:15.675419] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6171 [D 20:43:15.675444] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 44/70. [D 20:43:15.675619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38378. [D 20:43:15.675640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38379. [D 20:43:15.675655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38380. [D 20:43:15.675669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38381. [D 20:43:15.675684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38382. [D 20:43:15.675699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38383. [D 20:43:15.675713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38384. [D 20:43:15.675728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38385. [D 20:43:15.675742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38386. [D 20:43:15.675757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38387. [D 20:43:15.675772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38388. [D 20:43:15.675786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38389. [D 20:43:15.675801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38390. [D 20:43:15.675816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38391. [D 20:43:15.675830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38392. [D 20:43:15.675845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38393. [D 20:43:15.675859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38394. [D 20:43:15.675874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38395. [D 20:43:15.675888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38396. [D 20:43:15.675902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38397. [D 20:43:15.675917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38398. [D 20:43:15.675931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38399. [D 20:43:15.675946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38400. [D 20:43:15.675960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38401. [D 20:43:15.675975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38402. [D 20:43:15.675989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38403. [D 20:43:15.676004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38404. [D 20:43:15.676018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38405. [D 20:43:15.676033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38406. [D 20:43:15.676052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38407. [D 20:43:15.676066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38408. [D 20:43:15.676080] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38409. [D 20:43:15.676097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 38410. [D 20:43:15.676112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 38411. [D 20:43:15.676127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38412. [D 20:43:15.676141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38413. [D 20:43:15.676155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38414. [D 20:43:15.676170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38415. [D 20:43:15.676184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38416. [D 20:43:15.676199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38417. [D 20:43:15.676213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38418. [D 20:43:15.676227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38419. [D 20:43:15.676242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38420. [D 20:43:15.676256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38421. [D 20:43:15.676272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38422. [D 20:43:15.676286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38423. [D 20:43:15.676301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38424. [D 20:43:15.676315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38425. [D 20:43:15.676330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38426. [D 20:43:15.676344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38427. [D 20:43:15.676358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38428. [D 20:43:15.676373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38429. [D 20:43:15.676387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38430. [D 20:43:15.676402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38431. [D 20:43:15.676416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38432. [D 20:43:15.676431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38433. [D 20:43:15.676445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38434. [D 20:43:15.676460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38435. [D 20:43:15.676474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38436. [D 20:43:15.676489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38437. [D 20:43:15.676503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38438. [D 20:43:15.676518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38439. [D 20:43:15.676532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38440. [D 20:43:15.676546] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38441. [D 20:43:15.678310] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.678377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.678392] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.678436] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6176 [D 20:43:15.678451] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:15.678473] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 45/70. [D 20:43:15.678519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.678533] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.678546] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.678567] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6177 [D 20:43:15.678582] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:15.678597] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 46/70. [D 20:43:15.682223] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 38441. [D 20:43:15.682246] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 47/70. [D 20:43:15.690740] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 38440. [D 20:43:15.690769] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 48/70. [D 20:43:15.690833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.690852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.690868] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.690981] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.690996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.691008] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.696087] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6176 [D 20:43:15.696108] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 49/70. [D 20:43:15.696437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38440. [D 20:43:15.696455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38441. [D 20:43:15.696470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38442. [D 20:43:15.696485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38443. [D 20:43:15.696500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38444. [D 20:43:15.696515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38445. [D 20:43:15.696530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38446. [D 20:43:15.696545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38447. [D 20:43:15.696559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38448. [D 20:43:15.696574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38449. [D 20:43:15.696589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38450. [D 20:43:15.696604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38451. [D 20:43:15.696619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38452. [D 20:43:15.696633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38453. [D 20:43:15.696648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38454. [D 20:43:15.696662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38455. [D 20:43:15.696677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38456. [D 20:43:15.696692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38457. [D 20:43:15.696707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38458. [D 20:43:15.696722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38459. [D 20:43:15.696736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38460. [D 20:43:15.696751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38461. [D 20:43:15.696766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38462. [D 20:43:15.696781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38463. [D 20:43:15.696797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38464. [D 20:43:15.696812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38465. [D 20:43:15.696827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38466. [D 20:43:15.696841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38467. [D 20:43:15.696856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38468. [D 20:43:15.696870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38469. [D 20:43:15.696885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38470. [D 20:43:15.696900] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38471. [D 20:43:15.700212] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6177 [D 20:43:15.700235] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 50/70. [D 20:43:15.705805] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.705869] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.705883] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.705927] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6181 [D 20:43:15.705943] element 0: offset: 0x2aaaab027120, size: 24 [D 20:43:15.705964] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 51/70. [D 20:43:15.706012] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.706026] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.706039] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.706059] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6183 [D 20:43:15.706073] element 0: offset: 0x2aaaab001c00, size: 24 [D 20:43:15.706088] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 52/70. [D 20:43:15.708195] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38471. [D 20:43:15.708220] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 53/70. [D 20:43:15.708237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38471. [D 20:43:15.708252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38472. [D 20:43:15.708267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38473. [D 20:43:15.708281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38474. [D 20:43:15.708296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38475. [D 20:43:15.708311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38476. [D 20:43:15.708325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38477. [D 20:43:15.708340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38478. [D 20:43:15.708354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38479. [D 20:43:15.708369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38480. [D 20:43:15.708384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38481. [D 20:43:15.708398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38482. [D 20:43:15.708414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38483. [D 20:43:15.708428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38484. [D 20:43:15.708443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38485. [D 20:43:15.708457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38486. [D 20:43:15.708472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38487. [D 20:43:15.708487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38488. [D 20:43:15.708501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38489. [D 20:43:15.708516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38490. [D 20:43:15.708530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38491. [D 20:43:15.708545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38492. [D 20:43:15.708560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38493. [D 20:43:15.708574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38494. [D 20:43:15.708589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38495. [D 20:43:15.708603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38496. [D 20:43:15.708618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38497. [D 20:43:15.708632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38498. [D 20:43:15.708647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38499. [D 20:43:15.708661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38500. [D 20:43:15.708676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38501. [D 20:43:15.708691] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38502. [D 20:43:15.708746] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.708765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.708778] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.712005] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6181 [D 20:43:15.712032] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 54/70. [D 20:43:15.714308] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 38502. [D 20:43:15.714330] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 55/70. [D 20:43:15.714360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38502. [D 20:43:15.714375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38503. [D 20:43:15.714390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38504. [D 20:43:15.714405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38505. [D 20:43:15.714420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38506. [D 20:43:15.714435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38507. [D 20:43:15.714450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38508. [D 20:43:15.714465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38509. [D 20:43:15.714480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38510. [D 20:43:15.714494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38511. [D 20:43:15.714510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38512. [D 20:43:15.714525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38513. [D 20:43:15.714540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38514. [D 20:43:15.714554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38515. [D 20:43:15.714569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38516. [D 20:43:15.714584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38517. [D 20:43:15.714599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38518. [D 20:43:15.714614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38519. [D 20:43:15.714629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38520. [D 20:43:15.714644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38521. [D 20:43:15.714659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38522. [D 20:43:15.714674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38523. [D 20:43:15.714690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38524. [D 20:43:15.714705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38525. [D 20:43:15.714719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38526. [D 20:43:15.714735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38527. [D 20:43:15.714750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38528. [D 20:43:15.714764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38529. [D 20:43:15.714780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38530. [D 20:43:15.714795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38531. [D 20:43:15.714809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38532. [D 20:43:15.714824] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38533. [D 20:43:15.714924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.714992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.715006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.716084] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6183 [D 20:43:15.716114] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 56/70. [D 20:43:15.719917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.719932] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.719946] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.719984] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6187 [D 20:43:15.720000] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:15.720016] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 57/70. [D 20:43:15.722536] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.722552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.722565] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.722587] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6189 [D 20:43:15.722601] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:15.722616] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 58/70. [D 20:43:15.726334] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 38533. [D 20:43:15.726361] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 59/70. [D 20:43:15.726387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38533. [D 20:43:15.726403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38534. [D 20:43:15.726418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38535. [D 20:43:15.726433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38536. [D 20:43:15.726448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38537. [D 20:43:15.726463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38538. [D 20:43:15.726477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38539. [D 20:43:15.726492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38540. [D 20:43:15.726508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38541. [D 20:43:15.726522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38542. [D 20:43:15.726537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38543. [D 20:43:15.726552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38544. [D 20:43:15.726567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38545. [D 20:43:15.726581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38546. [D 20:43:15.726596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38547. [D 20:43:15.726610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38548. [D 20:43:15.726625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38549. [D 20:43:15.726640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38550. [D 20:43:15.726655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38551. [D 20:43:15.726669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38552. [D 20:43:15.726685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38553. [D 20:43:15.726700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38554. [D 20:43:15.726714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38555. [D 20:43:15.726729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38556. [D 20:43:15.726744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38557. [D 20:43:15.726758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38558. [D 20:43:15.726773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38559. [D 20:43:15.726787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38560. [D 20:43:15.726802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38561. [D 20:43:15.726817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38562. [D 20:43:15.726831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38563. [D 20:43:15.726846] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38564. [D 20:43:15.726902] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.726927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.726940] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.732090] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6187 [D 20:43:15.732170] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 60/70. [D 20:43:15.732822] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6189 [D 20:43:15.732851] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 0/70. [D 20:43:15.737715] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 38564. [D 20:43:15.737739] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 1/70. [D 20:43:15.737822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.737844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.737858] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.742875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38564. [D 20:43:15.742900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38565. [D 20:43:15.742915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38566. [D 20:43:15.742930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38567. [D 20:43:15.742945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38568. [D 20:43:15.742959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38569. [D 20:43:15.742974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38570. [D 20:43:15.742989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38571. [D 20:43:15.743004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38572. [D 20:43:15.743018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38573. [D 20:43:15.743034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38574. [D 20:43:15.743049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38575. [D 20:43:15.743064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38576. [D 20:43:15.743078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38577. [D 20:43:15.743093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38578. [D 20:43:15.743107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38579. [D 20:43:15.743122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38580. [D 20:43:15.743137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38581. [D 20:43:15.743151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38582. [D 20:43:15.743166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38583. [D 20:43:15.743180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38584. [D 20:43:15.743195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38585. [D 20:43:15.743209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38586. [D 20:43:15.743224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38587. [D 20:43:15.743238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38588. [D 20:43:15.743253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38589. [D 20:43:15.743268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38590. [D 20:43:15.743286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38591. [D 20:43:15.743301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38592. [D 20:43:15.743316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38593. [D 20:43:15.743330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38594. [D 20:43:15.743345] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38595. [D 20:43:15.743362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38596. [D 20:43:15.743377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38597. [D 20:43:15.743392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38598. [D 20:43:15.743406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38599. [D 20:43:15.743421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38600. [D 20:43:15.743435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38601. [D 20:43:15.743451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38602. [D 20:43:15.743466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38603. [D 20:43:15.743480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38604. [D 20:43:15.743495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38605. [D 20:43:15.743509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38606. [D 20:43:15.743524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38607. [D 20:43:15.743539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38608. [D 20:43:15.743554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38609. [D 20:43:15.743568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38610. [D 20:43:15.743583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38611. [D 20:43:15.743598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38612. [D 20:43:15.743613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38613. [D 20:43:15.743627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38614. [D 20:43:15.743642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38615. [D 20:43:15.743657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38616. [D 20:43:15.743672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38617. [D 20:43:15.743686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38618. [D 20:43:15.743701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38619. [D 20:43:15.743716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38620. [D 20:43:15.743730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38621. [D 20:43:15.743745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38622. [D 20:43:15.743760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38623. [D 20:43:15.743775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38624. [D 20:43:15.743789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38625. [D 20:43:15.743804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38626. [D 20:43:15.743819] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38627. [D 20:43:15.748789] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38627. [D 20:43:15.748805] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 2/70. [D 20:43:15.752245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.752267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.752280] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.752320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6193 [D 20:43:15.752337] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:15.752354] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 3/70. [D 20:43:15.752388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.752402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.752414] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:15.752435] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6195 [D 20:43:15.752449] element 0: offset: 0x2aaaab027120, size: 24 [D 20:43:15.752465] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 4/70. [D 20:43:15.759781] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 38626. [D 20:43:15.759806] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 5/70. [D 20:43:15.759858] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.759879] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.759893] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:15.760014] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.760040] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.760054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.764084] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6193 [D 20:43:15.764168] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 6/70. [D 20:43:15.764313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38626. [D 20:43:15.764336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38627. [D 20:43:15.764351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38628. [D 20:43:15.764366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38629. [D 20:43:15.764380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38630. [D 20:43:15.764395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38631. [D 20:43:15.764410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38632. [D 20:43:15.764424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38633. [D 20:43:15.764439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38634. [D 20:43:15.764453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38635. [D 20:43:15.764469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38636. [D 20:43:15.764483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38637. [D 20:43:15.764498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38638. [D 20:43:15.764512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38639. [D 20:43:15.764527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38640. [D 20:43:15.764541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38641. [D 20:43:15.764556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38642. [D 20:43:15.764571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38643. [D 20:43:15.764585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38644. [D 20:43:15.764602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38645. [D 20:43:15.764616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38646. [D 20:43:15.764631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38647. [D 20:43:15.764645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38648. [D 20:43:15.764660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38649. [D 20:43:15.764675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38650. [D 20:43:15.764689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38651. [D 20:43:15.764704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38652. [D 20:43:15.764719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38653. [D 20:43:15.764733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38654. [D 20:43:15.764748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38655. [D 20:43:15.764762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38656. [D 20:43:15.764777] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38657. [D 20:43:15.766265] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6195 [D 20:43:15.766318] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 7/70. [D 20:43:15.772270] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 38657. [D 20:43:15.772295] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 8/70. [D 20:43:15.772381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.772404] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.772418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:15.773437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38657. [D 20:43:15.773457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38658. [D 20:43:15.773472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38659. [D 20:43:15.773487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38660. [D 20:43:15.773502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38661. [D 20:43:15.773516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38662. [D 20:43:15.773531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38663. [D 20:43:15.773546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38664. [D 20:43:15.773561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38665. [D 20:43:15.773576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38666. [D 20:43:15.773591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38667. [D 20:43:15.773606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38668. [D 20:43:15.773621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38669. [D 20:43:15.773636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38670. [D 20:43:15.773650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38671. [D 20:43:15.773665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38672. [D 20:43:15.773680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38673. [D 20:43:15.773694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38674. [D 20:43:15.773709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38675. [D 20:43:15.773723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38676. [D 20:43:15.773738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38677. [D 20:43:15.773753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38678. [D 20:43:15.773767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38679. [D 20:43:15.773782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38680. [D 20:43:15.773796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38681. [D 20:43:15.773811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38682. [D 20:43:15.773825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38683. [D 20:43:15.773840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38684. [D 20:43:15.773854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38685. [D 20:43:15.773869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38686. [D 20:43:15.773883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38687. [D 20:43:15.773898] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38688. [D 20:43:15.779739] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 38688. [D 20:43:15.779760] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 9/70. [D 20:43:15.779870] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.779890] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.779903] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:15.781684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.781702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.781715] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:15.781754] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6199 [D 20:43:15.781769] element 0: offset: 0x2aaaab001c00, size: 24 [D 20:43:15.781787] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 10/70. [D 20:43:15.781825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.781839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.781852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:15.781875] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6202 [D 20:43:15.781891] element 0: offset: 0x658610, size: 24 [D 20:43:15.781907] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 11/70. [D 20:43:15.788074] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6199 [D 20:43:15.788103] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 12/70. [D 20:43:15.788240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38688. [D 20:43:15.788259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38689. [D 20:43:15.788273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38690. [D 20:43:15.788288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38691. [D 20:43:15.788302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38692. [D 20:43:15.788317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38693. [D 20:43:15.788331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38694. [D 20:43:15.788345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38695. [D 20:43:15.788360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38696. [D 20:43:15.788374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38697. [D 20:43:15.788389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38698. [D 20:43:15.788403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38699. [D 20:43:15.788418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38700. [D 20:43:15.788432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38701. [D 20:43:15.788447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38702. [D 20:43:15.788461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38703. [D 20:43:15.788475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38704. [D 20:43:15.788490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38705. [D 20:43:15.788504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38706. [D 20:43:15.788519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38707. [D 20:43:15.788533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38708. [D 20:43:15.788548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38709. [D 20:43:15.788562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38710. [D 20:43:15.788576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38711. [D 20:43:15.788591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38712. [D 20:43:15.788605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38713. [D 20:43:15.788620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38714. [D 20:43:15.788635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38715. [D 20:43:15.788650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38716. [D 20:43:15.788665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38717. [D 20:43:15.788680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38718. [D 20:43:15.788694] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38719. [D 20:43:15.791673] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6202 [D 20:43:15.791691] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 13/70. [D 20:43:15.796988] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 38719. [D 20:43:15.797010] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 14/70. [D 20:43:15.797102] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.797169] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.797182] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:15.799670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38719. [D 20:43:15.799690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38720. [D 20:43:15.799704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38721. [D 20:43:15.799719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38722. [D 20:43:15.799734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38723. [D 20:43:15.799748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38724. [D 20:43:15.799763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38725. [D 20:43:15.799777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38726. [D 20:43:15.799792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38727. [D 20:43:15.799806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38728. [D 20:43:15.799821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38729. [D 20:43:15.799836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38730. [D 20:43:15.799850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38731. [D 20:43:15.799865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38732. [D 20:43:15.799879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38733. [D 20:43:15.799894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38734. [D 20:43:15.799908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38735. [D 20:43:15.799923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38736. [D 20:43:15.799938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38737. [D 20:43:15.799952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38738. [D 20:43:15.799968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38739. [D 20:43:15.799982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38740. [D 20:43:15.799996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38741. [D 20:43:15.800011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38742. [D 20:43:15.800026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38743. [D 20:43:15.800044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38744. [D 20:43:15.800059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38745. [D 20:43:15.800074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38746. [D 20:43:15.800088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38747. [D 20:43:15.800103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38748. [D 20:43:15.800117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38749. [D 20:43:15.800132] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38750. [D 20:43:15.808895] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.808916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.808929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:15.808972] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6205 [D 20:43:15.808987] element 0: offset: 0x65a860, size: 24 [D 20:43:15.809007] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 15/70. [D 20:43:15.809051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:15.809065] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.809078] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:15.809098] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6207 [D 20:43:15.809113] element 0: offset: 0x67edb0, size: 24 [D 20:43:15.809128] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 16/70. [D 20:43:15.811434] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 38750. [D 20:43:15.811459] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 17/70. [D 20:43:15.811586] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:15.811605] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:15.811618] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:15.816066] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6205 [D 20:43:15.816091] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 18/70. [D 20:43:15.816231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38750. [D 20:43:15.816249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38751. [D 20:43:15.816264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 38752. [D 20:43:15.816279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 38753. [D 20:43:15.816293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 38754. [D 20:43:15.816308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 38755. [D 20:43:15.817595] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6207 [D 20:43:16.076563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 38756. [D 20:43:16.076587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38757. [D 20:43:16.076602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38758. [D 20:43:16.076616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38759. [D 20:43:16.076631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 38760. [D 20:43:16.076645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 38761. [D 20:43:16.076659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 38762. [D 20:43:16.076674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 38763. [D 20:43:16.076688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 38764. [D 20:43:16.076702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38765. [D 20:43:16.076716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38766. [D 20:43:16.076731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38767. [D 20:43:16.076745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 38768. [D 20:43:16.076759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 38769. [D 20:43:16.076774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 38770. [D 20:43:16.076788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 38771. [D 20:43:16.076802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 38772. [D 20:43:16.076817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38773. [D 20:43:16.076830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38774. [D 20:43:16.076845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38775. [D 20:43:16.076859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 38776. [D 20:43:16.076873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 38777. [D 20:43:16.076888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 38778. [D 20:43:16.076902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 38779. [D 20:43:16.076916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 38780. [D 20:43:16.076930] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38781. [D 20:43:16.076957] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 19/70. [D 20:43:16.077030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.077098] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.077112] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.077159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6211 [D 20:43:16.077175] element 0: offset: 0x67ef10, size: 24 [D 20:43:16.077197] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 20/70. [D 20:43:16.077242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.077256] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.077269] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.077289] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6213 [D 20:43:16.077304] element 0: offset: 0x61e720, size: 24 [D 20:43:16.077319] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 21/70. [D 20:43:16.081519] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 38781. [D 20:43:16.081542] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 22/70. [D 20:43:16.081574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 38781. [D 20:43:16.081591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 38782. [D 20:43:16.081605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38783. [D 20:43:16.081620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38784. [D 20:43:16.081634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38785. [D 20:43:16.081651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38786. [D 20:43:16.081667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38787. [D 20:43:16.081681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38788. [D 20:43:16.081695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38789. [D 20:43:16.081710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38790. [D 20:43:16.081724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38791. [D 20:43:16.081739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38792. [D 20:43:16.081757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38793. [D 20:43:16.081773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38794. [D 20:43:16.081788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38795. [D 20:43:16.081802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38796. [D 20:43:16.081816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38797. [D 20:43:16.081831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38798. [D 20:43:16.081845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38799. [D 20:43:16.081860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38800. [D 20:43:16.081874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38801. [D 20:43:16.081888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38802. [D 20:43:16.081903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38803. [D 20:43:16.081917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38804. [D 20:43:16.081936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38805. [D 20:43:16.081952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38806. [D 20:43:16.081967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38807. [D 20:43:16.081981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38808. [D 20:43:16.081995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38809. [D 20:43:16.082019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38810. [D 20:43:16.082034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38811. [D 20:43:16.082048] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38812. [D 20:43:16.085159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.085176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.085189] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.087504] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 38812. [D 20:43:16.087564] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 23/70. [D 20:43:16.090555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.090572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.090585] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.094873] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6211 [D 20:43:16.094902] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 24/70. [D 20:43:16.094919] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6213 [D 20:43:16.094942] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 25/70. [D 20:43:16.094976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38812. [D 20:43:16.095041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 38813. [D 20:43:16.095056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 38814. [D 20:43:16.095070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 38815. [D 20:43:16.095084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 38816. [D 20:43:16.095103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 38817. [D 20:43:16.095119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38818. [D 20:43:16.095133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38819. [D 20:43:16.095147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38820. [D 20:43:16.095161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 38821. [D 20:43:16.095176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 38822. [D 20:43:16.095190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 38823. [D 20:43:16.095204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 38824. [D 20:43:16.095219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 38825. [D 20:43:16.095233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38826. [D 20:43:16.095247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38827. [D 20:43:16.095265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38828. [D 20:43:16.095280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38829. [D 20:43:16.095294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38830. [D 20:43:16.095309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38831. [D 20:43:16.095324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38832. [D 20:43:16.095338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38833. [D 20:43:16.095353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38834. [D 20:43:16.095367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38835. [D 20:43:16.095381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38836. [D 20:43:16.095395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38837. [D 20:43:16.095409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38838. [D 20:43:16.095424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38839. [D 20:43:16.095438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38840. [D 20:43:16.095452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38841. [D 20:43:16.095466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38842. [D 20:43:16.095485] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38843. [D 20:43:16.095505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 38844. [D 20:43:16.095519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 38845. [D 20:43:16.095537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 38846. [D 20:43:16.095558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 38847. [D 20:43:16.095573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 38848. [D 20:43:16.095587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 38849. [D 20:43:16.095600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 38850. [D 20:43:16.095615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 38851. [D 20:43:16.095629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 38852. [D 20:43:16.095643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 38853. [D 20:43:16.095659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 38854. [D 20:43:16.095673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 38855. [D 20:43:16.095690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 38856. [D 20:43:16.095704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 38857. [D 20:43:16.095718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 38858. [D 20:43:16.095732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 38859. [D 20:43:16.095746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 38860. [D 20:43:16.095760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 38861. [D 20:43:16.095774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 38862. [D 20:43:16.095788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 38863. [D 20:43:16.095802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 38864. [D 20:43:16.095817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 38865. [D 20:43:16.095831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 38866. [D 20:43:16.095845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 38867. [D 20:43:16.095859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 38868. [D 20:43:16.095873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 38869. [D 20:43:16.095887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 38870. [D 20:43:16.095901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 38871. [D 20:43:16.095915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 38872. [D 20:43:16.095929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 38873. [D 20:43:16.095943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 38874. [D 20:43:16.095957] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 38875. [D 20:43:16.100080] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.100105] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.100119] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.100163] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6216 [D 20:43:16.100178] element 0: offset: 0x5b0030, size: 24 [D 20:43:16.100195] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 26/70. [D 20:43:16.100916] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 38875. [D 20:43:16.100940] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 27/70. [D 20:43:16.111702] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 38874. [D 20:43:16.111730] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 28/70. [D 20:43:16.114636] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.114652] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.114666] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.114753] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.114769] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.114783] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:16.117713] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6216 [D 20:43:16.117735] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 29/70. [D 20:43:16.122240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 38874. [D 20:43:16.122258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 38875. [D 20:43:16.122273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 38876. [D 20:43:16.122287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 38877. [D 20:43:16.122302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 38878. [D 20:43:16.122317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 38879. [D 20:43:16.122332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 38880. [D 20:43:16.122346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38881. [D 20:43:16.122361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38882. [D 20:43:16.122376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38883. [D 20:43:16.122391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 38884. [D 20:43:16.122405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 38885. [D 20:43:16.122420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 38886. [D 20:43:16.122435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 38887. [D 20:43:16.122449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 38888. [D 20:43:16.122464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38889. [D 20:43:16.122479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38890. [D 20:43:16.122493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38891. [D 20:43:16.122508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 38892. [D 20:43:16.122523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 38893. [D 20:43:16.122537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 38894. [D 20:43:16.122552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 38895. [D 20:43:16.122567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 38896. [D 20:43:16.122582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38897. [D 20:43:16.122596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38898. [D 20:43:16.122611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38899. [D 20:43:16.122627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 38900. [D 20:43:16.122642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 38901. [D 20:43:16.122656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 38902. [D 20:43:16.122671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 38903. [D 20:43:16.122685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 38904. [D 20:43:16.122700] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38905. [D 20:43:16.128128] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 38905. [D 20:43:16.128145] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 30/70. [D 20:43:16.131185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.131203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.131217] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:16.131240] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6221 [D 20:43:16.131266] element 0: offset: 0x691fe0, size: 24 [D 20:43:16.131281] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 31/70. [D 20:43:16.131304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.131327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.131340] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.131361] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6222 [D 20:43:16.131376] element 0: offset: 0x620d10, size: 24 [D 20:43:16.131391] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 32/70. [D 20:43:16.131413] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.131427] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.131441] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.134770] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6221 [D 20:43:16.134848] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 33/70. [D 20:43:16.135136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38905. [D 20:43:16.135175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 38906. [D 20:43:16.135204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 38907. [D 20:43:16.135229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 38908. [D 20:43:16.135244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 38909. [D 20:43:16.135271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 38910. [D 20:43:16.135286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38911. [D 20:43:16.135315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38912. [D 20:43:16.135342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38913. [D 20:43:16.135357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 38914. [D 20:43:16.135382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 38915. [D 20:43:16.135397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 38916. [D 20:43:16.135426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 38917. [D 20:43:16.135452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 38918. [D 20:43:16.135467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38919. [D 20:43:16.135495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38920. [D 20:43:16.135510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38921. [D 20:43:16.135535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 38922. [D 20:43:16.135561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 38923. [D 20:43:16.135577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 38924. [D 20:43:16.135602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 38925. [D 20:43:16.135625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 38926. [D 20:43:16.135640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38927. [D 20:43:16.135655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38928. [D 20:43:16.135670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38929. [D 20:43:16.135684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 38930. [D 20:43:16.135699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 38931. [D 20:43:16.135714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 38932. [D 20:43:16.135729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 38933. [D 20:43:16.135744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 38934. [D 20:43:16.135758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38935. [D 20:43:16.135773] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38936. [D 20:43:16.137980] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6222 [D 20:43:16.138055] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 34/70. [D 20:43:16.146906] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 38936. [D 20:43:16.146932] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 35/70. [D 20:43:16.146952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38936. [D 20:43:16.146968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38937. [D 20:43:16.146982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 38938. [D 20:43:16.146997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 38939. [D 20:43:16.147012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 38940. [D 20:43:16.147027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 38941. [D 20:43:16.147041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 38942. [D 20:43:16.147058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38943. [D 20:43:16.147072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38944. [D 20:43:16.147087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38945. [D 20:43:16.147102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 38946. [D 20:43:16.147117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 38947. [D 20:43:16.147132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 38948. [D 20:43:16.147146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 38949. [D 20:43:16.147161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 38950. [D 20:43:16.147176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38951. [D 20:43:16.147191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38952. [D 20:43:16.147206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38953. [D 20:43:16.147221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38954. [D 20:43:16.147235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38955. [D 20:43:16.147250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38956. [D 20:43:16.147265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38957. [D 20:43:16.147280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38958. [D 20:43:16.147295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38959. [D 20:43:16.147313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38960. [D 20:43:16.147327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38961. [D 20:43:16.147342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38962. [D 20:43:16.147357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38963. [D 20:43:16.147371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38964. [D 20:43:16.147386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38965. [D 20:43:16.147401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38966. [D 20:43:16.147416] openib_post_sr_rdmaw: ibv_post_send wr_id 630060 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38967. [D 20:43:16.147489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.147512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.147526] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:16.158034] openib_check_cq: completed rdma wr_id 630060, nic_wr_credit 38967. [D 20:43:16.158059] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 36/70. [D 20:43:16.158120] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.158140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.158154] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:16.171562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.171582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.171596] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:16.171635] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6227 [D 20:43:16.171650] element 0: offset: 0x5b0030, size: 24 [D 20:43:16.171667] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 37/70. [D 20:43:16.171707] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.171721] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.171734] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:16.171754] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6228 [D 20:43:16.171769] element 0: offset: 0x61fa30, size: 24 [D 20:43:16.171784] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 38/70. [D 20:43:16.175164] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6227 [D 20:43:16.175243] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 39/70. [D 20:43:16.175303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 38967. [D 20:43:16.175333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 38968. [D 20:43:16.175348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 38969. [D 20:43:16.175362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 38970. [D 20:43:16.175377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 38971. [D 20:43:16.175392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 38972. [D 20:43:16.175407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38973. [D 20:43:16.175421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38974. [D 20:43:16.175436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38975. [D 20:43:16.175451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 38976. [D 20:43:16.175466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 38977. [D 20:43:16.175480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 38978. [D 20:43:16.175495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 38979. [D 20:43:16.175510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 38980. [D 20:43:16.175525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38981. [D 20:43:16.175540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38982. [D 20:43:16.175554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38983. [D 20:43:16.175569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 38984. [D 20:43:16.175584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 38985. [D 20:43:16.175598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 38986. [D 20:43:16.175614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 38987. [D 20:43:16.175629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 38988. [D 20:43:16.175643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38989. [D 20:43:16.175658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38990. [D 20:43:16.175673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38991. [D 20:43:16.175688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 38992. [D 20:43:16.175703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 38993. [D 20:43:16.175717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 38994. [D 20:43:16.175732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 38995. [D 20:43:16.175747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 38996. [D 20:43:16.175762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38997. [D 20:43:16.175776] openib_post_sr_rdmaw: ibv_post_send wr_id 62ff30 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38998. [D 20:43:16.178424] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6228 [D 20:43:16.178496] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 40/70. [D 20:43:16.183551] openib_check_cq: completed rdma wr_id 62ff30, nic_wr_credit 38998. [D 20:43:16.183578] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 41/70. [D 20:43:16.183601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38998. [D 20:43:16.183617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38999. [D 20:43:16.183631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39000. [D 20:43:16.183646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39001. [D 20:43:16.183661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39002. [D 20:43:16.183676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39003. [D 20:43:16.183691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39004. [D 20:43:16.183705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39005. [D 20:43:16.183720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39006. [D 20:43:16.183735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39007. [D 20:43:16.183750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39008. [D 20:43:16.183764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39009. [D 20:43:16.183779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39010. [D 20:43:16.183794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39011. [D 20:43:16.183808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39012. [D 20:43:16.183823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39013. [D 20:43:16.183839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39014. [D 20:43:16.183854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39015. [D 20:43:16.183869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39016. [D 20:43:16.183883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39017. [D 20:43:16.183898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39018. [D 20:43:16.183913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39019. [D 20:43:16.183928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39020. [D 20:43:16.183943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39021. [D 20:43:16.183958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39022. [D 20:43:16.183972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39023. [D 20:43:16.183987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39024. [D 20:43:16.184002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39025. [D 20:43:16.184017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39026. [D 20:43:16.184032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39027. [D 20:43:16.184051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39028. [D 20:43:16.184067] openib_post_sr_rdmaw: ibv_post_send wr_id 67ee80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39029. [D 20:43:16.184150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.184172] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.184185] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:16.195281] openib_check_cq: completed rdma wr_id 67ee80, nic_wr_credit 39029. [D 20:43:16.195307] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 42/70. [D 20:43:16.195423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.195443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.195456] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:16.204894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.204911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.204924] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:16.204964] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6232 [D 20:43:16.204979] element 0: offset: 0x2aaaab617a30, size: 24 [D 20:43:16.205000] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 43/70. [D 20:43:16.207507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.207564] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.207578] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:16.207618] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6234 [D 20:43:16.207633] element 0: offset: 0x2aaaab635b80, size: 24 [D 20:43:16.207652] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 44/70. [D 20:43:16.210952] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6234 [D 20:43:16.211025] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 45/70. [D 20:43:16.211082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39029. [D 20:43:16.211108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39030. [D 20:43:16.211124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39031. [D 20:43:16.211139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39032. [D 20:43:16.211154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39033. [D 20:43:16.211169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39034. [D 20:43:16.211184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39035. [D 20:43:16.211199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39036. [D 20:43:16.211213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39037. [D 20:43:16.211228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39038. [D 20:43:16.211244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39039. [D 20:43:16.211258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39040. [D 20:43:16.211273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39041. [D 20:43:16.211288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39042. [D 20:43:16.211303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39043. [D 20:43:16.211321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39044. [D 20:43:16.211336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39045. [D 20:43:16.211351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39046. [D 20:43:16.211366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39047. [D 20:43:16.211380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39048. [D 20:43:16.211395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39049. [D 20:43:16.211410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39050. [D 20:43:16.211425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39051. [D 20:43:16.211440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39052. [D 20:43:16.211440] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6232 [D 20:43:16.211464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39053. [D 20:43:16.211494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39054. [D 20:43:16.211509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39055. [D 20:43:16.211523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39056. [D 20:43:16.211538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39057. [D 20:43:16.211554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39058. [D 20:43:16.211569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39059. [D 20:43:16.211583] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39060. [D 20:43:16.211610] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 46/70. [D 20:43:16.219920] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.219940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.219953] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.219994] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6237 [D 20:43:16.220009] element 0: offset: 0x2aaaab60d1a0, size: 24 [D 20:43:16.220028] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 47/70. [D 20:43:16.222005] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39060. [D 20:43:16.222029] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 48/70. [D 20:43:16.222064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39060. [D 20:43:16.222089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39061. [D 20:43:16.222105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39062. [D 20:43:16.222120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39063. [D 20:43:16.222135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39064. [D 20:43:16.222150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39065. [D 20:43:16.222165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39066. [D 20:43:16.222180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39067. [D 20:43:16.222194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39068. [D 20:43:16.222209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39069. [D 20:43:16.222224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39070. [D 20:43:16.222239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39071. [D 20:43:16.222254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39072. [D 20:43:16.222268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39073. [D 20:43:16.222283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39074. [D 20:43:16.222298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39075. [D 20:43:16.222313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39076. [D 20:43:16.222337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39077. [D 20:43:16.222353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39078. [D 20:43:16.222367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39079. [D 20:43:16.222382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39080. [D 20:43:16.222411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39081. [D 20:43:16.222434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39082. [D 20:43:16.222449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39083. [D 20:43:16.222464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39084. [D 20:43:16.222479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39085. [D 20:43:16.222494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39086. [D 20:43:16.222509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39087. [D 20:43:16.222523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39088. [D 20:43:16.222538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39089. [D 20:43:16.222553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39090. [D 20:43:16.222568] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39091. [D 20:43:16.222635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.222667] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.222680] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.225273] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6237 [D 20:43:16.225335] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 49/70. [D 20:43:16.233716] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39091. [D 20:43:16.233742] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 50/70. [D 20:43:16.233762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39091. [D 20:43:16.233777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39092. [D 20:43:16.233792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39093. [D 20:43:16.233807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39094. [D 20:43:16.233822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39095. [D 20:43:16.233837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39096. [D 20:43:16.233851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39097. [D 20:43:16.233866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39098. [D 20:43:16.233881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39099. [D 20:43:16.233896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39100. [D 20:43:16.233910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39101. [D 20:43:16.233925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39102. [D 20:43:16.233940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39103. [D 20:43:16.233955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39104. [D 20:43:16.233970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39105. [D 20:43:16.233985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39106. [D 20:43:16.234000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39107. [D 20:43:16.234015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39108. [D 20:43:16.234029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39109. [D 20:43:16.234044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39110. [D 20:43:16.234059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39111. [D 20:43:16.234074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39112. [D 20:43:16.234088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39113. [D 20:43:16.234103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39114. [D 20:43:16.234118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39115. [D 20:43:16.234133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39116. [D 20:43:16.234147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39117. [D 20:43:16.234162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39118. [D 20:43:16.234177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39119. [D 20:43:16.234191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39120. [D 20:43:16.234206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39121. [D 20:43:16.234221] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39122. [D 20:43:16.234287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.234309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.234322] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:16.240919] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39122. [D 20:43:16.240944] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 51/70. [D 20:43:16.241054] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.241074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.241088] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:16.252226] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.252243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.252260] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:16.252299] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6242 [D 20:43:16.252314] element 0: offset: 0x2aaaab614ff0, size: 24 [D 20:43:16.252331] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 52/70. [D 20:43:16.252371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.252385] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.252398] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:16.252419] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6243 [D 20:43:16.252433] element 0: offset: 0x2aaaab60d1a0, size: 24 [D 20:43:16.252449] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 53/70. [D 20:43:16.254901] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.254959] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.254973] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.255012] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6246 [D 20:43:16.255027] element 0: offset: 0x2aaaab617a30, size: 24 [D 20:43:16.255047] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 54/70. [D 20:43:16.258896] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6242 [D 20:43:16.258982] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 55/70. [D 20:43:16.259063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39122. [D 20:43:16.259064] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6243 [D 20:43:16.259155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39123. [D 20:43:16.259176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39124. [D 20:43:16.259191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39125. [D 20:43:16.259206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39126. [D 20:43:16.259221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39127. [D 20:43:16.259236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39128. [D 20:43:16.259251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39129. [D 20:43:16.259266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39130. [D 20:43:16.259281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39131. [D 20:43:16.259296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39132. [D 20:43:16.259311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39133. [D 20:43:16.259330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39134. [D 20:43:16.259345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39135. [D 20:43:16.259360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39136. [D 20:43:16.259375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39137. [D 20:43:16.259390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39138. [D 20:43:16.259404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39139. [D 20:43:16.259419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39140. [D 20:43:16.259434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39141. [D 20:43:16.259449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39142. [D 20:43:16.259464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39143. [D 20:43:16.259479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39144. [D 20:43:16.259494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39145. [D 20:43:16.259515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39146. [D 20:43:16.259530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39147. [D 20:43:16.259545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39148. [D 20:43:16.259560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39149. [D 20:43:16.259574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39150. [D 20:43:16.259589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39151. [D 20:43:16.259603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39152. [D 20:43:16.259618] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39153. [D 20:43:16.259645] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 56/70. [D 20:43:16.265361] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39153. [D 20:43:16.265437] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 57/70. [D 20:43:16.265459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39153. [D 20:43:16.265475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39154. [D 20:43:16.265490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39155. [D 20:43:16.265505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39156. [D 20:43:16.265520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39157. [D 20:43:16.265534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39158. [D 20:43:16.265549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39159. [D 20:43:16.265563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39160. [D 20:43:16.265578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39161. [D 20:43:16.265592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39162. [D 20:43:16.265607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39163. [D 20:43:16.265621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39164. [D 20:43:16.265635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39165. [D 20:43:16.265650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39166. [D 20:43:16.265664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39167. [D 20:43:16.265679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39168. [D 20:43:16.265693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39169. [D 20:43:16.265708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39170. [D 20:43:16.265722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39171. [D 20:43:16.531831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39172. [D 20:43:16.531869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39173. [D 20:43:16.531896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39174. [D 20:43:16.531912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39175. [D 20:43:16.531927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39176. [D 20:43:16.266262] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6246 [D 20:43:16.531958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39177. [D 20:43:16.532521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39178. [D 20:43:16.532539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39179. [D 20:43:16.532554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39180. [D 20:43:16.532569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39181. [D 20:43:16.532583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39182. [D 20:43:16.532598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39183. [D 20:43:16.532613] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39184. [D 20:43:16.532898] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 58/70. [D 20:43:16.532973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.532990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.533003] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.533034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.533048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.533061] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.533100] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6249 [D 20:43:16.533115] element 0: offset: 0x2aaaab6355c0, size: 24 [D 20:43:16.533132] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 59/70. [D 20:43:16.533163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.533178] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.533190] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.533211] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6253 [D 20:43:16.533225] element 0: offset: 0x2aaaab60db10, size: 24 [D 20:43:16.533240] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 60/70. [D 20:43:16.534393] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39184. [D 20:43:16.534420] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 0/70. [D 20:43:16.534476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39184. [D 20:43:16.534492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39185. [D 20:43:16.534507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39186. [D 20:43:16.534522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39187. [D 20:43:16.534536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39188. [D 20:43:16.534553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39189. [D 20:43:16.534562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.534588] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.534601] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.534569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39190. [D 20:43:16.534646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39191. [D 20:43:16.534662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39192. [D 20:43:16.534676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39193. [D 20:43:16.534691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39194. [D 20:43:16.534709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39195. [D 20:43:16.534724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39196. [D 20:43:16.534739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39197. [D 20:43:16.534753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39198. [D 20:43:16.534768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39199. [D 20:43:16.534783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39200. [D 20:43:16.534798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39201. [D 20:43:16.534812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39202. [D 20:43:16.534827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39203. [D 20:43:16.534841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39204. [D 20:43:16.534856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39205. [D 20:43:16.534871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39206. [D 20:43:16.534886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39207. [D 20:43:16.534900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39208. [D 20:43:16.534915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39209. [D 20:43:16.534930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39210. [D 20:43:16.534945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39211. [D 20:43:16.534959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39212. [D 20:43:16.534974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39213. [D 20:43:16.534988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39214. [D 20:43:16.535003] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39215. [D 20:43:16.538878] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6249 [D 20:43:16.538955] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 1/70. [D 20:43:16.540441] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39215. [D 20:43:16.540642] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 2/70. [D 20:43:16.540667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 39215. [D 20:43:16.540684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 39216. [D 20:43:16.540703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 39217. [D 20:43:16.540721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 39218. [D 20:43:16.540736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 39219. [D 20:43:16.540751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 39220. [D 20:43:16.540765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 39221. [D 20:43:16.540785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 39222. [D 20:43:16.540800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 39223. [D 20:43:16.540814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 39224. [D 20:43:16.540829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 39225. [D 20:43:16.540843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 39226. [D 20:43:16.540858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 39227. [D 20:43:16.540872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 39228. [D 20:43:16.540886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 39229. [D 20:43:16.540901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 39230. [D 20:43:16.540915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 39231. [D 20:43:16.540930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 39232. [D 20:43:16.540944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 39233. [D 20:43:16.540962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 39234. [D 20:43:16.540977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 39235. [D 20:43:16.540991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 39236. [D 20:43:16.541031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 39237. [D 20:43:16.541046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 39238. [D 20:43:16.541060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 39239. [D 20:43:16.541075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 39240. [D 20:43:16.541089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 39241. [D 20:43:16.541104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 39242. [D 20:43:16.541119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 39243. [D 20:43:16.541133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 39244. [D 20:43:16.541148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 39245. [D 20:43:16.541162] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 39246. [D 20:43:16.541279] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.541303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.541316] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.546599] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39246. [D 20:43:16.546696] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 3/70. [D 20:43:16.546808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.546832] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.546845] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.546884] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6255 [D 20:43:16.546899] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:16.546917] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 4/70. [D 20:43:16.546955] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.546969] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.546982] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.550521] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6253 [D 20:43:16.550603] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 5/70. [D 20:43:16.552247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39246. [D 20:43:16.552274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39247. [D 20:43:16.552289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39248. [D 20:43:16.552319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39249. [D 20:43:16.552334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39250. [D 20:43:16.552349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39251. [D 20:43:16.552364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39252. [D 20:43:16.552378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39253. [D 20:43:16.552393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39254. [D 20:43:16.552407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39255. [D 20:43:16.552422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39256. [D 20:43:16.552436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39257. [D 20:43:16.552450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39258. [D 20:43:16.552465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39259. [D 20:43:16.552480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39260. [D 20:43:16.552494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39261. [D 20:43:16.552517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39262. [D 20:43:16.552533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39263. [D 20:43:16.552557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39264. [D 20:43:16.552606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39265. [D 20:43:16.552620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39266. [D 20:43:16.552651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39267. [D 20:43:16.552705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39268. [D 20:43:16.552725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39269. [D 20:43:16.552740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39270. [D 20:43:16.552755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39271. [D 20:43:16.552793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39272. [D 20:43:16.552819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39273. [D 20:43:16.552835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39274. [D 20:43:16.552861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39275. [D 20:43:16.552876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39276. [D 20:43:16.552891] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39277. [D 20:43:16.552985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.553017] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.553031] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.553074] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6258 [D 20:43:16.553089] element 0: offset: 0x2aaaab001c00, size: 24 [D 20:43:16.553108] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 6/70. [D 20:43:16.558600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.558627] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.558641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.558700] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6261 [D 20:43:16.558716] element 0: offset: 0x2aaaab027120, size: 24 [D 20:43:16.558735] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 7/70. [D 20:43:16.559787] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6255 [D 20:43:16.559816] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 8/70. [D 20:43:16.563792] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39277. [D 20:43:16.563818] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 9/70. [D 20:43:16.563905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39277. [D 20:43:16.563921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39278. [D 20:43:16.563936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39279. [D 20:43:16.563951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39280. [D 20:43:16.563966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39281. [D 20:43:16.563981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39282. [D 20:43:16.563995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39283. [D 20:43:16.564010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39284. [D 20:43:16.564025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39285. [D 20:43:16.564058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39286. [D 20:43:16.564082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39287. [D 20:43:16.564097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39288. [D 20:43:16.564112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39289. [D 20:43:16.564126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39290. [D 20:43:16.564144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39291. [D 20:43:16.564159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39292. [D 20:43:16.564179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39293. [D 20:43:16.564194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39294. [D 20:43:16.564209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39295. [D 20:43:16.564223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39296. [D 20:43:16.564239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39297. [D 20:43:16.564254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39298. [D 20:43:16.564268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39299. [D 20:43:16.564283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39300. [D 20:43:16.564298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39301. [D 20:43:16.564313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39302. [D 20:43:16.564328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39303. [D 20:43:16.564342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39304. [D 20:43:16.564357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39305. [D 20:43:16.564372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39306. [D 20:43:16.564387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39307. [D 20:43:16.564402] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39308. [D 20:43:16.564468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.564492] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.564505] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.570010] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39308. [D 20:43:16.570035] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 10/70. [D 20:43:16.570188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.570249] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.570263] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.570584] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6258 [D 20:43:16.570610] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 11/70. [D 20:43:16.570690] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6261 [D 20:43:16.570707] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 12/70. [D 20:43:16.575499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39308. [D 20:43:16.575525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39309. [D 20:43:16.575540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39310. [D 20:43:16.575555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39311. [D 20:43:16.575569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39312. [D 20:43:16.575583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39313. [D 20:43:16.575598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39314. [D 20:43:16.575612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39315. [D 20:43:16.575626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39316. [D 20:43:16.575641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39317. [D 20:43:16.575655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39318. [D 20:43:16.575670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39319. [D 20:43:16.575684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39320. [D 20:43:16.575698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39321. [D 20:43:16.575712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39322. [D 20:43:16.575727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39323. [D 20:43:16.575741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39324. [D 20:43:16.575756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39325. [D 20:43:16.575770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39326. [D 20:43:16.575784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39327. [D 20:43:16.575799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39328. [D 20:43:16.575813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39329. [D 20:43:16.575829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39330. [D 20:43:16.575844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39331. [D 20:43:16.575858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39332. [D 20:43:16.575872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39333. [D 20:43:16.575887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39334. [D 20:43:16.575902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39335. [D 20:43:16.575916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39336. [D 20:43:16.575931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39337. [D 20:43:16.575945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39338. [D 20:43:16.575959] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39339. [D 20:43:16.575987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 39340. [D 20:43:16.576010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 39341. [D 20:43:16.576025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 39342. [D 20:43:16.576040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 39343. [D 20:43:16.576060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 39344. [D 20:43:16.576075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 39345. [D 20:43:16.576090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 39346. [D 20:43:16.576104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 39347. [D 20:43:16.576119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 39348. [D 20:43:16.576133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 39349. [D 20:43:16.576152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 39350. [D 20:43:16.576167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 39351. [D 20:43:16.576182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 39352. [D 20:43:16.576196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 39353. [D 20:43:16.576210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 39354. [D 20:43:16.576225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 39355. [D 20:43:16.576239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 39356. [D 20:43:16.576254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 39357. [D 20:43:16.576268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 39358. [D 20:43:16.576284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 39359. [D 20:43:16.576298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 39360. [D 20:43:16.576313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 39361. [D 20:43:16.576327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 39362. [D 20:43:16.576341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 39363. [D 20:43:16.576356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 39364. [D 20:43:16.576370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 39365. [D 20:43:16.576385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 39366. [D 20:43:16.576399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 39367. [D 20:43:16.576413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 39368. [D 20:43:16.576428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 39369. [D 20:43:16.576442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 39370. [D 20:43:16.576456] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 39371. [D 20:43:16.576513] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.576537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.576550] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.576590] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6265 [D 20:43:16.576606] element 0: offset: 0x2aaaab025c60, size: 24 [D 20:43:16.576624] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 13/70. [D 20:43:16.578367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.578385] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.578398] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.578421] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6267 [D 20:43:16.578435] element 0: offset: 0x2aaaab001eb0, size: 24 [D 20:43:16.578452] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 14/70. [D 20:43:16.587233] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39371. [D 20:43:16.587257] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 15/70. [D 20:43:16.593612] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39370. [D 20:43:16.593634] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 16/70. [D 20:43:16.593698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.593719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.593733] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.593847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.593862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.593874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.600138] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6265 [D 20:43:16.600215] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 17/70. [D 20:43:16.600447] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6267 [D 20:43:16.600466] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 18/70. [D 20:43:16.605137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 39370. [D 20:43:16.605163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39371. [D 20:43:16.605179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39372. [D 20:43:16.605194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39373. [D 20:43:16.605208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39374. [D 20:43:16.605234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39375. [D 20:43:16.605261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39376. [D 20:43:16.605277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39377. [D 20:43:16.605291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39378. [D 20:43:16.605306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39379. [D 20:43:16.605321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39380. [D 20:43:16.605340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39381. [D 20:43:16.605355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39382. [D 20:43:16.605370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39383. [D 20:43:16.605385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39384. [D 20:43:16.605399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39385. [D 20:43:16.605414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39386. [D 20:43:16.605429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39387. [D 20:43:16.605444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39388. [D 20:43:16.605459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39389. [D 20:43:16.605473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39390. [D 20:43:16.605488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39391. [D 20:43:16.605503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39392. [D 20:43:16.605518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39393. [D 20:43:16.605533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39394. [D 20:43:16.605548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39395. [D 20:43:16.605562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39396. [D 20:43:16.605577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39397. [D 20:43:16.605592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39398. [D 20:43:16.605607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39399. [D 20:43:16.605622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39400. [D 20:43:16.605637] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39401. [D 20:43:16.605653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39402. [D 20:43:16.605668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39403. [D 20:43:16.605683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39404. [D 20:43:16.605698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39405. [D 20:43:16.605712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39406. [D 20:43:16.605726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39407. [D 20:43:16.605741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39408. [D 20:43:16.605755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39409. [D 20:43:16.605770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39410. [D 20:43:16.605784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39411. [D 20:43:16.605799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39412. [D 20:43:16.605813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39413. [D 20:43:16.605828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39414. [D 20:43:16.605842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39415. [D 20:43:16.605857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39416. [D 20:43:16.605871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39417. [D 20:43:16.605886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39418. [D 20:43:16.605900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39419. [D 20:43:16.605915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39420. [D 20:43:16.605929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39421. [D 20:43:16.605944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39422. [D 20:43:16.605958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39423. [D 20:43:16.605973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39424. [D 20:43:16.605987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39425. [D 20:43:16.606002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39426. [D 20:43:16.606016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39427. [D 20:43:16.606031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39428. [D 20:43:16.606046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39429. [D 20:43:16.606061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39430. [D 20:43:16.606075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39431. [D 20:43:16.606090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39432. [D 20:43:16.606105] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39433. [D 20:43:16.607817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.607841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.607854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.607898] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6271 [D 20:43:16.607913] element 0: offset: 0x2aaaab030960, size: 24 [D 20:43:16.607930] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 19/70. [D 20:43:16.607970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.607984] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.608001] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.608023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6273 [D 20:43:16.608041] element 0: offset: 0x2aaaab014bd0, size: 24 [D 20:43:16.608056] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 20/70. [D 20:43:16.611030] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39433. [D 20:43:16.611057] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 21/70. [D 20:43:16.618797] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39432. [D 20:43:16.618818] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 22/70. [D 20:43:16.618877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.618898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.618912] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.619028] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.619043] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.619056] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.622102] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6271 [D 20:43:16.622177] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 23/70. [D 20:43:16.626861] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6273 [D 20:43:16.626940] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 24/70. [D 20:43:16.629974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39432. [D 20:43:16.629999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39433. [D 20:43:16.630013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39434. [D 20:43:16.630028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39435. [D 20:43:16.630043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39436. [D 20:43:16.630057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39437. [D 20:43:16.630072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39438. [D 20:43:16.630087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39439. [D 20:43:16.630101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39440. [D 20:43:16.630118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39441. [D 20:43:16.630133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39442. [D 20:43:16.630148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39443. [D 20:43:16.630162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39444. [D 20:43:16.630177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39445. [D 20:43:16.630191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39446. [D 20:43:16.630206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39447. [D 20:43:16.630221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39448. [D 20:43:16.630235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39449. [D 20:43:16.630250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39450. [D 20:43:16.630264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39451. [D 20:43:16.630279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39452. [D 20:43:16.630293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39453. [D 20:43:16.630308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39454. [D 20:43:16.630322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39455. [D 20:43:16.630337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39456. [D 20:43:16.630352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39457. [D 20:43:16.630366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39458. [D 20:43:16.630381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39459. [D 20:43:16.630396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39460. [D 20:43:16.630410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39461. [D 20:43:16.630425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39462. [D 20:43:16.630439] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39463. [D 20:43:16.630456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 39464. [D 20:43:16.630471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 39465. [D 20:43:16.630486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 39466. [D 20:43:16.630500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 39467. [D 20:43:16.630515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 39468. [D 20:43:16.630530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 39469. [D 20:43:16.630545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 39470. [D 20:43:16.630560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 39471. [D 20:43:16.630574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 39472. [D 20:43:16.630589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 39473. [D 20:43:16.630604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 39474. [D 20:43:16.630619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 39475. [D 20:43:16.630633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 39476. [D 20:43:16.630647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 39477. [D 20:43:16.630662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 39478. [D 20:43:16.630676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 39479. [D 20:43:16.630691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 39480. [D 20:43:16.630705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 39481. [D 20:43:16.630720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 39482. [D 20:43:16.630734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 39483. [D 20:43:16.630749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 39484. [D 20:43:16.630763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 39485. [D 20:43:16.630778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 39486. [D 20:43:16.630792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 39487. [D 20:43:16.630806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 39488. [D 20:43:16.630821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 39489. [D 20:43:16.630835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 39490. [D 20:43:16.630850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 39491. [D 20:43:16.630864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 39492. [D 20:43:16.630879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 39493. [D 20:43:16.630893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 39494. [D 20:43:16.630907] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 39495. [D 20:43:16.632801] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.632826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.632840] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.632882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6278 [D 20:43:16.632897] element 0: offset: 0x2aaaab038c20, size: 24 [D 20:43:16.632917] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 25/70. [D 20:43:16.632962] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.632976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.632989] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.633010] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6279 [D 20:43:16.633024] element 0: offset: 0x2aaaab027000, size: 24 [D 20:43:16.633040] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 26/70. [D 20:43:16.635866] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39495. [D 20:43:16.635889] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 27/70. [D 20:43:16.642805] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39494. [D 20:43:16.642828] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 28/70. [D 20:43:16.642894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.642915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.642929] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.643047] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.643062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.643075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:16.648088] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6278 [D 20:43:16.648115] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 29/70. [D 20:43:16.651363] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6279 [D 20:43:16.651387] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 30/70. [D 20:43:16.654212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 39494. [D 20:43:16.654230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39495. [D 20:43:16.654245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39496. [D 20:43:16.654259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39497. [D 20:43:16.654274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39498. [D 20:43:16.654469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39499. [D 20:43:16.654498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39500. [D 20:43:16.654513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39501. [D 20:43:16.654540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39502. [D 20:43:16.654555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39503. [D 20:43:16.654579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39504. [D 20:43:16.654593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39505. [D 20:43:16.654620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39506. [D 20:43:16.654635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39507. [D 20:43:16.654659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39508. [D 20:43:16.654685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39509. [D 20:43:16.654700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39510. [D 20:43:16.654716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39511. [D 20:43:16.654731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39512. [D 20:43:16.654745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39513. [D 20:43:16.654763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39514. [D 20:43:16.654778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39515. [D 20:43:16.654793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39516. [D 20:43:16.654807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39517. [D 20:43:16.654821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39518. [D 20:43:16.654836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39519. [D 20:43:16.654850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39520. [D 20:43:16.654865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39521. [D 20:43:16.654879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39522. [D 20:43:16.654894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39523. [D 20:43:16.654908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39524. [D 20:43:16.654922] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39525. [D 20:43:16.654939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39526. [D 20:43:16.654954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39527. [D 20:43:16.654968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39528. [D 20:43:16.654982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39529. [D 20:43:16.654997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39530. [D 20:43:16.655011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39531. [D 20:43:16.655026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39532. [D 20:43:16.655040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39533. [D 20:43:16.655054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39534. [D 20:43:16.655069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39535. [D 20:43:16.655083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39536. [D 20:43:16.655098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39537. [D 20:43:16.655112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39538. [D 20:43:16.655127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39539. [D 20:43:16.987273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39540. [D 20:43:16.987316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39541. [D 20:43:16.987788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39542. [D 20:43:16.987816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39543. [D 20:43:16.987831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39544. [D 20:43:16.987857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39545. [D 20:43:16.987881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39546. [D 20:43:16.987905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39547. [D 20:43:16.987920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39548. [D 20:43:16.987935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39549. [D 20:43:16.987949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39550. [D 20:43:16.987974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39551. [D 20:43:16.987989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39552. [D 20:43:16.988004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39553. [D 20:43:16.988028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39554. [D 20:43:16.988043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39555. [D 20:43:16.988073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39556. [D 20:43:16.988144] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39557. [D 20:43:16.988192] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39557. [D 20:43:16.988208] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 31/70. [D 20:43:16.991194] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39556. [D 20:43:16.991215] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 32/70. [D 20:43:16.997371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.997393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.997408] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:16.997451] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6283 [D 20:43:16.997467] element 0: offset: 0x2aaaab027120, size: 24 [D 20:43:16.997482] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 33/70. [D 20:43:16.997522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:16.997536] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.997549] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:16.997570] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6285 [D 20:43:16.997584] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:16.997599] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 34/70. [D 20:43:16.997634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.997649] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.997662] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:16.997684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:16.997698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:16.997711] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.006775] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6283 [D 20:43:17.006853] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 35/70. [D 20:43:17.006945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39556. [D 20:43:17.006966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39557. [D 20:43:17.006981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39558. [D 20:43:17.006996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39559. [D 20:43:17.007010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39560. [D 20:43:17.007025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39561. [D 20:43:17.007039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39562. [D 20:43:17.007054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39563. [D 20:43:17.007068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39564. [D 20:43:17.007083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39565. [D 20:43:17.007097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39566. [D 20:43:17.007112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39567. [D 20:43:17.007126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39568. [D 20:43:17.007141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39569. [D 20:43:17.007155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39570. [D 20:43:17.007169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39571. [D 20:43:17.007184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39572. [D 20:43:17.007198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39573. [D 20:43:17.007213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39574. [D 20:43:17.007227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39575. [D 20:43:17.007242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39576. [D 20:43:17.007256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39577. [D 20:43:17.007271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39578. [D 20:43:17.007285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39579. [D 20:43:17.007300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39580. [D 20:43:17.007314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39581. [D 20:43:17.007329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39582. [D 20:43:17.007343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39583. [D 20:43:17.007364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39584. [D 20:43:17.007380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39585. [D 20:43:17.007395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39586. [D 20:43:17.007409] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39587. [D 20:43:17.008108] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6285 [D 20:43:17.008178] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 36/70. [D 20:43:17.012846] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39587. [D 20:43:17.012869] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 37/70. [D 20:43:17.012885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 39587. [D 20:43:17.012900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 39588. [D 20:43:17.012915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 39589. [D 20:43:17.012929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 39590. [D 20:43:17.012944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 39591. [D 20:43:17.012958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 39592. [D 20:43:17.012973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 39593. [D 20:43:17.012987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 39594. [D 20:43:17.013002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 39595. [D 20:43:17.013016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 39596. [D 20:43:17.013031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 39597. [D 20:43:17.013045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 39598. [D 20:43:17.013060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 39599. [D 20:43:17.013074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 39600. [D 20:43:17.013089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 39601. [D 20:43:17.013103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 39602. [D 20:43:17.013118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 39603. [D 20:43:17.013132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 39604. [D 20:43:17.013147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 39605. [D 20:43:17.013161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 39606. [D 20:43:17.013176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 39607. [D 20:43:17.013190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 39608. [D 20:43:17.013205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 39609. [D 20:43:17.013219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 39610. [D 20:43:17.013234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 39611. [D 20:43:17.013249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 39612. [D 20:43:17.013264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 39613. [D 20:43:17.013278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 39614. [D 20:43:17.013292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 39615. [D 20:43:17.013307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 39616. [D 20:43:17.013321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 39617. [D 20:43:17.013336] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 39618. [D 20:43:17.016107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.016130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.016143] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.018958] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39618. [D 20:43:17.018978] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 38/70. [D 20:43:17.019030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.019049] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.019061] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:17.028073] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.028091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.028104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:17.028142] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6289 [D 20:43:17.028158] element 0: offset: 0x2aaaab001eb0, size: 24 [D 20:43:17.028174] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 39/70. [D 20:43:17.030303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.030370] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.030383] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.030426] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6291 [D 20:43:17.030441] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:17.030462] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 40/70. [D 20:43:17.034846] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6289 [D 20:43:17.034923] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 41/70. [D 20:43:17.034981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39618. [D 20:43:17.035001] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6291 [D 20:43:17.035009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39619. [D 20:43:17.035033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 39620. [D 20:43:17.035052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 39621. [D 20:43:17.035067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 39622. [D 20:43:17.035081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 39623. [D 20:43:17.035096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 39624. [D 20:43:17.035110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39625. [D 20:43:17.035126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39626. [D 20:43:17.035141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39627. [D 20:43:17.035156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 39628. [D 20:43:17.035171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 39629. [D 20:43:17.035186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 39630. [D 20:43:17.035200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 39631. [D 20:43:17.035215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 39632. [D 20:43:17.035229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39633. [D 20:43:17.035244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39634. [D 20:43:17.035259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39635. [D 20:43:17.035273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 39636. [D 20:43:17.035288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 39637. [D 20:43:17.035302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 39638. [D 20:43:17.035317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 39639. [D 20:43:17.035331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 39640. [D 20:43:17.035346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39641. [D 20:43:17.035364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39642. [D 20:43:17.035379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39643. [D 20:43:17.035394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 39644. [D 20:43:17.035408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 39645. [D 20:43:17.035423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 39646. [D 20:43:17.035437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 39647. [D 20:43:17.035452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 39648. [D 20:43:17.035466] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39649. [D 20:43:17.035492] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 42/70. [D 20:43:17.046690] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39649. [D 20:43:17.046742] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 43/70. [D 20:43:17.046759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39649. [D 20:43:17.046787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39650. [D 20:43:17.046802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39651. [D 20:43:17.046841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39652. [D 20:43:17.046857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39653. [D 20:43:17.046871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39654. [D 20:43:17.046897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39655. [D 20:43:17.046920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39656. [D 20:43:17.046944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39657. [D 20:43:17.046959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39658. [D 20:43:17.046985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39659. [D 20:43:17.047001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39660. [D 20:43:17.047016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39661. [D 20:43:17.047030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39662. [D 20:43:17.047045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39663. [D 20:43:17.047059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39664. [D 20:43:17.047078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39665. [D 20:43:17.047105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39666. [D 20:43:17.047132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39667. [D 20:43:17.047147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39668. [D 20:43:17.047180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39669. [D 20:43:17.047194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39670. [D 20:43:17.047219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39671. [D 20:43:17.047242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39672. [D 20:43:17.047257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39673. [D 20:43:17.047271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39674. [D 20:43:17.047285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39675. [D 20:43:17.047300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39676. [D 20:43:17.047314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39677. [D 20:43:17.047329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39678. [D 20:43:17.047343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39679. [D 20:43:17.047358] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39680. [D 20:43:17.047431] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.047454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.047468] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.056075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.056095] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.056108] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.056148] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6294 [D 20:43:17.056163] element 0: offset: 0x2aaaab030960, size: 24 [D 20:43:17.056179] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 44/70. [D 20:43:17.058522] openib_check_cq: completed rdma wr_id 61e6a0, nic_wr_credit 39680. [D 20:43:17.058561] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 45/70. [D 20:43:17.058695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.058715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.058728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.062029] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6294 [D 20:43:17.062104] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 46/70. [D 20:43:17.065117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39680. [D 20:43:17.065142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39681. [D 20:43:17.065157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 39682. [D 20:43:17.065171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 39683. [D 20:43:17.065186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 39684. [D 20:43:17.065201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 39685. [D 20:43:17.065215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 39686. [D 20:43:17.065243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39687. [D 20:43:17.065258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39688. [D 20:43:17.065284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39689. [D 20:43:17.065311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 39690. [D 20:43:17.065326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 39691. [D 20:43:17.065342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 39692. [D 20:43:17.065366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 39693. [D 20:43:17.065402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 39694. [D 20:43:17.065417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39695. [D 20:43:17.065432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39696. [D 20:43:17.065458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39697. [D 20:43:17.065473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 39698. [D 20:43:17.065501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 39699. [D 20:43:17.065529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 39700. [D 20:43:17.065557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 39701. [D 20:43:17.065572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 39702. [D 20:43:17.065596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39703. [D 20:43:17.065611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39704. [D 20:43:17.065640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39705. [D 20:43:17.065663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 39706. [D 20:43:17.065678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 39707. [D 20:43:17.065702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 39708. [D 20:43:17.065716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 39709. [D 20:43:17.065731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 39710. [D 20:43:17.065746] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39711. [D 20:43:17.067810] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.067836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.067849] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.067892] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6297 [D 20:43:17.067907] element 0: offset: 0x2aaaab027000, size: 24 [D 20:43:17.067924] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 47/70. [D 20:43:17.076841] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39711. [D 20:43:17.076865] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 48/70. [D 20:43:17.076980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.077001] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.077014] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.080152] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6297 [D 20:43:17.080225] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 49/70. [D 20:43:17.083170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39711. [D 20:43:17.083192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39712. [D 20:43:17.083207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39713. [D 20:43:17.083221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39714. [D 20:43:17.083236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39715. [D 20:43:17.083250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39716. [D 20:43:17.083277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39717. [D 20:43:17.083292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39718. [D 20:43:17.083321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39719. [D 20:43:17.083336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39720. [D 20:43:17.083352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39721. [D 20:43:17.083387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39722. [D 20:43:17.083410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39723. [D 20:43:17.083425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39724. [D 20:43:17.083451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39725. [D 20:43:17.083474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39726. [D 20:43:17.083489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39727. [D 20:43:17.083514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39728. [D 20:43:17.083530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39729. [D 20:43:17.083556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39730. [D 20:43:17.083571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39731. [D 20:43:17.083601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39732. [D 20:43:17.083623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39733. [D 20:43:17.083647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39734. [D 20:43:17.083661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39735. [D 20:43:17.083688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39736. [D 20:43:17.083718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39737. [D 20:43:17.083733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39738. [D 20:43:17.083748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39739. [D 20:43:17.083762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39740. [D 20:43:17.083777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39741. [D 20:43:17.083792] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39742. [D 20:43:17.085880] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.085905] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.085918] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.085960] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6300 [D 20:43:17.085976] element 0: offset: 0x2aaaab0144f0, size: 24 [D 20:43:17.085992] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 50/70. [D 20:43:17.094930] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39742. [D 20:43:17.094954] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 51/70. [D 20:43:17.095067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.095089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.095102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.098487] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6300 [D 20:43:17.098564] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 52/70. [D 20:43:17.101444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 39742. [D 20:43:17.101466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 39743. [D 20:43:17.101481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 39744. [D 20:43:17.101496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 39745. [D 20:43:17.101511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 39746. [D 20:43:17.101525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 39747. [D 20:43:17.101541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 39748. [D 20:43:17.101555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39749. [D 20:43:17.101582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39750. [D 20:43:17.101597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39751. [D 20:43:17.101623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 39752. [D 20:43:17.101638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 39753. [D 20:43:17.101668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 39754. [D 20:43:17.101691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 39755. [D 20:43:17.101706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 39756. [D 20:43:17.101721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39757. [D 20:43:17.101749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39758. [D 20:43:17.101776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39759. [D 20:43:17.101791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 39760. [D 20:43:17.101819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 39761. [D 20:43:17.101842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 39762. [D 20:43:17.101857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 39763. [D 20:43:17.101872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 39764. [D 20:43:17.101887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39765. [D 20:43:17.101915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39766. [D 20:43:17.101938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39767. [D 20:43:17.101953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 39768. [D 20:43:17.101979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 39769. [D 20:43:17.101994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 39770. [D 20:43:17.102024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 39771. [D 20:43:17.102048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 39772. [D 20:43:17.102067] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39773. [D 20:43:17.104195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.104220] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.104233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.104276] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6303 [D 20:43:17.104291] element 0: offset: 0x2aaaab001eb0, size: 24 [D 20:43:17.104308] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 53/70. [D 20:43:17.113139] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 39773. [D 20:43:17.113160] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 54/70. [D 20:43:17.113285] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.113307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.113320] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.116442] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6303 [D 20:43:17.116517] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 55/70. [D 20:43:17.122768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39773. [D 20:43:17.122790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39774. [D 20:43:17.122804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39775. [D 20:43:17.122819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39776. [D 20:43:17.122833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39777. [D 20:43:17.122848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39778. [D 20:43:17.122875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39779. [D 20:43:17.122890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39780. [D 20:43:17.122916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39781. [D 20:43:17.122931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39782. [D 20:43:17.122957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39783. [D 20:43:17.122972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39784. [D 20:43:17.122996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39785. [D 20:43:17.123011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39786. [D 20:43:17.123036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39787. [D 20:43:17.123051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39788. [D 20:43:17.123066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39789. [D 20:43:17.123091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39790. [D 20:43:17.123114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39791. [D 20:43:17.123130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39792. [D 20:43:17.123155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39793. [D 20:43:17.123170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39794. [D 20:43:17.123194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39795. [D 20:43:17.123209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39796. [D 20:43:17.123244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39797. [D 20:43:17.123263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39798. [D 20:43:17.123288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39799. [D 20:43:17.123304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39800. [D 20:43:17.123318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39801. [D 20:43:17.123333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39802. [D 20:43:17.123347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39803. [D 20:43:17.123362] openib_post_sr_rdmaw: ibv_post_send wr_id 62fc80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39804. [D 20:43:17.126181] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.126205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.126217] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.126260] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6307 [D 20:43:17.126275] element 0: offset: 0x62fee0, size: 24 [D 20:43:17.126291] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 56/70. [D 20:43:17.134503] openib_check_cq: completed rdma wr_id 62fc80, nic_wr_credit 39804. [D 20:43:17.134524] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 57/70. [D 20:43:17.134643] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.134665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.134678] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.138210] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6307 [D 20:43:17.138284] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 58/70. [D 20:43:17.140972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 39804. [D 20:43:17.140996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39805. [D 20:43:17.141011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39806. [D 20:43:17.141026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39807. [D 20:43:17.141040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39808. [D 20:43:17.141055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39809. [D 20:43:17.141069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39810. [D 20:43:17.141084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39811. [D 20:43:17.141110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39812. [D 20:43:17.141126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39813. [D 20:43:17.141154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39814. [D 20:43:17.141169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39815. [D 20:43:17.141193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39816. [D 20:43:17.141208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39817. [D 20:43:17.141222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39818. [D 20:43:17.141248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39819. [D 20:43:17.141271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39820. [D 20:43:17.141286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39821. [D 20:43:17.141312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39822. [D 20:43:17.141326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39823. [D 20:43:17.141351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39824. [D 20:43:17.141377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39825. [D 20:43:17.141391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39826. [D 20:43:17.141417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39827. [D 20:43:17.141431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39828. [D 20:43:17.141458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39829. [D 20:43:17.141472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39830. [D 20:43:17.141489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39831. [D 20:43:17.141517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39832. [D 20:43:17.141540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39833. [D 20:43:17.141555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39834. [D 20:43:17.141569] openib_post_sr_rdmaw: ibv_post_send wr_id 643aa0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39835. [D 20:43:17.141681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.141705] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.141718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.141761] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6309 [D 20:43:17.141776] element 0: offset: 0x630250, size: 24 [D 20:43:17.141793] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 59/70. [D 20:43:17.143779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.143797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.143810] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.143833] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6312 [D 20:43:17.143849] element 0: offset: 0x658610, size: 24 [D 20:43:17.143865] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 60/70. [D 20:43:17.152629] openib_check_cq: completed rdma wr_id 643aa0, nic_wr_credit 39835. [D 20:43:17.152653] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 0/70. [D 20:43:17.152813] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.152834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.152847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.156106] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6309 [D 20:43:17.156182] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 1/70. [D 20:43:17.158646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39835. [D 20:43:17.158668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39836. [D 20:43:17.158683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39837. [D 20:43:17.158697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39838. [D 20:43:17.158712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39839. [D 20:43:17.158727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39840. [D 20:43:17.158741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39841. [D 20:43:17.158756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39842. [D 20:43:17.158784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39843. [D 20:43:17.158799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39844. [D 20:43:17.158823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39845. [D 20:43:17.158838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39846. [D 20:43:17.158863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39847. [D 20:43:17.158878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39848. [D 20:43:17.158910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39849. [D 20:43:17.158933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39850. [D 20:43:17.158947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39851. [D 20:43:17.158971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39852. [D 20:43:17.158995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39853. [D 20:43:17.159010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39854. [D 20:43:17.159038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39855. [D 20:43:17.159053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39856. [D 20:43:17.159067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39857. [D 20:43:17.159091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39858. [D 20:43:17.159108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39859. [D 20:43:17.159122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39860. [D 20:43:17.159137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39861. [D 20:43:17.159180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39862. [D 20:43:17.159197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39863. [D 20:43:17.159221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39864. [D 20:43:17.159236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39865. [D 20:43:17.159265] openib_post_sr_rdmaw: ibv_post_send wr_id 643aa0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39866. [D 20:43:17.159345] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6312 [D 20:43:17.159421] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 2/70. [D 20:43:17.161374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.161394] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.161406] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.161449] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6316 [D 20:43:17.161464] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.161480] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 3/70. [D 20:43:17.170378] openib_check_cq: completed rdma wr_id 643aa0, nic_wr_credit 39866. [D 20:43:17.170404] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 4/70. [D 20:43:17.170421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39866. [D 20:43:17.170436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39867. [D 20:43:17.170451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39868. [D 20:43:17.170476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39869. [D 20:43:17.170499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39870. [D 20:43:17.170513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39871. [D 20:43:17.170528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39872. [D 20:43:17.170543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39873. [D 20:43:17.170557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39874. [D 20:43:17.170572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 39875. [D 20:43:17.170587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 39876. [D 20:43:17.170601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 39877. [D 20:43:17.170616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 39878. [D 20:43:17.170631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 39879. [D 20:43:17.170645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 39880. [D 20:43:17.170661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 39881. [D 20:43:17.170675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 39882. [D 20:43:17.170690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 39883. [D 20:43:17.170704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 39884. [D 20:43:17.170719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 39885. [D 20:43:17.170733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 39886. [D 20:43:17.170748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 39887. [D 20:43:17.170763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 39888. [D 20:43:17.170777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 39889. [D 20:43:17.170792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 39890. [D 20:43:17.170806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 39891. [D 20:43:17.170821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 39892. [D 20:43:17.170836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 39893. [D 20:43:17.170850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 39894. [D 20:43:17.170865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 39895. [D 20:43:17.170880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 39896. [D 20:43:17.170894] openib_post_sr_rdmaw: ibv_post_send wr_id 62e640 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 39897. [D 20:43:17.170956] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.170977] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.170990] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.176931] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6316 [D 20:43:17.176953] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 5/70. [D 20:43:17.182132] openib_check_cq: completed rdma wr_id 62e640, nic_wr_credit 39897. [D 20:43:17.182208] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 6/70. [D 20:43:17.182273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.182292] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.182306] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.187474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39897. [D 20:43:17.187496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39898. [D 20:43:17.187511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39899. [D 20:43:17.187526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39900. [D 20:43:17.187540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39901. [D 20:43:17.187555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39902. [D 20:43:17.187571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39903. [D 20:43:17.187598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39904. [D 20:43:17.187614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39905. [D 20:43:17.187641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39906. [D 20:43:17.187656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39907. [D 20:43:17.187686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39908. [D 20:43:17.187702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39909. [D 20:43:17.187716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39910. [D 20:43:17.187750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39911. [D 20:43:17.187776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39912. [D 20:43:17.187791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39913. [D 20:43:17.187819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39914. [D 20:43:17.187846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39915. [D 20:43:17.187862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39916. [D 20:43:17.187892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39917. [D 20:43:17.187918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39918. [D 20:43:17.187933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39919. [D 20:43:17.187961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39920. [D 20:43:17.187988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39921. [D 20:43:17.188016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39922. [D 20:43:17.188031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39923. [D 20:43:17.188061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39924. [D 20:43:17.188076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39925. [D 20:43:17.188091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39926. [D 20:43:17.188105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39927. [D 20:43:17.188120] openib_post_sr_rdmaw: ibv_post_send wr_id 643aa0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39928. [D 20:43:17.199280] openib_check_cq: completed rdma wr_id 643aa0, nic_wr_credit 39928. [D 20:43:17.199300] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 7/70. [D 20:43:17.199422] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.199444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.199457] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:17.439185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.439305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.439345] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:17.439426] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6318 [D 20:43:17.439920] element 0: offset: 0x61fa30, size: 24 [D 20:43:17.439939] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 8/70. [D 20:43:17.439981] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.439995] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.440009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.440031] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6322 [D 20:43:17.440115] element 0: offset: 0x62fee0, size: 24 [D 20:43:17.440135] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 9/70. [D 20:43:17.440235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.440331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.440465] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.441045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6324 [D 20:43:17.441061] element 0: offset: 0x658610, size: 24 [D 20:43:17.441076] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 10/70. [D 20:43:17.441107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.441121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.441134] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.441155] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6327 [D 20:43:17.441169] element 0: offset: 0x691fe0, size: 24 [D 20:43:17.441183] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 11/70. [D 20:43:17.452862] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6318 [D 20:43:17.452949] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 12/70. [D 20:43:17.453045] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6322 [D 20:43:17.453046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 39928. [D 20:43:17.453093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 39929. [D 20:43:17.453108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 39930. [D 20:43:17.453123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 39931. [D 20:43:17.453136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 39932. [D 20:43:17.453150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 39933. [D 20:43:17.453165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 39934. [D 20:43:17.453179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 39935. [D 20:43:17.453193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 39936. [D 20:43:17.453207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 39937. [D 20:43:17.453221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 39938. [D 20:43:17.453235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 39939. [D 20:43:17.453249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 39940. [D 20:43:17.453263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 39941. [D 20:43:17.453278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 39942. [D 20:43:17.453292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 39943. [D 20:43:17.453306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 39944. [D 20:43:17.453320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 39945. [D 20:43:17.453335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 39946. [D 20:43:17.453349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 39947. [D 20:43:17.453363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 39948. [D 20:43:17.453377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 39949. [D 20:43:17.453391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 39950. [D 20:43:17.453405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 39951. [D 20:43:17.453419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 39952. [D 20:43:17.453433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 39953. [D 20:43:17.453447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 39954. [D 20:43:17.453461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 39955. [D 20:43:17.453475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 39956. [D 20:43:17.453489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 39957. [D 20:43:17.453503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 39958. [D 20:43:17.453518] openib_post_sr_rdmaw: ibv_post_send wr_id 63c6a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 39959. [D 20:43:17.456506] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 13/70. [D 20:43:17.456529] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6324 [D 20:43:17.456544] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 14/70. [D 20:43:17.456558] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6327 [D 20:43:17.456573] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 15/70. [D 20:43:17.458967] openib_check_cq: completed rdma wr_id 63c6a0, nic_wr_credit 39959. [D 20:43:17.458985] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 16/70. [D 20:43:17.459002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39959. [D 20:43:17.459016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 39960. [D 20:43:17.459030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 39961. [D 20:43:17.459044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 39962. [D 20:43:17.459058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 39963. [D 20:43:17.459073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 39964. [D 20:43:17.459087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39965. [D 20:43:17.459102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39966. [D 20:43:17.459116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39967. [D 20:43:17.459130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 39968. [D 20:43:17.459144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 39969. [D 20:43:17.459158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 39970. [D 20:43:17.459172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 39971. [D 20:43:17.459186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 39972. [D 20:43:17.459200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39973. [D 20:43:17.459214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39974. [D 20:43:17.459228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39975. [D 20:43:17.459242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 39976. [D 20:43:17.459257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 39977. [D 20:43:17.459271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 39978. [D 20:43:17.459285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 39979. [D 20:43:17.459299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 39980. [D 20:43:17.459313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39981. [D 20:43:17.459327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39982. [D 20:43:17.459341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39983. [D 20:43:17.459355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 39984. [D 20:43:17.459369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 39985. [D 20:43:17.459383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 39986. [D 20:43:17.459398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 39987. [D 20:43:17.459412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 39988. [D 20:43:17.459426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39989. [D 20:43:17.459440] openib_post_sr_rdmaw: ibv_post_send wr_id 644080 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39990. [D 20:43:17.459455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 39991. [D 20:43:17.459469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 39992. [D 20:43:17.459483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 39993. [D 20:43:17.459498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 39994. [D 20:43:17.459513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 39995. [D 20:43:17.459527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 39996. [D 20:43:17.459541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 39997. [D 20:43:17.459555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 39998. [D 20:43:17.459569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 39999. [D 20:43:17.459583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40000. [D 20:43:17.459597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40001. [D 20:43:17.459611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40002. [D 20:43:17.459625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40003. [D 20:43:17.459639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40004. [D 20:43:17.459653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40005. [D 20:43:17.459667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40006. [D 20:43:17.459681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40007. [D 20:43:17.459696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40008. [D 20:43:17.459710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40009. [D 20:43:17.459724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40010. [D 20:43:17.459738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40011. [D 20:43:17.459752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40012. [D 20:43:17.459766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40013. [D 20:43:17.459780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40014. [D 20:43:17.459794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40015. [D 20:43:17.459811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40016. [D 20:43:17.459824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40017. [D 20:43:17.459839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40018. [D 20:43:17.459853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40019. [D 20:43:17.459867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40020. [D 20:43:17.459881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40021. [D 20:43:17.459895] openib_post_sr_rdmaw: ibv_post_send wr_id 63bca0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40022. [D 20:43:17.459911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40023. [D 20:43:17.459926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40024. [D 20:43:17.459940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40025. [D 20:43:17.459954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40026. [D 20:43:17.459968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40027. [D 20:43:17.459982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40028. [E 20:43:17.460000] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40029, block for 10 ms. [D 20:43:17.460057] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40028. [D 20:43:17.460410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40029. [E 20:43:17.460431] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40030, block for 10 ms. [D 20:43:17.464917] openib_check_cq: completed rdma wr_id 644080, nic_wr_credit 40029. [D 20:43:17.464958] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 17/70. [D 20:43:17.464997] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40028. [D 20:43:17.465013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40029. [D 20:43:17.465028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40030. [D 20:43:17.465042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40031. [D 20:43:17.465057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40032. [D 20:43:17.465072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40033. [D 20:43:17.465086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40034. [D 20:43:17.465101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40035. [D 20:43:17.465115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40036. [D 20:43:17.465130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40037. [D 20:43:17.465145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40038. [D 20:43:17.465159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40039. [D 20:43:17.465174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40040. [D 20:43:17.465189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40041. [D 20:43:17.465203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40042. [D 20:43:17.465218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40043. [D 20:43:17.465233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40044. [D 20:43:17.465247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40045. [D 20:43:17.465262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40046. [D 20:43:17.465277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40047. [D 20:43:17.465292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40048. [D 20:43:17.465307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40049. [D 20:43:17.465322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40050. [D 20:43:17.465336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40051. [D 20:43:17.465351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40052. [D 20:43:17.465366] openib_post_sr_rdmaw: ibv_post_send wr_id 63c3c0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40053. [D 20:43:17.465450] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.465475] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.465488] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.466867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.466882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.466895] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.466934] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6330 [D 20:43:17.466949] element 0: offset: 0x642760, size: 24 [D 20:43:17.466969] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 18/70. [D 20:43:17.470741] openib_check_cq: completed rdma wr_id 63bca0, nic_wr_credit 40053. [D 20:43:17.470767] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 19/70. [D 20:43:17.471882] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.471904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.471917] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.481371] openib_check_cq: completed rdma wr_id 63c3c0, nic_wr_credit 40052. [D 20:43:17.481396] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 20/70. [D 20:43:17.484088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.484106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.484120] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.484163] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6334 [D 20:43:17.484179] element 0: offset: 0x63c820, size: 24 [D 20:43:17.484980] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 21/70. [D 20:43:17.485032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.485047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.485060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.485146] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.485161] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.485175] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.489039] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6330 [D 20:43:17.489132] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 22/70. [D 20:43:17.492884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40052. [D 20:43:17.492947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40053. [D 20:43:17.492963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40054. [D 20:43:17.492978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40055. [D 20:43:17.492993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40056. [D 20:43:17.493008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40057. [D 20:43:17.493023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40058. [D 20:43:17.493038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40059. [D 20:43:17.493052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40060. [D 20:43:17.493106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40061. [D 20:43:17.493121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40062. [D 20:43:17.493136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40063. [D 20:43:17.493151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40064. [D 20:43:17.493165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40065. [D 20:43:17.493180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40066. [D 20:43:17.493195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40067. [D 20:43:17.493209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40068. [D 20:43:17.493224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40069. [D 20:43:17.493246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40070. [D 20:43:17.493260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40071. [D 20:43:17.493275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40072. [D 20:43:17.493289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40073. [D 20:43:17.493304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40074. [D 20:43:17.493319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40075. [D 20:43:17.493333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40076. [D 20:43:17.493348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40077. [D 20:43:17.493363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40078. [D 20:43:17.493378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40079. [D 20:43:17.493392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40080. [D 20:43:17.493407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40081. [D 20:43:17.493422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40082. [D 20:43:17.493436] openib_post_sr_rdmaw: ibv_post_send wr_id 63c4c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40083. [D 20:43:17.494642] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6334 [D 20:43:17.494723] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 23/70. [D 20:43:17.498830] openib_check_cq: completed rdma wr_id 63c4c0, nic_wr_credit 40083. [D 20:43:17.498862] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 24/70. [D 20:43:17.498879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 40083. [D 20:43:17.498894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40084. [D 20:43:17.498908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40085. [D 20:43:17.498923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40086. [D 20:43:17.498938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40087. [D 20:43:17.498952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40088. [D 20:43:17.498967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40089. [D 20:43:17.498981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40090. [D 20:43:17.498996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40091. [D 20:43:17.499011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40092. [D 20:43:17.499025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40093. [D 20:43:17.499040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40094. [D 20:43:17.499055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40095. [D 20:43:17.499069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40096. [D 20:43:17.499084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40097. [D 20:43:17.499099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40098. [D 20:43:17.499113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40099. [D 20:43:17.499128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40100. [D 20:43:17.499142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40101. [D 20:43:17.499157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40102. [D 20:43:17.499172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40103. [D 20:43:17.499186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40104. [D 20:43:17.499201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40105. [D 20:43:17.499216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40106. [D 20:43:17.499231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40107. [D 20:43:17.499245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40108. [D 20:43:17.499260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40109. [D 20:43:17.499275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40110. [D 20:43:17.499290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40111. [D 20:43:17.499305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40112. [D 20:43:17.499320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40113. [D 20:43:17.499335] openib_post_sr_rdmaw: ibv_post_send wr_id 62fff0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40114. [D 20:43:17.500074] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.500091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.500105] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.500147] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6337 [D 20:43:17.500163] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.500180] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 25/70. [D 20:43:17.500213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.500227] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.500240] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.500261] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6339 [D 20:43:17.500277] element 0: offset: 0x62e9e0, size: 24 [D 20:43:17.500291] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 26/70. [D 20:43:17.500324] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.500339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.500351] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.505267] openib_check_cq: completed rdma wr_id 62fff0, nic_wr_credit 40114. [D 20:43:17.505289] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 27/70. [D 20:43:17.508215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.508240] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.508254] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.511457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.511506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.511520] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.511563] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6342 [D 20:43:17.511579] element 0: offset: 0x658610, size: 24 [D 20:43:17.511600] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 28/70. [D 20:43:17.513917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.513981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.513996] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.514039] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6346 [D 20:43:17.514055] element 0: offset: 0x61fa30, size: 24 [D 20:43:17.514076] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 29/70. [D 20:43:17.518445] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6339 [D 20:43:17.518532] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 30/70. [D 20:43:17.518596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40114. [D 20:43:17.518616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40115. [D 20:43:17.518631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40116. [D 20:43:17.518646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40117. [D 20:43:17.518661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40118. [D 20:43:17.518676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40119. [D 20:43:17.518690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40120. [D 20:43:17.518707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40121. [D 20:43:17.518721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40122. [D 20:43:17.518736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40123. [D 20:43:17.518751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40124. [D 20:43:17.518766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40125. [D 20:43:17.518780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40126. [D 20:43:17.518795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40127. [D 20:43:17.518809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40128. [D 20:43:17.518824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40129. [D 20:43:17.518839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40130. [D 20:43:17.518853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40131. [D 20:43:17.518868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40132. [D 20:43:17.518883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40133. [D 20:43:17.518897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40134. [D 20:43:17.518912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40135. [D 20:43:17.518926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40136. [D 20:43:17.518941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40137. [D 20:43:17.518956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40138. [D 20:43:17.518970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40139. [D 20:43:17.518985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40140. [D 20:43:17.519000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40141. [D 20:43:17.519014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40142. [D 20:43:17.519029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40143. [D 20:43:17.519044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40144. [D 20:43:17.519058] openib_post_sr_rdmaw: ibv_post_send wr_id 6424f0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40145. [D 20:43:17.522129] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6337 [D 20:43:17.522147] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 31/70. [D 20:43:17.522163] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6342 [D 20:43:17.522178] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 32/70. [D 20:43:17.522781] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6346 [D 20:43:17.522807] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 33/70. [D 20:43:17.527363] openib_check_cq: completed rdma wr_id 6424f0, nic_wr_credit 40145. [D 20:43:17.527382] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 34/70. [D 20:43:17.527407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40145. [D 20:43:17.527422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40146. [D 20:43:17.527437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40147. [D 20:43:17.527451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40148. [D 20:43:17.527466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40149. [D 20:43:17.527480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40150. [D 20:43:17.527495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40151. [D 20:43:17.527510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40152. [D 20:43:17.527524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40153. [D 20:43:17.527539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40154. [D 20:43:17.527553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40155. [D 20:43:17.527568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40156. [D 20:43:17.527583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40157. [D 20:43:17.527597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40158. [D 20:43:17.527612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40159. [D 20:43:17.527626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40160. [D 20:43:17.527641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40161. [D 20:43:17.527656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40162. [D 20:43:17.527670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40163. [D 20:43:17.527685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40164. [D 20:43:17.527699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40165. [D 20:43:17.527714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40166. [D 20:43:17.527728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40167. [D 20:43:17.527743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40168. [D 20:43:17.527758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40169. [D 20:43:17.527772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40170. [D 20:43:17.527787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40171. [D 20:43:17.527802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40172. [D 20:43:17.527817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40173. [D 20:43:17.527832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40174. [D 20:43:17.527846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40175. [D 20:43:17.527861] openib_post_sr_rdmaw: ibv_post_send wr_id 643c10 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40176. [D 20:43:17.527877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40177. [D 20:43:17.527892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40178. [D 20:43:17.527907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40179. [D 20:43:17.527922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40180. [D 20:43:17.527937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40181. [D 20:43:17.527951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40182. [D 20:43:17.527966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40183. [D 20:43:17.527980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40184. [D 20:43:17.527995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40185. [D 20:43:17.528009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40186. [D 20:43:17.528024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40187. [D 20:43:17.528039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40188. [D 20:43:17.528060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40189. [D 20:43:17.528075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40190. [D 20:43:17.528089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40191. [D 20:43:17.528104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40192. [D 20:43:17.528119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40193. [D 20:43:17.528133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40194. [D 20:43:17.528148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40195. [D 20:43:17.528163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40196. [D 20:43:17.528177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40197. [D 20:43:17.528192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40198. [D 20:43:17.528206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40199. [D 20:43:17.528221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40200. [D 20:43:17.528236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40201. [D 20:43:17.528251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40202. [D 20:43:17.528265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40203. [D 20:43:17.528280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40204. [D 20:43:17.528294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40205. [D 20:43:17.528309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40206. [D 20:43:17.528324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40207. [D 20:43:17.528338] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40208. [D 20:43:17.528354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 40209. [D 20:43:17.528369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40210. [D 20:43:17.528384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40211. [D 20:43:17.528398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40212. [D 20:43:17.528413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40213. [D 20:43:17.528427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40214. [E 20:43:17.528446] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40215, block for 10 ms. [D 20:43:17.528528] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40214. [D 20:43:17.528546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40215. [E 20:43:17.528562] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40216, block for 10 ms. [D 20:43:17.535907] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40215. [E 20:43:17.535929] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40216, block for 10 ms. [D 20:43:17.539073] openib_check_cq: completed rdma wr_id 643c10, nic_wr_credit 40215. [D 20:43:17.539096] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 35/70. [D 20:43:17.539110] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40214. [D 20:43:17.539125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40215. [D 20:43:17.539140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40216. [D 20:43:17.539155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40217. [D 20:43:17.539169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40218. [D 20:43:17.539184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40219. [D 20:43:17.539199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40220. [D 20:43:17.539213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40221. [D 20:43:17.539228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40222. [D 20:43:17.539243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40223. [D 20:43:17.539258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40224. [D 20:43:17.539273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40225. [D 20:43:17.539287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40226. [D 20:43:17.539302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40227. [D 20:43:17.539317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40228. [D 20:43:17.539332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40229. [D 20:43:17.539346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40230. [D 20:43:17.539361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40231. [D 20:43:17.539376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40232. [D 20:43:17.539394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40233. [D 20:43:17.539409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40234. [D 20:43:17.539424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40235. [D 20:43:17.539439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40236. [D 20:43:17.539453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40237. [D 20:43:17.539468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40238. [D 20:43:17.539482] openib_post_sr_rdmaw: ibv_post_send wr_id 66dca0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40239. [D 20:43:17.539551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.539619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.539634] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 5 [D 20:43:17.539686] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.539701] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.539713] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 4 [D 20:43:17.539748] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6348 [D 20:43:17.539763] element 0: offset: 0x62e9e0, size: 24 [D 20:43:17.539783] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 36/70. [D 20:43:17.548001] openib_check_cq: completed rdma wr_id 61f5f0, nic_wr_credit 40239. [D 20:43:17.548028] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 37/70. [D 20:43:17.549118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.549138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.549151] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.553849] openib_check_cq: completed rdma wr_id 66dca0, nic_wr_credit 40238. [D 20:43:17.553870] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 38/70. [D 20:43:17.553924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.553945] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.553957] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.554038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.554053] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.554068] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.557672] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6348 [D 20:43:17.557746] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 39/70. [D 20:43:17.565742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40238. [D 20:43:17.565765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40239. [D 20:43:17.565780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40240. [D 20:43:17.565795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40241. [D 20:43:17.565809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40242. [D 20:43:17.565824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40243. [D 20:43:17.565838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40244. [D 20:43:17.565852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40245. [D 20:43:17.565867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40246. [D 20:43:17.565881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40247. [D 20:43:17.565895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40248. [D 20:43:17.565910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40249. [D 20:43:17.565924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40250. [D 20:43:17.565938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40251. [D 20:43:17.565952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40252. [D 20:43:17.565967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40253. [D 20:43:17.565981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40254. [D 20:43:17.565995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40255. [D 20:43:17.566010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40256. [D 20:43:17.566024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40257. [D 20:43:17.566038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40258. [D 20:43:17.566053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40259. [D 20:43:17.566067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40260. [D 20:43:17.566081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40261. [D 20:43:17.566096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40262. [D 20:43:17.566110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40263. [D 20:43:17.566124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40264. [D 20:43:17.566138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40265. [D 20:43:17.566159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40266. [D 20:43:17.566174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40267. [D 20:43:17.566188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40268. [D 20:43:17.566202] openib_post_sr_rdmaw: ibv_post_send wr_id 63c580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40269. [D 20:43:17.568550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.568576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.568589] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.568637] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6353 [D 20:43:17.568653] element 0: offset: 0x62fee0, size: 24 [D 20:43:17.568669] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 40/70. [D 20:43:17.568819] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.568836] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.568849] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.568872] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6355 [D 20:43:17.568886] element 0: offset: 0x630220, size: 24 [D 20:43:17.568902] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 41/70. [D 20:43:17.568930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.568944] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.568956] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.568977] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6358 [D 20:43:17.568991] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.569008] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 42/70. [D 20:43:17.571646] openib_check_cq: completed rdma wr_id 63c580, nic_wr_credit 40269. [D 20:43:17.571670] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 43/70. [D 20:43:17.571859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.571880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.571893] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.576089] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6353 [D 20:43:17.576115] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 44/70. [D 20:43:17.577489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40269. [D 20:43:17.577507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40270. [D 20:43:17.577522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40271. [D 20:43:17.577537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40272. [D 20:43:17.577552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40273. [D 20:43:17.577566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40274. [D 20:43:17.577580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40275. [D 20:43:17.577595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40276. [D 20:43:17.577609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40277. [D 20:43:17.577623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40278. [D 20:43:17.577647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40279. [D 20:43:17.577663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40280. [D 20:43:17.577686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40281. [D 20:43:17.577701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40282. [D 20:43:17.577716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40283. [D 20:43:17.577730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40284. [D 20:43:17.577745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40285. [D 20:43:17.577760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40286. [D 20:43:17.577775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40287. [D 20:43:17.577790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40288. [D 20:43:17.577805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40289. [D 20:43:17.577820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40290. [D 20:43:17.577835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40291. [D 20:43:17.577850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40292. [D 20:43:17.577864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40293. [D 20:43:17.577879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40294. [D 20:43:17.577894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40295. [D 20:43:17.577909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40296. [D 20:43:17.577924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40297. [D 20:43:17.577938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40298. [D 20:43:17.577953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40299. [D 20:43:17.577968] openib_post_sr_rdmaw: ibv_post_send wr_id 62fc80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40300. [D 20:43:17.580173] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.580247] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.580261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.580306] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6360 [D 20:43:17.580322] element 0: offset: 0x658610, size: 24 [D 20:43:17.580342] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 45/70. [D 20:43:17.581471] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6355 [D 20:43:17.581498] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 46/70. [D 20:43:17.581521] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6358 [D 20:43:17.581536] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 47/70. [D 20:43:17.589184] openib_check_cq: completed rdma wr_id 62fc80, nic_wr_credit 40300. [D 20:43:17.589205] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 48/70. [D 20:43:17.589233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40300. [D 20:43:17.589250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40301. [D 20:43:17.589265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40302. [D 20:43:17.589280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40303. [D 20:43:17.589295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40304. [D 20:43:17.589310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40305. [D 20:43:17.589325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40306. [D 20:43:17.589340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40307. [D 20:43:17.589355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40308. [D 20:43:17.589370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40309. [D 20:43:17.589384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40310. [D 20:43:17.589399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40311. [D 20:43:17.589414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40312. [D 20:43:17.589429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40313. [D 20:43:17.589443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40314. [D 20:43:17.589458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40315. [D 20:43:17.589473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40316. [D 20:43:17.589488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40317. [D 20:43:17.589503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40318. [D 20:43:17.589517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40319. [D 20:43:17.589532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40320. [D 20:43:17.589547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40321. [D 20:43:17.589562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40322. [D 20:43:17.589576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40323. [D 20:43:17.589591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40324. [D 20:43:17.589606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40325. [D 20:43:17.589621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40326. [D 20:43:17.589636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40327. [D 20:43:17.589650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40328. [D 20:43:17.589665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40329. [D 20:43:17.589681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40330. [D 20:43:17.589696] openib_post_sr_rdmaw: ibv_post_send wr_id 66de90 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40331. [D 20:43:17.589712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 40332. [D 20:43:17.589727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40333. [D 20:43:17.589741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40334. [D 20:43:17.589756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40335. [D 20:43:17.589770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40336. [D 20:43:17.589785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40337. [D 20:43:17.589800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40338. [D 20:43:17.589814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40339. [D 20:43:17.589828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40340. [D 20:43:17.589843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40341. [D 20:43:17.589857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40342. [D 20:43:17.589872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40343. [D 20:43:17.589886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40344. [D 20:43:17.589901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40345. [D 20:43:17.589915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40346. [D 20:43:17.589930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40347. [D 20:43:17.589944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40348. [D 20:43:17.589959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40349. [D 20:43:17.589973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40350. [D 20:43:17.589988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40351. [D 20:43:17.590002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40352. [D 20:43:17.590017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40353. [D 20:43:17.590031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40354. [D 20:43:17.590045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40355. [D 20:43:17.590060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40356. [D 20:43:17.590074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40357. [D 20:43:17.590089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40358. [D 20:43:17.590104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40359. [D 20:43:17.590119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40360. [D 20:43:17.590134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40361. [D 20:43:17.590148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40362. [D 20:43:17.590162] openib_post_sr_rdmaw: ibv_post_send wr_id 644100 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40363. [D 20:43:17.590242] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.590315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.590328] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.593452] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6360 [D 20:43:17.593486] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 49/70. [D 20:43:17.601093] openib_check_cq: completed rdma wr_id 66de90, nic_wr_credit 40363. [D 20:43:17.601111] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 50/70. [D 20:43:17.609347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.609397] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.609410] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.609455] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6363 [D 20:43:17.609470] element 0: offset: 0x642080, size: 24 [D 20:43:17.609491] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 51/70. [D 20:43:17.612754] openib_check_cq: completed rdma wr_id 644100, nic_wr_credit 40362. [D 20:43:17.612778] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 52/70. [D 20:43:17.612806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40362. [D 20:43:17.612823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40363. [D 20:43:17.612838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40364. [D 20:43:17.612837] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.612865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40365. [D 20:43:17.612883] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.612902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40366. [D 20:43:17.612917] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.612936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40367. [D 20:43:17.612966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40368. [D 20:43:17.612982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40369. [D 20:43:17.612996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40370. [D 20:43:17.613011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40371. [D 20:43:17.613025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40372. [D 20:43:17.613040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40373. [D 20:43:17.613054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40374. [D 20:43:17.613069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40375. [D 20:43:17.616551] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6363 [D 20:43:17.890212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40376. [D 20:43:17.890630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40377. [D 20:43:17.890648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40378. [D 20:43:17.890663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40379. [D 20:43:17.890678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40380. [D 20:43:17.890692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40381. [D 20:43:17.890707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40382. [D 20:43:17.890735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40383. [D 20:43:17.890750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40384. [D 20:43:17.890765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40385. [D 20:43:17.890779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40386. [D 20:43:17.890794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40387. [D 20:43:17.890809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40388. [D 20:43:17.890836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40389. [D 20:43:17.890851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40390. [D 20:43:17.890865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40391. [D 20:43:17.890880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40392. [D 20:43:17.890895] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40393. [D 20:43:17.891461] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 53/70. [D 20:43:17.891908] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.891963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.891977] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.892021] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6367 [D 20:43:17.892036] element 0: offset: 0x630220, size: 24 [D 20:43:17.894257] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40393. [D 20:43:17.894281] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 54/70. [D 20:43:17.894297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40393. [D 20:43:17.894312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40394. [D 20:43:17.894327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40395. [D 20:43:17.894356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40396. [D 20:43:17.894371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40397. [D 20:43:17.894386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40398. [D 20:43:17.894401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40399. [D 20:43:17.894415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40400. [D 20:43:17.894430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40401. [D 20:43:17.894445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40402. [D 20:43:17.894460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40403. [D 20:43:17.894474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40404. [D 20:43:17.894489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40405. [D 20:43:17.894503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40406. [D 20:43:17.894518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40407. [D 20:43:17.894533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40408. [D 20:43:17.894635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40409. [D 20:43:17.894652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40410. [D 20:43:17.895130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40411. [D 20:43:17.895147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40412. [D 20:43:17.895162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40413. [D 20:43:17.895177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40414. [D 20:43:17.895206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40415. [D 20:43:17.895221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40416. [D 20:43:17.895235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40417. [D 20:43:17.895250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40418. [D 20:43:17.895264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40419. [D 20:43:17.895279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40420. [D 20:43:17.895294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40421. [D 20:43:17.895320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40422. [D 20:43:17.895335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40423. [D 20:43:17.895350] openib_post_sr_rdmaw: ibv_post_send wr_id 66de90 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40424. [D 20:43:17.900226] openib_check_cq: completed rdma wr_id 66de90, nic_wr_credit 40424. [D 20:43:17.900248] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 55/70. [D 20:43:17.904087] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 56/70. [D 20:43:17.904152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.904166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.904180] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.904215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.904228] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.904241] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.904265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6370 [D 20:43:17.904280] element 0: offset: 0x2aaaab6104a0, size: 24 [D 20:43:17.904295] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 57/70. [D 20:43:17.904332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.904347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.904360] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.904382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.904395] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.904408] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.906183] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.906248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.906262] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.906302] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6372 [D 20:43:17.906317] element 0: offset: 0x2aaaab02a0b0, size: 24 [D 20:43:17.906337] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 58/70. [D 20:43:17.912156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.912183] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.912198] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.912249] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6375 [D 20:43:17.912265] element 0: offset: 0x2aaaab001f70, size: 24 [D 20:43:17.912281] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 59/70. [D 20:43:17.913844] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6372 [D 20:43:17.913868] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 60/70. [D 20:43:17.913889] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6370 [D 20:43:17.913906] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 0/70. [D 20:43:17.913922] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6367 [D 20:43:17.913937] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 1/70. [D 20:43:17.914012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40424. [D 20:43:17.914028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40425. [D 20:43:17.914043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40426. [D 20:43:17.914058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40427. [D 20:43:17.914073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40428. [D 20:43:17.914088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40429. [D 20:43:17.914102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40430. [D 20:43:17.914117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40431. [D 20:43:17.914132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40432. [D 20:43:17.914146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40433. [D 20:43:17.914161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40434. [D 20:43:17.914176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40435. [D 20:43:17.914191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40436. [D 20:43:17.914206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40437. [D 20:43:17.914221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40438. [D 20:43:17.914236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40439. [D 20:43:17.914250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40440. [D 20:43:17.914265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40441. [D 20:43:17.914280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40442. [D 20:43:17.914295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40443. [D 20:43:17.914309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40444. [D 20:43:17.914324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40445. [D 20:43:17.914338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40446. [D 20:43:17.914353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40447. [D 20:43:17.914368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40448. [D 20:43:17.914383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40449. [D 20:43:17.914397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40450. [D 20:43:17.914412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40451. [D 20:43:17.914426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40452. [D 20:43:17.914441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40453. [D 20:43:17.914456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40454. [D 20:43:17.914471] openib_post_sr_rdmaw: ibv_post_send wr_id 66de90 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40455. [D 20:43:17.914487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 40456. [D 20:43:17.914502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40457. [D 20:43:17.914517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40458. [D 20:43:17.914531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40459. [D 20:43:17.914546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40460. [D 20:43:17.914561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40461. [D 20:43:17.914576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40462. [D 20:43:17.914590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40463. [D 20:43:17.914605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40464. [D 20:43:17.914620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40465. [D 20:43:17.914635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40466. [D 20:43:17.914650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40467. [D 20:43:17.914664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40468. [D 20:43:17.914679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40469. [D 20:43:17.914693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40470. [D 20:43:17.914708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40471. [D 20:43:17.914723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40472. [D 20:43:17.914737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40473. [D 20:43:17.914752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40474. [D 20:43:17.914767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40475. [D 20:43:17.914781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40476. [D 20:43:17.914796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40477. [D 20:43:17.914811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40478. [D 20:43:17.914825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40479. [D 20:43:17.914840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40480. [D 20:43:17.914854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40481. [D 20:43:17.914869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40482. [D 20:43:17.914884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40483. [D 20:43:17.914898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40484. [D 20:43:17.914913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40485. [D 20:43:17.914928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40486. [D 20:43:17.914942] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40487. [D 20:43:17.914958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40488. [D 20:43:17.914973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40489. [D 20:43:17.914988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40490. [D 20:43:17.915002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40491. [D 20:43:17.915017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40492. [D 20:43:17.915032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40493. [D 20:43:17.915047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40494. [E 20:43:17.915064] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40495, block for 10 ms. [D 20:43:17.918168] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6375 [D 20:43:17.925712] openib_check_cq: completed rdma wr_id 66de90, nic_wr_credit 40494. [D 20:43:17.925734] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 2/70. [D 20:43:17.925749] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40493. [D 20:43:17.925764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40494. [D 20:43:17.925779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40495. [D 20:43:17.925794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40496. [D 20:43:17.925808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40497. [D 20:43:17.925823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40498. [D 20:43:17.925838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40499. [D 20:43:17.925853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40500. [D 20:43:17.925868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40501. [D 20:43:17.925882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40502. [D 20:43:17.925897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40503. [D 20:43:17.925912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40504. [D 20:43:17.925926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40505. [D 20:43:17.925941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40506. [D 20:43:17.925956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40507. [D 20:43:17.925971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40508. [D 20:43:17.925986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40509. [D 20:43:17.926000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40510. [D 20:43:17.926015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40511. [D 20:43:17.926030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40512. [D 20:43:17.926045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40513. [D 20:43:17.926059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40514. [D 20:43:17.926074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40515. [D 20:43:17.926089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40516. [D 20:43:17.926104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40517. [D 20:43:17.926119] openib_post_sr_rdmaw: ibv_post_send wr_id 6391d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40518. [D 20:43:17.928345] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 3/70. [D 20:43:17.936660] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40518. [D 20:43:17.936687] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 4/70. [D 20:43:17.940203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.940227] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.940241] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.942532] openib_check_cq: completed rdma wr_id 6391d0, nic_wr_credit 40517. [D 20:43:17.942552] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 5/70. [D 20:43:17.942591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.942608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.942621] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:17.942648] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.942661] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.942674] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:17.943664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40517. [D 20:43:17.943684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40518. [D 20:43:17.943699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40519. [D 20:43:17.943714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40520. [D 20:43:17.943729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40521. [D 20:43:17.943743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40522. [D 20:43:17.943758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40523. [D 20:43:17.943772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40524. [D 20:43:17.943787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40525. [D 20:43:17.943802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40526. [D 20:43:17.943817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40527. [D 20:43:17.943831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40528. [D 20:43:17.943846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40529. [D 20:43:17.943860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40530. [D 20:43:17.943875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40531. [D 20:43:17.943889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40532. [D 20:43:17.943904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40533. [D 20:43:17.943918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40534. [D 20:43:17.943933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40535. [D 20:43:17.943948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40536. [D 20:43:17.943964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40537. [D 20:43:17.943979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40538. [D 20:43:17.943993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40539. [D 20:43:17.944008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40540. [D 20:43:17.944022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40541. [D 20:43:17.944037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40542. [D 20:43:17.944052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40543. [D 20:43:17.944072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40544. [D 20:43:17.944087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40545. [D 20:43:17.944103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40546. [D 20:43:17.944118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40547. [D 20:43:17.944133] openib_post_sr_rdmaw: ibv_post_send wr_id 61ed20 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40548. [D 20:43:17.949584] openib_check_cq: completed rdma wr_id 61ed20, nic_wr_credit 40548. [D 20:43:17.949600] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 6/70. [D 20:43:17.949653] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.949673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.949686] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:17.960655] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.960673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.960686] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:17.960725] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6380 [D 20:43:17.960741] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:17.960760] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 7/70. [D 20:43:17.963293] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.963355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.963369] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:17.963417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6383 [D 20:43:17.963432] element 0: offset: 0x2aaaab038c60, size: 24 [D 20:43:17.963453] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 8/70. [D 20:43:17.963496] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.963511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.963524] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:17.963548] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6386 [D 20:43:17.963563] element 0: offset: 0x2aaaab0258e0, size: 24 [D 20:43:17.963581] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 9/70. [D 20:43:17.963631] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:17.963645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.963658] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:17.963679] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6387 [D 20:43:17.963693] element 0: offset: 0x2aaaab6104a0, size: 24 [D 20:43:17.963710] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 10/70. [D 20:43:17.968119] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6383 [D 20:43:17.968153] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 11/70. [D 20:43:17.968223] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6380 [D 20:43:17.968245] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 12/70. [D 20:43:17.968300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40548. [D 20:43:17.968317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40549. [D 20:43:17.968331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40550. [D 20:43:17.968346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40551. [D 20:43:17.968361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40552. [D 20:43:17.968376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40553. [D 20:43:17.968391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40554. [D 20:43:17.968405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40555. [D 20:43:17.968420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40556. [D 20:43:17.968435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40557. [D 20:43:17.968450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40558. [D 20:43:17.968465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40559. [D 20:43:17.968479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40560. [D 20:43:17.968494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40561. [D 20:43:17.968509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40562. [D 20:43:17.968524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40563. [D 20:43:17.968538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40564. [D 20:43:17.968553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40565. [D 20:43:17.968568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40566. [D 20:43:17.968583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40567. [D 20:43:17.968598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40568. [D 20:43:17.968612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40569. [D 20:43:17.968627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40570. [D 20:43:17.968642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40571. [D 20:43:17.968657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40572. [D 20:43:17.968671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40573. [D 20:43:17.968686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40574. [D 20:43:17.968702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40575. [D 20:43:17.968717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40576. [D 20:43:17.968731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40577. [D 20:43:17.968746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40578. [D 20:43:17.968761] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40579. [D 20:43:17.968778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40580. [D 20:43:17.968793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40581. [D 20:43:17.968808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40582. [D 20:43:17.968823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40583. [D 20:43:17.968838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40584. [D 20:43:17.968852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40585. [D 20:43:17.968867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40586. [D 20:43:17.968882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40587. [D 20:43:17.968897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40588. [D 20:43:17.968912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40589. [D 20:43:17.968926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40590. [D 20:43:17.968941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40591. [D 20:43:17.968956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40592. [D 20:43:17.968971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40593. [D 20:43:17.968986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40594. [D 20:43:17.969000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40595. [D 20:43:17.969015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40596. [D 20:43:17.969030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40597. [D 20:43:17.969045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40598. [D 20:43:17.969060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40599. [D 20:43:17.969074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40600. [D 20:43:17.969089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40601. [D 20:43:17.969104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40602. [D 20:43:17.969119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40603. [D 20:43:17.969134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40604. [D 20:43:17.969149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40605. [D 20:43:17.969164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40606. [D 20:43:17.969178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40607. [D 20:43:17.969193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40608. [D 20:43:17.969208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40609. [D 20:43:17.969223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40610. [D 20:43:17.969237] openib_post_sr_rdmaw: ibv_post_send wr_id 62e640 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40611. [D 20:43:17.973706] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6386 [D 20:43:17.973729] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 13/70. [D 20:43:17.973748] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6387 [D 20:43:17.973763] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 14/70. [D 20:43:17.979864] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40611. [D 20:43:17.979886] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 15/70. [D 20:43:17.991485] openib_check_cq: completed rdma wr_id 62e640, nic_wr_credit 40610. [D 20:43:17.991506] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 16/70. [D 20:43:17.991534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 40610. [D 20:43:17.991550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40611. [D 20:43:17.991578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40612. [D 20:43:17.991593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40613. [D 20:43:17.991610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40614. [D 20:43:17.991599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.991635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40615. [D 20:43:17.991695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.991700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40616. [D 20:43:17.991717] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:17.991735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40617. [D 20:43:17.991763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40618. [D 20:43:17.991778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40619. [D 20:43:17.991793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40620. [D 20:43:17.991808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40621. [D 20:43:17.991822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40622. [D 20:43:17.991837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40623. [D 20:43:17.991852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40624. [D 20:43:17.991867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40625. [D 20:43:17.991881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40626. [D 20:43:17.991896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40627. [D 20:43:17.991911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40628. [D 20:43:17.991925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40629. [D 20:43:17.991940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40630. [D 20:43:17.991955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40631. [D 20:43:17.991970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40632. [D 20:43:17.991984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40633. [D 20:43:17.991999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40634. [D 20:43:17.992014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40635. [D 20:43:17.992028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40636. [D 20:43:17.992043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40637. [D 20:43:17.992062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40638. [D 20:43:17.992077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40639. [D 20:43:17.992092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40640. [D 20:43:17.992107] openib_post_sr_rdmaw: ibv_post_send wr_id 61ed20 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40641. [D 20:43:17.992123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40642. [D 20:43:17.992137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40643. [D 20:43:17.992152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40644. [D 20:43:17.992166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40645. [D 20:43:17.992181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40646. [D 20:43:17.992195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40647. [D 20:43:17.992210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40648. [D 20:43:17.992224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40649. [D 20:43:17.992238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40650. [D 20:43:17.992253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40651. [D 20:43:17.992267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40652. [D 20:43:17.992282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40653. [D 20:43:17.992297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40654. [D 20:43:17.992311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40655. [D 20:43:17.992326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40656. [D 20:43:17.992340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40657. [D 20:43:17.992354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40658. [D 20:43:17.992368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40659. [D 20:43:17.992383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40660. [D 20:43:17.992397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40661. [D 20:43:17.992412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40662. [D 20:43:17.992426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40663. [D 20:43:17.992440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40664. [D 20:43:17.992454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40665. [D 20:43:17.992469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40666. [D 20:43:17.992483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40667. [D 20:43:17.992497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40668. [D 20:43:17.992512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40669. [D 20:43:17.992526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40670. [D 20:43:17.992540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40671. [D 20:43:17.992555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40672. [D 20:43:17.992569] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40673. [D 20:43:17.992614] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:17.992635] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:17.992648] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.000230] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.000248] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.000261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.000301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6390 [D 20:43:18.000317] element 0: offset: 0x2aaaab60ce70, size: 24 [D 20:43:18.000337] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 17/70. [D 20:43:18.003548] openib_check_cq: completed rdma wr_id 61ed20, nic_wr_credit 40673. [D 20:43:18.003574] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 18/70. [D 20:43:18.011131] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.011151] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.011164] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.011190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6393 [D 20:43:18.011205] element 0: offset: 0x2aaaab60dcc0, size: 24 [D 20:43:18.011220] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 19/70. [D 20:43:18.013929] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 40672. [D 20:43:18.013953] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 20/70. [D 20:43:18.014005] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.014023] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.014036] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.014165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.014181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.014194] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.017240] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6390 [D 20:43:18.017307] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 21/70. [D 20:43:18.020367] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6393 [D 20:43:18.020430] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 22/70. [D 20:43:18.022700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40672. [D 20:43:18.022726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40673. [D 20:43:18.022741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40674. [D 20:43:18.022755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40675. [D 20:43:18.022770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40676. [D 20:43:18.022784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40677. [D 20:43:18.022798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40678. [D 20:43:18.023152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40679. [D 20:43:18.023170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40680. [D 20:43:18.023195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40681. [D 20:43:18.023221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40682. [D 20:43:18.023236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40683. [D 20:43:18.023260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40684. [D 20:43:18.023287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40685. [D 20:43:18.023302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40686. [D 20:43:18.023326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40687. [D 20:43:18.023341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40688. [D 20:43:18.023367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40689. [D 20:43:18.023383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40690. [D 20:43:18.023407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40691. [D 20:43:18.023438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40692. [D 20:43:18.023454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40693. [D 20:43:18.023480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40694. [D 20:43:18.023507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40695. [D 20:43:18.023522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40696. [D 20:43:18.023546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40697. [D 20:43:18.023572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40698. [D 20:43:18.023587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40699. [D 20:43:18.023612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40700. [D 20:43:18.023638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40701. [D 20:43:18.023654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40702. [D 20:43:18.023678] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40703. [D 20:43:18.023708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40704. [D 20:43:18.023723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40705. [D 20:43:18.023737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40706. [D 20:43:18.023752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40707. [D 20:43:18.023766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40708. [D 20:43:18.023784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40709. [D 20:43:18.023798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40710. [D 20:43:18.023813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40711. [D 20:43:18.023826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40712. [D 20:43:18.023841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40713. [D 20:43:18.023855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40714. [D 20:43:18.023870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40715. [D 20:43:18.023883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40716. [D 20:43:18.023898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40717. [D 20:43:18.023912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40718. [D 20:43:18.023926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40719. [D 20:43:18.023940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40720. [D 20:43:18.023955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40721. [D 20:43:18.023970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40722. [D 20:43:18.023985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40723. [D 20:43:18.023999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40724. [D 20:43:18.024013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40725. [D 20:43:18.024027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40726. [D 20:43:18.024041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40727. [D 20:43:18.024056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40728. [D 20:43:18.024075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40729. [D 20:43:18.024089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40730. [D 20:43:18.024103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40731. [D 20:43:18.024118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40732. [D 20:43:18.024132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40733. [D 20:43:18.024146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40734. [D 20:43:18.024160] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40735. [D 20:43:18.031493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.031517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.031530] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.031573] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6396 [D 20:43:18.031588] element 0: offset: 0x2aaaab6359a0, size: 24 [D 20:43:18.031606] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 23/70. [D 20:43:18.034525] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40735. [D 20:43:18.034550] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 24/70. [D 20:43:18.046215] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 40734. [D 20:43:18.046232] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 25/70. [D 20:43:18.046368] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.046389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.046402] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.046488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.046503] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.046516] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.049800] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6396 [D 20:43:18.049878] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 26/70. [D 20:43:18.052597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 40734. [D 20:43:18.052619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 40735. [D 20:43:18.052634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 40736. [D 20:43:18.052648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 40737. [D 20:43:18.052662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 40738. [D 20:43:18.341125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 40739. [D 20:43:18.341544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 40740. [D 20:43:18.341563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40741. [D 20:43:18.341577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40742. [D 20:43:18.341592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40743. [D 20:43:18.341606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 40744. [D 20:43:18.341624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 40745. [D 20:43:18.341639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 40746. [D 20:43:18.341665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 40747. [D 20:43:18.341680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 40748. [D 20:43:18.341695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40749. [D 20:43:18.341709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40750. [D 20:43:18.341724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40751. [D 20:43:18.341738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 40752. [D 20:43:18.341764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 40753. [D 20:43:18.341779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 40754. [D 20:43:18.341793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 40755. [D 20:43:18.341808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 40756. [D 20:43:18.341913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40757. [D 20:43:18.342374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40758. [D 20:43:18.342395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40759. [D 20:43:18.342425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 40760. [D 20:43:18.342440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 40761. [D 20:43:18.342454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 40762. [D 20:43:18.342469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 40763. [D 20:43:18.342483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 40764. [D 20:43:18.342498] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40765. [D 20:43:18.342562] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.342579] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.342593] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.342641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6399 [D 20:43:18.342656] element 0: offset: 0x2aaaab60c7b0, size: 24 [D 20:43:18.342675] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 27/70. [D 20:43:18.343289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.343308] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.343321] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.343349] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6403 [D 20:43:18.343364] element 0: offset: 0x2aaaab60ce70, size: 24 [D 20:43:18.343379] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 28/70. [D 20:43:18.346481] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40765. [D 20:43:18.346503] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 29/70. [D 20:43:18.349859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.349877] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.349891] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.349913] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6405 [D 20:43:18.349928] element 0: offset: 0x2aaaab60a200, size: 24 [D 20:43:18.349943] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 30/70. [D 20:43:18.350067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.350083] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.350097] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.358145] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.358164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.358177] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.358205] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6408 [D 20:43:18.358219] element 0: offset: 0x2aaaab60c760, size: 24 [D 20:43:18.358234] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 31/70. [D 20:43:18.359027] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6399 [D 20:43:18.359111] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 32/70. [D 20:43:18.359173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40765. [D 20:43:18.359197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40766. [D 20:43:18.359212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40767. [D 20:43:18.359227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40768. [D 20:43:18.359242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40769. [D 20:43:18.359257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40770. [D 20:43:18.359272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40771. [D 20:43:18.359287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40772. [D 20:43:18.359301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40773. [D 20:43:18.359316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40774. [D 20:43:18.359331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40775. [D 20:43:18.359346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40776. [D 20:43:18.359361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40777. [D 20:43:18.359376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40778. [D 20:43:18.359391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40779. [D 20:43:18.359405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40780. [D 20:43:18.359420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40781. [D 20:43:18.359435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40782. [D 20:43:18.359453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 40783. [D 20:43:18.359468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 40784. [D 20:43:18.359483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 40785. [D 20:43:18.359498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 40786. [D 20:43:18.359512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 40787. [D 20:43:18.359527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40788. [D 20:43:18.359541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40789. [D 20:43:18.359556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40790. [D 20:43:18.359571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 40791. [D 20:43:18.359586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 40792. [D 20:43:18.359600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 40793. [D 20:43:18.359615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 40794. [D 20:43:18.359630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 40795. [D 20:43:18.359644] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40796. [D 20:43:18.362349] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6403 [D 20:43:18.362422] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 33/70. [D 20:43:18.362496] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6408 [D 20:43:18.362514] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 34/70. [D 20:43:18.362561] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6405 [D 20:43:18.362579] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 35/70. [D 20:43:18.370221] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40796. [D 20:43:18.370251] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 36/70. [D 20:43:18.370268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40796. [D 20:43:18.370284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 40797. [D 20:43:18.370299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 40798. [D 20:43:18.370313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 40799. [D 20:43:18.370328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 40800. [D 20:43:18.370342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 40801. [D 20:43:18.370357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40802. [D 20:43:18.370372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40803. [D 20:43:18.370386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40804. [D 20:43:18.370401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 40805. [D 20:43:18.370415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 40806. [D 20:43:18.370430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 40807. [D 20:43:18.370445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 40808. [D 20:43:18.370459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 40809. [D 20:43:18.370474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40810. [D 20:43:18.370488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40811. [D 20:43:18.370503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40812. [D 20:43:18.370518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40813. [D 20:43:18.370532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40814. [D 20:43:18.370547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40815. [D 20:43:18.370562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40816. [D 20:43:18.370576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40817. [D 20:43:18.370591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40818. [D 20:43:18.370605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40819. [D 20:43:18.370620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40820. [D 20:43:18.370635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40821. [D 20:43:18.370649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40822. [D 20:43:18.370664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40823. [D 20:43:18.370679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40824. [D 20:43:18.370693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40825. [D 20:43:18.370708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40826. [D 20:43:18.370722] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40827. [D 20:43:18.370739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 40828. [D 20:43:18.370754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 40829. [D 20:43:18.370769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 40830. [D 20:43:18.370784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 40831. [D 20:43:18.370799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 40832. [D 20:43:18.370813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 40833. [D 20:43:18.370828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 40834. [D 20:43:18.370842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40835. [D 20:43:18.370857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40836. [D 20:43:18.370871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40837. [D 20:43:18.370886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 40838. [D 20:43:18.370900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 40839. [D 20:43:18.370914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 40840. [D 20:43:18.370929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 40841. [D 20:43:18.370943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 40842. [D 20:43:18.370958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40843. [D 20:43:18.370972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40844. [D 20:43:18.370987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40845. [D 20:43:18.371001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 40846. [D 20:43:18.371016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 40847. [D 20:43:18.371030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 40848. [D 20:43:18.371045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 40849. [D 20:43:18.371059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 40850. [D 20:43:18.371074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40851. [D 20:43:18.371088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40852. [D 20:43:18.371103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40853. [D 20:43:18.371117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 40854. [D 20:43:18.371131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 40855. [D 20:43:18.371146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 40856. [D 20:43:18.371160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 40857. [D 20:43:18.371175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 40858. [D 20:43:18.371190] openib_post_sr_rdmaw: ibv_post_send wr_id 620cb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40859. [D 20:43:18.371206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 40860. [D 20:43:18.371221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 40861. [D 20:43:18.371236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 40862. [D 20:43:18.371250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 40863. [D 20:43:18.371265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 40864. [D 20:43:18.371279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40865. [E 20:43:18.371297] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40866, block for 10 ms. [D 20:43:18.372090] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 40865. [D 20:43:18.372113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40866. [E 20:43:18.372130] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40867, block for 10 ms. [D 20:43:18.376798] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 40866. [D 20:43:18.376821] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 37/70. [D 20:43:18.376835] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 40865. [D 20:43:18.376851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 40866. [D 20:43:18.376866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 40867. [D 20:43:18.376880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 40868. [D 20:43:18.376895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 40869. [D 20:43:18.376909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 40870. [D 20:43:18.376924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 40871. [D 20:43:18.376938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 40872. [D 20:43:18.376953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 40873. [D 20:43:18.376967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 40874. [D 20:43:18.376982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 40875. [D 20:43:18.376996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 40876. [D 20:43:18.377011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 40877. [D 20:43:18.377025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 40878. [D 20:43:18.377040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 40879. [D 20:43:18.377054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 40880. [D 20:43:18.377069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 40881. [D 20:43:18.377083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 40882. [D 20:43:18.377098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 40883. [D 20:43:18.377112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 40884. [D 20:43:18.377126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 40885. [D 20:43:18.377140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 40886. [D 20:43:18.377155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 40887. [D 20:43:18.377169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 40888. [D 20:43:18.377183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 40889. [D 20:43:18.377197] openib_post_sr_rdmaw: ibv_post_send wr_id 66e760 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 40890. [D 20:43:18.380347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.380363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.380378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.382714] openib_check_cq: completed rdma wr_id 620cb0, nic_wr_credit 40890. [D 20:43:18.382731] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 38/70. [D 20:43:18.384074] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.384090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.384103] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.388591] openib_check_cq: completed rdma wr_id 66e760, nic_wr_credit 40889. [D 20:43:18.388607] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 39/70. [D 20:43:18.391627] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.391642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.391655] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.391675] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.391689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.391702] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:18.406787] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.406805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.406819] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:18.406845] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6413 [D 20:43:18.406861] element 0: offset: 0x2aaaab60a200, size: 24 [D 20:43:18.406876] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 40/70. [D 20:43:18.406897] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.406916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.406929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.406949] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6414 [D 20:43:18.406964] element 0: offset: 0x2aaaab60ce70, size: 24 [D 20:43:18.406978] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 41/70. [D 20:43:18.412110] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6413 [D 20:43:18.412194] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 42/70. [D 20:43:18.412335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40889. [D 20:43:18.412361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 40890. [D 20:43:18.412376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 40891. [D 20:43:18.412390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 40892. [D 20:43:18.412405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 40893. [D 20:43:18.412419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 40894. [D 20:43:18.412434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40895. [D 20:43:18.412449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40896. [D 20:43:18.412464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40897. [D 20:43:18.412478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 40898. [D 20:43:18.412493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 40899. [D 20:43:18.412508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 40900. [D 20:43:18.412522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 40901. [D 20:43:18.412537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 40902. [D 20:43:18.412552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40903. [D 20:43:18.412566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40904. [D 20:43:18.412581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40905. [D 20:43:18.412595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 40906. [D 20:43:18.412610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 40907. [D 20:43:18.412625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 40908. [D 20:43:18.412640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 40909. [D 20:43:18.412654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 40910. [D 20:43:18.412669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40911. [D 20:43:18.412683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40912. [D 20:43:18.412698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40913. [D 20:43:18.412713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 40914. [D 20:43:18.412728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 40915. [D 20:43:18.412742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 40916. [D 20:43:18.412757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 40917. [D 20:43:18.412771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 40918. [D 20:43:18.412786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40919. [D 20:43:18.412800] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40920. [D 20:43:18.414764] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6414 [D 20:43:18.414825] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 43/70. [D 20:43:18.423983] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40920. [D 20:43:18.424009] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 44/70. [D 20:43:18.424025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40920. [D 20:43:18.424040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40921. [D 20:43:18.424055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 40922. [D 20:43:18.424073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 40923. [D 20:43:18.424088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 40924. [D 20:43:18.424102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 40925. [D 20:43:18.424118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 40926. [D 20:43:18.424132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40927. [D 20:43:18.424147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40928. [D 20:43:18.424161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40929. [D 20:43:18.424176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 40930. [D 20:43:18.424191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 40931. [D 20:43:18.424205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 40932. [D 20:43:18.424220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 40933. [D 20:43:18.424234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 40934. [D 20:43:18.424249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40935. [D 20:43:18.424263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40936. [D 20:43:18.424278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40937. [D 20:43:18.424292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40938. [D 20:43:18.424307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40939. [D 20:43:18.424321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40940. [D 20:43:18.424336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40941. [D 20:43:18.424351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40942. [D 20:43:18.424365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40943. [D 20:43:18.424380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40944. [D 20:43:18.424394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40945. [D 20:43:18.424409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40946. [D 20:43:18.424423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40947. [D 20:43:18.424439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40948. [D 20:43:18.424454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40949. [D 20:43:18.424468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40950. [D 20:43:18.424482] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40951. [D 20:43:18.424557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.424580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.424593] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.432746] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.432764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.432777] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.432817] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6418 [D 20:43:18.432832] element 0: offset: 0x2aaaab60c7b0, size: 24 [D 20:43:18.432850] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 45/70. [D 20:43:18.434861] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 40951. [D 20:43:18.434884] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 46/70. [D 20:43:18.434996] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.435015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.435028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.438239] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6418 [D 20:43:18.438307] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 47/70. [D 20:43:18.440563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 40951. [D 20:43:18.440588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 40952. [D 20:43:18.440603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 40953. [D 20:43:18.440669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 40954. [D 20:43:18.440695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 40955. [D 20:43:18.440710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 40956. [D 20:43:18.440724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40957. [D 20:43:18.440739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40958. [D 20:43:18.440753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40959. [D 20:43:18.440768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 40960. [D 20:43:18.441168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 40961. [D 20:43:18.441184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 40962. [D 20:43:18.441199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 40963. [D 20:43:18.441226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 40964. [D 20:43:18.441240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40965. [D 20:43:18.441255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40966. [D 20:43:18.441270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40967. [D 20:43:18.441285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 40968. [D 20:43:18.441302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 40969. [D 20:43:18.441317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 40970. [D 20:43:18.441331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 40971. [D 20:43:18.441346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 40972. [D 20:43:18.441360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40973. [D 20:43:18.441375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40974. [D 20:43:18.441389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40975. [D 20:43:18.441404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 40976. [D 20:43:18.441418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 40977. [D 20:43:18.441433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 40978. [D 20:43:18.441447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 40979. [D 20:43:18.441462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 40980. [D 20:43:18.441476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40981. [D 20:43:18.441491] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40982. [D 20:43:18.443321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.443345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.443358] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.443400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6420 [D 20:43:18.443416] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:18.443433] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 48/70. [D 20:43:18.452188] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 40982. [D 20:43:18.452213] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 49/70. [D 20:43:18.452325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.452345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.452359] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.455581] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6420 [D 20:43:18.455655] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 50/70. [D 20:43:18.458412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40982. [D 20:43:18.458433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40983. [D 20:43:18.458448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 40984. [D 20:43:18.458463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 40985. [D 20:43:18.458478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 40986. [D 20:43:18.458492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 40987. [D 20:43:18.458520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 40988. [D 20:43:18.458535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40989. [D 20:43:18.458560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40990. [D 20:43:18.458576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40991. [D 20:43:18.458599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 40992. [D 20:43:18.458625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 40993. [D 20:43:18.458640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 40994. [D 20:43:18.458668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 40995. [D 20:43:18.458683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 40996. [D 20:43:18.458699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40997. [D 20:43:18.458729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40998. [D 20:43:18.458754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40999. [D 20:43:18.458779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41000. [D 20:43:18.458795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41001. [D 20:43:18.458809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41002. [D 20:43:18.458836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41003. [D 20:43:18.458857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41004. [D 20:43:18.458872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41005. [D 20:43:18.458898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41006. [D 20:43:18.458913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41007. [D 20:43:18.458937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41008. [D 20:43:18.458951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41009. [D 20:43:18.458966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41010. [D 20:43:18.458980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41011. [D 20:43:18.458995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41012. [D 20:43:18.459009] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41013. [D 20:43:18.461157] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.461182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.461195] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.461238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6424 [D 20:43:18.461254] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:18.461273] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 51/70. [D 20:43:18.470105] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41013. [D 20:43:18.470129] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 52/70. [D 20:43:18.470302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.470323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.470336] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.473519] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6424 [D 20:43:18.473590] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 53/70. [D 20:43:18.475930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 41013. [D 20:43:18.475951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 41014. [D 20:43:18.475965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 41015. [D 20:43:18.475980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 41016. [D 20:43:18.475995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 41017. [D 20:43:18.476010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 41018. [D 20:43:18.476024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41019. [D 20:43:18.476039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41020. [D 20:43:18.476053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41021. [D 20:43:18.476071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 41022. [D 20:43:18.476085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 41023. [D 20:43:18.476100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 41024. [D 20:43:18.476115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 41025. [D 20:43:18.476129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 41026. [D 20:43:18.476144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41027. [D 20:43:18.476158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41028. [D 20:43:18.476173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41029. [D 20:43:18.476187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 41030. [D 20:43:18.476202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 41031. [D 20:43:18.476216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 41032. [D 20:43:18.476231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 41033. [D 20:43:18.476245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 41034. [D 20:43:18.476260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41035. [D 20:43:18.476275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41036. [D 20:43:18.476289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41037. [D 20:43:18.476305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 41038. [D 20:43:18.476319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 41039. [D 20:43:18.476334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 41040. [D 20:43:18.476349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 41041. [D 20:43:18.476363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 41042. [D 20:43:18.476378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41043. [D 20:43:18.476392] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41044. [D 20:43:18.478589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.478612] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.478626] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.478669] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6426 [D 20:43:18.478684] element 0: offset: 0x2aaaab018ed0, size: 24 [D 20:43:18.478702] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 54/70. [D 20:43:18.482530] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41044. [D 20:43:18.482554] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 55/70. [D 20:43:18.482671] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.482692] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.482705] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.485734] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6426 [D 20:43:18.485798] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 56/70. [D 20:43:18.485945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41044. [D 20:43:18.485966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41045. [D 20:43:18.485981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41046. [D 20:43:18.486006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41047. [D 20:43:18.486021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41048. [D 20:43:18.486040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41049. [D 20:43:18.486055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41050. [D 20:43:18.486070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41051. [D 20:43:18.486084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41052. [D 20:43:18.486099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41053. [D 20:43:18.486114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41054. [D 20:43:18.486128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41055. [D 20:43:18.486143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41056. [D 20:43:18.486158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41057. [D 20:43:18.486173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41058. [D 20:43:18.486188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41059. [D 20:43:18.486202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41060. [D 20:43:18.486217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41061. [D 20:43:18.486232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41062. [D 20:43:18.486246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41063. [D 20:43:18.486261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41064. [D 20:43:18.486276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41065. [D 20:43:18.486290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41066. [D 20:43:18.486305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41067. [D 20:43:18.486320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41068. [D 20:43:18.486334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41069. [D 20:43:18.486349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41070. [D 20:43:18.486364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41071. [D 20:43:18.486379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41072. [D 20:43:18.486393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41073. [D 20:43:18.486408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41074. [D 20:43:18.486422] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41075. [D 20:43:18.497640] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41075. [D 20:43:18.497657] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 57/70. [D 20:43:18.497788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.497811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.497824] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:18.498266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.498281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.498294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:18.498333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6430 [D 20:43:18.498348] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:18.498365] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 58/70. [D 20:43:18.502042] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6430 [D 20:43:18.502118] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 59/70. [D 20:43:18.505004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 41075. [D 20:43:18.505028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 41076. [D 20:43:18.505043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 41077. [D 20:43:18.505059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 41078. [D 20:43:18.505073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 41079. [D 20:43:18.505088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 41080. [D 20:43:18.505102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41081. [D 20:43:18.505117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41082. [D 20:43:18.505131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41083. [D 20:43:18.505146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 41084. [D 20:43:18.505160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 41085. [D 20:43:18.505175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 41086. [D 20:43:18.505189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 41087. [D 20:43:18.505204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 41088. [D 20:43:18.505230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41089. [D 20:43:18.505245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41090. [D 20:43:18.505270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41091. [D 20:43:18.505284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 41092. [D 20:43:18.505310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 41093. [D 20:43:18.505339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 41094. [D 20:43:18.505354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 41095. [D 20:43:18.505381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 41096. [D 20:43:18.505403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41097. [D 20:43:18.505418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41098. [D 20:43:18.505443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41099. [D 20:43:18.505468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 41100. [D 20:43:18.505484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 41101. [D 20:43:18.505512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 41102. [D 20:43:18.505528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 41103. [D 20:43:18.505551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 41104. [D 20:43:18.505566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41105. [D 20:43:18.505594] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41106. [D 20:43:18.507730] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.507755] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.507768] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.507812] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6432 [D 20:43:18.507827] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:18.507844] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:43:18.511364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.511382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.511395] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.511419] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6435 [D 20:43:18.511434] element 0: offset: 0x2aaaab018ed0, size: 24 [D 20:43:18.511460] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 0/70. [D 20:43:18.516582] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41106. [D 20:43:18.516606] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 1/70. [D 20:43:18.516755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.516776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.516789] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.520188] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6432 [D 20:43:18.520262] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 2/70. [D 20:43:18.522511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41106. [D 20:43:18.522534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41107. [D 20:43:18.522549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41108. [D 20:43:18.522563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41109. [D 20:43:18.522577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41110. [D 20:43:18.522592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41111. [D 20:43:18.522618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41112. [D 20:43:18.522634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41113. [D 20:43:18.522657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41114. [D 20:43:18.522677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41115. [D 20:43:18.522701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41116. [D 20:43:18.522716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41117. [D 20:43:18.522749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41118. [D 20:43:18.522777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41119. [D 20:43:18.522799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41120. [D 20:43:18.522814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41121. [D 20:43:18.522841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41122. [D 20:43:18.522855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41123. [D 20:43:18.522880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41124. [D 20:43:18.522895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41125. [D 20:43:18.522922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41126. [D 20:43:18.522937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41127. [D 20:43:18.522962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41128. [D 20:43:18.522976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41129. [D 20:43:18.522999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41130. [D 20:43:18.523013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41131. [D 20:43:18.523040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41132. [D 20:43:18.523055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41133. [D 20:43:18.523069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41134. [D 20:43:18.523083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41135. [D 20:43:18.523098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41136. [D 20:43:18.523115] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41137. [D 20:43:18.523337] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6435 [D 20:43:18.523412] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 3/70. [D 20:43:18.525227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.525245] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.525258] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.525300] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6439 [D 20:43:18.525315] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:18.525334] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 4/70. [D 20:43:18.530038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.530055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.530067] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.530091] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6441 [D 20:43:18.530105] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:18.530121] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 5/70. [D 20:43:18.534261] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41137. [D 20:43:18.534288] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 6/70. [D 20:43:18.534351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41137. [D 20:43:18.534374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41138. [D 20:43:18.534389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 41139. [D 20:43:18.534417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 41140. [D 20:43:18.534432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 41141. [D 20:43:18.534457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 41142. [D 20:43:18.538995] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6441 [D 20:43:18.796124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 41143. [D 20:43:18.796169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41144. [D 20:43:18.796304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41145. [D 20:43:18.796320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41146. [D 20:43:18.796333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 41147. [D 20:43:18.796348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 41148. [D 20:43:18.796362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 41149. [D 20:43:18.796376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 41150. [D 20:43:18.796390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 41151. [D 20:43:18.796404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41152. [D 20:43:18.796418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41153. [D 20:43:18.796432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41154. [D 20:43:18.796446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41155. [D 20:43:18.796460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41156. [D 20:43:18.796474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41157. [D 20:43:18.796488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41158. [D 20:43:18.796502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41159. [D 20:43:18.796516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41160. [D 20:43:18.796530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41161. [D 20:43:18.796546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41162. [D 20:43:18.796559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41163. [D 20:43:18.796573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41164. [D 20:43:18.796591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41165. [D 20:43:18.796605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41166. [D 20:43:18.796619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41167. [D 20:43:18.796637] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41168. [D 20:43:18.796676] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 7/70. [D 20:43:18.796703] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6439 [D 20:43:18.796719] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 8/70. [D 20:43:18.796793] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.796809] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.796822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.800325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.800347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.800360] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.800399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6444 [D 20:43:18.800414] element 0: offset: 0x2aaaab038850, size: 24 [D 20:43:18.800431] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 9/70. [D 20:43:18.801076] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41168. [D 20:43:18.801096] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 10/70. [D 20:43:18.801158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41168. [D 20:43:18.801176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41169. [D 20:43:18.801190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41170. [D 20:43:18.801205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41171. [D 20:43:18.801219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41172. [D 20:43:18.801234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41173. [D 20:43:18.801248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41174. [D 20:43:18.801264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41175. [D 20:43:18.801279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41176. [D 20:43:18.801293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41177. [D 20:43:18.801308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41178. [D 20:43:18.801322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41179. [D 20:43:18.801341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41180. [D 20:43:18.801355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41181. [D 20:43:18.801370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41182. [D 20:43:18.801385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41183. [D 20:43:18.801399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41184. [D 20:43:18.801413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41185. [D 20:43:18.801428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41186. [D 20:43:18.801442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41187. [D 20:43:18.801457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41188. [D 20:43:18.801490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41189. [D 20:43:18.801551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41190. [D 20:43:18.801565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41191. [D 20:43:18.801580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41192. [D 20:43:18.801594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41193. [D 20:43:18.801608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41194. [D 20:43:18.801622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41195. [D 20:43:18.801636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41196. [D 20:43:18.801650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41197. [D 20:43:18.801664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41198. [D 20:43:18.801679] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41199. [D 20:43:18.801695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 41200. [D 20:43:18.801709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 41201. [D 20:43:18.801723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 41202. [D 20:43:18.801737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 41203. [D 20:43:18.801751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 41204. [D 20:43:18.801765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 41205. [D 20:43:18.801779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41206. [D 20:43:18.801793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41207. [D 20:43:18.801808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41208. [D 20:43:18.801822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 41209. [D 20:43:18.801836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 41210. [D 20:43:18.801850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 41211. [D 20:43:18.801864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 41212. [D 20:43:18.801878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 41213. [D 20:43:18.801892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41214. [D 20:43:18.801906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41215. [D 20:43:18.801921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41216. [D 20:43:18.801936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 41217. [D 20:43:18.801950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 41218. [D 20:43:18.801964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 41219. [D 20:43:18.801984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 41220. [D 20:43:18.801998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 41221. [D 20:43:18.802012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41222. [D 20:43:18.802026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41223. [D 20:43:18.802043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41224. [D 20:43:18.802057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 41225. [D 20:43:18.802071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 41226. [D 20:43:18.802085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 41227. [D 20:43:18.802100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 41228. [D 20:43:18.802114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 41229. [D 20:43:18.802128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41230. [D 20:43:18.802142] openib_post_sr_rdmaw: ibv_post_send wr_id 61ed20 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41231. [D 20:43:18.805367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.805384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.805396] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.807054] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41231. [D 20:43:18.807069] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 11/70. [D 20:43:18.812130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.812209] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.812296] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.812345] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6447 [D 20:43:18.812366] element 0: offset: 0x2aaaab011980, size: 24 [D 20:43:18.812388] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 12/70. [D 20:43:18.812443] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6444 [D 20:43:18.812463] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 13/70. [D 20:43:18.812891] openib_check_cq: completed rdma wr_id 61ed20, nic_wr_credit 41230. [D 20:43:18.812914] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 14/70. [D 20:43:18.812930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41230. [D 20:43:18.812945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41231. [D 20:43:18.812959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41232. [D 20:43:18.812973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41233. [D 20:43:18.812987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41234. [D 20:43:18.813002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41235. [D 20:43:18.813016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41236. [D 20:43:18.813030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41237. [D 20:43:18.813044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41238. [D 20:43:18.813058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41239. [D 20:43:18.813073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41240. [D 20:43:18.813087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41241. [D 20:43:18.813101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41242. [D 20:43:18.813115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41243. [D 20:43:18.813130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41244. [D 20:43:18.813144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41245. [D 20:43:18.813158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41246. [D 20:43:18.813173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41247. [D 20:43:18.813187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41248. [D 20:43:18.813202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41249. [D 20:43:18.813216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41250. [D 20:43:18.813230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41251. [D 20:43:18.813245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41252. [D 20:43:18.813259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41253. [D 20:43:18.813273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41254. [D 20:43:18.813287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41255. [D 20:43:18.813302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41256. [D 20:43:18.813316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41257. [D 20:43:18.813330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41258. [D 20:43:18.813344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41259. [D 20:43:18.813359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41260. [D 20:43:18.813373] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41261. [D 20:43:18.813442] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.813463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.813477] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.813502] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.813516] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.813529] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.818995] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41261. [D 20:43:18.819014] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 15/70. [D 20:43:18.822003] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6447 [D 20:43:18.822091] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 16/70. [D 20:43:18.822101] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.822121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.822134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.824266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41261. [D 20:43:18.824284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41262. [D 20:43:18.824298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 41263. [D 20:43:18.824312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 41264. [D 20:43:18.824327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 41265. [D 20:43:18.824341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 41266. [D 20:43:18.824356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 41267. [D 20:43:18.824370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41268. [D 20:43:18.824384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41269. [D 20:43:18.824399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41270. [D 20:43:18.824413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 41271. [D 20:43:18.824427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 41272. [D 20:43:18.824441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 41273. [D 20:43:18.824456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 41274. [D 20:43:18.824470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 41275. [D 20:43:18.824484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41276. [D 20:43:18.824499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41277. [D 20:43:18.824513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41278. [D 20:43:18.824527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41279. [D 20:43:18.824542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41280. [D 20:43:18.824556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41281. [D 20:43:18.824570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41282. [D 20:43:18.824585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41283. [D 20:43:18.824599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41284. [D 20:43:18.824613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41285. [D 20:43:18.824628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41286. [D 20:43:18.824642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41287. [D 20:43:18.824658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41288. [D 20:43:18.824672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41289. [D 20:43:18.824686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41290. [D 20:43:18.824700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41291. [D 20:43:18.824715] openib_post_sr_rdmaw: ibv_post_send wr_id 641fb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41292. [D 20:43:18.829913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.829928] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.829941] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.829965] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6451 [D 20:43:18.829980] element 0: offset: 0x2aaaab018ed0, size: 24 [D 20:43:18.829997] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 17/70. [D 20:43:18.830600] openib_check_cq: completed rdma wr_id 641fb0, nic_wr_credit 41292. [D 20:43:18.830628] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 18/70. [D 20:43:18.830702] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.830720] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.830733] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.836642] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.836658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.836671] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.836693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6455 [D 20:43:18.836707] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:18.836730] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 19/70. [D 20:43:18.836764] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.836778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.836791] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.836810] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6456 [D 20:43:18.836824] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:18.836838] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 20/70. [D 20:43:18.839171] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.839187] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.839199] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.839220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6459 [D 20:43:18.839234] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:18.839249] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 21/70. [D 20:43:18.847947] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6451 [D 20:43:18.848043] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 22/70. [D 20:43:18.848187] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6455 [D 20:43:18.848265] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 23/70. [D 20:43:18.848312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41292. [D 20:43:18.848331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41293. [D 20:43:18.848347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41294. [D 20:43:18.848361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41295. [D 20:43:18.848376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41296. [D 20:43:18.848393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41297. [D 20:43:18.848408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41298. [D 20:43:18.848422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41299. [D 20:43:18.848437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41300. [D 20:43:18.848451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41301. [D 20:43:18.848466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41302. [D 20:43:18.848480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41303. [D 20:43:18.848494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41304. [D 20:43:18.848509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41305. [D 20:43:18.848523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41306. [D 20:43:18.848537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41307. [D 20:43:18.848552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41308. [D 20:43:18.848566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41309. [D 20:43:18.848581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41310. [D 20:43:18.848595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41311. [D 20:43:18.848609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41312. [D 20:43:18.848624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41313. [D 20:43:18.848639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41314. [D 20:43:18.848653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41315. [D 20:43:18.848669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41316. [D 20:43:18.848683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41317. [D 20:43:18.848697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41318. [D 20:43:18.848712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41319. [D 20:43:18.848726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41320. [D 20:43:18.848740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41321. [D 20:43:18.848755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41322. [D 20:43:18.848769] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41323. [D 20:43:18.848788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 41324. [D 20:43:18.848803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 41325. [D 20:43:18.848818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 41326. [D 20:43:18.848833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 41327. [D 20:43:18.848847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 41328. [D 20:43:18.848861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 41329. [D 20:43:18.848876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41330. [D 20:43:18.848891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41331. [D 20:43:18.848905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41332. [D 20:43:18.848919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 41333. [D 20:43:18.848933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 41334. [D 20:43:18.848948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 41335. [D 20:43:18.848962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 41336. [D 20:43:18.848977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 41337. [D 20:43:18.848991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41338. [D 20:43:18.849005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41339. [D 20:43:18.849022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41340. [D 20:43:18.849036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 41341. [D 20:43:18.849051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 41342. [D 20:43:18.849065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 41343. [D 20:43:18.849080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 41344. [D 20:43:18.849094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 41345. [D 20:43:18.849108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41346. [D 20:43:18.849123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41347. [D 20:43:18.849137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41348. [D 20:43:18.849151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 41349. [D 20:43:18.849166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 41350. [D 20:43:18.849180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 41351. [D 20:43:18.849194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 41352. [D 20:43:18.849209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 41353. [D 20:43:18.849223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41354. [D 20:43:18.849239] openib_post_sr_rdmaw: ibv_post_send wr_id 620cb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41355. [D 20:43:18.852109] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6456 [D 20:43:18.852140] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 24/70. [D 20:43:18.854586] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6459 [D 20:43:18.854639] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 25/70. [D 20:43:18.859999] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41355. [D 20:43:18.860025] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 26/70. [D 20:43:18.871562] openib_check_cq: completed rdma wr_id 620cb0, nic_wr_credit 41354. [D 20:43:18.871584] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 27/70. [D 20:43:18.871621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41354. [D 20:43:18.871638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41355. [D 20:43:18.871653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41356. [D 20:43:18.871659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.871670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41357. [D 20:43:18.871689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.871707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41358. [D 20:43:18.871723] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.871742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41359. [D 20:43:18.871772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41360. [D 20:43:18.871787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41361. [D 20:43:18.871802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41362. [D 20:43:18.871817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41363. [D 20:43:18.871832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41364. [D 20:43:18.871847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41365. [D 20:43:18.871862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41366. [D 20:43:18.871877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41367. [D 20:43:18.871892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41368. [D 20:43:18.871906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41369. [D 20:43:18.871921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41370. [D 20:43:18.871936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41371. [D 20:43:18.871951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41372. [D 20:43:18.871966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41373. [D 20:43:18.871981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41374. [D 20:43:18.872002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41375. [D 20:43:18.872017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41376. [D 20:43:18.872031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41377. [D 20:43:18.872046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41378. [D 20:43:18.872061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41379. [D 20:43:18.872082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41380. [D 20:43:18.872097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41381. [D 20:43:18.872112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41382. [D 20:43:18.872138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41383. [D 20:43:18.872161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41384. [D 20:43:18.872176] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41385. [D 20:43:18.872195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41386. [D 20:43:18.872210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41387. [D 20:43:18.872225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 41388. [D 20:43:18.872240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 41389. [D 20:43:18.872255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 41390. [D 20:43:18.872269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 41391. [D 20:43:18.872284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 41392. [D 20:43:18.872299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41393. [D 20:43:18.872314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41394. [D 20:43:18.872329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41395. [D 20:43:18.872344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 41396. [D 20:43:18.872359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 41397. [D 20:43:18.872374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 41398. [D 20:43:18.872389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 41399. [D 20:43:18.872403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 41400. [D 20:43:18.872418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41401. [D 20:43:18.872433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41402. [D 20:43:18.872448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41403. [D 20:43:18.872464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41404. [D 20:43:18.872478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41405. [D 20:43:18.872493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41406. [D 20:43:18.872508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41407. [D 20:43:18.872523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41408. [D 20:43:18.872537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41409. [D 20:43:18.872552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41410. [D 20:43:18.872567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41411. [D 20:43:18.872581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41412. [D 20:43:18.872596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41413. [D 20:43:18.872611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41414. [D 20:43:18.872626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41415. [D 20:43:18.872640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41416. [D 20:43:18.872655] openib_post_sr_rdmaw: ibv_post_send wr_id 638dc0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41417. [D 20:43:18.872699] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.872719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.872732] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.877786] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 41417. [D 20:43:18.877811] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 28/70. [D 20:43:18.883669] openib_check_cq: completed rdma wr_id 638dc0, nic_wr_credit 41416. [D 20:43:18.883685] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 29/70. [D 20:43:18.883724] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.883742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.883755] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.883780] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.883794] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.883806] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:18.889128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.889145] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.889158] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:18.889195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6463 [D 20:43:18.889210] element 0: offset: 0x2aaaab030720, size: 24 [D 20:43:18.889229] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 30/70. [D 20:43:18.889266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.889279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.889292] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.889312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6466 [D 20:43:18.889326] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:43:18.889340] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 31/70. [D 20:43:18.895214] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6463 [D 20:43:18.895242] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 32/70. [D 20:43:18.895266] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6466 [D 20:43:18.895291] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 33/70. [D 20:43:18.895354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41416. [D 20:43:18.895424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41417. [D 20:43:18.895439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41418. [D 20:43:18.895453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41419. [D 20:43:18.895471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41420. [D 20:43:18.895486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41421. [D 20:43:18.895500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41422. [D 20:43:18.895514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41423. [D 20:43:18.895528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41424. [D 20:43:18.895542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41425. [D 20:43:18.895557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41426. [D 20:43:18.895571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41427. [D 20:43:18.895585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41428. [D 20:43:18.895599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41429. [D 20:43:18.895613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41430. [D 20:43:18.895627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41431. [D 20:43:18.895641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41432. [D 20:43:18.895655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41433. [D 20:43:18.895669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41434. [D 20:43:18.895684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41435. [D 20:43:18.895698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41436. [D 20:43:18.895712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41437. [D 20:43:18.895726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41438. [D 20:43:18.895740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41439. [D 20:43:18.895754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41440. [D 20:43:18.895769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41441. [D 20:43:18.895783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41442. [D 20:43:18.895798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41443. [D 20:43:18.895813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41444. [D 20:43:18.895827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41445. [D 20:43:18.895841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41446. [D 20:43:18.895855] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41447. [D 20:43:18.895874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 41448. [D 20:43:18.895888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 41449. [D 20:43:18.895902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 41450. [D 20:43:18.895917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 41451. [D 20:43:18.895931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 41452. [D 20:43:18.895945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 41453. [D 20:43:18.895959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41454. [D 20:43:18.895973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41455. [D 20:43:18.895987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41456. [D 20:43:18.896001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 41457. [D 20:43:18.896016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 41458. [D 20:43:18.896030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 41459. [D 20:43:18.896043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 41460. [D 20:43:18.896058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 41461. [D 20:43:18.896088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41462. [D 20:43:18.896103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41463. [D 20:43:18.896117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41464. [D 20:43:18.896131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 41465. [D 20:43:18.896145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 41466. [D 20:43:18.896159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 41467. [D 20:43:18.896173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 41468. [D 20:43:18.896187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 41469. [D 20:43:18.896201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41470. [D 20:43:18.896216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41471. [D 20:43:18.896231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41472. [D 20:43:18.896245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 41473. [D 20:43:18.896259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 41474. [D 20:43:18.896274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 41475. [D 20:43:18.896288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 41476. [D 20:43:18.896302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 41477. [D 20:43:18.896317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41478. [D 20:43:18.896331] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41479. [D 20:43:18.900118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.900136] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.900149] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.900192] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6469 [D 20:43:18.900206] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:18.901004] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 34/70. [D 20:43:18.901032] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.901046] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.901058] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:18.901079] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6471 [D 20:43:18.901093] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:18.901106] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 35/70. [D 20:43:18.905450] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41479. [D 20:43:18.905477] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 36/70. [D 20:43:18.917063] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 41478. [D 20:43:18.917084] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 37/70. [D 20:43:18.917144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.917163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.917177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:18.917290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.917305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.917318] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.920256] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6469 [D 20:43:18.920284] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 38/70. [D 20:43:18.924550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41478. [D 20:43:18.924654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41479. [D 20:43:18.924680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41480. [D 20:43:18.924695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41481. [D 20:43:18.924719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41482. [D 20:43:18.924734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41483. [D 20:43:18.924748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41484. [D 20:43:18.924777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41485. [D 20:43:18.924793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41486. [D 20:43:18.924807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41487. [D 20:43:18.924831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41488. [D 20:43:18.924846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41489. [D 20:43:18.924861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41490. [D 20:43:18.924888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41491. [D 20:43:18.924912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41492. [D 20:43:18.924927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41493. [D 20:43:18.924949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41494. [D 20:43:18.924965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41495. [D 20:43:18.924991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41496. [D 20:43:18.925016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41497. [D 20:43:18.925030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41498. [D 20:43:18.925045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41499. [D 20:43:18.925071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41500. [D 20:43:18.925086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41501. [D 20:43:18.925101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41502. [D 20:43:18.925115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41503. [D 20:43:18.925130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41504. [D 20:43:18.925144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41505. [D 20:43:18.925159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41506. [D 20:43:18.925173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41507. [D 20:43:18.925188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41508. [D 20:43:18.925202] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41509. [D 20:43:18.930594] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6471 [D 20:43:18.930674] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 39/70. [D 20:43:18.932953] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.933002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.933016] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:18.933058] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6474 [D 20:43:18.933076] element 0: offset: 0x2aaaab014050, size: 24 [D 20:43:18.933097] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 40/70. [D 20:43:18.936383] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41509. [D 20:43:18.936412] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 41/70. [D 20:43:18.936897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41509. [D 20:43:18.936913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41510. [D 20:43:18.936928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 41511. [D 20:43:18.936942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 41512. [D 20:43:18.936957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 41513. [D 20:43:18.936971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 41514. [D 20:43:18.936986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 41515. [D 20:43:18.937000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41516. [D 20:43:18.937015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41517. [D 20:43:18.937029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41518. [D 20:43:18.937044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 41519. [D 20:43:18.937058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 41520. [D 20:43:18.937073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 41521. [D 20:43:18.937087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 41522. [D 20:43:18.937102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 41523. [D 20:43:18.937116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41524. [D 20:43:18.937130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41525. [D 20:43:18.937145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41526. [D 20:43:18.937159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41527. [D 20:43:18.937174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41528. [D 20:43:18.937188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41529. [D 20:43:18.937203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41530. [D 20:43:18.937217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41531. [D 20:43:18.937232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41532. [D 20:43:18.937246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41533. [D 20:43:18.937260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41534. [D 20:43:18.937275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41535. [D 20:43:18.937290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41536. [D 20:43:18.937305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41537. [D 20:43:18.937320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41538. [D 20:43:18.937335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41539. [D 20:43:18.937349] openib_post_sr_rdmaw: ibv_post_send wr_id 62ea00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41540. [D 20:43:18.937415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.937437] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.937450] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:18.940487] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6474 [D 20:43:18.940511] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 42/70. [D 20:43:18.948519] openib_check_cq: completed rdma wr_id 62ea00, nic_wr_credit 41540. [D 20:43:18.948541] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 43/70. [D 20:43:18.948681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.948734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.948747] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:18.953004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 41540. [D 20:43:18.953025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 41541. [D 20:43:18.953040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 41542. [D 20:43:18.953055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 41543. [D 20:43:18.953069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 41544. [D 20:43:18.953083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 41545. [D 20:43:18.953098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 41546. [D 20:43:18.953112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41547. [D 20:43:18.953127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41548. [D 20:43:18.953141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41549. [D 20:43:18.953156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 41550. [D 20:43:18.953170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 41551. [D 20:43:18.953185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 41552. [D 20:43:18.953199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 41553. [D 20:43:18.953214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 41554. [D 20:43:18.953228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41555. [D 20:43:18.953242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41556. [D 20:43:18.953257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41557. [D 20:43:18.953272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 41558. [D 20:43:18.953287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 41559. [D 20:43:18.953302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 41560. [D 20:43:18.953316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 41561. [D 20:43:18.953331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 41562. [D 20:43:18.953345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41563. [D 20:43:18.953360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41564. [D 20:43:18.953374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41565. [D 20:43:18.953388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 41566. [D 20:43:18.953403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 41567. [D 20:43:18.953417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 41568. [D 20:43:18.953432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 41569. [D 20:43:18.953446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 41570. [D 20:43:18.953460] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41571. [D 20:43:18.960003] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 41571. [D 20:43:18.960025] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 44/70. [D 20:43:18.960089] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:18.960107] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.960120] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:18.966610] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.966626] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.966639] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:18.966678] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6477 [D 20:43:18.966694] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:18.966714] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 45/70. [D 20:43:18.969124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:18.969139] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:18.969152] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:18.969172] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6480 [D 20:43:18.969187] element 0: offset: 0x2aaaab030720, size: 24 [D 20:43:18.969201] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 46/70. [D 20:43:18.972563] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6477 [D 20:43:18.972655] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 47/70. [D 20:43:18.972734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41571. [D 20:43:18.972772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41572. [D 20:43:18.972787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41573. [D 20:43:18.972801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41574. [D 20:43:18.975334] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6480 [D 20:43:19.253519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41575. [D 20:43:19.253593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41576. [D 20:43:19.253611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41577. [D 20:43:19.253626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41578. [D 20:43:19.253641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41579. [D 20:43:19.253654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41580. [D 20:43:19.253671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41581. [D 20:43:19.253687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41582. [D 20:43:19.253701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41583. [D 20:43:19.253715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41584. [D 20:43:19.253729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41585. [D 20:43:19.253743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41586. [D 20:43:19.253757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41587. [D 20:43:19.253774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41588. [D 20:43:19.253789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41589. [D 20:43:19.253803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41590. [D 20:43:19.253817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41591. [D 20:43:19.253831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41592. [D 20:43:19.253846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41593. [D 20:43:19.253860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41594. [D 20:43:19.253875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41595. [D 20:43:19.253890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41596. [D 20:43:19.253905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41597. [D 20:43:19.253918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41598. [D 20:43:19.253932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41599. [D 20:43:19.253947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41600. [D 20:43:19.253961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41601. [D 20:43:19.253975] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41602. [D 20:43:19.254039] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 48/70. [D 20:43:19.254054] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.254077] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.254091] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.254136] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6484 [D 20:43:19.254151] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:19.254170] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 49/70. [D 20:43:19.257448] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.257464] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.257477] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.257498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6486 [D 20:43:19.257512] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:19.257527] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 50/70. [D 20:43:19.258834] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41602. [D 20:43:19.258856] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 51/70. [D 20:43:19.258925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41602. [D 20:43:19.258941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41603. [D 20:43:19.258956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 41604. [D 20:43:19.258972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 41605. [D 20:43:19.258986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 41606. [D 20:43:19.259000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 41607. [D 20:43:19.259014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 41608. [D 20:43:19.259028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41609. [D 20:43:19.259041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41610. [D 20:43:19.259056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41611. [D 20:43:19.259072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 41612. [D 20:43:19.259085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 41613. [D 20:43:19.259100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 41614. [D 20:43:19.259114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 41615. [D 20:43:19.259128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 41616. [D 20:43:19.259141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41617. [D 20:43:19.259156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41618. [D 20:43:19.259171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41619. [D 20:43:19.259185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 41620. [D 20:43:19.259199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 41621. [D 20:43:19.259213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 41622. [D 20:43:19.259228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 41623. [D 20:43:19.259242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 41624. [D 20:43:19.259259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41625. [D 20:43:19.259274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41626. [D 20:43:19.259288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41627. [D 20:43:19.259307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 41628. [D 20:43:19.259323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 41629. [D 20:43:19.259337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 41630. [D 20:43:19.259351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 41631. [D 20:43:19.259365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 41632. [D 20:43:19.259379] openib_post_sr_rdmaw: ibv_post_send wr_id 620cb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41633. [D 20:43:19.262579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.262596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.262609] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.264853] openib_check_cq: completed rdma wr_id 620cb0, nic_wr_credit 41633. [D 20:43:19.264913] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 52/70. [D 20:43:19.267951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.267968] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.267981] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.271785] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6484 [D 20:43:19.271820] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 53/70. [D 20:43:19.271845] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6486 [D 20:43:19.271869] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 54/70. [D 20:43:19.271910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41633. [D 20:43:19.271971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 41634. [D 20:43:19.271986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 41635. [D 20:43:19.272000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 41636. [D 20:43:19.272014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 41637. [D 20:43:19.272028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 41638. [D 20:43:19.272043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41639. [D 20:43:19.272057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41640. [D 20:43:19.272080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41641. [D 20:43:19.272094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 41642. [D 20:43:19.272109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 41643. [D 20:43:19.272123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 41644. [D 20:43:19.272137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 41645. [D 20:43:19.272151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 41646. [D 20:43:19.272166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41647. [D 20:43:19.272180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41648. [D 20:43:19.272194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41649. [D 20:43:19.272208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41650. [D 20:43:19.272222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41651. [D 20:43:19.272236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41652. [D 20:43:19.272250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41653. [D 20:43:19.272265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41654. [D 20:43:19.272279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41655. [D 20:43:19.272293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41656. [D 20:43:19.272307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41657. [D 20:43:19.272321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41658. [D 20:43:19.272335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41659. [D 20:43:19.272349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41660. [D 20:43:19.272364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41661. [D 20:43:19.272378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41662. [D 20:43:19.272392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41663. [D 20:43:19.272406] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41664. [D 20:43:19.272426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41665. [D 20:43:19.272440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41666. [D 20:43:19.272454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41667. [D 20:43:19.272469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41668. [D 20:43:19.272483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41669. [D 20:43:19.272497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41670. [D 20:43:19.272511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41671. [D 20:43:19.272525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41672. [D 20:43:19.272540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41673. [D 20:43:19.272554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41674. [D 20:43:19.272569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41675. [D 20:43:19.272583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41676. [D 20:43:19.272597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41677. [D 20:43:19.272611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41678. [D 20:43:19.272625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41679. [D 20:43:19.272638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41680. [D 20:43:19.272652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41681. [D 20:43:19.272666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41682. [D 20:43:19.272681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41683. [D 20:43:19.272695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41684. [D 20:43:19.272709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41685. [D 20:43:19.272723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41686. [D 20:43:19.272737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41687. [D 20:43:19.272751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41688. [D 20:43:19.272764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41689. [D 20:43:19.272779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41690. [D 20:43:19.272793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41691. [D 20:43:19.272807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41692. [D 20:43:19.272821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41693. [D 20:43:19.272835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41694. [D 20:43:19.272849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41695. [D 20:43:19.272863] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41696. [D 20:43:19.276104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.276122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.276136] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.276180] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6490 [D 20:43:19.276195] element 0: offset: 0x2aaaab034340, size: 24 [D 20:43:19.276213] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 55/70. [D 20:43:19.276241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.276255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.276269] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.276289] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6492 [D 20:43:19.276303] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:43:19.276317] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 56/70. [D 20:43:19.277856] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 41696. [D 20:43:19.277875] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 57/70. [D 20:43:19.285743] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41695. [D 20:43:19.285773] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 58/70. [D 20:43:19.285837] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.285856] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.285869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.285978] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.285993] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.286006] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.291967] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6490 [D 20:43:19.291994] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 59/70. [D 20:43:19.292014] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6492 [D 20:43:19.292029] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 60/70. [D 20:43:19.296310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41695. [D 20:43:19.296333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41696. [D 20:43:19.296347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41697. [D 20:43:19.296362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41698. [D 20:43:19.296376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41699. [D 20:43:19.296390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41700. [D 20:43:19.296404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41701. [D 20:43:19.296418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41702. [D 20:43:19.296432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41703. [D 20:43:19.296447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41704. [D 20:43:19.296461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41705. [D 20:43:19.296475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41706. [D 20:43:19.296489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41707. [D 20:43:19.296503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41708. [D 20:43:19.296517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41709. [D 20:43:19.296531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41710. [D 20:43:19.296545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41711. [D 20:43:19.296559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41712. [D 20:43:19.296574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41713. [D 20:43:19.296589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41714. [D 20:43:19.296604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41715. [D 20:43:19.296618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41716. [D 20:43:19.296633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41717. [D 20:43:19.296647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41718. [D 20:43:19.296661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41719. [D 20:43:19.296676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41720. [D 20:43:19.296690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41721. [D 20:43:19.296705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41722. [D 20:43:19.296719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41723. [D 20:43:19.296733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41724. [D 20:43:19.296748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41725. [D 20:43:19.296762] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41726. [D 20:43:19.296780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 41727. [D 20:43:19.296795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 41728. [D 20:43:19.296809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 41729. [D 20:43:19.296824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 41730. [D 20:43:19.296838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 41731. [D 20:43:19.296853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 41732. [D 20:43:19.296867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 41733. [D 20:43:19.296882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41734. [D 20:43:19.296896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41735. [D 20:43:19.296910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41736. [D 20:43:19.296925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 41737. [D 20:43:19.296939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 41738. [D 20:43:19.296954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 41739. [D 20:43:19.296968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 41740. [D 20:43:19.296982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 41741. [D 20:43:19.296997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41742. [D 20:43:19.297012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41743. [D 20:43:19.297027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41744. [D 20:43:19.297041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 41745. [D 20:43:19.297056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 41746. [D 20:43:19.297070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 41747. [D 20:43:19.297085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 41748. [D 20:43:19.297099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 41749. [D 20:43:19.297113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41750. [D 20:43:19.297128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41751. [D 20:43:19.297142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41752. [D 20:43:19.297157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 41753. [D 20:43:19.297171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 41754. [D 20:43:19.297185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 41755. [D 20:43:19.297200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 41756. [D 20:43:19.297215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 41757. [D 20:43:19.297229] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41758. [D 20:43:19.299066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.299131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.299145] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.299189] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6497 [D 20:43:19.299205] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:19.299225] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 0/70. [D 20:43:19.299267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.299281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.299293] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.299314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6498 [D 20:43:19.299328] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:19.299342] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 1/70. [D 20:43:19.302201] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41758. [D 20:43:19.302228] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 2/70. [D 20:43:19.312330] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41757. [D 20:43:19.312351] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 3/70. [D 20:43:19.312415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.312436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.312449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.312565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.312580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.312592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.318664] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6497 [D 20:43:19.318693] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 4/70. [D 20:43:19.318721] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6498 [D 20:43:19.318736] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 5/70. [D 20:43:19.324445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41757. [D 20:43:19.324513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 41758. [D 20:43:19.324529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 41759. [D 20:43:19.324543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 41760. [D 20:43:19.324558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 41761. [D 20:43:19.324572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 41762. [D 20:43:19.324586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41763. [D 20:43:19.324601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41764. [D 20:43:19.324615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41765. [D 20:43:19.324629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 41766. [D 20:43:19.324644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 41767. [D 20:43:19.324658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 41768. [D 20:43:19.324672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 41769. [D 20:43:19.324687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 41770. [D 20:43:19.324701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41771. [D 20:43:19.324715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41772. [D 20:43:19.324730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41773. [D 20:43:19.324744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41774. [D 20:43:19.324758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41775. [D 20:43:19.324772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41776. [D 20:43:19.324787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41777. [D 20:43:19.324801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41778. [D 20:43:19.324815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41779. [D 20:43:19.324830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41780. [D 20:43:19.324844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41781. [D 20:43:19.324858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41782. [D 20:43:19.324872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41783. [D 20:43:19.324889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41784. [D 20:43:19.324903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41785. [D 20:43:19.324917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41786. [D 20:43:19.324932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41787. [D 20:43:19.324946] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41788. [D 20:43:19.324965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41789. [D 20:43:19.324980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41790. [D 20:43:19.324995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41791. [D 20:43:19.325009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41792. [D 20:43:19.325023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41793. [D 20:43:19.325038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41794. [D 20:43:19.325052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41795. [D 20:43:19.325067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41796. [D 20:43:19.325081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41797. [D 20:43:19.325095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41798. [D 20:43:19.325109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41799. [D 20:43:19.325124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41800. [D 20:43:19.325139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41801. [D 20:43:19.325153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41802. [D 20:43:19.325167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41803. [D 20:43:19.325182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41804. [D 20:43:19.325196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41805. [D 20:43:19.325210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41806. [D 20:43:19.325225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41807. [D 20:43:19.325239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41808. [D 20:43:19.325253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41809. [D 20:43:19.325268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41810. [D 20:43:19.325282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41811. [D 20:43:19.325296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41812. [D 20:43:19.325312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41813. [D 20:43:19.325326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41814. [D 20:43:19.325341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41815. [D 20:43:19.325355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41816. [D 20:43:19.325369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41817. [D 20:43:19.325383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41818. [D 20:43:19.325397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41819. [D 20:43:19.325412] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41820. [D 20:43:19.330219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.330236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.330249] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.330292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6502 [D 20:43:19.330307] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:19.330325] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 6/70. [D 20:43:19.330353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.330367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.330379] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.330400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6504 [D 20:43:19.330405] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 41820. [D 20:43:19.330441] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 7/70. [D 20:43:19.330415] element 0: offset: 0x2aaaab036d20, size: 24 [D 20:43:19.334042] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 8/70. [D 20:43:19.339023] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41819. [D 20:43:19.339044] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 9/70. [D 20:43:19.342063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.342080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.342094] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.342316] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.342350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.342363] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.346193] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6502 [D 20:43:19.346279] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 10/70. [D 20:43:19.349525] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6504 [D 20:43:19.349546] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 11/70. [D 20:43:19.349612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41819. [D 20:43:19.349632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41820. [D 20:43:19.349646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41821. [D 20:43:19.349661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41822. [D 20:43:19.349675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41823. [D 20:43:19.349690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41824. [D 20:43:19.349706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41825. [D 20:43:19.349721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41826. [D 20:43:19.349736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41827. [D 20:43:19.349750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41828. [D 20:43:19.349764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41829. [D 20:43:19.349779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41830. [D 20:43:19.349793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41831. [D 20:43:19.349808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41832. [D 20:43:19.349822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41833. [D 20:43:19.349836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41834. [D 20:43:19.349851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41835. [D 20:43:19.349865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41836. [D 20:43:19.349880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41837. [D 20:43:19.349894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41838. [D 20:43:19.349909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41839. [D 20:43:19.349923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41840. [D 20:43:19.349937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41841. [D 20:43:19.349952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41842. [D 20:43:19.349966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41843. [D 20:43:19.349981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41844. [D 20:43:19.349995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41845. [D 20:43:19.350009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41846. [D 20:43:19.350024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41847. [D 20:43:19.350038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41848. [D 20:43:19.350052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41849. [D 20:43:19.350067] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41850. [D 20:43:19.350085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 41851. [D 20:43:19.350100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 41852. [D 20:43:19.350115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 41853. [D 20:43:19.350130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 41854. [D 20:43:19.350144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 41855. [D 20:43:19.350159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 41856. [D 20:43:19.350173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 41857. [D 20:43:19.350188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41858. [D 20:43:19.350202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41859. [D 20:43:19.350216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41860. [D 20:43:19.350231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 41861. [D 20:43:19.350245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 41862. [D 20:43:19.350259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 41863. [D 20:43:19.350274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 41864. [D 20:43:19.350288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 41865. [D 20:43:19.350332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41866. [D 20:43:19.350347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41867. [D 20:43:19.350361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41868. [D 20:43:19.350375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 41869. [D 20:43:19.350390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 41870. [D 20:43:19.350404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 41871. [D 20:43:19.350419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 41872. [D 20:43:19.350433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 41873. [D 20:43:19.350447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41874. [D 20:43:19.350462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41875. [D 20:43:19.350476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41876. [D 20:43:19.350490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 41877. [D 20:43:19.350505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 41878. [D 20:43:19.350519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 41879. [D 20:43:19.350534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 41880. [D 20:43:19.350548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 41881. [D 20:43:19.350562] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41882. [D 20:43:19.355577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.355654] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.355669] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.355722] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6509 [D 20:43:19.355737] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:43:19.355756] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 12/70. [D 20:43:19.355802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.355815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.355828] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.355848] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6510 [D 20:43:19.355861] element 0: offset: 0x2aaaab013f80, size: 24 [D 20:43:19.355876] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 13/70. [D 20:43:19.357355] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 41882. [D 20:43:19.357382] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 14/70. [D 20:43:19.368856] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41881. [D 20:43:19.368877] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 15/70. [D 20:43:19.368943] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.368963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.368976] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.369099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.369114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.369126] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.372057] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6509 [D 20:43:19.372084] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 16/70. [D 20:43:19.375066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41881. [D 20:43:19.375089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 41882. [D 20:43:19.375104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 41883. [D 20:43:19.375118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 41884. [D 20:43:19.375132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 41885. [D 20:43:19.375147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 41886. [D 20:43:19.375161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41887. [D 20:43:19.375175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41888. [D 20:43:19.375189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41889. [D 20:43:19.375204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 41890. [D 20:43:19.375218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 41891. [D 20:43:19.375232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 41892. [D 20:43:19.375246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 41893. [D 20:43:19.375261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 41894. [D 20:43:19.375275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41895. [D 20:43:19.375290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41896. [D 20:43:19.375305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41897. [D 20:43:19.375319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41898. [D 20:43:19.375334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41899. [D 20:43:19.375348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41900. [D 20:43:19.375363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41901. [D 20:43:19.375378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41902. [D 20:43:19.375392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41903. [D 20:43:19.375407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41904. [D 20:43:19.375422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41905. [D 20:43:19.375436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41906. [D 20:43:19.375451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41907. [D 20:43:19.375466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41908. [D 20:43:19.375480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41909. [D 20:43:19.375499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41910. [D 20:43:19.375514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41911. [D 20:43:19.375528] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41912. [D 20:43:19.378985] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6510 [D 20:43:19.379004] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 17/70. [D 20:43:19.380967] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 41912. [D 20:43:19.380985] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 18/70. [D 20:43:19.381055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 41912. [D 20:43:19.381071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 41913. [D 20:43:19.381073] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.381091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 41914. [D 20:43:19.381168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.381173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 41915. [D 20:43:19.381190] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.381208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 41916. [D 20:43:19.381238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 41917. [D 20:43:19.381254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 41918. [D 20:43:19.381269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 41919. [D 20:43:19.381285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 41920. [D 20:43:19.381299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 41921. [D 20:43:19.381314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 41922. [D 20:43:19.381329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 41923. [D 20:43:19.381344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 41924. [D 20:43:19.381359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 41925. [D 20:43:19.381373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 41926. [D 20:43:19.381388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 41927. [D 20:43:19.381402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 41928. [D 20:43:19.381417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 41929. [D 20:43:19.381432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 41930. [D 20:43:19.381447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 41931. [D 20:43:19.381461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 41932. [D 20:43:19.381476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 41933. [D 20:43:19.381491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 41934. [D 20:43:19.381506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 41935. [D 20:43:19.381520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 41936. [D 20:43:19.381535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 41937. [D 20:43:19.381550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 41938. [D 20:43:19.381564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 41939. [D 20:43:19.381579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 41940. [D 20:43:19.381594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 41941. [D 20:43:19.381608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 41942. [D 20:43:19.381623] openib_post_sr_rdmaw: ibv_post_send wr_id 638ef0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 41943. [D 20:43:19.386558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.386580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.386593] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.386634] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6514 [D 20:43:19.386649] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:19.386669] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 19/70. [D 20:43:19.386980] openib_check_cq: completed rdma wr_id 638ef0, nic_wr_credit 41943. [D 20:43:19.387004] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 20/70. [D 20:43:19.694942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.694965] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.694978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.695002] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6517 [D 20:43:19.695016] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:19.695032] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 21/70. [D 20:43:19.695061] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.695075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.695088] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.695169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.695184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.695197] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.695218] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6520 [D 20:43:19.695232] element 0: offset: 0x2aaaab030720, size: 24 [D 20:43:19.695246] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 22/70. [D 20:43:19.701919] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6514 [D 20:43:19.702017] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 23/70. [D 20:43:19.702041] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6517 [D 20:43:19.702066] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 24/70. [D 20:43:19.702197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 41943. [D 20:43:19.702217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 41944. [D 20:43:19.702232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 41945. [D 20:43:19.702247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 41946. [D 20:43:19.702262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 41947. [D 20:43:19.702302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 41948. [D 20:43:19.702332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 41949. [D 20:43:19.702347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 41950. [D 20:43:19.702361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 41951. [D 20:43:19.702375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 41952. [D 20:43:19.702390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 41953. [D 20:43:19.702418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 41954. [D 20:43:19.702447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 41955. [D 20:43:19.702462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 41956. [D 20:43:19.702477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 41957. [D 20:43:19.702491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 41958. [D 20:43:19.702506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 41959. [D 20:43:19.702525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 41960. [D 20:43:19.702539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 41961. [D 20:43:19.702572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 41962. [D 20:43:19.702588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 41963. [D 20:43:19.702602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 41964. [D 20:43:19.702617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 41965. [D 20:43:19.702631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 41966. [D 20:43:19.702645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 41967. [D 20:43:19.702677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 41968. [D 20:43:19.702707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 41969. [D 20:43:19.702735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 41970. [D 20:43:19.702750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 41971. [D 20:43:19.702764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 41972. [D 20:43:19.702778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 41973. [D 20:43:19.702793] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 41974. [D 20:43:19.702814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41975. [D 20:43:19.702829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41976. [D 20:43:19.702844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 41977. [D 20:43:19.702858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 41978. [D 20:43:19.702873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 41979. [D 20:43:19.702888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 41980. [D 20:43:19.702902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 41981. [D 20:43:19.702917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41982. [D 20:43:19.702931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41983. [D 20:43:19.702946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41984. [D 20:43:19.702961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 41985. [D 20:43:19.702975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 41986. [D 20:43:19.702990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 41987. [D 20:43:19.703004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 41988. [D 20:43:19.703019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 41989. [D 20:43:19.703034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41990. [D 20:43:19.706522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41991. [D 20:43:19.706616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41992. [D 20:43:19.706631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 41993. [D 20:43:19.706646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 41994. [D 20:43:19.706661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 41995. [D 20:43:19.706676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 41996. [D 20:43:19.706690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 41997. [D 20:43:19.706705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41998. [D 20:43:19.706721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41999. [D 20:43:19.706736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42000. [D 20:43:19.706750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42001. [D 20:43:19.706765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42002. [D 20:43:19.706806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42003. [D 20:43:19.706822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42004. [D 20:43:19.706837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42005. [D 20:43:19.706852] openib_post_sr_rdmaw: ibv_post_send wr_id 61ed20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42006. [D 20:43:19.707359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.707422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.707436] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.707479] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6522 [D 20:43:19.707494] element 0: offset: 0x2aaaab001d30, size: 24 [D 20:43:19.707514] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 25/70. [D 20:43:19.709036] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 42006. [D 20:43:19.709064] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 26/70. [D 20:43:19.712532] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6520 [D 20:43:19.712559] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 27/70. [D 20:43:19.719846] openib_check_cq: completed rdma wr_id 61ed20, nic_wr_credit 42005. [D 20:43:19.719873] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 28/70. [D 20:43:19.719890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42005. [D 20:43:19.719907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 42006. [D 20:43:19.719922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 42007. [D 20:43:19.719936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 42008. [D 20:43:19.719952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 42009. [D 20:43:19.719967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 42010. [D 20:43:19.719982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42011. [D 20:43:19.719996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42012. [D 20:43:19.720014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42013. [D 20:43:19.720028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 42014. [D 20:43:19.720043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 42015. [D 20:43:19.720057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 42016. [D 20:43:19.720072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 42017. [D 20:43:19.720091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 42018. [D 20:43:19.720119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42019. [D 20:43:19.720133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42020. [D 20:43:19.720148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42021. [D 20:43:19.720163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42022. [D 20:43:19.720177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42023. [D 20:43:19.720192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42024. [D 20:43:19.720206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42025. [D 20:43:19.720221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42026. [D 20:43:19.720235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42027. [D 20:43:19.720250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42028. [D 20:43:19.720264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42029. [D 20:43:19.720279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42030. [D 20:43:19.720293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42031. [D 20:43:19.720307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42032. [D 20:43:19.720322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42033. [D 20:43:19.720336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42034. [D 20:43:19.720351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42035. [D 20:43:19.720366] openib_post_sr_rdmaw: ibv_post_send wr_id 62ea00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42036. [D 20:43:19.720439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.720462] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.720476] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.720501] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.720514] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.720528] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.723730] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6522 [D 20:43:19.723758] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 29/70. [D 20:43:19.725790] openib_check_cq: completed rdma wr_id 62ea00, nic_wr_credit 42036. [D 20:43:19.725808] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 30/70. [D 20:43:19.725894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.725948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.725962] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.726066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42036. [D 20:43:19.726086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42037. [D 20:43:19.726101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42038. [D 20:43:19.726115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42039. [D 20:43:19.726130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42040. [D 20:43:19.726144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42041. [D 20:43:19.726159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42042. [D 20:43:19.726174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42043. [D 20:43:19.726188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42044. [D 20:43:19.726203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42045. [D 20:43:19.726218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42046. [D 20:43:19.726232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42047. [D 20:43:19.726247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42048. [D 20:43:19.726262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42049. [D 20:43:19.726276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42050. [D 20:43:19.726291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42051. [D 20:43:19.726306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42052. [D 20:43:19.726320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42053. [D 20:43:19.726335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42054. [D 20:43:19.726350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42055. [D 20:43:19.726365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42056. [D 20:43:19.726379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42057. [D 20:43:19.726394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42058. [D 20:43:19.726408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42059. [D 20:43:19.726423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42060. [D 20:43:19.726440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42061. [D 20:43:19.726454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42062. [D 20:43:19.726468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42063. [D 20:43:19.726483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42064. [D 20:43:19.726497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42065. [D 20:43:19.726511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42066. [D 20:43:19.726525] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42067. [D 20:43:19.732090] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 42067. [D 20:43:19.732110] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 31/70. [D 20:43:19.732222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.732244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.732256] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:19.746773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.746793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.746807] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:19.746847] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6527 [D 20:43:19.746862] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:19.746882] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 32/70. [D 20:43:19.746927] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.746941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.746953] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.746974] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6528 [D 20:43:19.746988] element 0: offset: 0x2aaaab00ecd0, size: 24 [D 20:43:19.747004] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 33/70. [D 20:43:19.752107] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6527 [D 20:43:19.752132] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 34/70. [D 20:43:19.752208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42067. [D 20:43:19.752226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 42068. [D 20:43:19.752241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 42069. [D 20:43:19.752255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 42070. [D 20:43:19.752269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 42071. [D 20:43:19.752284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 42072. [D 20:43:19.752298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42073. [D 20:43:19.752312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42074. [D 20:43:19.752327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42075. [D 20:43:19.752341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 42076. [D 20:43:19.752355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 42077. [D 20:43:19.752370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 42078. [D 20:43:19.752384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 42079. [D 20:43:19.752399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 42080. [D 20:43:19.752413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42081. [D 20:43:19.752428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42082. [D 20:43:19.752443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42083. [D 20:43:19.752457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 42084. [D 20:43:19.752472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 42085. [D 20:43:19.752487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 42086. [D 20:43:19.752501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 42087. [D 20:43:19.752516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 42088. [D 20:43:19.752531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42089. [D 20:43:19.752546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42090. [D 20:43:19.752560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42091. [D 20:43:19.752575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 42092. [D 20:43:19.752589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 42093. [D 20:43:19.752604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 42094. [D 20:43:19.752619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 42095. [D 20:43:19.752633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 42096. [D 20:43:19.752648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42097. [D 20:43:19.752663] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42098. [D 20:43:19.756695] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6528 [D 20:43:19.756720] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 35/70. [D 20:43:19.762174] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 42098. [D 20:43:19.762190] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 36/70. [D 20:43:19.762224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42098. [D 20:43:19.762239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42099. [D 20:43:19.762254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 42100. [D 20:43:19.762268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 42101. [D 20:43:19.762283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 42102. [D 20:43:19.762297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 42103. [D 20:43:19.762313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 42104. [D 20:43:19.762328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42105. [D 20:43:19.762342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42106. [D 20:43:19.762356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42107. [D 20:43:19.762371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 42108. [D 20:43:19.762386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 42109. [D 20:43:19.762400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 42110. [D 20:43:19.762415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 42111. [D 20:43:19.762429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 42112. [D 20:43:19.762444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42113. [D 20:43:19.762458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42114. [D 20:43:19.762473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42115. [D 20:43:19.762487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 42116. [D 20:43:19.762502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 42117. [D 20:43:19.762516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 42118. [D 20:43:19.762531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 42119. [D 20:43:19.762545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 42120. [D 20:43:19.762560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42121. [D 20:43:19.762574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42122. [D 20:43:19.762589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42123. [D 20:43:19.762603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 42124. [D 20:43:19.762617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 42125. [D 20:43:19.762632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 42126. [D 20:43:19.762646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 42127. [D 20:43:19.762661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 42128. [D 20:43:19.762675] openib_post_sr_rdmaw: ibv_post_send wr_id 61e660 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42129. [D 20:43:19.762754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.762819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.762833] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.773988] openib_check_cq: completed rdma wr_id 61e660, nic_wr_credit 42129. [D 20:43:19.774012] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 37/70. [D 20:43:19.774122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.774141] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.774154] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:19.790227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.790246] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.790259] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:19.790298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6533 [D 20:43:19.790313] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:19.790333] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 38/70. [D 20:43:19.790376] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.790390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.790402] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.790423] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6534 [D 20:43:19.790437] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:43:19.790454] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 39/70. [D 20:43:19.796128] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6533 [D 20:43:19.796153] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 40/70. [D 20:43:19.796208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42129. [D 20:43:19.796226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 42130. [D 20:43:19.796241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 42131. [D 20:43:19.796256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 42132. [D 20:43:19.796271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 42133. [D 20:43:19.796285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 42134. [D 20:43:19.796300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42135. [D 20:43:19.796315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42136. [D 20:43:19.796329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42137. [D 20:43:19.796344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 42138. [D 20:43:19.796359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 42139. [D 20:43:19.796374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 42140. [D 20:43:19.796388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 42141. [D 20:43:19.796403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 42142. [D 20:43:19.796418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42143. [D 20:43:19.796433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42144. [D 20:43:19.796447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42145. [D 20:43:19.796462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 42146. [D 20:43:19.796477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 42147. [D 20:43:19.796492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 42148. [D 20:43:19.796508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 42149. [D 20:43:19.796522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 42150. [D 20:43:19.796537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42151. [D 20:43:19.796552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42152. [D 20:43:19.796566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42153. [D 20:43:19.796581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 42154. [D 20:43:19.796595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 42155. [D 20:43:19.796610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 42156. [D 20:43:19.796625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 42157. [D 20:43:19.796639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 42158. [D 20:43:19.796654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42159. [D 20:43:19.796669] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42160. [D 20:43:19.800030] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6534 [D 20:43:19.800048] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 41/70. [D 20:43:19.806410] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 42160. [D 20:43:19.806429] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 42/70. [D 20:43:19.806462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42160. [D 20:43:19.806477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42161. [D 20:43:19.806491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 42162. [D 20:43:19.806506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 42163. [D 20:43:19.806520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 42164. [D 20:43:19.806535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 42165. [D 20:43:19.806549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 42166. [D 20:43:19.806564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42167. [D 20:43:19.806578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42168. [D 20:43:19.806593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42169. [D 20:43:19.806607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 42170. [D 20:43:19.806622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 42171. [D 20:43:19.806636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 42172. [D 20:43:19.806651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 42173. [D 20:43:19.806665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 42174. [D 20:43:19.806681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42175. [D 20:43:19.806695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42176. [D 20:43:19.806710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42177. [D 20:43:19.806724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 42178. [D 20:43:19.806738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 42179. [D 20:43:19.806752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 42180. [D 20:43:19.806766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 42181. [D 20:43:19.806780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 42182. [D 20:43:19.806794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42183. [D 20:43:19.806808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42184. [D 20:43:19.806822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42185. [D 20:43:19.806836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 42186. [D 20:43:19.806851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 42187. [D 20:43:19.806865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 42188. [D 20:43:19.806879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 42189. [D 20:43:19.806893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 42190. [D 20:43:19.806907] openib_post_sr_rdmaw: ibv_post_send wr_id 620cb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42191. [D 20:43:19.806992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.807058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.807072] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.818246] openib_check_cq: completed rdma wr_id 620cb0, nic_wr_credit 42191. [D 20:43:19.818269] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 43/70. [D 20:43:19.818382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.818402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.818415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:19.834147] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.834166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.834179] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:19.834220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6539 [D 20:43:19.834236] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:19.834255] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 44/70. [D 20:43:19.834305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.834319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.834332] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.834352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6540 [D 20:43:19.834367] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:19.834382] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 45/70. [D 20:43:19.837758] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6539 [D 20:43:19.837784] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 46/70. [D 20:43:19.837843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42191. [D 20:43:19.837860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 42192. [D 20:43:19.837875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 42193. [D 20:43:19.837890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 42194. [D 20:43:19.837904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 42195. [D 20:43:19.837919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 42196. [D 20:43:19.837934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42197. [D 20:43:19.837948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42198. [D 20:43:19.837963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42199. [D 20:43:19.837978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 42200. [D 20:43:19.837992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 42201. [D 20:43:19.838007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 42202. [D 20:43:19.838021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 42203. [D 20:43:19.838036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 42204. [D 20:43:19.838051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42205. [D 20:43:19.838065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42206. [D 20:43:19.838080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42207. [D 20:43:19.838094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 42208. [D 20:43:19.838109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 42209. [D 20:43:19.838124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 42210. [D 20:43:19.838138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 42211. [D 20:43:19.838153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 42212. [D 20:43:19.838168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42213. [D 20:43:19.838182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42214. [D 20:43:19.838197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42215. [D 20:43:19.838211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 42216. [D 20:43:19.838226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 42217. [D 20:43:19.838240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 42218. [D 20:43:19.838255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 42219. [D 20:43:19.838270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 42220. [D 20:43:19.838285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42221. [D 20:43:19.838300] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42222. [D 20:43:19.843050] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6540 [D 20:43:19.843069] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 47/70. [D 20:43:19.848355] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 42222. [D 20:43:19.848373] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 48/70. [D 20:43:19.848401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42222. [D 20:43:19.848416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42223. [D 20:43:19.848431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 42224. [D 20:43:19.848446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 42225. [D 20:43:19.848460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 42226. [D 20:43:19.848475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 42227. [D 20:43:19.848490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 42228. [D 20:43:19.848505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42229. [D 20:43:19.848520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42230. [D 20:43:19.848534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42231. [D 20:43:19.848549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 42232. [D 20:43:19.848564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 42233. [D 20:43:19.848579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 42234. [D 20:43:19.848594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 42235. [D 20:43:19.848609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 42236. [D 20:43:19.848624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42237. [D 20:43:19.848638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42238. [D 20:43:19.848653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42239. [D 20:43:19.848668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 42240. [D 20:43:19.848682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 42241. [D 20:43:19.848697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 42242. [D 20:43:19.848712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 42243. [D 20:43:19.848727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 42244. [D 20:43:19.848741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42245. [D 20:43:19.848757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42246. [D 20:43:19.848772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42247. [D 20:43:19.848787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 42248. [D 20:43:19.848801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 42249. [D 20:43:19.848816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 42250. [D 20:43:19.848831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 42251. [D 20:43:19.848845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 42252. [D 20:43:19.848860] openib_post_sr_rdmaw: ibv_post_send wr_id 63c760 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42253. [D 20:43:19.848941] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.849009] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.849023] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.860105] openib_check_cq: completed rdma wr_id 63c760, nic_wr_credit 42253. [D 20:43:19.860128] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 49/70. [D 20:43:19.860237] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.860257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.860270] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:19.866723] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.866742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.866755] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:19.866796] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6546 [D 20:43:19.866811] element 0: offset: 0x2aaaab030720, size: 24 [D 20:43:19.866832] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 50/70. [D 20:43:19.866880] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.866894] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.866907] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.866928] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6547 [D 20:43:19.866942] element 0: offset: 0x2aaaab013f80, size: 24 [D 20:43:19.866957] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:43:19.866983] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.866997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.867010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:19.867032] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6549 [D 20:43:19.867046] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:19.867060] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 52/70. [D 20:43:19.869493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.869555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.869569] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:19.869607] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6552 [D 20:43:19.869623] element 0: offset: 0x2aaaab00ecd0, size: 24 [D 20:43:19.869642] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 53/70. [D 20:43:19.877110] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6549 [D 20:43:19.877200] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 54/70. [D 20:43:19.877350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42253. [D 20:43:19.877372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42254. [D 20:43:19.877388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42255. [D 20:43:19.877403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42256. [D 20:43:19.877418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42257. [D 20:43:19.877432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42258. [D 20:43:19.877447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42259. [D 20:43:19.877461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42260. [D 20:43:19.877476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42261. [D 20:43:19.877490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42262. [D 20:43:19.877504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42263. [D 20:43:19.877519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42264. [D 20:43:19.877533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42265. [D 20:43:19.877548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42266. [D 20:43:19.877562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42267. [D 20:43:19.877577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42268. [D 20:43:19.877591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42269. [D 20:43:19.877606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42270. [D 20:43:19.877620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42271. [D 20:43:19.877635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42272. [D 20:43:19.877649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42273. [D 20:43:19.877664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42274. [D 20:43:19.877678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42275. [D 20:43:19.877692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42276. [D 20:43:19.877707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42277. [D 20:43:19.877721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42278. [D 20:43:19.877735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42279. [D 20:43:19.877750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42280. [D 20:43:19.877764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42281. [D 20:43:19.877779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42282. [D 20:43:19.877793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42283. [D 20:43:19.877808] openib_post_sr_rdmaw: ibv_post_send wr_id 644580 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42284. [D 20:43:19.880097] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6546 [D 20:43:19.880116] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 55/70. [D 20:43:19.880133] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6547 [D 20:43:19.880148] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 56/70. [D 20:43:19.880164] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6552 [D 20:43:19.880179] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 57/70. [D 20:43:19.889014] openib_check_cq: completed rdma wr_id 644580, nic_wr_credit 42284. [D 20:43:19.889037] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 58/70. [D 20:43:19.889053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42284. [D 20:43:19.889069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 42285. [D 20:43:19.889084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 42286. [D 20:43:19.889098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 42287. [D 20:43:19.889113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 42288. [D 20:43:19.889127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 42289. [D 20:43:19.889142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42290. [D 20:43:19.889157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42291. [D 20:43:19.889172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42292. [D 20:43:19.889186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 42293. [D 20:43:19.889201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 42294. [D 20:43:19.889215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 42295. [D 20:43:19.889230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 42296. [D 20:43:19.889245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 42297. [D 20:43:19.889260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42298. [D 20:43:19.889274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42299. [D 20:43:19.889289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42300. [D 20:43:19.889303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 42301. [D 20:43:19.889318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 42302. [D 20:43:19.889333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 42303. [D 20:43:19.889348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 42304. [D 20:43:19.889362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 42305. [D 20:43:19.889377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42306. [D 20:43:19.889393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42307. [D 20:43:19.889407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42308. [D 20:43:19.889422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 42309. [D 20:43:19.889437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 42310. [D 20:43:19.889451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 42311. [D 20:43:19.889466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 42312. [D 20:43:19.889480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 42313. [D 20:43:19.889495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42314. [D 20:43:19.889509] openib_post_sr_rdmaw: ibv_post_send wr_id 6424f0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42315. [D 20:43:19.889525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42316. [D 20:43:19.889540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42317. [D 20:43:19.889555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42318. [D 20:43:19.889569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42319. [D 20:43:19.889584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42320. [D 20:43:19.889598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42321. [D 20:43:19.889613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42322. [D 20:43:19.889627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42323. [D 20:43:19.889642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42324. [D 20:43:19.889656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42325. [D 20:43:19.889671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42326. [D 20:43:19.889685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42327. [D 20:43:19.889700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42328. [D 20:43:19.889714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42329. [D 20:43:19.889729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42330. [D 20:43:19.889743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42331. [D 20:43:19.889758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42332. [D 20:43:19.889772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42333. [D 20:43:19.889787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42334. [D 20:43:19.889801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42335. [D 20:43:19.889817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42336. [D 20:43:19.889831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42337. [D 20:43:19.889845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42338. [D 20:43:19.889860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42339. [D 20:43:19.889874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42340. [D 20:43:19.889888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42341. [D 20:43:19.889903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42342. [D 20:43:19.889917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42343. [D 20:43:19.889932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42344. [D 20:43:19.889946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42345. [D 20:43:19.889960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42346. [D 20:43:19.889975] openib_post_sr_rdmaw: ibv_post_send wr_id 63fad0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42347. [D 20:43:19.889991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42348. [D 20:43:19.890006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42349. [D 20:43:19.890020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 42350. [D 20:43:19.890035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 42351. [D 20:43:19.890049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 42352. [D 20:43:19.890064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 42353. [E 20:43:19.890083] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42354, block for 10 ms. [D 20:43:19.890114] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 42353. [D 20:43:19.890130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 42354. [E 20:43:19.890146] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42355, block for 10 ms. [D 20:43:19.900769] openib_check_cq: completed rdma wr_id 6424f0, nic_wr_credit 42354. [D 20:43:19.900791] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 59/70. [D 20:43:19.900806] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 42353. [D 20:43:19.900821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42354. [D 20:43:19.900836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42355. [D 20:43:19.900850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42356. [D 20:43:19.900865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 42357. [D 20:43:19.900880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 42358. [D 20:43:19.900895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 42359. [D 20:43:19.900910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 42360. [D 20:43:19.900925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 42361. [D 20:43:19.900939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42362. [D 20:43:19.900954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42363. [D 20:43:19.900969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42364. [D 20:43:19.900984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 42365. [D 20:43:19.900998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 42366. [D 20:43:19.901013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 42367. [D 20:43:19.901028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 42368. [D 20:43:19.901042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 42369. [D 20:43:19.901057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42370. [D 20:43:19.901072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42371. [D 20:43:19.901086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42372. [D 20:43:19.901101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 42373. [D 20:43:19.901115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 42374. [D 20:43:19.901130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 42375. [D 20:43:19.901145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 42376. [D 20:43:19.901159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 42377. [D 20:43:19.901174] openib_post_sr_rdmaw: ibv_post_send wr_id 61ed20 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42378. [D 20:43:19.901260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.901324] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.901338] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:19.912389] openib_check_cq: completed rdma wr_id 63fad0, nic_wr_credit 42378. [D 20:43:19.912414] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 60/70. [D 20:43:19.914595] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.914615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.914627] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:19.923258] openib_check_cq: completed rdma wr_id 61ed20, nic_wr_credit 42377. [D 20:43:19.923283] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 0/70. [D 20:43:19.923334] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.923354] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.923367] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:19.923392] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:19.923406] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.923418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:19.942254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.942271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.942285] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:19.942325] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6556 [D 20:43:19.942340] element 0: offset: 0x2aaaab029db0, size: 24 [D 20:43:19.942360] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 1/70. [D 20:43:19.942415] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:19.942429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:19.942443] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:19.942463] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6558 [D 20:43:19.942477] element 0: offset: 0x5b0030, size: 24 [D 20:43:19.942492] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 2/70. [D 20:43:19.947520] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6556 [D 20:43:19.947604] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 3/70. [D 20:43:19.947694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 42377. [D 20:43:19.947775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 42378. [D 20:43:19.947791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42379. [D 20:43:19.947805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42380. [D 20:43:19.947820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42381. [D 20:43:19.947835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42382. [D 20:43:19.947849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42383. [D 20:43:19.947864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42384. [D 20:43:19.947878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42385. [D 20:43:19.947892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42386. [D 20:43:19.947907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42387. [D 20:43:19.947922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42388. [D 20:43:19.947936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42389. [D 20:43:19.947950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42390. [D 20:43:19.947965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42391. [D 20:43:19.947979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42392. [D 20:43:19.947994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42393. [D 20:43:19.948008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42394. [D 20:43:19.948023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42395. [D 20:43:19.948037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42396. [D 20:43:19.948052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42397. [D 20:43:19.948067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42398. [D 20:43:19.950172] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6558 [D 20:43:20.152210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42399. [D 20:43:20.152268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42400. [D 20:43:20.152284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42401. [D 20:43:20.152298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42402. [D 20:43:20.152313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42403. [D 20:43:20.152328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42404. [D 20:43:20.152342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42405. [D 20:43:20.152357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42406. [D 20:43:20.152372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42407. [D 20:43:20.152387] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42408. [D 20:43:20.152423] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 4/70. [D 20:43:20.152557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.152583] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.152596] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.152639] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6562 [D 20:43:20.152654] element 0: offset: 0x2aaaab60ca60, size: 24 [D 20:43:20.152671] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 5/70. [D 20:43:20.152705] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.152719] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.152732] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.152754] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6564 [D 20:43:20.152768] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:20.152783] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 6/70. [D 20:43:20.154225] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 42408. [D 20:43:20.154251] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 7/70. [D 20:43:20.154302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42408. [D 20:43:20.154319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42409. [D 20:43:20.154336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42410. [D 20:43:20.154351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42411. [D 20:43:20.154367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42412. [D 20:43:20.154382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42413. [D 20:43:20.154397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42414. [D 20:43:20.154406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.154432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.154445] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.154412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42415. [D 20:43:20.156698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42416. [D 20:43:20.156715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42417. [D 20:43:20.156730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42418. [D 20:43:20.156744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42419. [D 20:43:20.156759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42420. [D 20:43:20.156773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42421. [D 20:43:20.156788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42422. [D 20:43:20.156803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42423. [D 20:43:20.156818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42424. [D 20:43:20.156832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42425. [D 20:43:20.156847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42426. [D 20:43:20.156861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42427. [D 20:43:20.156877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42428. [D 20:43:20.156891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42429. [D 20:43:20.156906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42430. [D 20:43:20.156920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42431. [D 20:43:20.156935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42432. [D 20:43:20.156956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42433. [D 20:43:20.156977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42434. [D 20:43:20.157017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42435. [D 20:43:20.157031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42436. [D 20:43:20.157046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42437. [D 20:43:20.159538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42438. [D 20:43:20.159608] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42439. [D 20:43:20.159861] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6564 [D 20:43:20.159890] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 8/70. [D 20:43:20.161270] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 42439. [D 20:43:20.161291] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 9/70. [D 20:43:20.161308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42439. [D 20:43:20.161327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42440. [D 20:43:20.161341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42441. [D 20:43:20.161359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42442. [D 20:43:20.161374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42443. [D 20:43:20.161388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42444. [D 20:43:20.161403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42445. [D 20:43:20.161418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42446. [D 20:43:20.161433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42447. [D 20:43:20.161449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42448. [D 20:43:20.161464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42449. [D 20:43:20.161479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42450. [D 20:43:20.161493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42451. [D 20:43:20.161508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42452. [D 20:43:20.161523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42453. [D 20:43:20.161538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42454. [D 20:43:20.161555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42455. [D 20:43:20.161570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42456. [D 20:43:20.161585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42457. [D 20:43:20.161599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42458. [D 20:43:20.161614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42459. [D 20:43:20.161629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42460. [D 20:43:20.161643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42461. [D 20:43:20.161658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42462. [D 20:43:20.161672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42463. [D 20:43:20.161687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42464. [D 20:43:20.161702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42465. [D 20:43:20.161716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42466. [D 20:43:20.161731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42467. [D 20:43:20.161745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42468. [D 20:43:20.161760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42469. [D 20:43:20.161775] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42470. [D 20:43:20.162052] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.162109] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.162122] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:20.165122] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6562 [D 20:43:20.165147] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 10/70. [D 20:43:20.167211] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 42470. [D 20:43:20.167230] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 11/70. [D 20:43:20.167305] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.167311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42470. [D 20:43:20.167334] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.167351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 42471. [D 20:43:20.167369] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.167388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 42472. [D 20:43:20.167420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 42473. [D 20:43:20.167436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 42474. [D 20:43:20.167453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 42475. [D 20:43:20.167468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42476. [D 20:43:20.167483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42477. [D 20:43:20.167498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42478. [D 20:43:20.167512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 42479. [D 20:43:20.167527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 42480. [D 20:43:20.167546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 42481. [D 20:43:20.167565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 42482. [D 20:43:20.167579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 42483. [D 20:43:20.167594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42484. [D 20:43:20.167609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42485. [D 20:43:20.167623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42486. [D 20:43:20.167638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 42487. [D 20:43:20.167653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 42488. [D 20:43:20.167668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 42489. [D 20:43:20.167682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 42490. [D 20:43:20.167697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 42491. [D 20:43:20.167712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42492. [D 20:43:20.167727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42493. [D 20:43:20.167742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42494. [D 20:43:20.167757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 42495. [D 20:43:20.167772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 42496. [D 20:43:20.167786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 42497. [D 20:43:20.167801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 42498. [D 20:43:20.167816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 42499. [D 20:43:20.167831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42500. [D 20:43:20.167846] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42501. [D 20:43:20.170957] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.170976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.170990] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.171033] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6567 [D 20:43:20.171086] element 0: offset: 0x2aaaab001f40, size: 24 [D 20:43:20.171248] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 12/70. [D 20:43:20.173564] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 42501. [D 20:43:20.173588] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 13/70. [D 20:43:20.176713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.176730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.176743] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.180106] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.180129] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.180142] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.180183] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6571 [D 20:43:20.180198] element 0: offset: 0x2aaaab02c6b0, size: 24 [D 20:43:20.180219] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 14/70. [D 20:43:20.180259] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.180273] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.180286] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.180308] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6573 [D 20:43:20.180321] element 0: offset: 0x67edf0, size: 24 [D 20:43:20.180336] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 15/70. [D 20:43:20.182123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.182189] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.182203] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.182247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6577 [D 20:43:20.182262] element 0: offset: 0x2aaaab60dc60, size: 24 [D 20:43:20.182282] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 16/70. [D 20:43:20.186073] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6567 [D 20:43:20.186159] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 17/70. [D 20:43:20.186253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42501. [D 20:43:20.186273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42502. [D 20:43:20.186288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42503. [D 20:43:20.186304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42504. [D 20:43:20.186319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42505. [D 20:43:20.186333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42506. [D 20:43:20.186348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42507. [D 20:43:20.186362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42508. [D 20:43:20.186377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42509. [D 20:43:20.186392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42510. [D 20:43:20.186406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42511. [D 20:43:20.186421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42512. [D 20:43:20.186435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42513. [D 20:43:20.186450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42514. [D 20:43:20.186465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42515. [D 20:43:20.186479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42516. [D 20:43:20.186494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42517. [D 20:43:20.186508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42518. [D 20:43:20.186523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42519. [D 20:43:20.186537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42520. [D 20:43:20.186552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42521. [D 20:43:20.186567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42522. [D 20:43:20.186581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42523. [D 20:43:20.186596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42524. [D 20:43:20.186610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42525. [D 20:43:20.186625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42526. [D 20:43:20.186640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42527. [D 20:43:20.186654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42528. [D 20:43:20.186669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42529. [D 20:43:20.186683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42530. [D 20:43:20.186698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42531. [D 20:43:20.186712] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42532. [D 20:43:20.191132] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6577 [D 20:43:20.191156] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 18/70. [D 20:43:20.191173] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6571 [D 20:43:20.191188] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 19/70. [D 20:43:20.191258] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6573 [D 20:43:20.191274] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 20/70. [D 20:43:20.197329] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 42532. [D 20:43:20.197351] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 21/70. [D 20:43:20.197371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42532. [D 20:43:20.197387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 42533. [D 20:43:20.197402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 42534. [D 20:43:20.197417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 42535. [D 20:43:20.197432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 42536. [D 20:43:20.197447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 42537. [D 20:43:20.197462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42538. [D 20:43:20.197476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42539. [D 20:43:20.197492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42540. [D 20:43:20.197506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 42541. [D 20:43:20.197521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 42542. [D 20:43:20.197536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 42543. [D 20:43:20.197551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 42544. [D 20:43:20.197565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 42545. [D 20:43:20.197580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42546. [D 20:43:20.197595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42547. [D 20:43:20.197610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42548. [D 20:43:20.197625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 42549. [D 20:43:20.197640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 42550. [D 20:43:20.197654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 42551. [D 20:43:20.197669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 42552. [D 20:43:20.197684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 42553. [D 20:43:20.197699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42554. [D 20:43:20.197714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42555. [D 20:43:20.197730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42556. [D 20:43:20.197744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 42557. [D 20:43:20.197759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 42558. [D 20:43:20.197773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 42559. [D 20:43:20.197788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 42560. [D 20:43:20.197803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 42561. [D 20:43:20.197818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42562. [D 20:43:20.197832] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42563. [D 20:43:20.197848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42564. [D 20:43:20.197863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42565. [D 20:43:20.197878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42566. [D 20:43:20.197892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42567. [D 20:43:20.197907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42568. [D 20:43:20.197922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42569. [D 20:43:20.197937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42570. [D 20:43:20.197951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42571. [D 20:43:20.197966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42572. [D 20:43:20.197980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42573. [D 20:43:20.197995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42574. [D 20:43:20.198010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42575. [D 20:43:20.198025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42576. [D 20:43:20.198039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42577. [D 20:43:20.198054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42578. [D 20:43:20.198069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42579. [D 20:43:20.198083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42580. [D 20:43:20.198098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42581. [D 20:43:20.198113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42582. [D 20:43:20.198128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42583. [D 20:43:20.198142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42584. [D 20:43:20.198158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42585. [D 20:43:20.198172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42586. [D 20:43:20.198187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42587. [D 20:43:20.198202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42588. [D 20:43:20.198217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42589. [D 20:43:20.198232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42590. [D 20:43:20.198246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42591. [D 20:43:20.198261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42592. [D 20:43:20.198276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42593. [D 20:43:20.198290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42594. [D 20:43:20.198305] openib_post_sr_rdmaw: ibv_post_send wr_id 67e8b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42595. [D 20:43:20.198321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42596. [D 20:43:20.198336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42597. [D 20:43:20.198351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42598. [D 20:43:20.198366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42599. [D 20:43:20.198381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42600. [D 20:43:20.198395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42601. [E 20:43:20.198415] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42602, block for 10 ms. [D 20:43:20.198446] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42601. [D 20:43:20.198462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42602. [E 20:43:20.198478] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42603, block for 10 ms. [D 20:43:20.204222] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 42602. [D 20:43:20.204259] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 22/70. [D 20:43:20.204275] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42601. [D 20:43:20.204299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42602. [D 20:43:20.204321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42603. [D 20:43:20.204337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42604. [D 20:43:20.204352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42605. [D 20:43:20.204366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42606. [D 20:43:20.204381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42607. [D 20:43:20.204397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42608. [D 20:43:20.204412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42609. [D 20:43:20.204427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42610. [D 20:43:20.204441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42611. [D 20:43:20.204456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42612. [D 20:43:20.204471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42613. [D 20:43:20.204486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42614. [D 20:43:20.204501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42615. [D 20:43:20.204515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42616. [D 20:43:20.204530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42617. [D 20:43:20.204545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42618. [D 20:43:20.204560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42619. [D 20:43:20.204574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42620. [D 20:43:20.204589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42621. [D 20:43:20.204603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42622. [D 20:43:20.204618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42623. [D 20:43:20.204633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42624. [D 20:43:20.204648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42625. [D 20:43:20.204663] openib_post_sr_rdmaw: ibv_post_send wr_id 644560 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42626. [D 20:43:20.204746] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.204813] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.204827] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.206173] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.206190] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.206203] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.206244] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6579 [D 20:43:20.206259] element 0: offset: 0x2aaaab60d6a0, size: 24 [D 20:43:20.206280] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 23/70. [D 20:43:20.215945] openib_check_cq: completed rdma wr_id 67e8b0, nic_wr_credit 42626. [D 20:43:20.215973] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 24/70. [D 20:43:20.218139] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.218159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.218172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.227233] openib_check_cq: completed rdma wr_id 644560, nic_wr_credit 42625. [D 20:43:20.227259] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 25/70. [D 20:43:20.227309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.227331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.227344] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:20.227428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.227443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.227455] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.231041] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6579 [D 20:43:20.231108] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 26/70. [D 20:43:20.232329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42625. [D 20:43:20.232364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42626. [D 20:43:20.232382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42627. [D 20:43:20.232410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42628. [D 20:43:20.232438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42629. [D 20:43:20.232454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42630. [D 20:43:20.232468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42631. [D 20:43:20.232493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42632. [D 20:43:20.232509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42633. [D 20:43:20.232533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42634. [D 20:43:20.232559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42635. [D 20:43:20.232573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42636. [D 20:43:20.232602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42637. [D 20:43:20.232625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42638. [D 20:43:20.232640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42639. [D 20:43:20.232667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42640. [D 20:43:20.232682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42641. [D 20:43:20.232696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42642. [D 20:43:20.232722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42643. [D 20:43:20.232737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42644. [D 20:43:20.232760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42645. [D 20:43:20.232775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42646. [D 20:43:20.232790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42647. [D 20:43:20.232804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42648. [D 20:43:20.232819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42649. [D 20:43:20.232835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42650. [D 20:43:20.232854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42651. [D 20:43:20.232873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42652. [D 20:43:20.232888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42653. [D 20:43:20.232903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42654. [D 20:43:20.232918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42655. [D 20:43:20.232933] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42656. [D 20:43:20.243996] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 42656. [D 20:43:20.244018] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 27/70. [D 20:43:20.244112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.244135] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.244149] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:20.250128] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.250146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.250159] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:20.250199] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6585 [D 20:43:20.250215] element 0: offset: 0x2aaaab610190, size: 24 [D 20:43:20.250232] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 28/70. [D 20:43:20.250290] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.250305] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.250318] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.250339] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6586 [D 20:43:20.250353] element 0: offset: 0x2aaaab60ef00, size: 24 [D 20:43:20.250368] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 29/70. [D 20:43:20.250453] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.250468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.250481] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.250502] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6588 [D 20:43:20.250516] element 0: offset: 0x2aaaab60dc60, size: 24 [D 20:43:20.250531] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 30/70. [D 20:43:20.255827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.255867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.255883] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.255932] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6591 [D 20:43:20.255953] element 0: offset: 0x2aaaab60dd60, size: 24 [D 20:43:20.255970] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:43:20.260139] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6585 [D 20:43:20.260164] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 32/70. [D 20:43:20.260220] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6586 [D 20:43:20.260237] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 33/70. [D 20:43:20.260298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42656. [D 20:43:20.260314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 42657. [D 20:43:20.260329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 42658. [D 20:43:20.260345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 42659. [D 20:43:20.260360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 42660. [D 20:43:20.260375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 42661. [D 20:43:20.260390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42662. [D 20:43:20.260405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42663. [D 20:43:20.260420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42664. [D 20:43:20.260435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 42665. [D 20:43:20.260450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 42666. [D 20:43:20.260465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 42667. [D 20:43:20.260480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 42668. [D 20:43:20.260495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 42669. [D 20:43:20.260510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42670. [D 20:43:20.260525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42671. [D 20:43:20.260540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42672. [D 20:43:20.260555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 42673. [D 20:43:20.260570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 42674. [D 20:43:20.260585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 42675. [D 20:43:20.260600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 42676. [D 20:43:20.260614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 42677. [D 20:43:20.260630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42678. [D 20:43:20.260645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42679. [D 20:43:20.260659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42680. [D 20:43:20.260675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 42681. [D 20:43:20.260690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 42682. [D 20:43:20.260704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 42683. [D 20:43:20.260719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 42684. [D 20:43:20.260734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 42685. [D 20:43:20.260749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42686. [D 20:43:20.260764] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42687. [D 20:43:20.260782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42688. [D 20:43:20.260797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42689. [D 20:43:20.260813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42690. [D 20:43:20.260828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42691. [D 20:43:20.260843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42692. [D 20:43:20.260858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42693. [D 20:43:20.260873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42694. [D 20:43:20.260888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42695. [D 20:43:20.260903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42696. [D 20:43:20.260918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42697. [D 20:43:20.260933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42698. [D 20:43:20.260948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42699. [D 20:43:20.260963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42700. [D 20:43:20.260978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42701. [D 20:43:20.260993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42702. [D 20:43:20.261008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42703. [D 20:43:20.261023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42704. [D 20:43:20.261038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42705. [D 20:43:20.261053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42706. [D 20:43:20.261068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42707. [D 20:43:20.261083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42708. [D 20:43:20.261098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42709. [D 20:43:20.261113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42710. [D 20:43:20.261128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42711. [D 20:43:20.261143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42712. [D 20:43:20.261158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42713. [D 20:43:20.261173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42714. [D 20:43:20.261188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42715. [D 20:43:20.261203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42716. [D 20:43:20.261219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42717. [D 20:43:20.261234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42718. [D 20:43:20.261249] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42719. [D 20:43:20.264599] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6588 [D 20:43:20.264620] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 34/70. [D 20:43:20.264636] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6591 [D 20:43:20.264651] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 35/70. [D 20:43:20.271944] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 42719. [D 20:43:20.271965] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 36/70. [D 20:43:20.283618] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 42718. [D 20:43:20.283639] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 37/70. [D 20:43:20.283664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42718. [D 20:43:20.283680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42719. [D 20:43:20.283695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42720. [D 20:43:20.283710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42721. [D 20:43:20.283725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42722. [D 20:43:20.283740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42723. [D 20:43:20.283754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42724. [D 20:43:20.283769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42725. [D 20:43:20.283784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42726. [D 20:43:20.283799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42727. [D 20:43:20.283814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42728. [D 20:43:20.283829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42729. [D 20:43:20.283844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42730. [D 20:43:20.283859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42731. [D 20:43:20.283874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42732. [D 20:43:20.283889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42733. [D 20:43:20.283904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42734. [D 20:43:20.283919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42735. [D 20:43:20.283934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42736. [D 20:43:20.283948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42737. [D 20:43:20.283964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42738. [D 20:43:20.283979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42739. [D 20:43:20.283994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42740. [D 20:43:20.284009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42741. [D 20:43:20.284024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42742. [D 20:43:20.284038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42743. [D 20:43:20.284053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42744. [D 20:43:20.284110] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.284126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.284140] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.284067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42745. [D 20:43:20.284169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42746. [D 20:43:20.284184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42747. [D 20:43:20.284199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42748. [D 20:43:20.284214] openib_post_sr_rdmaw: ibv_post_send wr_id 620c80 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42749. [D 20:43:20.284231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42750. [D 20:43:20.284246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42751. [D 20:43:20.284260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42752. [D 20:43:20.284275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42753. [D 20:43:20.284289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42754. [D 20:43:20.284304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42755. [D 20:43:20.284318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42756. [D 20:43:20.284333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42757. [D 20:43:20.284347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42758. [D 20:43:20.284362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42759. [D 20:43:20.284377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42760. [D 20:43:20.284391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42761. [D 20:43:20.284406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42762. [D 20:43:20.284421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42763. [D 20:43:20.284435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42764. [D 20:43:20.284450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42765. [D 20:43:20.600109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42766. [D 20:43:20.600175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42767. [D 20:43:20.600190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42768. [D 20:43:20.600204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42769. [D 20:43:20.600219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42770. [D 20:43:20.600233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42771. [D 20:43:20.600248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42772. [D 20:43:20.600262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42773. [D 20:43:20.600276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42774. [D 20:43:20.600291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42775. [D 20:43:20.600305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42776. [D 20:43:20.600319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42777. [D 20:43:20.600333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42778. [D 20:43:20.600347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42779. [D 20:43:20.600361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42780. [D 20:43:20.600375] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42781. [D 20:43:20.600403] openib_check_cq: completed rdma wr_id 620c80, nic_wr_credit 42781. [D 20:43:20.600422] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 38/70. [D 20:43:20.600485] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.600517] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.600532] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.600566] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6595 [D 20:43:20.600582] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:20.600601] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 39/70. [D 20:43:20.600645] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.600660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.600673] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.600695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.600709] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.600722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.600744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6597 [D 20:43:20.600759] element 0: offset: 0x2aaaab00ecd0, size: 24 [D 20:43:20.600775] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 40/70. [D 20:43:20.603236] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 42780. [D 20:43:20.603257] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 41/70. [D 20:43:20.603325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.603412] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.603427] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.603646] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.603665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.603679] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:20.610366] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6595 [D 20:43:20.610429] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 42/70. [D 20:43:20.614454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42780. [D 20:43:20.614477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 42781. [D 20:43:20.614491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 42782. [D 20:43:20.614505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 42783. [D 20:43:20.614519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 42784. [D 20:43:20.614533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 42785. [D 20:43:20.614548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42786. [D 20:43:20.614561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42787. [D 20:43:20.614575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42788. [D 20:43:20.614589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 42789. [D 20:43:20.614603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 42790. [D 20:43:20.614617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 42791. [D 20:43:20.614631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 42792. [D 20:43:20.614645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 42793. [D 20:43:20.614659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42794. [D 20:43:20.614673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42795. [D 20:43:20.614687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42796. [D 20:43:20.614701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 42797. [D 20:43:20.614716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 42798. [D 20:43:20.614730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 42799. [D 20:43:20.614744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 42800. [D 20:43:20.614759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 42801. [D 20:43:20.614773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42802. [D 20:43:20.614790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42803. [D 20:43:20.614804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42804. [D 20:43:20.614817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 42805. [D 20:43:20.614833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 42806. [D 20:43:20.614848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 42807. [D 20:43:20.614864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 42808. [D 20:43:20.614878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 42809. [D 20:43:20.614892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42810. [D 20:43:20.614908] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42811. [D 20:43:20.617751] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6597 [D 20:43:20.620124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.620144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.620157] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.620200] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6601 [D 20:43:20.620215] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:20.620231] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 43/70. [D 20:43:20.620265] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.620279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.620291] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.620311] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6603 [D 20:43:20.620325] element 0: offset: 0x2aaaab001e60, size: 24 [D 20:43:20.620339] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 44/70. [D 20:43:20.620365] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 45/70. [D 20:43:20.620391] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 42811. [D 20:43:20.620406] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 46/70. [D 20:43:20.623510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42811. [D 20:43:20.623580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42812. [D 20:43:20.623596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42813. [D 20:43:20.623610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42814. [D 20:43:20.623625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42815. [D 20:43:20.623639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42816. [D 20:43:20.623654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42817. [D 20:43:20.623668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42818. [D 20:43:20.623683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42819. [D 20:43:20.623697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42820. [D 20:43:20.623712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42821. [D 20:43:20.623726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42822. [D 20:43:20.623740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42823. [D 20:43:20.623755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42824. [D 20:43:20.623769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42825. [D 20:43:20.623785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42826. [D 20:43:20.623799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42827. [D 20:43:20.623813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42828. [D 20:43:20.623828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42829. [D 20:43:20.623842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42830. [D 20:43:20.623857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42831. [D 20:43:20.623871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42832. [D 20:43:20.623885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42833. [D 20:43:20.623900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42834. [D 20:43:20.623914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42835. [D 20:43:20.623929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42836. [D 20:43:20.623944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42837. [D 20:43:20.623958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42838. [D 20:43:20.623972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42839. [D 20:43:20.623987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42840. [D 20:43:20.624001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42841. [D 20:43:20.624015] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42842. [D 20:43:20.624104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.624121] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.624134] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.626585] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6603 [D 20:43:20.626674] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 47/70. [D 20:43:20.626709] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6601 [D 20:43:20.626727] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 48/70. [D 20:43:20.628594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.628614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.628627] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.628661] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6607 [D 20:43:20.628677] element 0: offset: 0x2aaaab001f70, size: 24 [D 20:43:20.628695] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 49/70. [D 20:43:20.635242] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 42842. [D 20:43:20.635272] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 50/70. [D 20:43:20.635292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42842. [D 20:43:20.635308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42843. [D 20:43:20.635323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42844. [D 20:43:20.635339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42845. [D 20:43:20.635354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42846. [D 20:43:20.635369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42847. [D 20:43:20.635384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42848. [D 20:43:20.635398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42849. [D 20:43:20.635413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42850. [D 20:43:20.635428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42851. [D 20:43:20.635442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42852. [D 20:43:20.635457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42853. [D 20:43:20.635471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42854. [D 20:43:20.635486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42855. [D 20:43:20.635500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42856. [D 20:43:20.635515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42857. [D 20:43:20.635529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42858. [D 20:43:20.635544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42859. [D 20:43:20.635558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42860. [D 20:43:20.635576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42861. [D 20:43:20.635591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42862. [D 20:43:20.635606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42863. [D 20:43:20.635620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42864. [D 20:43:20.635635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42865. [D 20:43:20.635650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42866. [D 20:43:20.635664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42867. [D 20:43:20.635679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42868. [D 20:43:20.635693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42869. [D 20:43:20.635708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42870. [D 20:43:20.635722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42871. [D 20:43:20.635737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42872. [D 20:43:20.635752] openib_post_sr_rdmaw: ibv_post_send wr_id 6303b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42873. [D 20:43:20.635769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42874. [D 20:43:20.635784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42875. [D 20:43:20.635799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42876. [D 20:43:20.635814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 42877. [D 20:43:20.635829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 42878. [D 20:43:20.635843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 42879. [D 20:43:20.635858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 42880. [D 20:43:20.635873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 42881. [D 20:43:20.635887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 42882. [D 20:43:20.635902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 42883. [D 20:43:20.635917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 42884. [D 20:43:20.635932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 42885. [D 20:43:20.635946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 42886. [D 20:43:20.635961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 42887. [D 20:43:20.635976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 42888. [D 20:43:20.635990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 42889. [D 20:43:20.636005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 42890. [D 20:43:20.636020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 42891. [D 20:43:20.636034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 42892. [D 20:43:20.636049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 42893. [D 20:43:20.636064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 42894. [D 20:43:20.636079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 42895. [D 20:43:20.636099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 42896. [D 20:43:20.636114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 42897. [D 20:43:20.636129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 42898. [D 20:43:20.636144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 42899. [D 20:43:20.636158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 42900. [D 20:43:20.636173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 42901. [D 20:43:20.636188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 42902. [D 20:43:20.636204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 42903. [D 20:43:20.636219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 42904. [D 20:43:20.636233] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 42905. [D 20:43:20.636289] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.636309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.636322] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.639552] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6607 [D 20:43:20.639581] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 51/70. [D 20:43:20.647052] openib_check_cq: completed rdma wr_id 6303b0, nic_wr_credit 42905. [D 20:43:20.647113] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 52/70. [D 20:43:20.648122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.648147] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.648162] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.648205] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6609 [D 20:43:20.648221] element 0: offset: 0x2aaaab013f80, size: 24 [D 20:43:20.648238] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 53/70. [D 20:43:20.657176] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 42904. [D 20:43:20.657200] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 54/70. [D 20:43:20.657217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42904. [D 20:43:20.657233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 42905. [D 20:43:20.657248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 42906. [D 20:43:20.657263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 42907. [D 20:43:20.657277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 42908. [D 20:43:20.657292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 42909. [D 20:43:20.657307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42910. [D 20:43:20.657321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42911. [D 20:43:20.657336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42912. [D 20:43:20.657350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 42913. [D 20:43:20.657365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 42914. [D 20:43:20.657380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 42915. [D 20:43:20.657394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 42916. [D 20:43:20.657409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 42917. [D 20:43:20.657423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42918. [D 20:43:20.657438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42919. [D 20:43:20.657452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42920. [D 20:43:20.657468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 42921. [D 20:43:20.657482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 42922. [D 20:43:20.657497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 42923. [D 20:43:20.657512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 42924. [D 20:43:20.657526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 42925. [D 20:43:20.657541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42926. [D 20:43:20.657556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42927. [D 20:43:20.657570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42928. [D 20:43:20.657585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 42929. [D 20:43:20.657600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 42930. [D 20:43:20.657615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 42931. [D 20:43:20.657629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 42932. [D 20:43:20.657644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 42933. [D 20:43:20.657659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42934. [D 20:43:20.657674] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42935. [D 20:43:20.660148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.660170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.660183] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.660205] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.660218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.660231] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:20.663131] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 42935. [D 20:43:20.663151] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 55/70. [D 20:43:20.663273] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.663344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.663358] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.666207] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6609 [D 20:43:20.666229] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 56/70. [D 20:43:20.668429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 42935. [D 20:43:20.668447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 42936. [D 20:43:20.668462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 42937. [D 20:43:20.668476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 42938. [D 20:43:20.668491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 42939. [D 20:43:20.668506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 42940. [D 20:43:20.668521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 42941. [D 20:43:20.668537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 42942. [D 20:43:20.668552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 42943. [D 20:43:20.668567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 42944. [D 20:43:20.668581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 42945. [D 20:43:20.668596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 42946. [D 20:43:20.668611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 42947. [D 20:43:20.668626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 42948. [D 20:43:20.668640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 42949. [D 20:43:20.668655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 42950. [D 20:43:20.668669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 42951. [D 20:43:20.668684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 42952. [D 20:43:20.668699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 42953. [D 20:43:20.668714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 42954. [D 20:43:20.668728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 42955. [D 20:43:20.668743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 42956. [D 20:43:20.668758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 42957. [D 20:43:20.668772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 42958. [D 20:43:20.668787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 42959. [D 20:43:20.668802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 42960. [D 20:43:20.668817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 42961. [D 20:43:20.668831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 42962. [D 20:43:20.668846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 42963. [D 20:43:20.668861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 42964. [D 20:43:20.668876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 42965. [D 20:43:20.668890] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 42966. [D 20:43:20.674124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.674151] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.674164] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.674207] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6613 [D 20:43:20.674222] element 0: offset: 0x2aaaab02e770, size: 24 [D 20:43:20.674245] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 57/70. [D 20:43:20.674958] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 42966. [D 20:43:20.674982] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 58/70. [D 20:43:20.675096] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.675117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.675130] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.678395] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6613 [D 20:43:20.678420] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 59/70. [D 20:43:20.680961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42966. [D 20:43:20.680980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42967. [D 20:43:20.680994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 42968. [D 20:43:20.681009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 42969. [D 20:43:20.681024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 42970. [D 20:43:20.681051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 42971. [D 20:43:20.681066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 42972. [D 20:43:20.681081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42973. [D 20:43:20.681104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42974. [D 20:43:20.681130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42975. [D 20:43:20.681146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 42976. [D 20:43:20.681171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 42977. [D 20:43:20.681186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 42978. [D 20:43:20.681212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 42979. [D 20:43:20.681238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 42980. [D 20:43:20.681253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42981. [D 20:43:20.681279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42982. [D 20:43:20.681293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42983. [D 20:43:20.681320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 42984. [D 20:43:20.681344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 42985. [D 20:43:20.681370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 42986. [D 20:43:20.681385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 42987. [D 20:43:20.681400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 42988. [D 20:43:20.681425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42989. [D 20:43:20.681448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42990. [D 20:43:20.681463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42991. [D 20:43:20.681488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 42992. [D 20:43:20.681503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 42993. [D 20:43:20.681519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 42994. [D 20:43:20.681533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 42995. [D 20:43:20.681548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 42996. [D 20:43:20.681567] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42997. [D 20:43:20.681639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.681691] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.681705] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.681751] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6616 [D 20:43:20.681766] element 0: offset: 0x67edb0, size: 24 [D 20:43:20.681787] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 60/70. [D 20:43:20.681824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.681838] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.681851] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.681871] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6619 [D 20:43:20.681886] element 0: offset: 0x62fd10, size: 24 [D 20:43:20.681900] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 0/70. [D 20:43:20.683769] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.683787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.683800] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.683823] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6621 [D 20:43:20.683837] element 0: offset: 0x62fee0, size: 24 [D 20:43:20.683855] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 1/70. [D 20:43:20.692693] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 42997. [D 20:43:20.692715] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 2/70. [D 20:43:20.692915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.692936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.692949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.696123] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6616 [D 20:43:20.696146] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 3/70. [D 20:43:20.698836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 42997. [D 20:43:20.698855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 42998. [D 20:43:20.698870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 42999. [D 20:43:20.698885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 43000. [D 20:43:20.698900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 43001. [D 20:43:20.698914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 43002. [D 20:43:20.698939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 43003. [D 20:43:20.698954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 43004. [D 20:43:20.698979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 43005. [D 20:43:20.699010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 43006. [D 20:43:20.699026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 43007. [D 20:43:20.699050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 43008. [D 20:43:20.699073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 43009. [D 20:43:20.699088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 43010. [D 20:43:20.699102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 43011. [D 20:43:20.699126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 43012. [D 20:43:20.699155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 43013. [D 20:43:20.699179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 43014. [D 20:43:20.699194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 43015. [D 20:43:20.699218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 43016. [D 20:43:20.699233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 43017. [D 20:43:20.699248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 43018. [D 20:43:20.699271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 43019. [D 20:43:20.699300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 43020. [D 20:43:20.699315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 43021. [D 20:43:20.699330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 43022. [D 20:43:20.699345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 43023. [D 20:43:20.699360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 43024. [D 20:43:20.699391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 43025. [D 20:43:20.699406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 43026. [D 20:43:20.699434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 43027. [D 20:43:20.699459] openib_post_sr_rdmaw: ibv_post_send wr_id 636c30 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 43028. [D 20:43:20.701861] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.701929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.701943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:20.701988] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6624 [D 20:43:20.702003] element 0: offset: 0x6301c0, size: 24 [D 20:43:20.702023] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 4/70. [D 20:43:20.702506] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6619 [D 20:43:20.702532] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 5/70. [D 20:43:20.702549] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6621 [D 20:43:20.702565] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 6/70. [D 20:43:20.710601] openib_check_cq: completed rdma wr_id 636c30, nic_wr_credit 43028. [D 20:43:20.710621] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 7/70. [D 20:43:20.710647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43028. [D 20:43:20.710662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 43029. [D 20:43:20.710678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 43030. [D 20:43:20.710692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 43031. [D 20:43:20.710707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 43032. [D 20:43:20.710722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 43033. [D 20:43:20.710737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43034. [D 20:43:20.710751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43035. [D 20:43:20.710766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43036. [D 20:43:20.710780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 43037. [D 20:43:20.710795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 43038. [D 20:43:20.710810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 43039. [D 20:43:20.710825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 43040. [D 20:43:20.710839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 43041. [D 20:43:20.710854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43042. [D 20:43:20.710868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43043. [D 20:43:20.710883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43044. [D 20:43:20.710898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 43045. [D 20:43:20.710913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 43046. [D 20:43:20.710927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 43047. [D 20:43:20.710942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 43048. [D 20:43:20.710957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 43049. [D 20:43:20.710972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43050. [D 20:43:20.710987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43051. [D 20:43:20.711001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43052. [D 20:43:20.711016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 43053. [D 20:43:20.711031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 43054. [D 20:43:20.711045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 43055. [D 20:43:20.711061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 43056. [D 20:43:20.711076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 43057. [D 20:43:20.711090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43058. [D 20:43:20.711105] openib_post_sr_rdmaw: ibv_post_send wr_id 6369b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43059. [D 20:43:20.711122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43060. [D 20:43:20.711137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43061. [D 20:43:20.711152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43062. [D 20:43:20.711167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43063. [D 20:43:20.711182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43064. [D 20:43:20.711197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43065. [D 20:43:20.711211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43066. [D 20:43:20.711226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43067. [D 20:43:20.711270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43068. [D 20:43:20.711285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43069. [D 20:43:20.711299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43070. [D 20:43:20.711315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 43071. [D 20:43:20.711329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 43072. [D 20:43:20.711348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 43073. [D 20:43:20.711363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 43074. [D 20:43:20.711378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43075. [D 20:43:20.711393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43076. [D 20:43:20.711408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43077. [D 20:43:20.711423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43078. [D 20:43:20.711437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43079. [D 20:43:20.711452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43080. [D 20:43:20.711466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43081. [D 20:43:20.711481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43082. [D 20:43:20.711496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43083. [D 20:43:20.711511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43084. [D 20:43:20.711526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43085. [D 20:43:20.711541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43086. [D 20:43:20.711556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43087. [D 20:43:20.711570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43088. [D 20:43:20.711588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43089. [D 20:43:20.711603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43090. [D 20:43:20.711617] openib_post_sr_rdmaw: ibv_post_send wr_id 66e6c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43091. [D 20:43:20.711695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.711758] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.711772] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:20.713903] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6624 [D 20:43:20.713959] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 8/70. [D 20:43:20.722397] openib_check_cq: completed rdma wr_id 6369b0, nic_wr_credit 43091. [D 20:43:20.722423] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 9/70. [D 20:43:20.733947] openib_check_cq: completed rdma wr_id 66e6c0, nic_wr_credit 43090. [D 20:43:20.733968] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 10/70. [D 20:43:20.734038] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.734062] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.734075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:20.734098] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.734112] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.734124] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:20.738893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 43090. [D 20:43:20.738918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 43091. [D 20:43:20.738933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43092. [D 20:43:20.738948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43093. [D 20:43:20.738963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43094. [D 20:43:20.738977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43095. [D 20:43:20.738992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43096. [D 20:43:20.739007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43097. [D 20:43:20.739021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43098. [D 20:43:20.739036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43099. [D 20:43:20.739050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43100. [D 20:43:20.739065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43101. [D 20:43:20.739080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43102. [D 20:43:20.739095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43103. [D 20:43:20.739110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43104. [D 20:43:20.739125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43105. [D 20:43:20.739139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43106. [D 20:43:20.739154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43107. [D 20:43:20.739169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43108. [D 20:43:20.739183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43109. [D 20:43:20.739198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43110. [D 20:43:20.739213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43111. [D 20:43:20.739227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43112. [D 20:43:20.739242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43113. [D 20:43:20.739257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43114. [D 20:43:20.739271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43115. [D 20:43:20.739286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43116. [D 20:43:20.739300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43117. [D 20:43:20.739315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43118. [D 20:43:20.739330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43119. [D 20:43:20.739344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43120. [D 20:43:20.739359] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43121. [D 20:43:20.750759] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 43121. [D 20:43:20.750775] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 11/70. [D 20:43:20.750839] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:20.750859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.750872] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:20.756752] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.756772] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.756784] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:20.756824] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6629 [D 20:43:20.756839] element 0: offset: 0x5b0030, size: 24 [D 20:43:20.756856] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 12/70. [D 20:43:20.756894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.756907] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.756920] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:20.756946] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6632 [D 20:43:20.756960] element 0: offset: 0x658610, size: 24 [D 20:43:20.756977] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 13/70. [D 20:43:20.757065] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:20.757081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:20.757094] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:20.757115] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6633 [D 20:43:20.757129] element 0: offset: 0x2aaaab60ef00, size: 24 [D 20:43:20.757146] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 14/70. [D 20:43:20.764161] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6629 [D 20:43:20.764240] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 15/70. [D 20:43:20.764390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 43121. [D 20:43:20.764416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 43122. [D 20:43:20.764432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 43123. [D 20:43:20.764446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 43124. [D 20:43:20.764462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 43125. [D 20:43:20.764476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 43126. [D 20:43:20.764491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 43127. [D 20:43:20.764505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 43128. [D 20:43:20.764520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 43129. [D 20:43:20.764534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 43130. [D 20:43:20.764549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 43131. [D 20:43:20.764564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 43132. [D 20:43:20.764579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 43133. [D 20:43:20.764593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 43134. [D 20:43:20.764609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 43135. [D 20:43:20.764623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 43136. [D 20:43:20.764638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 43137. [D 20:43:20.764653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 43138. [D 20:43:20.764667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 43139. [D 20:43:20.764682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 43140. [D 20:43:20.764697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 43141. [D 20:43:20.764712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 43142. [D 20:43:20.764726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 43143. [D 20:43:20.764741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 43144. [D 20:43:20.764755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 43145. [D 20:43:20.767315] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6632 [D 20:43:21.048606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 43146. [D 20:43:21.049043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 43147. [D 20:43:21.049060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 43148. [D 20:43:21.049075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 43149. [D 20:43:21.049090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 43150. [D 20:43:21.049105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 43151. [D 20:43:21.049119] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 43152. [D 20:43:21.049147] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 16/70. [D 20:43:21.049173] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6633 [D 20:43:21.049190] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 17/70. [D 20:43:21.049252] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.049269] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.049283] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.049312] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6636 [D 20:43:21.049327] element 0: offset: 0x2aaaab60a260, size: 24 [D 20:43:21.049342] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 18/70. [D 20:43:21.050644] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43152. [D 20:43:21.050666] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 19/70. [D 20:43:21.050682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43152. [D 20:43:21.050697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 43153. [D 20:43:21.050713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 43154. [D 20:43:21.050727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 43155. [D 20:43:21.050742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 43156. [D 20:43:21.050757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 43157. [D 20:43:21.050771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43158. [D 20:43:21.050786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43159. [D 20:43:21.050801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43160. [D 20:43:21.050816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 43161. [D 20:43:21.050830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 43162. [D 20:43:21.050845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 43163. [D 20:43:21.050860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 43164. [D 20:43:21.050874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 43165. [D 20:43:21.050889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43166. [D 20:43:21.050904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43167. [D 20:43:21.050919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43168. [D 20:43:21.050934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 43169. [D 20:43:21.050949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 43170. [D 20:43:21.051062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 43171. [D 20:43:21.051460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 43172. [D 20:43:21.051478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 43173. [D 20:43:21.051493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43174. [D 20:43:21.051507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43175. [D 20:43:21.051522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43176. [D 20:43:21.051537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 43177. [D 20:43:21.051551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 43178. [D 20:43:21.051566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 43179. [D 20:43:21.051580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 43180. [D 20:43:21.051598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 43181. [D 20:43:21.051613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43182. [D 20:43:21.051628] openib_post_sr_rdmaw: ibv_post_send wr_id 62fff0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43183. [D 20:43:21.051645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43184. [D 20:43:21.051660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43185. [D 20:43:21.051675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43186. [D 20:43:21.051689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43187. [D 20:43:21.051704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43188. [D 20:43:21.051719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43189. [D 20:43:21.051733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43190. [D 20:43:21.051748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43191. [D 20:43:21.051803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43192. [D 20:43:21.052346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43193. [D 20:43:21.052366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43194. [D 20:43:21.052380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 43195. [D 20:43:21.052395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 43196. [D 20:43:21.052410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 43197. [D 20:43:21.052425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 43198. [D 20:43:21.052440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43199. [D 20:43:21.052455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43200. [D 20:43:21.052470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43201. [D 20:43:21.052485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43202. [D 20:43:21.052499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43203. [D 20:43:21.052514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43204. [D 20:43:21.052529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43205. [D 20:43:21.052544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43206. [D 20:43:21.052559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43207. [D 20:43:21.052573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43208. [D 20:43:21.052665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43209. [D 20:43:21.052689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43210. [D 20:43:21.053082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43211. [D 20:43:21.053099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43212. [D 20:43:21.053114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43213. [D 20:43:21.053129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43214. [D 20:43:21.053143] openib_post_sr_rdmaw: ibv_post_send wr_id 61e550 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43215. [D 20:43:21.053202] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.053218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.053232] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.056585] openib_check_cq: completed rdma wr_id 62fff0, nic_wr_credit 43215. [D 20:43:21.056606] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 20/70. [D 20:43:21.062034] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6636 [D 20:43:21.062071] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 21/70. [D 20:43:21.063388] openib_check_cq: completed rdma wr_id 61e550, nic_wr_credit 43214. [D 20:43:21.063409] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 22/70. [D 20:43:21.063454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 43214. [D 20:43:21.063470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 43215. [D 20:43:21.063485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43216. [D 20:43:21.063499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43217. [D 20:43:21.063514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43218. [D 20:43:21.063529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43219. [D 20:43:21.063544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43220. [D 20:43:21.063558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43221. [D 20:43:21.063572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43222. [D 20:43:21.063587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43223. [D 20:43:21.063602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43224. [D 20:43:21.063617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43225. [D 20:43:21.063631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43226. [D 20:43:21.063646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43227. [D 20:43:21.063660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43228. [D 20:43:21.063675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43229. [D 20:43:21.063689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43230. [D 20:43:21.063703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43231. [D 20:43:21.063718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43232. [D 20:43:21.063732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43233. [D 20:43:21.063747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43234. [D 20:43:21.063761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43235. [D 20:43:21.063775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43236. [D 20:43:21.063790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43237. [D 20:43:21.063804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43238. [D 20:43:21.063818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43239. [D 20:43:21.063833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43240. [D 20:43:21.063847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43241. [D 20:43:21.063862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43242. [D 20:43:21.063876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43243. [D 20:43:21.063891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43244. [D 20:43:21.063905] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43245. [D 20:43:21.066901] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.066918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.066932] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.066972] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6639 [D 20:43:21.066987] element 0: offset: 0x2aaaab60d6a0, size: 24 [D 20:43:21.067003] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 23/70. [D 20:43:21.067047] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.067061] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.067075] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.067099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.067112] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.067128] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.074343] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43245. [D 20:43:21.074368] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 24/70. [D 20:43:21.077348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.077364] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.077377] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.080502] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6639 [D 20:43:21.080523] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 25/70. [D 20:43:21.080861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 43245. [D 20:43:21.080877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 43246. [D 20:43:21.080891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 43247. [D 20:43:21.080906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 43248. [D 20:43:21.080920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 43249. [D 20:43:21.080934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 43250. [D 20:43:21.080948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 43251. [D 20:43:21.080962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 43252. [D 20:43:21.080976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 43253. [D 20:43:21.080990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 43254. [D 20:43:21.081004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 43255. [D 20:43:21.081019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 43256. [D 20:43:21.081033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 43257. [D 20:43:21.081047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 43258. [D 20:43:21.081061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 43259. [D 20:43:21.081075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 43260. [D 20:43:21.081089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 43261. [D 20:43:21.081103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 43262. [D 20:43:21.081117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 43263. [D 20:43:21.081132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 43264. [D 20:43:21.081146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 43265. [D 20:43:21.081159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 43266. [D 20:43:21.081173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 43267. [D 20:43:21.081187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 43268. [D 20:43:21.081202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 43269. [D 20:43:21.081216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 43270. [D 20:43:21.081229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 43271. [D 20:43:21.081243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 43272. [D 20:43:21.081257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 43273. [D 20:43:21.081271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 43274. [D 20:43:21.081285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 43275. [D 20:43:21.081299] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 43276. [D 20:43:21.084098] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.084113] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.084126] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.084149] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6643 [D 20:43:21.084163] element 0: offset: 0x2aaaab60ef00, size: 24 [D 20:43:21.084178] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 26/70. [D 20:43:21.084200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.084214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.084226] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.084247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6645 [D 20:43:21.084262] element 0: offset: 0x2aaaab60a260, size: 24 [D 20:43:21.084276] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 27/70. [D 20:43:21.087920] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43276. [D 20:43:21.087936] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 28/70. [D 20:43:21.088308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.088378] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.088393] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.091639] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6643 [D 20:43:21.091671] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 29/70. [D 20:43:21.093380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43276. [D 20:43:21.093470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 43277. [D 20:43:21.093486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 43278. [D 20:43:21.093531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 43279. [D 20:43:21.093559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 43280. [D 20:43:21.093576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 43281. [D 20:43:21.093606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43282. [D 20:43:21.093621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43283. [D 20:43:21.093636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43284. [D 20:43:21.093660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 43285. [D 20:43:21.093675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 43286. [D 20:43:21.093690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 43287. [D 20:43:21.093705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 43288. [D 20:43:21.093734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 43289. [D 20:43:21.093759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43290. [D 20:43:21.093784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43291. [D 20:43:21.093799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43292. [D 20:43:21.093814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 43293. [D 20:43:21.093842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 43294. [D 20:43:21.093869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 43295. [D 20:43:21.093884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 43296. [D 20:43:21.093899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 43297. [D 20:43:21.093914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43298. [D 20:43:21.093928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43299. [D 20:43:21.093943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43300. [D 20:43:21.093958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 43301. [D 20:43:21.093973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 43302. [D 20:43:21.093987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 43303. [D 20:43:21.094002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 43304. [D 20:43:21.094017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 43305. [D 20:43:21.094032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43306. [D 20:43:21.094047] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43307. [D 20:43:21.094248] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6645 [D 20:43:21.094311] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 30/70. [D 20:43:21.099417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.099443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.099458] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.099504] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6648 [D 20:43:21.099520] element 0: offset: 0x2aaaab610190, size: 24 [D 20:43:21.099538] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:43:21.105069] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43307. [D 20:43:21.105092] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 32/70. [D 20:43:21.105109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43307. [D 20:43:21.105124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43308. [D 20:43:21.105149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43309. [D 20:43:21.105165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43310. [D 20:43:21.105179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43311. [D 20:43:21.105194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43312. [D 20:43:21.105209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43313. [D 20:43:21.105223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43314. [D 20:43:21.105238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43315. [D 20:43:21.105253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43316. [D 20:43:21.105267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43317. [D 20:43:21.105282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43318. [D 20:43:21.105296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43319. [D 20:43:21.105311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43320. [D 20:43:21.105325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43321. [D 20:43:21.105340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43322. [D 20:43:21.105355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43323. [D 20:43:21.105369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43324. [D 20:43:21.105384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43325. [D 20:43:21.105399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43326. [D 20:43:21.105413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43327. [D 20:43:21.105428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43328. [D 20:43:21.105442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43329. [D 20:43:21.105457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43330. [D 20:43:21.105472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43331. [D 20:43:21.105487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43332. [D 20:43:21.105502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43333. [D 20:43:21.105517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43334. [D 20:43:21.105531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43335. [D 20:43:21.105546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43336. [D 20:43:21.105560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43337. [D 20:43:21.105575] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43338. [D 20:43:21.108169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.108191] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.108213] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.111210] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43338. [D 20:43:21.111315] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 33/70. [D 20:43:21.111635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.111658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.111672] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.115306] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6648 [D 20:43:21.115325] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 34/70. [D 20:43:21.117886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43338. [D 20:43:21.117945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43339. [D 20:43:21.117961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43340. [D 20:43:21.117975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43341. [D 20:43:21.117990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43342. [D 20:43:21.118005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43343. [D 20:43:21.118020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43344. [D 20:43:21.118034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43345. [D 20:43:21.118049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43346. [D 20:43:21.118064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43347. [D 20:43:21.118078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43348. [D 20:43:21.118093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 43349. [D 20:43:21.118108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 43350. [D 20:43:21.118123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 43351. [D 20:43:21.118137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 43352. [D 20:43:21.118152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43353. [D 20:43:21.118168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43354. [D 20:43:21.118183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43355. [D 20:43:21.118198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43356. [D 20:43:21.118213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43357. [D 20:43:21.118228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43358. [D 20:43:21.118242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43359. [D 20:43:21.118257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43360. [D 20:43:21.118272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43361. [D 20:43:21.118286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43362. [D 20:43:21.118301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43363. [D 20:43:21.118316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43364. [D 20:43:21.118331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43365. [D 20:43:21.118345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43366. [D 20:43:21.118360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43367. [D 20:43:21.118375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43368. [D 20:43:21.118389] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43369. [D 20:43:21.120575] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.120598] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.120611] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.120650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6651 [D 20:43:21.120666] element 0: offset: 0x2aaaab60d3a0, size: 24 [D 20:43:21.120682] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 35/70. [D 20:43:21.124366] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43369. [D 20:43:21.124392] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 36/70. [D 20:43:21.124500] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.124521] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.124533] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.127473] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6651 [D 20:43:21.127528] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 37/70. [D 20:43:21.130172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43369. [D 20:43:21.130196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43370. [D 20:43:21.130212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43371. [D 20:43:21.130226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43372. [D 20:43:21.130241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43373. [D 20:43:21.130257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43374. [D 20:43:21.130271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43375. [D 20:43:21.130286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43376. [D 20:43:21.130301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43377. [D 20:43:21.130315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43378. [D 20:43:21.130330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43379. [D 20:43:21.130345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43380. [D 20:43:21.130359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43381. [D 20:43:21.130374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43382. [D 20:43:21.130388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43383. [D 20:43:21.130403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43384. [D 20:43:21.130418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43385. [D 20:43:21.130433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43386. [D 20:43:21.130447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43387. [D 20:43:21.130462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43388. [D 20:43:21.130477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43389. [D 20:43:21.130491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43390. [D 20:43:21.130506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43391. [D 20:43:21.130521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43392. [D 20:43:21.130535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43393. [D 20:43:21.130550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43394. [D 20:43:21.130564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43395. [D 20:43:21.130579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43396. [D 20:43:21.130593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43397. [D 20:43:21.130608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43398. [D 20:43:21.130623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43399. [D 20:43:21.130637] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43400. [D 20:43:21.136087] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43400. [D 20:43:21.136108] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 38/70. [D 20:43:21.136188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.136212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.136225] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:21.145108] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.145127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.145141] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:21.145181] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6654 [D 20:43:21.145196] element 0: offset: 0x2aaaab60ef00, size: 24 [D 20:43:21.145213] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 39/70. [D 20:43:21.151815] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6654 [D 20:43:21.151891] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 40/70. [D 20:43:21.152032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43400. [D 20:43:21.152058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43401. [D 20:43:21.152073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43402. [D 20:43:21.152095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43403. [D 20:43:21.152110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43404. [D 20:43:21.152124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43405. [D 20:43:21.152139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43406. [D 20:43:21.152154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43407. [D 20:43:21.152169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43408. [D 20:43:21.152183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43409. [D 20:43:21.152198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43410. [D 20:43:21.152213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43411. [D 20:43:21.152227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43412. [D 20:43:21.152242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43413. [D 20:43:21.152257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43414. [D 20:43:21.152271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43415. [D 20:43:21.152286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43416. [D 20:43:21.152300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43417. [D 20:43:21.152315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43418. [D 20:43:21.152330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43419. [D 20:43:21.152345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43420. [D 20:43:21.152359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43421. [D 20:43:21.152374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43422. [D 20:43:21.152388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43423. [D 20:43:21.152404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43424. [D 20:43:21.152419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43425. [D 20:43:21.152434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43426. [D 20:43:21.152449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43427. [D 20:43:21.152464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43428. [D 20:43:21.152479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43429. [D 20:43:21.152493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43430. [D 20:43:21.152508] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43431. [D 20:43:21.161122] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43431. [D 20:43:21.161145] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 41/70. [D 20:43:21.161227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.161249] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.161262] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:21.170180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.170199] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.170212] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:21.170252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6657 [D 20:43:21.170267] element 0: offset: 0x2aaaab60a260, size: 24 [D 20:43:21.170283] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 42/70. [D 20:43:21.173369] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6657 [D 20:43:21.173439] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 43/70. [D 20:43:21.173693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43431. [D 20:43:21.173720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43432. [D 20:43:21.173754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43433. [D 20:43:21.173769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43434. [D 20:43:21.173784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43435. [D 20:43:21.173799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43436. [D 20:43:21.173814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43437. [D 20:43:21.173829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43438. [D 20:43:21.173844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43439. [D 20:43:21.173859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43440. [D 20:43:21.173883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43441. [D 20:43:21.173898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43442. [D 20:43:21.173913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43443. [D 20:43:21.173928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43444. [D 20:43:21.173945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43445. [D 20:43:21.173960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43446. [D 20:43:21.173975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43447. [D 20:43:21.173990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43448. [D 20:43:21.174005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43449. [D 20:43:21.174020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43450. [D 20:43:21.174035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43451. [D 20:43:21.174050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43452. [D 20:43:21.174064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43453. [D 20:43:21.174079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43454. [D 20:43:21.174094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43455. [D 20:43:21.174109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43456. [D 20:43:21.174124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43457. [D 20:43:21.174139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43458. [D 20:43:21.174154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43459. [D 20:43:21.174169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43460. [D 20:43:21.174183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43461. [D 20:43:21.174199] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43462. [D 20:43:21.184383] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43462. [D 20:43:21.184405] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 44/70. [D 20:43:21.184488] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.184510] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.184523] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:21.193455] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.193472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.193485] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:21.193523] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6660 [D 20:43:21.193537] element 0: offset: 0x2aaaab610190, size: 24 [D 20:43:21.193554] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 45/70. [D 20:43:21.196763] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6660 [D 20:43:21.196837] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 46/70. [D 20:43:21.196899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43462. [D 20:43:21.196923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43463. [D 20:43:21.196939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43464. [D 20:43:21.196954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43465. [D 20:43:21.196975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43466. [D 20:43:21.196990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43467. [D 20:43:21.197005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43468. [D 20:43:21.197019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43469. [D 20:43:21.197034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43470. [D 20:43:21.197049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43471. [D 20:43:21.197064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43472. [D 20:43:21.197079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43473. [D 20:43:21.197093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43474. [D 20:43:21.197108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43475. [D 20:43:21.197123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43476. [D 20:43:21.197138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43477. [D 20:43:21.197153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43478. [D 20:43:21.197168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43479. [D 20:43:21.197182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43480. [D 20:43:21.197197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43481. [D 20:43:21.197212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43482. [D 20:43:21.197227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43483. [D 20:43:21.197242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43484. [D 20:43:21.197257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43485. [D 20:43:21.197272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43486. [D 20:43:21.197286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43487. [D 20:43:21.197301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43488. [D 20:43:21.197316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43489. [D 20:43:21.197331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43490. [D 20:43:21.197346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43491. [D 20:43:21.197360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43492. [D 20:43:21.197375] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43493. [D 20:43:21.207765] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43493. [D 20:43:21.207786] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 47/70. [D 20:43:21.207918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.207940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.207954] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:21.217543] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.217562] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.217575] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:21.217615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6664 [D 20:43:21.217630] element 0: offset: 0x2aaaab609740, size: 24 [D 20:43:21.217647] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 48/70. [D 20:43:21.217688] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.217702] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.217714] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.217735] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6666 [D 20:43:21.217749] element 0: offset: 0x2aaaab60d3a0, size: 24 [D 20:43:21.217764] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 49/70. [D 20:43:21.224359] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6664 [D 20:43:21.224388] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 50/70. [D 20:43:21.224526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43493. [D 20:43:21.224544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43494. [D 20:43:21.224559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 43495. [D 20:43:21.224574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 43496. [D 20:43:21.224589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 43497. [D 20:43:21.224603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 43498. [D 20:43:21.224618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 43499. [D 20:43:21.224633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43500. [D 20:43:21.224647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43501. [D 20:43:21.224662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43502. [D 20:43:21.224677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 43503. [D 20:43:21.224692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 43504. [D 20:43:21.224707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 43505. [D 20:43:21.224721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 43506. [D 20:43:21.224736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 43507. [D 20:43:21.224751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43508. [D 20:43:21.224765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43509. [D 20:43:21.224780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43510. [D 20:43:21.224795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 43511. [D 20:43:21.225013] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6666 [D 20:43:21.484875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 43512. [D 20:43:21.485314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 43513. [D 20:43:21.485346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 43514. [D 20:43:21.485361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 43515. [D 20:43:21.485376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43516. [D 20:43:21.485414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43517. [D 20:43:21.485439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43518. [D 20:43:21.485455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 43519. [D 20:43:21.485480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 43520. [D 20:43:21.485495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 43521. [D 20:43:21.485510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 43522. [D 20:43:21.485525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 43523. [D 20:43:21.485539] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43524. [D 20:43:21.485566] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 51/70. [D 20:43:21.485714] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.485779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.485793] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.485839] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6670 [D 20:43:21.485854] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:21.485874] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 52/70. [D 20:43:21.485913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.485927] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.485940] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.485961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6672 [D 20:43:21.485975] element 0: offset: 0x2aaaab02e770, size: 24 [D 20:43:21.485991] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 53/70. [D 20:43:21.487699] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43524. [D 20:43:21.487723] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 54/70. [D 20:43:21.487781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43524. [D 20:43:21.487797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43525. [D 20:43:21.487813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43526. [D 20:43:21.487828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43527. [D 20:43:21.487843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43528. [D 20:43:21.487858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43529. [D 20:43:21.487873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43530. [D 20:43:21.487894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43531. [D 20:43:21.487910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43532. [D 20:43:21.487925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43533. [D 20:43:21.487940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43534. [D 20:43:21.487955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43535. [D 20:43:21.487970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43536. [D 20:43:21.487985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43537. [D 20:43:21.488000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43538. [D 20:43:21.488014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43539. [D 20:43:21.488029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43540. [D 20:43:21.488044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43541. [D 20:43:21.488059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43542. [D 20:43:21.488073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43543. [D 20:43:21.488088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43544. [D 20:43:21.488157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43545. [D 20:43:21.488174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43546. [D 20:43:21.488189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43547. [D 20:43:21.488204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43548. [D 20:43:21.488218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43549. [D 20:43:21.488237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43550. [D 20:43:21.488252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43551. [D 20:43:21.488266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43552. [D 20:43:21.488281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43553. [D 20:43:21.488296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43554. [D 20:43:21.488311] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43555. [D 20:43:21.487876] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.490955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.490970] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.494076] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43555. [D 20:43:21.494102] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 55/70. [D 20:43:21.494189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.494239] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.494254] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.496107] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6670 [D 20:43:21.496134] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 56/70. [D 20:43:21.496165] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6672 [D 20:43:21.496182] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 57/70. [D 20:43:21.499727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43555. [D 20:43:21.499746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 43556. [D 20:43:21.499760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 43557. [D 20:43:21.499775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 43558. [D 20:43:21.499789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 43559. [D 20:43:21.499804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 43560. [D 20:43:21.499818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43561. [D 20:43:21.499832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43562. [D 20:43:21.499846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43563. [D 20:43:21.499861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 43564. [D 20:43:21.499875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 43565. [D 20:43:21.499889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 43566. [D 20:43:21.499903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 43567. [D 20:43:21.499918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 43568. [D 20:43:21.499932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43569. [D 20:43:21.499946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43570. [D 20:43:21.499960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43571. [D 20:43:21.499975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43572. [D 20:43:21.499989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43573. [D 20:43:21.500003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43574. [D 20:43:21.500017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43575. [D 20:43:21.500032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43576. [D 20:43:21.500046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43577. [D 20:43:21.500060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43578. [D 20:43:21.500074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43579. [D 20:43:21.500260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43580. [D 20:43:21.500276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43581. [D 20:43:21.500291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43582. [D 20:43:21.500307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43583. [D 20:43:21.500321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43584. [D 20:43:21.500336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43585. [D 20:43:21.500350] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43586. [D 20:43:21.500369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 43587. [D 20:43:21.500384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 43588. [D 20:43:21.500398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 43589. [D 20:43:21.500413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 43590. [D 20:43:21.500427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 43591. [D 20:43:21.500442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 43592. [D 20:43:21.500456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 43593. [D 20:43:21.500470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 43594. [D 20:43:21.500484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 43595. [D 20:43:21.500499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 43596. [D 20:43:21.500516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 43597. [D 20:43:21.500532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 43598. [D 20:43:21.500546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 43599. [D 20:43:21.500560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 43600. [D 20:43:21.500575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 43601. [D 20:43:21.500589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 43602. [D 20:43:21.500604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 43603. [D 20:43:21.500621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 43604. [D 20:43:21.500638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 43605. [D 20:43:21.500652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 43606. [D 20:43:21.500667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 43607. [D 20:43:21.500681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 43608. [D 20:43:21.500696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 43609. [D 20:43:21.500712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 43610. [D 20:43:21.500730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 43611. [D 20:43:21.500746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 43612. [D 20:43:21.500760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 43613. [D 20:43:21.500775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 43614. [D 20:43:21.500789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 43615. [D 20:43:21.500804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 43616. [D 20:43:21.500818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 43617. [D 20:43:21.500837] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 43618. [D 20:43:21.505506] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.505550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.505563] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.505603] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6675 [D 20:43:21.505620] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:21.505636] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 58/70. [D 20:43:21.505668] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.505682] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.505694] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.505714] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6678 [D 20:43:21.505729] element 0: offset: 0x2aaaab037130, size: 24 [D 20:43:21.505743] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 59/70. [D 20:43:21.508778] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43618. [D 20:43:21.508802] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 60/70. [D 20:43:21.517909] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43617. [D 20:43:21.517946] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 0/70. [D 20:43:21.518002] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.518021] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.518034] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.518145] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.518160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.518173] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.524072] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6675 [D 20:43:21.524149] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 1/70. [D 20:43:21.524277] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6678 [D 20:43:21.524298] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 2/70. [D 20:43:21.528374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43617. [D 20:43:21.528401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43618. [D 20:43:21.528416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 43619. [D 20:43:21.528431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 43620. [D 20:43:21.528450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 43621. [D 20:43:21.528466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 43622. [D 20:43:21.528480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 43623. [D 20:43:21.528495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43624. [D 20:43:21.528509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43625. [D 20:43:21.528524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43626. [D 20:43:21.528538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 43627. [D 20:43:21.528553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 43628. [D 20:43:21.528568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 43629. [D 20:43:21.528582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 43630. [D 20:43:21.528597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 43631. [D 20:43:21.528611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43632. [D 20:43:21.528626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43633. [D 20:43:21.528640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43634. [D 20:43:21.528655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 43635. [D 20:43:21.528669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 43636. [D 20:43:21.528684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 43637. [D 20:43:21.528698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 43638. [D 20:43:21.528713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 43639. [D 20:43:21.528728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43640. [D 20:43:21.528742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43641. [D 20:43:21.528757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43642. [D 20:43:21.528771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 43643. [D 20:43:21.528786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 43644. [D 20:43:21.528800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 43645. [D 20:43:21.528814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 43646. [D 20:43:21.528829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 43647. [D 20:43:21.528843] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43648. [D 20:43:21.528861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 43649. [D 20:43:21.528875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 43650. [D 20:43:21.528891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 43651. [D 20:43:21.528905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 43652. [D 20:43:21.528920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 43653. [D 20:43:21.528935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 43654. [D 20:43:21.528949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 43655. [D 20:43:21.528964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43656. [D 20:43:21.528978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43657. [D 20:43:21.528993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43658. [D 20:43:21.529008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 43659. [D 20:43:21.529022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 43660. [D 20:43:21.529037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 43661. [D 20:43:21.529051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 43662. [D 20:43:21.529066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 43663. [D 20:43:21.529080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43664. [D 20:43:21.529095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43665. [D 20:43:21.529110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43666. [D 20:43:21.529124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 43667. [D 20:43:21.529139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 43668. [D 20:43:21.529154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 43669. [D 20:43:21.529168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 43670. [D 20:43:21.529183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 43671. [D 20:43:21.529197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43672. [D 20:43:21.529212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43673. [D 20:43:21.529226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43674. [D 20:43:21.529241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 43675. [D 20:43:21.529256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 43676. [D 20:43:21.529270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 43677. [D 20:43:21.529285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 43678. [D 20:43:21.529299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 43679. [D 20:43:21.529315] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43680. [D 20:43:21.531118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.531138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.531151] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.531198] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6683 [D 20:43:21.531213] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:21.531229] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 3/70. [D 20:43:21.534271] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43680. [D 20:43:21.534295] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 4/70. [D 20:43:21.537544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.537559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.537572] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.537594] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6684 [D 20:43:21.537609] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:21.537623] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 5/70. [D 20:43:21.544621] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43679. [D 20:43:21.544649] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 6/70. [D 20:43:21.544709] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.544728] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.544742] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.544850] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.544865] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.544878] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.548132] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6683 [D 20:43:21.548197] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 7/70. [D 20:43:21.550646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43679. [D 20:43:21.550670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 43680. [D 20:43:21.550686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 43681. [D 20:43:21.550700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 43682. [D 20:43:21.550716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 43683. [D 20:43:21.550742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 43684. [D 20:43:21.550757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43685. [D 20:43:21.550780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43686. [D 20:43:21.550795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43687. [D 20:43:21.550805] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6684 [D 20:43:21.550810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 43688. [D 20:43:21.551256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 43689. [D 20:43:21.551271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 43690. [D 20:43:21.551285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 43691. [D 20:43:21.551300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 43692. [D 20:43:21.551314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43693. [D 20:43:21.551329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43694. [D 20:43:21.551344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43695. [D 20:43:21.551358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43696. [D 20:43:21.551373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43697. [D 20:43:21.551387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43698. [D 20:43:21.551402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43699. [D 20:43:21.551416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43700. [D 20:43:21.551431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43701. [D 20:43:21.551445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43702. [D 20:43:21.551460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43703. [D 20:43:21.551474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43704. [D 20:43:21.551489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43705. [D 20:43:21.551503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43706. [D 20:43:21.551518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43707. [D 20:43:21.551532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43708. [D 20:43:21.551547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43709. [D 20:43:21.551561] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43710. [D 20:43:21.551591] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 8/70. [D 20:43:21.559182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.559199] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.559212] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.559255] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6687 [D 20:43:21.559269] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:21.559286] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 9/70. [D 20:43:21.562537] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43710. [D 20:43:21.562567] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 10/70. [D 20:43:21.562584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 43710. [D 20:43:21.562599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 43711. [D 20:43:21.562614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 43712. [D 20:43:21.562628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 43713. [D 20:43:21.562643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 43714. [D 20:43:21.562657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 43715. [D 20:43:21.562672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 43716. [D 20:43:21.562687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 43717. [D 20:43:21.562701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 43718. [D 20:43:21.562716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 43719. [D 20:43:21.562730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 43720. [D 20:43:21.562744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 43721. [D 20:43:21.562759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 43722. [D 20:43:21.562773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 43723. [D 20:43:21.562788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 43724. [D 20:43:21.562802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 43725. [D 20:43:21.562816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 43726. [D 20:43:21.562831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 43727. [D 20:43:21.562845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 43728. [D 20:43:21.562860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 43729. [D 20:43:21.562874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 43730. [D 20:43:21.562888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 43731. [D 20:43:21.562903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 43732. [D 20:43:21.562917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 43733. [D 20:43:21.562931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 43734. [D 20:43:21.562946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 43735. [D 20:43:21.562960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 43736. [D 20:43:21.562974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 43737. [D 20:43:21.562989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 43738. [D 20:43:21.563003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 43739. [D 20:43:21.563017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 43740. [D 20:43:21.563032] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 43741. [D 20:43:21.563087] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.563106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.563119] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.567244] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6687 [D 20:43:21.567320] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 11/70. [D 20:43:21.568993] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43741. [D 20:43:21.569020] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 12/70. [D 20:43:21.569041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43741. [D 20:43:21.569056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43742. [D 20:43:21.569071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 43743. [D 20:43:21.569085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 43744. [D 20:43:21.569099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 43745. [D 20:43:21.569114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 43746. [D 20:43:21.569128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 43747. [D 20:43:21.569143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43748. [D 20:43:21.569157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43749. [D 20:43:21.569172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43750. [D 20:43:21.569186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 43751. [D 20:43:21.569201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 43752. [D 20:43:21.569215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 43753. [D 20:43:21.569229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 43754. [D 20:43:21.569244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 43755. [D 20:43:21.569258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43756. [D 20:43:21.569273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43757. [D 20:43:21.569287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43758. [D 20:43:21.569302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 43759. [D 20:43:21.569316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 43760. [D 20:43:21.569331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 43761. [D 20:43:21.569345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 43762. [D 20:43:21.569360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 43763. [D 20:43:21.569374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43764. [D 20:43:21.569389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43765. [D 20:43:21.569403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43766. [D 20:43:21.569417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 43767. [D 20:43:21.569432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 43768. [D 20:43:21.569447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 43769. [D 20:43:21.569462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 43770. [D 20:43:21.569476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 43771. [D 20:43:21.569490] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43772. [D 20:43:21.569552] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.569572] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.569585] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.574899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.574917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.574930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.574969] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6691 [D 20:43:21.574983] element 0: offset: 0x2aaaab037130, size: 24 [D 20:43:21.575000] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 13/70. [D 20:43:21.577515] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.577532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.577545] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.577569] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6693 [D 20:43:21.577583] element 0: offset: 0x2aaaab02f7d0, size: 24 [D 20:43:21.577598] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 14/70. [D 20:43:21.580233] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43772. [D 20:43:21.580255] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 15/70. [D 20:43:21.580385] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.580405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.580418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.586250] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6691 [D 20:43:21.586316] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 16/70. [D 20:43:21.586395] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6693 [D 20:43:21.586412] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 17/70. [D 20:43:21.586649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 43772. [D 20:43:21.586675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 43773. [D 20:43:21.586689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 43774. [D 20:43:21.586704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 43775. [D 20:43:21.586726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 43776. [D 20:43:21.586741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 43777. [D 20:43:21.586763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43778. [D 20:43:21.586778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43779. [D 20:43:21.586793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43780. [D 20:43:21.586822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 43781. [D 20:43:21.586845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 43782. [D 20:43:21.586861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 43783. [D 20:43:21.586875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 43784. [D 20:43:21.586889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 43785. [D 20:43:21.586904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43786. [D 20:43:21.586918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43787. [D 20:43:21.586932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43788. [D 20:43:21.586966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 43789. [D 20:43:21.586991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 43790. [D 20:43:21.587006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 43791. [D 20:43:21.587029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 43792. [D 20:43:21.587043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 43793. [D 20:43:21.587058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43794. [D 20:43:21.587086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43795. [D 20:43:21.587110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43796. [D 20:43:21.587125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 43797. [D 20:43:21.587139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 43798. [D 20:43:21.587163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 43799. [D 20:43:21.587189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 43800. [D 20:43:21.587214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 43801. [D 20:43:21.587230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43802. [D 20:43:21.587252] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43803. [D 20:43:21.587269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43804. [D 20:43:21.587284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43805. [D 20:43:21.587311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43806. [D 20:43:21.587335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43807. [D 20:43:21.587349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43808. [D 20:43:21.587372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43809. [D 20:43:21.587386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43810. [D 20:43:21.587415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43811. [D 20:43:21.587439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43812. [D 20:43:21.587454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43813. [D 20:43:21.587478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43814. [D 20:43:21.587493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 43815. [D 20:43:21.587521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 43816. [D 20:43:21.587546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 43817. [D 20:43:21.587560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 43818. [D 20:43:21.587574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43819. [D 20:43:21.587589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43820. [D 20:43:21.587604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43821. [D 20:43:21.587618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43822. [D 20:43:21.587636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43823. [D 20:43:21.587650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43824. [D 20:43:21.587665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43825. [D 20:43:21.587680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43826. [D 20:43:21.587694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43827. [D 20:43:21.587709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43828. [D 20:43:21.587723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43829. [D 20:43:21.587738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43830. [D 20:43:21.587752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43831. [D 20:43:21.587767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43832. [D 20:43:21.587781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43833. [D 20:43:21.587796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43834. [D 20:43:21.587810] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43835. [D 20:43:21.589320] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.589343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.589356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.589398] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6696 [D 20:43:21.589413] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:21.589429] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 18/70. [D 20:43:21.598392] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43835. [D 20:43:21.598417] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 19/70. [D 20:43:21.609961] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43834. [D 20:43:21.609989] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 20/70. [D 20:43:21.610057] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.610077] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.610090] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.610170] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.610184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.610197] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.613379] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6696 [D 20:43:21.613450] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 21/70. [D 20:43:21.615861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43834. [D 20:43:21.615887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43835. [D 20:43:21.615902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 43836. [D 20:43:21.615917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 43837. [D 20:43:21.615931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 43838. [D 20:43:21.615956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 43839. [D 20:43:21.615971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 43840. [D 20:43:21.615993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43841. [D 20:43:21.616008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43842. [D 20:43:21.616035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43843. [D 20:43:21.616050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 43844. [D 20:43:21.616064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 43845. [D 20:43:21.616088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 43846. [D 20:43:21.616114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 43847. [D 20:43:21.616130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 43848. [D 20:43:21.616156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43849. [D 20:43:21.616172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43850. [D 20:43:21.616197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43851. [D 20:43:21.616212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 43852. [D 20:43:21.616235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 43853. [D 20:43:21.616250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 43854. [D 20:43:21.616278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 43855. [D 20:43:21.616302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 43856. [D 20:43:21.616316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43857. [D 20:43:21.616341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43858. [D 20:43:21.616364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43859. [D 20:43:21.616378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 43860. [D 20:43:21.616392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 43861. [D 20:43:21.616407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 43862. [D 20:43:21.616422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 43863. [D 20:43:21.616436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 43864. [D 20:43:21.616455] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43865. [D 20:43:21.624444] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.624469] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.624483] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.624526] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6701 [D 20:43:21.624541] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:21.624558] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 22/70. [D 20:43:21.624597] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.624611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.624623] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.624644] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6702 [D 20:43:21.624658] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:21.624673] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 23/70. [D 20:43:21.627582] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43865. [D 20:43:21.627605] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 24/70. [D 20:43:21.627768] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.627788] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.627801] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.632159] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6701 [D 20:43:21.632237] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 25/70. [D 20:43:21.634145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 43865. [D 20:43:21.634170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 43866. [D 20:43:21.634185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 43867. [D 20:43:21.634199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 43868. [D 20:43:21.634225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 43869. [D 20:43:21.634241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 43870. [D 20:43:21.634263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43871. [D 20:43:21.634279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43872. [D 20:43:21.634304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43873. [D 20:43:21.634319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 43874. [D 20:43:21.634346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 43875. [D 20:43:21.634372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 43876. [D 20:43:21.634387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 43877. [D 20:43:21.634412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 43878. [D 20:43:21.634438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43879. [D 20:43:21.634453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43880. [D 20:43:21.634467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43881. [D 20:43:21.634493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 43882. [D 20:43:21.634508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 43883. [D 20:43:21.634541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 43884. [D 20:43:21.634556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 43885. [D 20:43:21.634581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 43886. [D 20:43:21.634604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43887. [D 20:43:21.634619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43888. [D 20:43:21.634646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43889. [D 20:43:21.634671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 43890. [D 20:43:21.634686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 43891. [D 20:43:21.634713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 43892. [D 20:43:21.634739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 43893. [D 20:43:21.634755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 43894. [D 20:43:21.634769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43895. [D 20:43:21.634792] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43896. [D 20:43:21.635410] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6702 [D 20:43:21.635486] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 26/70. [D 20:43:21.636795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.636815] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.636829] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.636871] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6705 [D 20:43:21.636885] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:21.636902] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 27/70. [D 20:43:21.645881] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43896. [D 20:43:21.645905] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 28/70. [D 20:43:21.645930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43896. [D 20:43:21.645947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43897. [D 20:43:21.645962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43898. [D 20:43:21.645977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43899. [D 20:43:21.645991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43900. [D 20:43:21.646007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43901. [D 20:43:21.646022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43902. [D 20:43:21.646036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43903. [D 20:43:21.646050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43904. [D 20:43:21.646065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43905. [D 20:43:21.646079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43906. [D 20:43:21.646094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 43907. [D 20:43:21.646108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 43908. [D 20:43:21.646123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 43909. [D 20:43:21.646137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 43910. [D 20:43:21.646152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43911. [D 20:43:21.646166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43912. [D 20:43:21.646181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43913. [D 20:43:21.646195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43914. [D 20:43:21.646209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43915. [D 20:43:21.646224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43916. [D 20:43:21.646238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43917. [D 20:43:21.646253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43918. [D 20:43:21.646267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43919. [D 20:43:21.646282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43920. [D 20:43:21.646296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43921. [D 20:43:21.646311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43922. [D 20:43:21.646325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43923. [D 20:43:21.646340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43924. [D 20:43:21.646354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43925. [D 20:43:21.646369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43926. [D 20:43:21.646384] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43927. [D 20:43:21.646437] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.646458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.646471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.652616] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6705 [D 20:43:21.652640] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 29/70. [D 20:43:21.657532] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 43927. [D 20:43:21.657610] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 30/70. [D 20:43:21.657674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.657693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.657706] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:21.663208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43927. [D 20:43:21.663230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43928. [D 20:43:21.663245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 43929. [D 20:43:21.663260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 43930. [D 20:43:21.663275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 43931. [D 20:43:21.663289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 43932. [D 20:43:21.663317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 43933. [D 20:43:21.663331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43934. [D 20:43:21.663358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43935. [D 20:43:21.663373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43936. [D 20:43:21.663400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 43937. [D 20:43:21.663414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 43938. [D 20:43:21.663429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 43939. [D 20:43:21.663454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 43940. [D 20:43:21.663480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 43941. [D 20:43:21.663505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43942. [D 20:43:21.663520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43943. [D 20:43:21.663547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43944. [D 20:43:21.663562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 43945. [D 20:43:21.663586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 43946. [D 20:43:21.663626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 43947. [D 20:43:21.663647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 43948. [D 20:43:21.663662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 43949. [D 20:43:21.663676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43950. [D 20:43:21.663710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43951. [D 20:43:21.663724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43952. [D 20:43:21.663742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 43953. [D 20:43:21.663757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 43954. [D 20:43:21.663771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 43955. [D 20:43:21.663786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 43956. [D 20:43:21.663801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 43957. [D 20:43:21.663816] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43958. [D 20:43:21.671572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.671594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.671607] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:21.671634] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6710 [D 20:43:21.671648] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:21.671664] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 31/70. [D 20:43:21.671697] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.671713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.671726] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.671746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6711 [D 20:43:21.671760] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:21.671775] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 32/70. [D 20:43:21.674952] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43958. [D 20:43:21.674976] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 33/70. [D 20:43:21.675123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.675143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.675156] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.678419] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6710 [D 20:43:21.678501] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 34/70. [D 20:43:21.681503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 43958. [D 20:43:21.681544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 43959. [D 20:43:21.681559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 43960. [D 20:43:21.681587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 43961. [D 20:43:21.681602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 43962. [D 20:43:21.681625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 43963. [D 20:43:21.681641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43964. [D 20:43:21.932471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43965. [D 20:43:21.932496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43966. [D 20:43:21.932512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 43967. [D 20:43:21.932526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 43968. [D 20:43:21.683641] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6711 [D 20:43:21.932541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 43969. [D 20:43:21.933131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 43970. [D 20:43:21.933148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 43971. [D 20:43:21.933163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43972. [D 20:43:21.933178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43973. [D 20:43:21.933205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43974. [D 20:43:21.933220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 43975. [D 20:43:21.933234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 43976. [D 20:43:21.933249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 43977. [D 20:43:21.933264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 43978. [D 20:43:21.933278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 43979. [D 20:43:21.933293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43980. [D 20:43:21.933307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43981. [D 20:43:21.933322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43982. [D 20:43:21.933336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 43983. [D 20:43:21.933965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 43984. [D 20:43:21.933980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 43985. [D 20:43:21.933994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 43986. [D 20:43:21.934009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 43987. [D 20:43:21.934023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43988. [D 20:43:21.934037] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43989. [D 20:43:21.934111] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 35/70. [D 20:43:21.934190] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.934207] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.934221] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.934263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6714 [D 20:43:21.934280] element 0: offset: 0x2aaaab0342d0, size: 24 [D 20:43:21.934298] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 36/70. [D 20:43:21.934332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.934345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.934358] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.934378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6717 [D 20:43:21.934392] element 0: offset: 0x2aaaab037130, size: 24 [D 20:43:21.934406] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 37/70. [D 20:43:21.937221] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 43989. [D 20:43:21.937248] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 38/70. [D 20:43:21.937345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43989. [D 20:43:21.937361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43990. [D 20:43:21.937376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 43991. [D 20:43:21.937390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 43992. [D 20:43:21.937405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 43993. [D 20:43:21.937419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 43994. [D 20:43:21.937434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 43995. [D 20:43:21.937448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43996. [D 20:43:21.937515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43997. [D 20:43:21.937532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43998. [D 20:43:21.937555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 43999. [D 20:43:21.937637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 44000. [D 20:43:21.937653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 44001. [D 20:43:21.937668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 44002. [D 20:43:21.937683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 44003. [D 20:43:21.937698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44004. [D 20:43:21.937713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44005. [D 20:43:21.937728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44006. [D 20:43:21.937743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44007. [D 20:43:21.937758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44008. [D 20:43:21.937760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.937821] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.937835] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.937832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44009. [D 20:43:21.937878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44010. [D 20:43:21.938381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44011. [D 20:43:21.938399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44012. [D 20:43:21.938413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44013. [D 20:43:21.938428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44014. [D 20:43:21.938442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44015. [D 20:43:21.938457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44016. [D 20:43:21.938471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44017. [D 20:43:21.938485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44018. [D 20:43:21.938500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44019. [D 20:43:21.938514] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44020. [D 20:43:21.943278] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44020. [D 20:43:21.943299] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 39/70. [D 20:43:21.944815] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6714 [D 20:43:21.944890] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 40/70. [D 20:43:21.944923] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.944945] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.944954] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6717 [D 20:43:21.944959] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.945884] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 41/70. [D 20:43:21.948935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44020. [D 20:43:21.948961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44021. [D 20:43:21.948975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44022. [D 20:43:21.948990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44023. [D 20:43:21.949004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44024. [D 20:43:21.949083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44025. [D 20:43:21.949097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44026. [D 20:43:21.949112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44027. [D 20:43:21.949126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44028. [D 20:43:21.949141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44029. [D 20:43:21.949155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44030. [D 20:43:21.949170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44031. [D 20:43:21.949184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44032. [D 20:43:21.949199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44033. [D 20:43:21.949213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44034. [D 20:43:21.949236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44035. [D 20:43:21.949355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44036. [D 20:43:21.949377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44037. [D 20:43:21.949783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44038. [D 20:43:21.949800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44039. [D 20:43:21.949814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44040. [D 20:43:21.949829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44041. [D 20:43:21.949843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44042. [D 20:43:21.949857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44043. [D 20:43:21.949871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44044. [D 20:43:21.949885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44045. [D 20:43:21.949899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44046. [D 20:43:21.949913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44047. [D 20:43:21.949927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44048. [D 20:43:21.949941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44049. [D 20:43:21.949956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44050. [D 20:43:21.949970] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44051. [D 20:43:21.949987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44052. [D 20:43:21.950001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44053. [D 20:43:21.950015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44054. [D 20:43:21.950029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44055. [D 20:43:21.950044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44056. [D 20:43:21.950058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44057. [D 20:43:21.950072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44058. [D 20:43:21.950153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44059. [D 20:43:21.950188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44060. [D 20:43:21.950586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44061. [D 20:43:21.950603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44062. [D 20:43:21.950618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44063. [D 20:43:21.950632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44064. [D 20:43:21.950647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44065. [D 20:43:21.950661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44066. [D 20:43:21.950676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44067. [D 20:43:21.950691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44068. [D 20:43:21.950705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44069. [D 20:43:21.950720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44070. [D 20:43:21.950734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44071. [D 20:43:21.950749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44072. [D 20:43:21.950763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44073. [D 20:43:21.950778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44074. [D 20:43:21.950793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44075. [D 20:43:21.950807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44076. [D 20:43:21.950822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44077. [D 20:43:21.950836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44078. [D 20:43:21.950850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44079. [D 20:43:21.950865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44080. [D 20:43:21.950880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44081. [D 20:43:21.950954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44082. [D 20:43:21.951012] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44083. [D 20:43:21.954831] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44083. [D 20:43:21.954854] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 42/70. [D 20:43:21.958311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.958332] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.958346] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.958388] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6722 [D 20:43:21.958403] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:21.958420] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 43/70. [D 20:43:21.958452] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.958466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.958479] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.958499] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6723 [D 20:43:21.958514] element 0: offset: 0x2aaaab035750, size: 24 [D 20:43:21.958528] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 44/70. [D 20:43:21.962278] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44082. [D 20:43:21.962299] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 45/70. [D 20:43:21.964195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.964219] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.964232] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.964351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.964366] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.964378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.968145] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6722 [D 20:43:21.968169] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 46/70. [D 20:43:21.968732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44082. [D 20:43:21.968749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 44083. [D 20:43:21.968764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 44084. [D 20:43:21.968779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 44085. [D 20:43:21.968794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 44086. [D 20:43:21.968808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 44087. [D 20:43:21.968823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44088. [D 20:43:21.968837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44089. [D 20:43:21.968852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44090. [D 20:43:21.968866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 44091. [D 20:43:21.968881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 44092. [D 20:43:21.968896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 44093. [D 20:43:21.968910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 44094. [D 20:43:21.968925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 44095. [D 20:43:21.968939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44096. [D 20:43:21.968954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44097. [D 20:43:21.968968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44098. [D 20:43:21.968982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 44099. [D 20:43:21.968998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 44100. [D 20:43:21.969012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 44101. [D 20:43:21.969027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 44102. [D 20:43:21.969041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 44103. [D 20:43:21.969056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44104. [D 20:43:21.969070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44105. [D 20:43:21.969087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44106. [D 20:43:21.969101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 44107. [D 20:43:21.969116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 44108. [D 20:43:21.969130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 44109. [D 20:43:21.969145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 44110. [D 20:43:21.969159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 44111. [D 20:43:21.969173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44112. [D 20:43:21.969188] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44113. [D 20:43:21.972108] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6723 [D 20:43:21.972128] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 47/70. [D 20:43:21.976840] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.976899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.976914] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.976960] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6727 [D 20:43:21.976976] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:21.976995] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 48/70. [D 20:43:21.977040] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.977054] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.977066] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.977087] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6729 [D 20:43:21.977101] element 0: offset: 0x2aaaab0342d0, size: 24 [D 20:43:21.977115] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 49/70. [D 20:43:21.980455] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44113. [D 20:43:21.980479] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 50/70. [D 20:43:21.980495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44113. [D 20:43:21.980510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44114. [D 20:43:21.980524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 44115. [D 20:43:21.980539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 44116. [D 20:43:21.980553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 44117. [D 20:43:21.980568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 44118. [D 20:43:21.980582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 44119. [D 20:43:21.980597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44120. [D 20:43:21.980611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44121. [D 20:43:21.980626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44122. [D 20:43:21.980640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 44123. [D 20:43:21.980655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 44124. [D 20:43:21.980670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 44125. [D 20:43:21.980685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 44126. [D 20:43:21.980700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 44127. [D 20:43:21.980714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44128. [D 20:43:21.980728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44129. [D 20:43:21.980743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44130. [D 20:43:21.980758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44131. [D 20:43:21.980772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44132. [D 20:43:21.980786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44133. [D 20:43:21.980801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44134. [D 20:43:21.980815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44135. [D 20:43:21.980830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44136. [D 20:43:21.980845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44137. [D 20:43:21.980859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44138. [D 20:43:21.980873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44139. [D 20:43:21.980888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44140. [D 20:43:21.980902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44141. [D 20:43:21.980916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44142. [D 20:43:21.980931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44143. [D 20:43:21.980945] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44144. [D 20:43:21.981008] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.981028] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.981041] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:21.986419] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44144. [D 20:43:21.986439] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 51/70. [D 20:43:21.988194] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6727 [D 20:43:21.988274] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 52/70. [D 20:43:21.988287] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:21.988302] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6729 [D 20:43:21.988307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.988340] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:21.988376] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 53/70. [D 20:43:21.991879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44144. [D 20:43:21.991900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44145. [D 20:43:21.991915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44146. [D 20:43:21.991929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44147. [D 20:43:21.991944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44148. [D 20:43:21.991959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44149. [D 20:43:21.991973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44150. [D 20:43:21.991987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44151. [D 20:43:21.992002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44152. [D 20:43:21.992016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44153. [D 20:43:21.992030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44154. [D 20:43:21.992045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44155. [D 20:43:21.992059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44156. [D 20:43:21.992074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44157. [D 20:43:21.992088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44158. [D 20:43:21.992106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44159. [D 20:43:21.992121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44160. [D 20:43:21.992135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44161. [D 20:43:21.992150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44162. [D 20:43:21.992164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44163. [D 20:43:21.992178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44164. [D 20:43:21.992193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44165. [D 20:43:21.992207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44166. [D 20:43:21.992233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44167. [D 20:43:21.992248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44168. [D 20:43:21.992263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44169. [D 20:43:21.992277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44170. [D 20:43:21.992292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44171. [D 20:43:21.992307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44172. [D 20:43:21.992321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44173. [D 20:43:21.992336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44174. [D 20:43:21.992351] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44175. [D 20:43:21.992367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44176. [D 20:43:21.992382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44177. [D 20:43:21.992396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44178. [D 20:43:21.992411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44179. [D 20:43:21.992425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44180. [D 20:43:21.992440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44181. [D 20:43:21.992454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44182. [D 20:43:21.992469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44183. [D 20:43:21.992483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44184. [D 20:43:21.992497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44185. [D 20:43:21.992512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44186. [D 20:43:21.992526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44187. [D 20:43:21.992541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44188. [D 20:43:21.992555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44189. [D 20:43:21.992569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44190. [D 20:43:21.992584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44191. [D 20:43:21.992598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44192. [D 20:43:21.992613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44193. [D 20:43:21.992627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44194. [D 20:43:21.992642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44195. [D 20:43:21.992656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44196. [D 20:43:21.992671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44197. [D 20:43:21.992685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44198. [D 20:43:21.992699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44199. [D 20:43:21.992714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44200. [D 20:43:21.992728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44201. [D 20:43:21.992743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44202. [D 20:43:21.992757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44203. [D 20:43:21.992772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44204. [D 20:43:21.992787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44205. [D 20:43:21.992801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44206. [D 20:43:21.992815] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44207. [D 20:43:21.996168] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.996193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.996207] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:21.996256] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6734 [D 20:43:21.996271] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:21.996288] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 54/70. [D 20:43:21.996333] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:21.996347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:21.996359] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:21.996380] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6735 [D 20:43:21.996394] element 0: offset: 0x2aaaab037130, size: 24 [D 20:43:21.996411] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 55/70. [D 20:43:22.003660] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44207. [D 20:43:22.003683] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 56/70. [D 20:43:22.015274] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44206. [D 20:43:22.015290] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 57/70. [D 20:43:22.015359] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.015381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.015394] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:22.015507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.015522] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.015535] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.020157] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6734 [D 20:43:22.020181] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 58/70. [D 20:43:22.023438] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6735 [D 20:43:22.023466] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 59/70. [D 20:43:22.026851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44206. [D 20:43:22.026869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 44207. [D 20:43:22.026884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 44208. [D 20:43:22.026898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 44209. [D 20:43:22.026913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 44210. [D 20:43:22.026927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 44211. [D 20:43:22.026942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44212. [D 20:43:22.026956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44213. [D 20:43:22.026970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44214. [D 20:43:22.026985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 44215. [D 20:43:22.027000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 44216. [D 20:43:22.027015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 44217. [D 20:43:22.027030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 44218. [D 20:43:22.027044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 44219. [D 20:43:22.027059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44220. [D 20:43:22.027073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44221. [D 20:43:22.027087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44222. [D 20:43:22.027102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 44223. [D 20:43:22.027116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 44224. [D 20:43:22.027131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 44225. [D 20:43:22.027145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 44226. [D 20:43:22.027160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 44227. [D 20:43:22.027174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44228. [D 20:43:22.027189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44229. [D 20:43:22.027203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44230. [D 20:43:22.027218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 44231. [D 20:43:22.027232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 44232. [D 20:43:22.027247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 44233. [D 20:43:22.027261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 44234. [D 20:43:22.027275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 44235. [D 20:43:22.027290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44236. [D 20:43:22.027304] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44237. [D 20:43:22.027320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44238. [D 20:43:22.027335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44239. [D 20:43:22.027349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 44240. [D 20:43:22.027364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 44241. [D 20:43:22.027395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 44242. [D 20:43:22.027411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 44243. [D 20:43:22.027425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 44244. [D 20:43:22.027441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44245. [D 20:43:22.027455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44246. [D 20:43:22.027473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44247. [D 20:43:22.027488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 44248. [D 20:43:22.027503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 44249. [D 20:43:22.027517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 44250. [D 20:43:22.027532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 44251. [D 20:43:22.027546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 44252. [D 20:43:22.027561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44253. [D 20:43:22.027575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44254. [D 20:43:22.027589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44255. [D 20:43:22.027604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44256. [D 20:43:22.027618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44257. [D 20:43:22.027633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44258. [D 20:43:22.027647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44259. [D 20:43:22.027665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44260. [D 20:43:22.027679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44261. [D 20:43:22.027694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44262. [D 20:43:22.027709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44263. [D 20:43:22.027723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44264. [D 20:43:22.027737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44265. [D 20:43:22.027752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44266. [D 20:43:22.027766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44267. [D 20:43:22.027781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44268. [D 20:43:22.027796] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44269. [D 20:43:22.029645] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.029704] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.029718] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.029764] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6739 [D 20:43:22.029780] element 0: offset: 0x2aaaab038ba0, size: 24 [D 20:43:22.029802] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 60/70. [D 20:43:22.029849] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.029865] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.029878] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:22.029899] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6741 [D 20:43:22.029913] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:22.029928] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 0/70. [D 20:43:22.038583] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44269. [D 20:43:22.038609] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 1/70. [D 20:43:22.050259] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44268. [D 20:43:22.050278] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 2/70. [D 20:43:22.050343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.050364] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.050376] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:22.050489] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.050505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.050517] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.056150] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6739 [D 20:43:22.056174] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 3/70. [D 20:43:22.059186] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6741 [D 20:43:22.059205] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 4/70. [D 20:43:22.061446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44268. [D 20:43:22.061467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44269. [D 20:43:22.061482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44270. [D 20:43:22.061496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44271. [D 20:43:22.061511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44272. [D 20:43:22.061525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44273. [D 20:43:22.061540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44274. [D 20:43:22.061554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44275. [D 20:43:22.061568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44276. [D 20:43:22.061583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44277. [D 20:43:22.061597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44278. [D 20:43:22.061612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44279. [D 20:43:22.061626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44280. [D 20:43:22.061641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44281. [D 20:43:22.061655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44282. [D 20:43:22.061670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44283. [D 20:43:22.061684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44284. [D 20:43:22.061699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44285. [D 20:43:22.061713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44286. [D 20:43:22.061729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44287. [D 20:43:22.061743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44288. [D 20:43:22.061758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44289. [D 20:43:22.061773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44290. [D 20:43:22.061787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44291. [D 20:43:22.061802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44292. [D 20:43:22.061816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44293. [D 20:43:22.061830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44294. [D 20:43:22.061845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44295. [D 20:43:22.061859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44296. [D 20:43:22.061874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44297. [D 20:43:22.061888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44298. [D 20:43:22.061903] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44299. [D 20:43:22.061919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44300. [D 20:43:22.061933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44301. [D 20:43:22.061948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44302. [D 20:43:22.061976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44303. [D 20:43:22.061991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44304. [D 20:43:22.062005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44305. [D 20:43:22.062020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44306. [D 20:43:22.062035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44307. [D 20:43:22.062049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44308. [D 20:43:22.062064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44309. [D 20:43:22.062126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44310. [D 20:43:22.062142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44311. [D 20:43:22.062156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44312. [D 20:43:22.062171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44313. [D 20:43:22.062185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44314. [D 20:43:22.062200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44315. [D 20:43:22.062215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44316. [D 20:43:22.062230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44317. [D 20:43:22.062244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44318. [D 20:43:22.062258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44319. [D 20:43:22.062273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44320. [D 20:43:22.062287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44321. [D 20:43:22.062302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44322. [D 20:43:22.062316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44323. [D 20:43:22.062330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44324. [D 20:43:22.062345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44325. [D 20:43:22.062359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44326. [D 20:43:22.062374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44327. [D 20:43:22.062388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44328. [D 20:43:22.062402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44329. [D 20:43:22.062417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44330. [D 20:43:22.062431] openib_post_sr_rdmaw: ibv_post_send wr_id 65ab70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44331. [D 20:43:22.064302] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.064360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.064374] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.064417] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6746 [D 20:43:22.064432] element 0: offset: 0x2aaaab025ef0, size: 24 [D 20:43:22.064452] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 5/70. [D 20:43:22.064497] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.064511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.064523] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:22.064543] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6747 [D 20:43:22.064557] element 0: offset: 0x2aaaab0342d0, size: 24 [D 20:43:22.064572] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 6/70. [D 20:43:22.073161] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44331. [D 20:43:22.073186] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 7/70. [D 20:43:22.084760] openib_check_cq: completed rdma wr_id 65ab70, nic_wr_credit 44330. [D 20:43:22.084781] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 8/70. [D 20:43:22.084842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.084862] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.084874] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:22.084985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.085000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.085012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.088131] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6746 [D 20:43:22.104915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.366288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.366290] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 9/70. [D 20:43:22.366315] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.366405] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6747 [D 20:43:22.366428] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6750 [D 20:43:22.366441] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 10/70. [D 20:43:22.366452] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.366497] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 11/70. [D 20:43:22.366540] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.366545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44330. [D 20:43:22.366559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.366588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 44331. [D 20:43:22.366595] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:22.366615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 44332. [D 20:43:22.366633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6753 [D 20:43:22.366637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 44333. [D 20:43:22.366656] element 0: offset: 0x658610, size: 24 [D 20:43:22.366686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 44334. [D 20:43:22.366755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 44335. [D 20:43:22.366770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44336. [D 20:43:22.366785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44337. [D 20:43:22.366799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44338. [D 20:43:22.366818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 44339. [D 20:43:22.366832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 44340. [D 20:43:22.366847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 44341. [D 20:43:22.366861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 44342. [D 20:43:22.366876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 44343. [D 20:43:22.366901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44344. [D 20:43:22.366916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44345. [D 20:43:22.366931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44346. [D 20:43:22.366945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 44347. [D 20:43:22.366960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 44348. [D 20:43:22.366975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 44349. [D 20:43:22.366989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 44350. [D 20:43:22.367005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 44351. [D 20:43:22.367020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44352. [D 20:43:22.367034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44353. [D 20:43:22.367048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44354. [D 20:43:22.367062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 44355. [D 20:43:22.367076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 44356. [D 20:43:22.367090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 44357. [D 20:43:22.367104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 44358. [D 20:43:22.367118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 44359. [D 20:43:22.367132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44360. [D 20:43:22.367147] openib_post_sr_rdmaw: ibv_post_send wr_id 630120 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44361. [D 20:43:22.367164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44362. [D 20:43:22.367179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44363. [D 20:43:22.367193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 44364. [D 20:43:22.367207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 44365. [D 20:43:22.367221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 44366. [D 20:43:22.367235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 44367. [D 20:43:22.367250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 44368. [D 20:43:22.367264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44369. [D 20:43:22.367278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44370. [D 20:43:22.367292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44371. [D 20:43:22.367306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 44372. [D 20:43:22.367321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 44373. [D 20:43:22.367335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 44374. [D 20:43:22.367349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 44375. [D 20:43:22.367363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 44376. [D 20:43:22.367377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44377. [D 20:43:22.367391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44378. [D 20:43:22.367405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44379. [D 20:43:22.372270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44380. [D 20:43:22.372293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44381. [D 20:43:22.372307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44382. [D 20:43:22.372323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44383. [D 20:43:22.372337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44384. [D 20:43:22.372351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44385. [D 20:43:22.372365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44386. [D 20:43:22.372379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44387. [D 20:43:22.372393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44388. [D 20:43:22.372409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44389. [D 20:43:22.372424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44390. [D 20:43:22.372437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44391. [D 20:43:22.372455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44392. [D 20:43:22.372469] openib_post_sr_rdmaw: ibv_post_send wr_id 65a7b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44393. [D 20:43:22.372491] openib_check_cq: completed rdma wr_id 630120, nic_wr_credit 44393. [D 20:43:22.372587] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 12/70. [D 20:43:22.372610] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 13/70. [D 20:43:22.378318] openib_check_cq: completed rdma wr_id 65a7b0, nic_wr_credit 44392. [D 20:43:22.378387] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 14/70. [D 20:43:22.380141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.380158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.380171] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:22.380258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.380273] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.380285] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.384191] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6750 [D 20:43:22.384221] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 15/70. [D 20:43:22.388970] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6753 [D 20:43:22.388992] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 16/70. [D 20:43:22.391671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44392. [D 20:43:22.391692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44393. [D 20:43:22.391706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44394. [D 20:43:22.391721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44395. [D 20:43:22.391736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44396. [D 20:43:22.391751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44397. [D 20:43:22.391766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44398. [D 20:43:22.391780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44399. [D 20:43:22.391795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44400. [D 20:43:22.391810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44401. [D 20:43:22.391824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44402. [D 20:43:22.391839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44403. [D 20:43:22.391853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44404. [D 20:43:22.391868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44405. [D 20:43:22.391882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44406. [D 20:43:22.391897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44407. [D 20:43:22.391912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44408. [D 20:43:22.391926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44409. [D 20:43:22.391941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44410. [D 20:43:22.391955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44411. [D 20:43:22.391970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44412. [D 20:43:22.391985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44413. [D 20:43:22.391999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44414. [D 20:43:22.392014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44415. [D 20:43:22.392028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44416. [D 20:43:22.392043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44417. [D 20:43:22.392058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44418. [D 20:43:22.392072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44419. [D 20:43:22.392087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44420. [D 20:43:22.392106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44421. [D 20:43:22.392121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44422. [D 20:43:22.392135] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44423. [D 20:43:22.392152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44424. [D 20:43:22.392167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44425. [D 20:43:22.392181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44426. [D 20:43:22.392197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44427. [D 20:43:22.392211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44428. [D 20:43:22.392226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44429. [D 20:43:22.392241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44430. [D 20:43:22.392255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44431. [D 20:43:22.392270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44432. [D 20:43:22.392284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44433. [D 20:43:22.392299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44434. [D 20:43:22.392314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44435. [D 20:43:22.392328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44436. [D 20:43:22.392343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44437. [D 20:43:22.392358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44438. [D 20:43:22.392372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44439. [D 20:43:22.392387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44440. [D 20:43:22.392402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44441. [D 20:43:22.392416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44442. [D 20:43:22.392431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44443. [D 20:43:22.392446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44444. [D 20:43:22.392460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44445. [D 20:43:22.392475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44446. [D 20:43:22.392490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44447. [D 20:43:22.392504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44448. [D 20:43:22.392519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44449. [D 20:43:22.392533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44450. [D 20:43:22.392548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44451. [D 20:43:22.392563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44452. [D 20:43:22.392578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44453. [D 20:43:22.392592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44454. [D 20:43:22.392607] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44455. [D 20:43:22.397571] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44455. [D 20:43:22.397590] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 17/70. [D 20:43:22.403420] openib_check_cq: completed rdma wr_id 2aaaab60c9a0, nic_wr_credit 44454. [D 20:43:22.403436] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 18/70. [D 20:43:22.403517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.403576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.403589] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.403616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.403629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.403642] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:22.422039] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.422055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.422068] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:22.422107] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6757 [D 20:43:22.422122] element 0: offset: 0x62fd10, size: 24 [D 20:43:22.422161] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 19/70. [D 20:43:22.422203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.422217] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.422230] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.422252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6759 [D 20:43:22.422266] element 0: offset: 0x658610, size: 24 [D 20:43:22.422282] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 20/70. [D 20:43:22.428203] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6757 [D 20:43:22.428231] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 21/70. [D 20:43:22.428252] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6759 [D 20:43:22.428272] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 22/70. [D 20:43:22.428301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44454. [D 20:43:22.428317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44455. [D 20:43:22.428332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44456. [D 20:43:22.428346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44457. [D 20:43:22.428361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44458. [D 20:43:22.428375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44459. [D 20:43:22.428390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44460. [D 20:43:22.428404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44461. [D 20:43:22.428419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44462. [D 20:43:22.428433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44463. [D 20:43:22.428447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44464. [D 20:43:22.428462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44465. [D 20:43:22.428476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44466. [D 20:43:22.428491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44467. [D 20:43:22.428506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44468. [D 20:43:22.428521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44469. [D 20:43:22.428535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44470. [D 20:43:22.428549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44471. [D 20:43:22.428564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44472. [D 20:43:22.428579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 44473. [D 20:43:22.428593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 44474. [D 20:43:22.428608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 44475. [D 20:43:22.428622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 44476. [D 20:43:22.428637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44477. [D 20:43:22.428651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44478. [D 20:43:22.428666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44479. [D 20:43:22.428681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 44480. [D 20:43:22.428695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 44481. [D 20:43:22.428709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 44482. [D 20:43:22.428724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 44483. [D 20:43:22.428738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 44484. [D 20:43:22.428753] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44485. [D 20:43:22.428769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44486. [D 20:43:22.428784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44487. [D 20:43:22.428798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44488. [D 20:43:22.428813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44489. [D 20:43:22.428827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44490. [D 20:43:22.428841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44491. [D 20:43:22.428856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44492. [D 20:43:22.428870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44493. [D 20:43:22.428885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44494. [D 20:43:22.428899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44495. [D 20:43:22.428914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44496. [D 20:43:22.428929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44497. [D 20:43:22.428943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44498. [D 20:43:22.428958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44499. [D 20:43:22.428972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44500. [D 20:43:22.428986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44501. [D 20:43:22.429001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44502. [D 20:43:22.429015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44503. [D 20:43:22.429029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44504. [D 20:43:22.429044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44505. [D 20:43:22.429058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44506. [D 20:43:22.429073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44507. [D 20:43:22.429087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44508. [D 20:43:22.429102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44509. [D 20:43:22.429116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44510. [D 20:43:22.429130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44511. [D 20:43:22.429145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44512. [D 20:43:22.429159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44513. [D 20:43:22.429174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44514. [D 20:43:22.429188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44515. [D 20:43:22.429202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44516. [D 20:43:22.429217] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44517. [D 20:43:22.438538] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44517. [D 20:43:22.438560] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 23/70. [D 20:43:22.450210] openib_check_cq: completed rdma wr_id 2aaaab60c9a0, nic_wr_credit 44516. [D 20:43:22.450229] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 24/70. [D 20:43:22.450309] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.450373] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.450387] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.450418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.450432] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.450444] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:22.466872] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.466888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.466901] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:22.466942] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6763 [D 20:43:22.466957] element 0: offset: 0x658610, size: 24 [D 20:43:22.466976] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 25/70. [D 20:43:22.467017] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.467031] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.467046] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.467070] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6765 [D 20:43:22.467084] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.467098] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 26/70. [D 20:43:22.472153] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6763 [D 20:43:22.472178] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 27/70. [D 20:43:22.472235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44516. [D 20:43:22.472252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44517. [D 20:43:22.472267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44518. [D 20:43:22.472281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44519. [D 20:43:22.472296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44520. [D 20:43:22.472310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44521. [D 20:43:22.472325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44522. [D 20:43:22.472340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44523. [D 20:43:22.472354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44524. [D 20:43:22.472369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44525. [D 20:43:22.472384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44526. [D 20:43:22.472398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44527. [D 20:43:22.472413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44528. [D 20:43:22.472427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44529. [D 20:43:22.472442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44530. [D 20:43:22.472457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44531. [D 20:43:22.472471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44532. [D 20:43:22.472486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44533. [D 20:43:22.472500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44534. [D 20:43:22.472515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44535. [D 20:43:22.472529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44536. [D 20:43:22.472544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44537. [D 20:43:22.472559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44538. [D 20:43:22.472575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44539. [D 20:43:22.472589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44540. [D 20:43:22.472604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44541. [D 20:43:22.472619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44542. [D 20:43:22.472633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44543. [D 20:43:22.472648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44544. [D 20:43:22.472662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44545. [D 20:43:22.472677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44546. [D 20:43:22.472691] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44547. [D 20:43:22.475820] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6765 [D 20:43:22.475837] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 28/70. [D 20:43:22.482225] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44547. [D 20:43:22.482276] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 29/70. [D 20:43:22.482296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44547. [D 20:43:22.482313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44548. [D 20:43:22.482328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44549. [D 20:43:22.482342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44550. [D 20:43:22.482357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44551. [D 20:43:22.482372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44552. [D 20:43:22.482386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44553. [D 20:43:22.482401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44554. [D 20:43:22.482416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44555. [D 20:43:22.482430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44556. [D 20:43:22.482445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44557. [D 20:43:22.482460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44558. [D 20:43:22.482475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44559. [D 20:43:22.482489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44560. [D 20:43:22.482504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44561. [D 20:43:22.482518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44562. [D 20:43:22.482533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44563. [D 20:43:22.482549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44564. [D 20:43:22.482564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44565. [D 20:43:22.482578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 44566. [D 20:43:22.482593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 44567. [D 20:43:22.482607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 44568. [D 20:43:22.482621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 44569. [D 20:43:22.482635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44570. [D 20:43:22.482649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44571. [D 20:43:22.482663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44572. [D 20:43:22.482677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 44573. [D 20:43:22.482691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 44574. [D 20:43:22.482705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 44575. [D 20:43:22.482719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 44576. [D 20:43:22.482734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 44577. [D 20:43:22.482748] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44578. [D 20:43:22.482839] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.482886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.482900] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.493972] openib_check_cq: completed rdma wr_id 2aaaab60c9a0, nic_wr_credit 44578. [D 20:43:22.494004] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 30/70. [D 20:43:22.494125] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.494148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.494161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:22.508970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.508987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.508999] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:22.509037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6769 [D 20:43:22.509052] element 0: offset: 0x691fe0, size: 24 [D 20:43:22.509071] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 31/70. [D 20:43:22.509119] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.509133] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.509146] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.509166] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6771 [D 20:43:22.509179] element 0: offset: 0x658610, size: 24 [D 20:43:22.509194] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 32/70. [D 20:43:22.512250] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6769 [D 20:43:22.512281] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 33/70. [D 20:43:22.512340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44578. [D 20:43:22.512360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44579. [D 20:43:22.512375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44580. [D 20:43:22.512390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44581. [D 20:43:22.512404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44582. [D 20:43:22.512419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44583. [D 20:43:22.512433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44584. [D 20:43:22.512447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44585. [D 20:43:22.512462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44586. [D 20:43:22.512476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44587. [D 20:43:22.512491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44588. [D 20:43:22.512506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44589. [D 20:43:22.512520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44590. [D 20:43:22.512534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44591. [D 20:43:22.512549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44592. [D 20:43:22.512563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44593. [D 20:43:22.512578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44594. [D 20:43:22.512592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44595. [D 20:43:22.512607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44596. [D 20:43:22.512621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 44597. [D 20:43:22.512635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 44598. [D 20:43:22.512650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 44599. [D 20:43:22.512664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 44600. [D 20:43:22.512678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44601. [D 20:43:22.512693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44602. [D 20:43:22.512707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44603. [D 20:43:22.512722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 44604. [D 20:43:22.512737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 44605. [D 20:43:22.512751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 44606. [D 20:43:22.512766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 44607. [D 20:43:22.512781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 44608. [D 20:43:22.512796] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44609. [D 20:43:22.515265] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6771 [D 20:43:22.515945] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 34/70. [D 20:43:22.519408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.519477] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.519490] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.519535] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6775 [D 20:43:22.519550] element 0: offset: 0x61fa30, size: 24 [D 20:43:22.519572] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 35/70. [D 20:43:22.519641] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44609. [D 20:43:22.519665] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 36/70. [D 20:43:22.519705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44609. [D 20:43:22.519721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44610. [D 20:43:22.519737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44611. [D 20:43:22.519752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44612. [D 20:43:22.519767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44613. [D 20:43:22.519782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44614. [D 20:43:22.519796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44615. [D 20:43:22.519811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44616. [D 20:43:22.519826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44617. [D 20:43:22.519840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44618. [D 20:43:22.519855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44619. [D 20:43:22.519869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44620. [D 20:43:22.519884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44621. [D 20:43:22.519898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44622. [D 20:43:22.519913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44623. [D 20:43:22.519927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44624. [D 20:43:22.519942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44625. [D 20:43:22.519957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44626. [D 20:43:22.519972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44627. [D 20:43:22.519986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44628. [D 20:43:22.520001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44629. [D 20:43:22.520017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44630. [D 20:43:22.520031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44631. [D 20:43:22.520046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44632. [D 20:43:22.520060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44633. [D 20:43:22.520075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44634. [D 20:43:22.520089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44635. [D 20:43:22.520108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44636. [D 20:43:22.520123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44637. [D 20:43:22.520138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44638. [D 20:43:22.520153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44639. [D 20:43:22.520167] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44640. [D 20:43:22.520226] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.520251] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.520264] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.523459] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6775 [D 20:43:22.523485] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 37/70. [D 20:43:22.531490] openib_check_cq: completed rdma wr_id 2aaaab60c9a0, nic_wr_credit 44640. [D 20:43:22.531512] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 38/70. [D 20:43:22.531529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44640. [D 20:43:22.531543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 44641. [D 20:43:22.531558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 44642. [D 20:43:22.531572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 44643. [D 20:43:22.531587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 44644. [D 20:43:22.531602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 44645. [D 20:43:22.531616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44646. [D 20:43:22.531641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44647. [D 20:43:22.531656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44648. [D 20:43:22.531671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 44649. [D 20:43:22.531688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 44650. [D 20:43:22.531703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 44651. [D 20:43:22.531717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 44652. [D 20:43:22.531731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 44653. [D 20:43:22.531747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44654. [D 20:43:22.531761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44655. [D 20:43:22.531776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44656. [D 20:43:22.531790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44657. [D 20:43:22.531805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44658. [D 20:43:22.531819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44659. [D 20:43:22.531834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44660. [D 20:43:22.531848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44661. [D 20:43:22.531862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44662. [D 20:43:22.531876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44663. [D 20:43:22.531891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44664. [D 20:43:22.531905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44665. [D 20:43:22.531920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44666. [D 20:43:22.531934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44667. [D 20:43:22.531949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44668. [D 20:43:22.531963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44669. [D 20:43:22.531978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44670. [D 20:43:22.531992] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44671. [D 20:43:22.532064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.532131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.532145] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.533894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.533910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.533922] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.533961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6777 [D 20:43:22.533976] element 0: offset: 0x62fd10, size: 24 [D 20:43:22.533997] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 39/70. [D 20:43:22.541641] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44671. [D 20:43:22.541667] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 40/70. [D 20:43:22.541777] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.541796] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.541808] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.544766] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6777 [D 20:43:22.544786] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 41/70. [D 20:43:22.546084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44671. [D 20:43:22.546107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44672. [D 20:43:22.546122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44673. [D 20:43:22.546137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44674. [D 20:43:22.546151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44675. [D 20:43:22.546166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44676. [D 20:43:22.546180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44677. [D 20:43:22.546195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44678. [D 20:43:22.546209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44679. [D 20:43:22.546224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44680. [D 20:43:22.546238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44681. [D 20:43:22.546253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44682. [D 20:43:22.546267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44683. [D 20:43:22.546282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44684. [D 20:43:22.546296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44685. [D 20:43:22.546311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44686. [D 20:43:22.546325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44687. [D 20:43:22.546340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44688. [D 20:43:22.546355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44689. [D 20:43:22.546369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44690. [D 20:43:22.546384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44691. [D 20:43:22.546398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44692. [D 20:43:22.546413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44693. [D 20:43:22.546427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44694. [D 20:43:22.546442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44695. [D 20:43:22.546456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44696. [D 20:43:22.546470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44697. [D 20:43:22.546485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44698. [D 20:43:22.546500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44699. [D 20:43:22.546514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44700. [D 20:43:22.546529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44701. [D 20:43:22.546544] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db80 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44702. [D 20:43:22.554659] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.554710] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.554723] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.554765] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6781 [D 20:43:22.554780] element 0: offset: 0x658610, size: 24 [D 20:43:22.554801] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 42/70. [D 20:43:22.554845] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.554859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.554871] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.554893] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6783 [D 20:43:22.554907] element 0: offset: 0x61fa30, size: 24 [D 20:43:22.554921] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 43/70. [D 20:43:22.557863] openib_check_cq: completed rdma wr_id 2aaaab60db80, nic_wr_credit 44702. [D 20:43:22.557888] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 44/70. [D 20:43:22.558026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.558045] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.558058] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.563897] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6781 [D 20:43:22.563922] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 45/70. [D 20:43:22.563944] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6783 [D 20:43:22.563964] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 46/70. [D 20:43:22.568825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44702. [D 20:43:22.568855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44703. [D 20:43:22.568870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44704. [D 20:43:22.568884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44705. [D 20:43:22.568899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44706. [D 20:43:22.568914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44707. [D 20:43:22.568928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44708. [D 20:43:22.568942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44709. [D 20:43:22.568957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44710. [D 20:43:22.568971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44711. [D 20:43:22.568986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44712. [D 20:43:22.569000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44713. [D 20:43:22.569014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44714. [D 20:43:22.569029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44715. [D 20:43:22.569043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44716. [D 20:43:22.569058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44717. [D 20:43:22.843737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44718. [D 20:43:22.843761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44719. [D 20:43:22.843777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44720. [D 20:43:22.843791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44721. [D 20:43:22.843806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44722. [D 20:43:22.843820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44723. [D 20:43:22.843835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44724. [D 20:43:22.843849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44725. [D 20:43:22.843863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44726. [D 20:43:22.843878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44727. [D 20:43:22.843892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44728. [D 20:43:22.843907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44729. [D 20:43:22.843922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44730. [D 20:43:22.843936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44731. [D 20:43:22.843950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44732. [D 20:43:22.843965] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614dd0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44733. [D 20:43:22.843983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44734. [D 20:43:22.843998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44735. [D 20:43:22.844012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44736. [D 20:43:22.844027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44737. [D 20:43:22.844041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44738. [D 20:43:22.844056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44739. [D 20:43:22.844070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44740. [D 20:43:22.844085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44741. [D 20:43:22.844099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44742. [D 20:43:22.844135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44743. [D 20:43:22.844150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44744. [D 20:43:22.844164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44745. [D 20:43:22.844178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44746. [D 20:43:22.844194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44747. [D 20:43:22.844208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44748. [D 20:43:22.844223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44749. [D 20:43:22.844237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44750. [D 20:43:22.844252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44751. [D 20:43:22.844267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44752. [D 20:43:22.844281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 44753. [D 20:43:22.844296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 44754. [D 20:43:22.844311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 44755. [D 20:43:22.844325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 44756. [D 20:43:22.844340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44757. [D 20:43:22.844354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44758. [D 20:43:22.844369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44759. [D 20:43:22.844384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 44760. [D 20:43:22.844398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 44761. [D 20:43:22.844413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 44762. [D 20:43:22.844427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 44763. [D 20:43:22.844442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 44764. [D 20:43:22.844457] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44765. [D 20:43:22.844523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.844582] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.844597] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.844641] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6787 [D 20:43:22.844656] element 0: offset: 0x2aaaab60ca30, size: 24 [D 20:43:22.844675] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 47/70. [D 20:43:22.844715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.844728] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.844741] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:22.844762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6790 [D 20:43:22.844778] element 0: offset: 0x2aaaab60ca50, size: 24 [D 20:43:22.844792] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 48/70. [D 20:43:22.846844] openib_check_cq: completed rdma wr_id 2aaaab614dd0, nic_wr_credit 44765. [D 20:43:22.846864] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 49/70. [D 20:43:22.852700] openib_check_cq: completed rdma wr_id 2aaaab60c9a0, nic_wr_credit 44764. [D 20:43:22.852720] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 50/70. [D 20:43:22.855749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.855764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.855777] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:22.855878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.855893] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.855905] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.861996] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6787 [D 20:43:22.862069] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 51/70. [D 20:43:22.864498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 44764. [D 20:43:22.864518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 44765. [D 20:43:22.864533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 44766. [D 20:43:22.864547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 44767. [D 20:43:22.864561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 44768. [D 20:43:22.864575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 44769. [D 20:43:22.864589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 44770. [D 20:43:22.864604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 44771. [D 20:43:22.864618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 44772. [D 20:43:22.864632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 44773. [D 20:43:22.864646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 44774. [D 20:43:22.864662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 44775. [D 20:43:22.864676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 44776. [D 20:43:22.864690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 44777. [D 20:43:22.864705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 44778. [D 20:43:22.864719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 44779. [D 20:43:22.864733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 44780. [D 20:43:22.864748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 44781. [D 20:43:22.864762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 44782. [D 20:43:22.864781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 44783. [D 20:43:22.864796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 44784. [D 20:43:22.864810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 44785. [D 20:43:22.864825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 44786. [D 20:43:22.864839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 44787. [D 20:43:22.864854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 44788. [D 20:43:22.864868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 44789. [D 20:43:22.864883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 44790. [D 20:43:22.864897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 44791. [D 20:43:22.864911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 44792. [D 20:43:22.864924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 44793. [D 20:43:22.864939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 44794. [D 20:43:22.864954] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 44795. [D 20:43:22.870153] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.870170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.870184] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.870225] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6792 [D 20:43:22.870240] element 0: offset: 0x2aaaab60a260, size: 24 [D 20:43:22.870256] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 52/70. [D 20:43:22.870307] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6790 [D 20:43:22.870324] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 53/70. [D 20:43:22.870396] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 44795. [D 20:43:22.870413] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 54/70. [D 20:43:22.870428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44795. [D 20:43:22.870443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 44796. [D 20:43:22.870457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 44797. [D 20:43:22.870471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 44798. [D 20:43:22.870485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 44799. [D 20:43:22.870499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 44800. [D 20:43:22.870513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44801. [D 20:43:22.870527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44802. [D 20:43:22.870541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44803. [D 20:43:22.870555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 44804. [D 20:43:22.870569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 44805. [D 20:43:22.870583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 44806. [D 20:43:22.870597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 44807. [D 20:43:22.870611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 44808. [D 20:43:22.870625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44809. [D 20:43:22.870639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44810. [D 20:43:22.870654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44811. [D 20:43:22.870667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44812. [D 20:43:22.870681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44813. [D 20:43:22.870695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44814. [D 20:43:22.870709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44815. [D 20:43:22.870723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44816. [D 20:43:22.870737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44817. [D 20:43:22.870751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44818. [D 20:43:22.870765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44819. [D 20:43:22.870779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44820. [D 20:43:22.870793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44821. [D 20:43:22.870807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44822. [D 20:43:22.870821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44823. [D 20:43:22.870835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44824. [D 20:43:22.870848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44825. [D 20:43:22.870862] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c7c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44826. [D 20:43:22.872182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.872213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.872228] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.875733] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6792 [D 20:43:22.875754] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 55/70. [D 20:43:22.876614] openib_check_cq: completed rdma wr_id 2aaaab60c7c0, nic_wr_credit 44826. [D 20:43:22.876691] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 56/70. [D 20:43:22.876713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44826. [D 20:43:22.876729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44827. [D 20:43:22.876744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44828. [D 20:43:22.876758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44829. [D 20:43:22.876773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44830. [D 20:43:22.876787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44831. [D 20:43:22.876802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44832. [D 20:43:22.876816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44833. [D 20:43:22.876830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44834. [D 20:43:22.876862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44835. [D 20:43:22.876876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44836. [D 20:43:22.876891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44837. [D 20:43:22.876905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44838. [D 20:43:22.876920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44839. [D 20:43:22.876934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44840. [D 20:43:22.876948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44841. [D 20:43:22.876963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44842. [D 20:43:22.876977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44843. [D 20:43:22.876991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44844. [D 20:43:22.877006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44845. [D 20:43:22.877020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44846. [D 20:43:22.877035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44847. [D 20:43:22.877049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44848. [D 20:43:22.877063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44849. [D 20:43:22.877077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44850. [D 20:43:22.877092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44851. [D 20:43:22.877106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44852. [D 20:43:22.877121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44853. [D 20:43:22.877135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44854. [D 20:43:22.877150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44855. [D 20:43:22.877163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44856. [D 20:43:22.877178] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44857. [D 20:43:22.880254] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.880274] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.880288] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.884152] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.884173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.884186] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.884210] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6795 [D 20:43:22.884224] element 0: offset: 0x2aaaab609740, size: 24 [D 20:43:22.884240] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 57/70. [D 20:43:22.884923] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.884937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.884949] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.884970] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6799 [D 20:43:22.885001] element 0: offset: 0x2aaaab60cde0, size: 24 [D 20:43:22.885015] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 58/70. [D 20:43:22.888079] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 44857. [D 20:43:22.888096] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 59/70. [D 20:43:22.891262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.891278] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.891291] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.894792] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6799 [D 20:43:22.894858] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 60/70. [D 20:43:22.895000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44857. [D 20:43:22.895020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 44858. [D 20:43:22.895035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 44859. [D 20:43:22.895049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 44860. [D 20:43:22.895064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 44861. [D 20:43:22.895078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 44862. [D 20:43:22.895093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44863. [D 20:43:22.895107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44864. [D 20:43:22.895122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44865. [D 20:43:22.895136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 44866. [D 20:43:22.895151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 44867. [D 20:43:22.895166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 44868. [D 20:43:22.895181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 44869. [D 20:43:22.895195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 44870. [D 20:43:22.895209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44871. [D 20:43:22.895223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44872. [D 20:43:22.895238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44873. [D 20:43:22.895252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44874. [D 20:43:22.895266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44875. [D 20:43:22.895280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44876. [D 20:43:22.895294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44877. [D 20:43:22.895308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44878. [D 20:43:22.895323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44879. [D 20:43:22.895338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44880. [D 20:43:22.895353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44881. [D 20:43:22.895367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44882. [D 20:43:22.895381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44883. [D 20:43:22.895395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44884. [D 20:43:22.895409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44885. [D 20:43:22.895423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44886. [D 20:43:22.895437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44887. [D 20:43:22.895451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60db50 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44888. [D 20:43:22.900109] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6795 [D 20:43:22.900180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.900198] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.900210] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.900251] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6801 [D 20:43:22.900266] element 0: offset: 0x2aaaab60c840, size: 24 [D 20:43:22.900332] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 0/70. [D 20:43:22.900359] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 1/70. [D 20:43:22.906816] openib_check_cq: completed rdma wr_id 2aaaab60db50, nic_wr_credit 44888. [D 20:43:22.906895] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 2/70. [D 20:43:22.906918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 44888. [D 20:43:22.906934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 44889. [D 20:43:22.906949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44890. [D 20:43:22.906963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44891. [D 20:43:22.906977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44892. [D 20:43:22.906991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44893. [D 20:43:22.907006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44894. [D 20:43:22.907020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44895. [D 20:43:22.907034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44896. [D 20:43:22.907048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44897. [D 20:43:22.907062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44898. [D 20:43:22.907077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44899. [D 20:43:22.907091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44900. [D 20:43:22.907105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44901. [D 20:43:22.907121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44902. [D 20:43:22.907136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44903. [D 20:43:22.907150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44904. [D 20:43:22.907165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44905. [D 20:43:22.907180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44906. [D 20:43:22.907194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 44907. [D 20:43:22.907209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 44908. [D 20:43:22.907223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 44909. [D 20:43:22.907237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 44910. [D 20:43:22.907252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44911. [D 20:43:22.907267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44912. [D 20:43:22.907281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44913. [D 20:43:22.907296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 44914. [D 20:43:22.907310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 44915. [D 20:43:22.907325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 44916. [D 20:43:22.907339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 44917. [D 20:43:22.907354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 44918. [D 20:43:22.907368] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d9c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44919. [D 20:43:22.907433] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.907453] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.907465] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.910523] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6801 [D 20:43:22.910593] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 3/70. [D 20:43:22.917914] openib_check_cq: completed rdma wr_id 2aaaab60d9c0, nic_wr_credit 44919. [D 20:43:22.917939] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 4/70. [D 20:43:22.918018] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.918039] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.918052] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.922532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 44919. [D 20:43:22.922557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 44920. [D 20:43:22.922572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 44921. [D 20:43:22.922586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 44922. [D 20:43:22.922601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 44923. [D 20:43:22.922616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 44924. [D 20:43:22.922631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 44925. [D 20:43:22.922645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 44926. [D 20:43:22.922660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 44927. [D 20:43:22.922674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 44928. [D 20:43:22.922689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 44929. [D 20:43:22.922703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 44930. [D 20:43:22.922717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 44931. [D 20:43:22.922732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 44932. [D 20:43:22.922746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 44933. [D 20:43:22.922760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 44934. [D 20:43:22.922775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 44935. [D 20:43:22.922789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 44936. [D 20:43:22.922804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 44937. [D 20:43:22.922818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 44938. [D 20:43:22.922833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 44939. [D 20:43:22.922847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 44940. [D 20:43:22.922862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 44941. [D 20:43:22.922876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 44942. [D 20:43:22.922890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 44943. [D 20:43:22.922905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 44944. [D 20:43:22.922919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 44945. [D 20:43:22.922933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 44946. [D 20:43:22.922948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 44947. [D 20:43:22.922962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 44948. [D 20:43:22.922977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 44949. [D 20:43:22.922991] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 44950. [D 20:43:22.931122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.931142] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.931155] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.931195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6806 [D 20:43:22.931210] element 0: offset: 0x2aaaab612410, size: 24 [D 20:43:22.931228] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 5/70. [D 20:43:22.931267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.931281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.931293] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.931314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6807 [D 20:43:22.931327] element 0: offset: 0x2aaaab615250, size: 24 [D 20:43:22.931342] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 6/70. [D 20:43:22.934291] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 44950. [D 20:43:22.934316] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 7/70. [D 20:43:22.934449] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.934468] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.934480] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.937563] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6806 [D 20:43:22.937635] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 8/70. [D 20:43:22.940828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44950. [D 20:43:22.940856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 44951. [D 20:43:22.940871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 44952. [D 20:43:22.940885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 44953. [D 20:43:22.940900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 44954. [D 20:43:22.940914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 44955. [D 20:43:22.940929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44956. [D 20:43:22.940943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44957. [D 20:43:22.940958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44958. [D 20:43:22.940972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 44959. [D 20:43:22.940987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 44960. [D 20:43:22.941002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 44961. [D 20:43:22.941017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 44962. [D 20:43:22.941031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 44963. [D 20:43:22.941045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44964. [D 20:43:22.941060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44965. [D 20:43:22.941074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44966. [D 20:43:22.941088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44967. [D 20:43:22.941103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44968. [D 20:43:22.941117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44969. [D 20:43:22.941133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44970. [D 20:43:22.941148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44971. [D 20:43:22.941162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44972. [D 20:43:22.941271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44973. [D 20:43:22.941287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44974. [D 20:43:22.941302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44975. [D 20:43:22.941317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44976. [D 20:43:22.941332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44977. [D 20:43:22.941346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44978. [D 20:43:22.941361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44979. [D 20:43:22.941375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44980. [D 20:43:22.941390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61a000 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44981. [D 20:43:22.942991] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6807 [D 20:43:22.943068] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 9/70. [D 20:43:22.943474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.943491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.943506] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.943550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6810 [D 20:43:22.943564] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:22.943581] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 10/70. [D 20:43:22.952521] openib_check_cq: completed rdma wr_id 2aaaab61a000, nic_wr_credit 44981. [D 20:43:22.952548] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 11/70. [D 20:43:22.952565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 44981. [D 20:43:22.952580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 44982. [D 20:43:22.952594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 44983. [D 20:43:22.952609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 44984. [D 20:43:22.952623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 44985. [D 20:43:22.952637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 44986. [D 20:43:22.952652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 44987. [D 20:43:22.952666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44988. [D 20:43:22.952681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44989. [D 20:43:22.952695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44990. [D 20:43:22.952709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 44991. [D 20:43:22.952725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 44992. [D 20:43:22.952740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 44993. [D 20:43:22.952754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 44994. [D 20:43:22.952769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 44995. [D 20:43:22.952783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44996. [D 20:43:22.952798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44997. [D 20:43:22.952812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44998. [D 20:43:22.952827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 44999. [D 20:43:22.952841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45000. [D 20:43:22.952856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45001. [D 20:43:22.952870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45002. [D 20:43:22.952885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45003. [D 20:43:22.952899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45004. [D 20:43:22.952913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45005. [D 20:43:22.952928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45006. [D 20:43:22.952942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45007. [D 20:43:22.952956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45008. [D 20:43:22.952971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45009. [D 20:43:22.952985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45010. [D 20:43:22.953000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45011. [D 20:43:22.953014] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45012. [D 20:43:22.953077] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.953098] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.953111] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.956203] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6810 [D 20:43:22.956270] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 12/70. [D 20:43:22.964206] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45012. [D 20:43:22.964231] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 13/70. [D 20:43:22.964312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.964335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.964349] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:22.969482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45012. [D 20:43:22.969507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45013. [D 20:43:22.969523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45014. [D 20:43:22.969537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45015. [D 20:43:22.969552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45016. [D 20:43:22.969566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45017. [D 20:43:22.969580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45018. [D 20:43:22.969595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45019. [D 20:43:22.969609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45020. [D 20:43:22.969624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45021. [D 20:43:22.969638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45022. [D 20:43:22.969652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45023. [D 20:43:22.969667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45024. [D 20:43:22.969682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45025. [D 20:43:22.969696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45026. [D 20:43:22.969710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45027. [D 20:43:22.969725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45028. [D 20:43:22.969739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45029. [D 20:43:22.969754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45030. [D 20:43:22.969768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45031. [D 20:43:22.969782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45032. [D 20:43:22.969797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45033. [D 20:43:22.969811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45034. [D 20:43:22.969826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45035. [D 20:43:22.969840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45036. [D 20:43:22.969854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45037. [D 20:43:22.969869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45038. [D 20:43:22.969883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45039. [D 20:43:22.969898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45040. [D 20:43:22.969912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45041. [D 20:43:22.969927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45042. [D 20:43:22.969942] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab606360 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45043. [D 20:43:22.978043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.978063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.978076] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:22.978117] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6815 [D 20:43:22.978133] element 0: offset: 0x61fa30, size: 24 [D 20:43:22.978149] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 14/70. [D 20:43:22.978188] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.978202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.978215] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.978236] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6816 [D 20:43:22.978249] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.978264] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 15/70. [D 20:43:22.981234] openib_check_cq: completed rdma wr_id 2aaaab606360, nic_wr_credit 45043. [D 20:43:22.981260] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 16/70. [D 20:43:22.981379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:22.981398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.981410] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:22.987359] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6815 [D 20:43:22.987430] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 17/70. [D 20:43:22.987489] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6816 [D 20:43:22.987508] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 18/70. [D 20:43:22.987904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45043. [D 20:43:22.987930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 45044. [D 20:43:22.987944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 45045. [D 20:43:22.987959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 45046. [D 20:43:22.987974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 45047. [D 20:43:22.987987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 45048. [D 20:43:22.988002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45049. [D 20:43:22.988017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45050. [D 20:43:22.988031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45051. [D 20:43:22.988045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 45052. [D 20:43:22.988059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 45053. [D 20:43:22.988074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 45054. [D 20:43:22.988088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 45055. [D 20:43:22.988102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 45056. [D 20:43:22.988123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45057. [D 20:43:22.988138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45058. [D 20:43:22.988153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45059. [D 20:43:22.988167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45060. [D 20:43:22.988182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45061. [D 20:43:22.988197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45062. [D 20:43:22.988212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45063. [D 20:43:22.988226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45064. [D 20:43:22.988241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45065. [D 20:43:22.988255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45066. [D 20:43:22.988270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45067. [D 20:43:22.988285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45068. [D 20:43:22.988300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45069. [D 20:43:22.988314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45070. [D 20:43:22.988329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45071. [D 20:43:22.988343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45072. [D 20:43:22.988358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45073. [D 20:43:22.988373] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45074. [D 20:43:22.988389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45075. [D 20:43:22.988404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45076. [D 20:43:22.988419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45077. [D 20:43:22.988434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45078. [D 20:43:22.988448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45079. [D 20:43:22.988463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45080. [D 20:43:22.988478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45081. [D 20:43:22.988492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45082. [D 20:43:22.988507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45083. [D 20:43:22.988522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45084. [D 20:43:22.988536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45085. [D 20:43:22.988551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45086. [D 20:43:22.988566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45087. [D 20:43:22.988581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45088. [D 20:43:22.988596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45089. [D 20:43:22.988610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45090. [D 20:43:22.988624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45091. [D 20:43:22.988639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45092. [D 20:43:22.988654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45093. [D 20:43:22.988668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45094. [D 20:43:22.988683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45095. [D 20:43:22.988697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45096. [D 20:43:22.988712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45097. [D 20:43:22.988726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45098. [D 20:43:22.988741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45099. [D 20:43:22.988755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45100. [D 20:43:22.988769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45101. [D 20:43:22.988784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45102. [D 20:43:22.988798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45103. [D 20:43:22.988813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45104. [D 20:43:22.988828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45105. [D 20:43:22.988842] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab606360 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45106. [D 20:43:22.997821] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:22.997844] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:22.997857] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:22.997897] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6819 [D 20:43:22.997912] element 0: offset: 0x658610, size: 24 [D 20:43:22.997928] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 19/70. [D 20:43:22.999617] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45106. [D 20:43:22.999642] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 20/70. [D 20:43:23.011295] openib_check_cq: completed rdma wr_id 2aaaab606360, nic_wr_credit 45105. [D 20:43:23.011317] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 21/70. [D 20:43:23.011381] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.011402] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.011414] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.011498] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.011513] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.011525] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.014459] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6819 [D 20:43:23.014520] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 22/70. [D 20:43:23.022544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45105. [D 20:43:23.022569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45106. [D 20:43:23.022584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45107. [D 20:43:23.022598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45108. [D 20:43:23.022612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45109. [D 20:43:23.022627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45110. [D 20:43:23.022641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45111. [D 20:43:23.022656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45112. [D 20:43:23.022670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45113. [D 20:43:23.022685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45114. [D 20:43:23.022699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45115. [D 20:43:23.022713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45116. [D 20:43:23.022728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45117. [D 20:43:23.022742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45118. [D 20:43:23.022756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45119. [D 20:43:23.022771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45120. [D 20:43:23.022785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45121. [D 20:43:23.022800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45122. [D 20:43:23.022814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45123. [D 20:43:23.022829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45124. [D 20:43:23.022843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45125. [D 20:43:23.022858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45126. [D 20:43:23.022872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45127. [D 20:43:23.022886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45128. [D 20:43:23.022900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45129. [D 20:43:23.022915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45130. [D 20:43:23.022929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45131. [D 20:43:23.022944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45132. [D 20:43:23.022958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45133. [D 20:43:23.268149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45134. [D 20:43:23.268174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45135. [D 20:43:23.268192] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45136. [D 20:43:23.268886] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45136. [D 20:43:23.268904] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 23/70. [D 20:43:23.271816] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.271833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.271846] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.271886] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6824 [D 20:43:23.271901] element 0: offset: 0x66e390, size: 24 [D 20:43:23.271917] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 24/70. [D 20:43:23.271947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.271964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.271976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.271996] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6825 [D 20:43:23.272095] element 0: offset: 0x691f90, size: 24 [D 20:43:23.272120] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 25/70. [D 20:43:23.272142] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.272155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.272170] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.272192] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6828 [D 20:43:23.272206] element 0: offset: 0x61fa30, size: 24 [D 20:43:23.272224] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 26/70. [D 20:43:23.272256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.272270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.272282] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.280618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.280682] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.280695] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.280738] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6831 [D 20:43:23.280754] element 0: offset: 0x5b0030, size: 24 [D 20:43:23.280771] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 27/70. [D 20:43:23.290877] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6831 [D 20:43:23.290958] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 28/70. [D 20:43:23.291043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45136. [D 20:43:23.291053] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6825 [D 20:43:23.291097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45137. [D 20:43:23.291119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45138. [D 20:43:23.291135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45139. [D 20:43:23.291150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45140. [D 20:43:23.291166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45141. [D 20:43:23.291181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45142. [D 20:43:23.291195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45143. [D 20:43:23.291211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45144. [D 20:43:23.291226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45145. [D 20:43:23.291241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45146. [D 20:43:23.291255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45147. [D 20:43:23.291271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45148. [D 20:43:23.291285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45149. [D 20:43:23.291300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45150. [D 20:43:23.291315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45151. [D 20:43:23.291330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45152. [D 20:43:23.291344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45153. [D 20:43:23.291359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45154. [D 20:43:23.291374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45155. [D 20:43:23.291389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45156. [D 20:43:23.291403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45157. [D 20:43:23.291418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45158. [D 20:43:23.291433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45159. [D 20:43:23.291448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45160. [D 20:43:23.291462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45161. [D 20:43:23.291477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45162. [D 20:43:23.291492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45163. [D 20:43:23.291507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45164. [D 20:43:23.291521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45165. [D 20:43:23.291536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45166. [D 20:43:23.291551] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45167. [D 20:43:23.291578] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 29/70. [D 20:43:23.291612] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6824 [D 20:43:23.291628] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 30/70. [D 20:43:23.291647] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6828 [D 20:43:23.291664] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 31/70. [D 20:43:23.297002] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45167. [D 20:43:23.297027] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 32/70. [D 20:43:23.297044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45167. [D 20:43:23.297060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45168. [D 20:43:23.297074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45169. [D 20:43:23.297089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45170. [D 20:43:23.297104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45171. [D 20:43:23.297119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45172. [D 20:43:23.297133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45173. [D 20:43:23.297148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45174. [D 20:43:23.297163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45175. [D 20:43:23.297177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45176. [D 20:43:23.297192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45177. [D 20:43:23.297207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45178. [D 20:43:23.297221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45179. [D 20:43:23.297236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45180. [D 20:43:23.297251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45181. [D 20:43:23.297265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45182. [D 20:43:23.297280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45183. [D 20:43:23.297295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45184. [D 20:43:23.297309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45185. [D 20:43:23.297324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45186. [D 20:43:23.297339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45187. [D 20:43:23.297353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45188. [D 20:43:23.297368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45189. [D 20:43:23.297383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45190. [D 20:43:23.297397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45191. [D 20:43:23.297412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45192. [D 20:43:23.297426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45193. [D 20:43:23.297441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45194. [D 20:43:23.297456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45195. [D 20:43:23.297470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45196. [D 20:43:23.297486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45197. [D 20:43:23.297500] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45198. [D 20:43:23.297517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45199. [D 20:43:23.297532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 45200. [D 20:43:23.297547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 45201. [D 20:43:23.297562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 45202. [D 20:43:23.297577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 45203. [D 20:43:23.297592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 45204. [D 20:43:23.297606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45205. [D 20:43:23.297621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45206. [D 20:43:23.297636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45207. [D 20:43:23.297651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 45208. [D 20:43:23.297666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 45209. [D 20:43:23.297681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 45210. [D 20:43:23.297695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 45211. [D 20:43:23.297710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 45212. [D 20:43:23.297725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45213. [D 20:43:23.297740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45214. [D 20:43:23.297754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45215. [D 20:43:23.297769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45216. [D 20:43:23.297784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45217. [D 20:43:23.297799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45218. [D 20:43:23.297814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45219. [D 20:43:23.297829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45220. [D 20:43:23.297843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45221. [D 20:43:23.297858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45222. [D 20:43:23.297873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45223. [D 20:43:23.297888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45224. [D 20:43:23.297903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45225. [D 20:43:23.297918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45226. [D 20:43:23.297933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45227. [D 20:43:23.297948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45228. [D 20:43:23.297962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45229. [D 20:43:23.297977] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45230. [D 20:43:23.297994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45231. [D 20:43:23.298009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45232. [D 20:43:23.298024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45233. [D 20:43:23.298038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45234. [D 20:43:23.298053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45235. [D 20:43:23.298068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45236. [E 20:43:23.298087] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 45237, block for 10 ms. [D 20:43:23.298119] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45236. [D 20:43:23.298134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45237. [E 20:43:23.298150] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 45238, block for 10 ms. [D 20:43:23.302937] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 45237. [D 20:43:23.302953] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 33/70. [D 20:43:23.302968] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45236. [D 20:43:23.302982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45237. [D 20:43:23.302997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45238. [D 20:43:23.303011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45239. [D 20:43:23.303027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45240. [D 20:43:23.303041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45241. [D 20:43:23.303056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45242. [D 20:43:23.303071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45243. [D 20:43:23.303085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45244. [D 20:43:23.303100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45245. [D 20:43:23.303115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45246. [D 20:43:23.303130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45247. [D 20:43:23.303145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45248. [D 20:43:23.303160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45249. [D 20:43:23.303175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45250. [D 20:43:23.303189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45251. [D 20:43:23.303204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45252. [D 20:43:23.303231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45253. [D 20:43:23.303246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45254. [D 20:43:23.303260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45255. [D 20:43:23.303275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45256. [D 20:43:23.303290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45257. [D 20:43:23.303305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45258. [D 20:43:23.303320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45259. [D 20:43:23.303335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45260. [D 20:43:23.303349] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609ae0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45261. [D 20:43:23.303423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.303445] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.303458] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.305600] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.305617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.305630] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.305670] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6834 [D 20:43:23.305685] element 0: offset: 0x658610, size: 24 [D 20:43:23.305703] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 34/70. [D 20:43:23.308780] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 45261. [D 20:43:23.308805] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 35/70. [D 20:43:23.309913] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.309934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.309947] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.314660] openib_check_cq: completed rdma wr_id 2aaaab609ae0, nic_wr_credit 45260. [D 20:43:23.314685] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 36/70. [D 20:43:23.314739] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.314760] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.314773] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.314855] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.314870] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.314883] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.317853] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6834 [D 20:43:23.317914] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 37/70. [D 20:43:23.326317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45260. [D 20:43:23.326339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45261. [D 20:43:23.326355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45262. [D 20:43:23.326370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45263. [D 20:43:23.326385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45264. [D 20:43:23.326399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45265. [D 20:43:23.326414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45266. [D 20:43:23.326428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45267. [D 20:43:23.326443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45268. [D 20:43:23.326457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45269. [D 20:43:23.326472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45270. [D 20:43:23.326487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45271. [D 20:43:23.326501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45272. [D 20:43:23.326516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45273. [D 20:43:23.326530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45274. [D 20:43:23.326554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45275. [D 20:43:23.326569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45276. [D 20:43:23.326584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45277. [D 20:43:23.326598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45278. [D 20:43:23.326613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45279. [D 20:43:23.326627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45280. [D 20:43:23.326642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45281. [D 20:43:23.326656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45282. [D 20:43:23.326671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45283. [D 20:43:23.326685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45284. [D 20:43:23.326700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45285. [D 20:43:23.326723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45286. [D 20:43:23.326738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45287. [D 20:43:23.326752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45288. [D 20:43:23.326766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45289. [D 20:43:23.326781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45290. [D 20:43:23.326796] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45291. [D 20:43:23.329076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.329101] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.329115] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.329157] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6839 [D 20:43:23.329172] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.329189] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 38/70. [D 20:43:23.329229] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.329243] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.329256] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.329277] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6842 [D 20:43:23.329292] element 0: offset: 0x6425f0, size: 24 [D 20:43:23.329306] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 39/70. [D 20:43:23.329339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.329352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.329365] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.329385] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6843 [D 20:43:23.329399] element 0: offset: 0x5b0030, size: 24 [D 20:43:23.329414] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 40/70. [D 20:43:23.332216] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45291. [D 20:43:23.332238] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 41/70. [D 20:43:23.332423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.332444] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.332457] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.338945] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6839 [D 20:43:23.339023] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 42/70. [D 20:43:23.339084] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6842 [D 20:43:23.339101] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 43/70. [D 20:43:23.339181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 45291. [D 20:43:23.339251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 45292. [D 20:43:23.339267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45293. [D 20:43:23.339282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45294. [D 20:43:23.339298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45295. [D 20:43:23.339313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45296. [D 20:43:23.339328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45297. [D 20:43:23.339343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45298. [D 20:43:23.339358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45299. [D 20:43:23.339373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45300. [D 20:43:23.339388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45301. [D 20:43:23.339403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45302. [D 20:43:23.339418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45303. [D 20:43:23.339439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45304. [D 20:43:23.339454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45305. [D 20:43:23.339468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45306. [D 20:43:23.339483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45307. [D 20:43:23.339497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45308. [D 20:43:23.339512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45309. [D 20:43:23.339527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45310. [D 20:43:23.339541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45311. [D 20:43:23.339556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45312. [D 20:43:23.339570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45313. [D 20:43:23.339585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45314. [D 20:43:23.339599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45315. [D 20:43:23.339614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45316. [D 20:43:23.339628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45317. [D 20:43:23.339643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45318. [D 20:43:23.339657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45319. [D 20:43:23.339672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45320. [D 20:43:23.339687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45321. [D 20:43:23.339701] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45322. [D 20:43:23.339720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45323. [D 20:43:23.339742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 45324. [D 20:43:23.339756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 45325. [D 20:43:23.339771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 45326. [D 20:43:23.339785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 45327. [D 20:43:23.339800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 45328. [D 20:43:23.339815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45329. [D 20:43:23.339829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45330. [D 20:43:23.339843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45331. [D 20:43:23.339858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 45332. [D 20:43:23.339873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 45333. [D 20:43:23.339889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 45334. [D 20:43:23.339903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 45335. [D 20:43:23.339918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 45336. [D 20:43:23.339933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45337. [D 20:43:23.339948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45338. [D 20:43:23.339962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45339. [D 20:43:23.339977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45340. [D 20:43:23.339992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45341. [D 20:43:23.340007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45342. [D 20:43:23.340022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45343. [D 20:43:23.340037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45344. [D 20:43:23.340051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45345. [D 20:43:23.340066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45346. [D 20:43:23.340081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45347. [D 20:43:23.340095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45348. [D 20:43:23.340122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45349. [D 20:43:23.340137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45350. [D 20:43:23.340152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45351. [D 20:43:23.340167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45352. [D 20:43:23.340182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45353. [D 20:43:23.340196] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45354. [D 20:43:23.340635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.340657] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.340671] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.340712] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6846 [D 20:43:23.340727] element 0: offset: 0x61fa30, size: 24 [D 20:43:23.340743] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 44/70. [D 20:43:23.344293] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6843 [D 20:43:23.344316] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 45/70. [D 20:43:23.350910] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45354. [D 20:43:23.350968] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 46/70. [D 20:43:23.362565] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 45353. [D 20:43:23.362589] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 47/70. [D 20:43:23.362619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45353. [D 20:43:23.362636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45354. [D 20:43:23.362651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45355. [D 20:43:23.362665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45356. [D 20:43:23.362681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45357. [D 20:43:23.362695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45358. [D 20:43:23.362710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45359. [D 20:43:23.362725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45360. [D 20:43:23.362740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45361. [D 20:43:23.362755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45362. [D 20:43:23.362770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45363. [D 20:43:23.362784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45364. [D 20:43:23.362800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45365. [D 20:43:23.362814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45366. [D 20:43:23.362829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45367. [D 20:43:23.362844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45368. [D 20:43:23.362859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45369. [D 20:43:23.362874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45370. [D 20:43:23.362889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45371. [D 20:43:23.362904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45372. [D 20:43:23.362918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45373. [D 20:43:23.362933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45374. [D 20:43:23.362948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45375. [D 20:43:23.362963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45376. [D 20:43:23.362978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45377. [D 20:43:23.362992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45378. [D 20:43:23.363007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45379. [D 20:43:23.363022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45380. [D 20:43:23.363037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45381. [D 20:43:23.363053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45382. [D 20:43:23.363067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45383. [D 20:43:23.363082] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45384. [D 20:43:23.363151] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.363171] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.363184] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.363213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.363226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.363238] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.366319] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6846 [D 20:43:23.366390] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 48/70. [D 20:43:23.370981] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.371001] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.371014] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.371056] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6849 [D 20:43:23.371071] element 0: offset: 0x62fd10, size: 24 [D 20:43:23.371087] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 49/70. [D 20:43:23.374332] openib_check_cq: completed rdma wr_id 2aaaab60c8e0, nic_wr_credit 45384. [D 20:43:23.374359] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 50/70. [D 20:43:23.374476] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.374495] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.374507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.377055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45384. [D 20:43:23.377078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45385. [D 20:43:23.377093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45386. [D 20:43:23.377108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45387. [D 20:43:23.377123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45388. [D 20:43:23.377137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45389. [D 20:43:23.377152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45390. [D 20:43:23.377167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45391. [D 20:43:23.377182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45392. [D 20:43:23.377197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45393. [D 20:43:23.377211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45394. [D 20:43:23.377226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45395. [D 20:43:23.377241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45396. [D 20:43:23.377256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45397. [D 20:43:23.377270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45398. [D 20:43:23.377286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45399. [D 20:43:23.377301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45400. [D 20:43:23.377316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45401. [D 20:43:23.377331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45402. [D 20:43:23.377346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45403. [D 20:43:23.377361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45404. [D 20:43:23.377376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45405. [D 20:43:23.377391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45406. [D 20:43:23.377406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45407. [D 20:43:23.377421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45408. [D 20:43:23.377436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45409. [D 20:43:23.377452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45410. [D 20:43:23.377467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45411. [D 20:43:23.377482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45412. [D 20:43:23.377498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45413. [D 20:43:23.377513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45414. [D 20:43:23.377523] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6849 [D 20:43:23.377528] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45415. [D 20:43:23.377693] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 51/70. [D 20:43:23.384887] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45415. [D 20:43:23.384914] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 52/70. [D 20:43:23.384931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45415. [D 20:43:23.384947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45416. [D 20:43:23.384962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45417. [D 20:43:23.384976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45418. [D 20:43:23.384992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45419. [D 20:43:23.385007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45420. [D 20:43:23.385021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45421. [D 20:43:23.385037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45422. [D 20:43:23.385052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45423. [D 20:43:23.385067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45424. [D 20:43:23.385082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45425. [D 20:43:23.385097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45426. [D 20:43:23.385111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45427. [D 20:43:23.385126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45428. [D 20:43:23.385140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45429. [D 20:43:23.385155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45430. [D 20:43:23.385170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45431. [D 20:43:23.385185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45432. [D 20:43:23.385199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45433. [D 20:43:23.385214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45434. [D 20:43:23.385229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45435. [D 20:43:23.385243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45436. [D 20:43:23.385258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45437. [D 20:43:23.385273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45438. [D 20:43:23.385287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45439. [D 20:43:23.385302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45440. [D 20:43:23.385317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45441. [D 20:43:23.385332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45442. [D 20:43:23.385346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45443. [D 20:43:23.385361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45444. [D 20:43:23.385376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45445. [D 20:43:23.385390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45446. [D 20:43:23.385472] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.385493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.385507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.390865] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 45446. [D 20:43:23.390890] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 53/70. [D 20:43:23.390959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.390980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.390993] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.391033] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6854 [D 20:43:23.391048] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.391069] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 54/70. [D 20:43:23.391109] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.391123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.391135] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.391159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.391172] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.391185] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.391204] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6855 [D 20:43:23.391218] element 0: offset: 0x66e390, size: 24 [D 20:43:23.391234] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 55/70. [D 20:43:23.393706] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.393773] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.393788] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.393830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6858 [D 20:43:23.393845] element 0: offset: 0x61fa30, size: 24 [D 20:43:23.393865] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:43:23.398287] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6855 [D 20:43:23.398375] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 57/70. [D 20:43:23.398457] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6854 [D 20:43:23.398475] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 58/70. [D 20:43:23.402356] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6858 [D 20:43:23.402386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45446. [D 20:43:23.402494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45447. [D 20:43:23.402509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45448. [D 20:43:23.402524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45449. [D 20:43:23.402539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45450. [D 20:43:23.402553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45451. [D 20:43:23.402568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45452. [D 20:43:23.402582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45453. [D 20:43:23.402596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45454. [D 20:43:23.402611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45455. [D 20:43:23.402625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45456. [D 20:43:23.402640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45457. [D 20:43:23.402654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45458. [D 20:43:23.402669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45459. [D 20:43:23.402683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45460. [D 20:43:23.402698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45461. [D 20:43:23.402712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45462. [D 20:43:23.402726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45463. [D 20:43:23.402747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45464. [D 20:43:23.402762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45465. [D 20:43:23.402777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45466. [D 20:43:23.402792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45467. [D 20:43:23.402806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45468. [D 20:43:23.402821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45469. [D 20:43:23.402836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45470. [D 20:43:23.402851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45471. [D 20:43:23.402866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45472. [D 20:43:23.402880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45473. [D 20:43:23.402895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45474. [D 20:43:23.402910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45475. [D 20:43:23.402925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45476. [D 20:43:23.402939] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45477. [D 20:43:23.402958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45478. [D 20:43:23.402973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 45479. [D 20:43:23.402988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 45480. [D 20:43:23.403003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 45481. [D 20:43:23.403017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 45482. [D 20:43:23.403032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 45483. [D 20:43:23.403047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45484. [D 20:43:23.403061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45485. [D 20:43:23.403076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45486. [D 20:43:23.403091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 45487. [D 20:43:23.403106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 45488. [D 20:43:23.403120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 45489. [D 20:43:23.403135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 45490. [D 20:43:23.403150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 45491. [D 20:43:23.403165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45492. [D 20:43:23.682472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45493. [D 20:43:23.682531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45494. [D 20:43:23.682547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45495. [D 20:43:23.682562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45496. [D 20:43:23.682577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45497. [D 20:43:23.682592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45498. [D 20:43:23.682607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45499. [D 20:43:23.683217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45500. [D 20:43:23.683232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45501. [D 20:43:23.683247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45502. [D 20:43:23.683261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45503. [D 20:43:23.683276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45504. [D 20:43:23.683290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45505. [D 20:43:23.683305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45506. [D 20:43:23.683319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45507. [D 20:43:23.683334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45508. [D 20:43:23.683349] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45509. [D 20:43:23.683369] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45509. [D 20:43:23.683388] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 59/70. [D 20:43:23.683975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.683996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.684010] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.684055] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6861 [D 20:43:23.684070] element 0: offset: 0x644640, size: 24 [D 20:43:23.684086] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 60/70. [D 20:43:23.684132] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 0/70. [D 20:43:23.686113] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 45508. [D 20:43:23.686139] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 1/70. [D 20:43:23.686158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45508. [D 20:43:23.686173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45509. [D 20:43:23.686188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45510. [D 20:43:23.686203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45511. [D 20:43:23.686217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45512. [D 20:43:23.686232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45513. [D 20:43:23.686301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45514. [D 20:43:23.686315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45515. [D 20:43:23.686330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45516. [D 20:43:23.686864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45517. [D 20:43:23.686882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45518. [D 20:43:23.686896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45519. [D 20:43:23.686911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45520. [D 20:43:23.686926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45521. [D 20:43:23.686940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45522. [D 20:43:23.686955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45523. [D 20:43:23.686969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45524. [D 20:43:23.686984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45525. [D 20:43:23.686998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45526. [D 20:43:23.687013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45527. [D 20:43:23.687028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45528. [D 20:43:23.687042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45529. [D 20:43:23.687057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45530. [D 20:43:23.687071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45531. [D 20:43:23.687566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45532. [D 20:43:23.687583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45533. [D 20:43:23.687597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45534. [D 20:43:23.687612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45535. [D 20:43:23.687626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45536. [D 20:43:23.687641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45537. [D 20:43:23.687655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45538. [D 20:43:23.687670] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45539. [D 20:43:23.687733] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.687752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.687766] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.691319] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.691337] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.691350] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.692079] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 45539. [D 20:43:23.692097] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 2/70. [D 20:43:23.694417] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6861 [D 20:43:23.694496] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 3/70. [D 20:43:23.694503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.694523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.694537] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.703380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45539. [D 20:43:23.703402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45540. [D 20:43:23.703429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45541. [D 20:43:23.703445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45542. [D 20:43:23.703460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45543. [D 20:43:23.703474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45544. [D 20:43:23.703489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45545. [D 20:43:23.703503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45546. [D 20:43:23.703518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45547. [D 20:43:23.703532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45548. [D 20:43:23.703547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45549. [D 20:43:23.703561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45550. [D 20:43:23.703575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45551. [D 20:43:23.703590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45552. [D 20:43:23.703605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45553. [D 20:43:23.703619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45554. [D 20:43:23.703634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45555. [D 20:43:23.703648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45556. [D 20:43:23.703663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45557. [D 20:43:23.703677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45558. [D 20:43:23.703692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45559. [D 20:43:23.703706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45560. [D 20:43:23.703721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45561. [D 20:43:23.703735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45562. [D 20:43:23.703753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45563. [D 20:43:23.703768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45564. [D 20:43:23.703782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45565. [D 20:43:23.703797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45566. [D 20:43:23.703812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45567. [D 20:43:23.703826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45568. [D 20:43:23.703841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45569. [D 20:43:23.703855] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45570. [D 20:43:23.705863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.705888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.705902] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.705951] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6865 [D 20:43:23.705966] element 0: offset: 0x62fd10, size: 24 [D 20:43:23.705983] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 4/70. [D 20:43:23.706021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.706035] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.706048] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.706069] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6867 [D 20:43:23.706083] element 0: offset: 0x658610, size: 24 [D 20:43:23.706099] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 5/70. [D 20:43:23.709278] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45570. [D 20:43:23.709304] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 6/70. [D 20:43:23.709519] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.709541] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.709554] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.716180] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6867 [D 20:43:23.716206] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 7/70. [D 20:43:23.716276] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6865 [D 20:43:23.716298] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 8/70. [D 20:43:23.716356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45570. [D 20:43:23.716372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45571. [D 20:43:23.716387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45572. [D 20:43:23.716402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45573. [D 20:43:23.716417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45574. [D 20:43:23.716432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45575. [D 20:43:23.716446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45576. [D 20:43:23.716461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45577. [D 20:43:23.716475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45578. [D 20:43:23.716490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45579. [D 20:43:23.716505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45580. [D 20:43:23.716519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45581. [D 20:43:23.716534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45582. [D 20:43:23.716549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45583. [D 20:43:23.716563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45584. [D 20:43:23.716578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45585. [D 20:43:23.716593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45586. [D 20:43:23.716608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45587. [D 20:43:23.716622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45588. [D 20:43:23.716637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45589. [D 20:43:23.716652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45590. [D 20:43:23.716666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45591. [D 20:43:23.716681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45592. [D 20:43:23.716696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45593. [D 20:43:23.716710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45594. [D 20:43:23.716725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45595. [D 20:43:23.716739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45596. [D 20:43:23.716754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45597. [D 20:43:23.716769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45598. [D 20:43:23.716785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45599. [D 20:43:23.716800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45600. [D 20:43:23.716850] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45601. [D 20:43:23.716914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45602. [D 20:43:23.716929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45603. [D 20:43:23.716944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45604. [D 20:43:23.716959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45605. [D 20:43:23.716978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45606. [D 20:43:23.716994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45607. [D 20:43:23.717009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45608. [D 20:43:23.717029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45609. [D 20:43:23.717046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45610. [D 20:43:23.717060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45611. [D 20:43:23.717078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45612. [D 20:43:23.717094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45613. [D 20:43:23.717108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45614. [D 20:43:23.717127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45615. [D 20:43:23.717143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45616. [D 20:43:23.717157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45617. [D 20:43:23.717175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45618. [D 20:43:23.717191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45619. [D 20:43:23.717206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45620. [D 20:43:23.717224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45621. [D 20:43:23.717240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45622. [D 20:43:23.717255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45623. [D 20:43:23.717273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45624. [D 20:43:23.717289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45625. [D 20:43:23.717303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45626. [D 20:43:23.717322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45627. [D 20:43:23.717337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45628. [D 20:43:23.717352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45629. [D 20:43:23.717370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45630. [D 20:43:23.717387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45631. [D 20:43:23.717413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45632. [D 20:43:23.717428] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45633. [D 20:43:23.717606] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.717662] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.717676] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.717719] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6870 [D 20:43:23.717734] element 0: offset: 0x61fa30, size: 24 [D 20:43:23.717756] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 9/70. [D 20:43:23.728099] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45633. [D 20:43:23.728132] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 10/70. [D 20:43:23.738243] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 45632. [D 20:43:23.738261] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 11/70. [D 20:43:23.738325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.738347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.738360] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.738445] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.738460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.738473] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.741477] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6870 [D 20:43:23.741498] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 12/70. [D 20:43:23.743918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 45632. [D 20:43:23.743941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 45633. [D 20:43:23.743959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45634. [D 20:43:23.743974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45635. [D 20:43:23.743989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45636. [D 20:43:23.744003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45637. [D 20:43:23.744018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45638. [D 20:43:23.744032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45639. [D 20:43:23.744047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45640. [D 20:43:23.744061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45641. [D 20:43:23.744076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45642. [D 20:43:23.744090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45643. [D 20:43:23.744105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45644. [D 20:43:23.744139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45645. [D 20:43:23.744155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45646. [D 20:43:23.744169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45647. [D 20:43:23.744184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45648. [D 20:43:23.744199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45649. [D 20:43:23.744213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45650. [D 20:43:23.744228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45651. [D 20:43:23.744242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45652. [D 20:43:23.744257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45653. [D 20:43:23.744271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45654. [D 20:43:23.744287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45655. [D 20:43:23.744302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45656. [D 20:43:23.744316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45657. [D 20:43:23.744331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45658. [D 20:43:23.744346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45659. [D 20:43:23.744360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45660. [D 20:43:23.744375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45661. [D 20:43:23.744390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45662. [D 20:43:23.744404] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45663. [D 20:43:23.753103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.753158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.753172] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.753216] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6874 [D 20:43:23.753232] element 0: offset: 0x63c690, size: 24 [D 20:43:23.753252] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 13/70. [D 20:43:23.753295] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.753309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.753322] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.753344] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6876 [D 20:43:23.753357] element 0: offset: 0x5b0030, size: 24 [D 20:43:23.753371] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 14/70. [D 20:43:23.755750] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45663. [D 20:43:23.755777] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 15/70. [D 20:43:23.755916] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.755936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.755949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.760335] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6874 [D 20:43:23.760360] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 16/70. [D 20:43:23.761607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45663. [D 20:43:23.761625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45664. [D 20:43:23.761640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45665. [D 20:43:23.761655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45666. [D 20:43:23.761670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45667. [D 20:43:23.761685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45668. [D 20:43:23.761699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45669. [D 20:43:23.761714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45670. [D 20:43:23.761728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45671. [D 20:43:23.761744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45672. [D 20:43:23.761759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45673. [D 20:43:23.761774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45674. [D 20:43:23.761789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45675. [D 20:43:23.761804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45676. [D 20:43:23.761819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45677. [D 20:43:23.761834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45678. [D 20:43:23.761848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45679. [D 20:43:23.761863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45680. [D 20:43:23.761878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45681. [D 20:43:23.761892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45682. [D 20:43:23.761907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45683. [D 20:43:23.761921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45684. [D 20:43:23.761936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45685. [D 20:43:23.761950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45686. [D 20:43:23.761975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45687. [D 20:43:23.761990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45688. [D 20:43:23.762004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45689. [D 20:43:23.762019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45690. [D 20:43:23.762033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45691. [D 20:43:23.762048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45692. [D 20:43:23.762062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45693. [D 20:43:23.762077] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45694. [D 20:43:23.764363] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.764422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.764435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.764478] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6879 [D 20:43:23.764494] element 0: offset: 0x63c530, size: 24 [D 20:43:23.764513] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 17/70. [D 20:43:23.764568] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6876 [D 20:43:23.764595] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 18/70. [D 20:43:23.773311] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45694. [D 20:43:23.773333] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 19/70. [D 20:43:23.773363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45694. [D 20:43:23.773379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45695. [D 20:43:23.773394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 45696. [D 20:43:23.773408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 45697. [D 20:43:23.773424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 45698. [D 20:43:23.773439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 45699. [D 20:43:23.773453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 45700. [D 20:43:23.773468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45701. [D 20:43:23.773482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45702. [D 20:43:23.773497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45703. [D 20:43:23.773511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 45704. [D 20:43:23.773526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 45705. [D 20:43:23.773540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 45706. [D 20:43:23.773555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 45707. [D 20:43:23.773569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 45708. [D 20:43:23.773584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45709. [D 20:43:23.773598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45710. [D 20:43:23.773613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45711. [D 20:43:23.773627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45712. [D 20:43:23.773642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45713. [D 20:43:23.773657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45714. [D 20:43:23.773671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45715. [D 20:43:23.773686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45716. [D 20:43:23.773700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45717. [D 20:43:23.773715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45718. [D 20:43:23.773729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45719. [D 20:43:23.773744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45720. [D 20:43:23.773758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45721. [D 20:43:23.773773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45722. [D 20:43:23.773788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45723. [D 20:43:23.773803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45724. [D 20:43:23.773817] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45725. [D 20:43:23.773866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.773886] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.773899] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.780191] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6879 [D 20:43:23.780277] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 20/70. [D 20:43:23.785042] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 45725. [D 20:43:23.785066] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 21/70. [D 20:43:23.785122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.785140] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.785153] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.790692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45725. [D 20:43:23.790719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45726. [D 20:43:23.790734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45727. [D 20:43:23.790749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45728. [D 20:43:23.790763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45729. [D 20:43:23.790788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45730. [D 20:43:23.790803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45731. [D 20:43:23.790826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45732. [D 20:43:23.790841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45733. [D 20:43:23.790864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45734. [D 20:43:23.790878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45735. [D 20:43:23.790906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45736. [D 20:43:23.790930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45737. [D 20:43:23.790945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45738. [D 20:43:23.790968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45739. [D 20:43:23.790982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45740. [D 20:43:23.790997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45741. [D 20:43:23.791012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45742. [D 20:43:23.791035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45743. [D 20:43:23.791049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45744. [D 20:43:23.791065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45745. [D 20:43:23.791080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45746. [D 20:43:23.791095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45747. [D 20:43:23.791122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45748. [D 20:43:23.791146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45749. [D 20:43:23.791160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45750. [D 20:43:23.791187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45751. [D 20:43:23.791202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45752. [D 20:43:23.791217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45753. [D 20:43:23.791231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45754. [D 20:43:23.791246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45755. [D 20:43:23.791264] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45756. [D 20:43:23.800141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.800163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.800176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.800198] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6883 [D 20:43:23.800212] element 0: offset: 0x62fd10, size: 24 [D 20:43:23.800229] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 22/70. [D 20:43:23.800263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.800277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.800290] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.800309] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6885 [D 20:43:23.800323] element 0: offset: 0x66e390, size: 24 [D 20:43:23.800337] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 23/70. [D 20:43:23.802530] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45756. [D 20:43:23.802557] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 24/70. [D 20:43:23.802675] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.802695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.802707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.808691] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6883 [D 20:43:23.808761] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 25/70. [D 20:43:23.808842] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6885 [D 20:43:23.808859] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 26/70. [D 20:43:23.808938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45756. [D 20:43:23.808972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45757. [D 20:43:23.809002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45758. [D 20:43:23.809026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45759. [D 20:43:23.809041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45760. [D 20:43:23.809065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45761. [D 20:43:23.809080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45762. [D 20:43:23.809108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45763. [D 20:43:23.809131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45764. [D 20:43:23.809146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45765. [D 20:43:23.809169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45766. [D 20:43:23.809184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45767. [D 20:43:23.809199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45768. [D 20:43:23.809238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45769. [D 20:43:23.809254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45770. [D 20:43:23.809277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45771. [D 20:43:23.809292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45772. [D 20:43:23.809320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45773. [D 20:43:23.809344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45774. [D 20:43:23.809372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45775. [D 20:43:23.809387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45776. [D 20:43:23.809402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45777. [D 20:43:23.809417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45778. [D 20:43:23.809431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45779. [D 20:43:23.809446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45780. [D 20:43:23.809460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45781. [D 20:43:23.809475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45782. [D 20:43:23.809489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45783. [D 20:43:23.809504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45784. [D 20:43:23.809518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45785. [D 20:43:23.809533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45786. [D 20:43:23.809547] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45787. [D 20:43:23.809565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45788. [D 20:43:23.809580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45789. [D 20:43:23.809596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 45790. [D 20:43:23.809611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 45791. [D 20:43:23.809625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 45792. [D 20:43:23.809640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 45793. [D 20:43:23.809654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 45794. [D 20:43:23.809669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45795. [D 20:43:23.809683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45796. [D 20:43:23.809697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45797. [D 20:43:23.809712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 45798. [D 20:43:23.809727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 45799. [D 20:43:23.809741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 45800. [D 20:43:23.809756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 45801. [D 20:43:23.809770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 45802. [D 20:43:23.809784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45803. [D 20:43:23.809799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45804. [D 20:43:23.809813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45805. [D 20:43:23.809828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45806. [D 20:43:23.809842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45807. [D 20:43:23.809857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45808. [D 20:43:23.809871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45809. [D 20:43:23.809886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45810. [D 20:43:23.809900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45811. [D 20:43:23.809915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45812. [D 20:43:23.809929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45813. [D 20:43:23.809944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45814. [D 20:43:23.809958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45815. [D 20:43:23.809973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45816. [D 20:43:23.809987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45817. [D 20:43:23.810002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45818. [D 20:43:23.810017] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45819. [D 20:43:23.811150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.811170] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.811183] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:23.811224] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6888 [D 20:43:23.811238] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.811255] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 27/70. [D 20:43:23.820690] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45819. [D 20:43:23.820718] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 28/70. [D 20:43:23.829327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.829347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.829359] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:23.829381] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6892 [D 20:43:23.829394] element 0: offset: 0x63c690, size: 24 [D 20:43:23.829409] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 29/70. [D 20:43:23.831787] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 45818. [D 20:43:23.831812] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 30/70. [D 20:43:23.831873] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.831892] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.831904] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:23.832010] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.832025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.832037] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:23.836186] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6888 [D 20:43:23.836260] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 31/70. [D 20:43:23.837459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 45818. [D 20:43:23.837484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 45819. [D 20:43:23.837500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45820. [D 20:43:23.837514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45821. [D 20:43:23.837529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45822. [D 20:43:23.837544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45823. [D 20:43:23.837559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45824. [D 20:43:23.837573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45825. [D 20:43:23.837588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45826. [D 20:43:23.837602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45827. [D 20:43:23.837618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45828. [D 20:43:23.837632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45829. [D 20:43:23.837647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45830. [D 20:43:23.837661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45831. [D 20:43:23.837677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45832. [D 20:43:23.837692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45833. [D 20:43:23.837707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45834. [D 20:43:23.837722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45835. [D 20:43:23.837736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45836. [D 20:43:23.837751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45837. [D 20:43:23.837766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45838. [D 20:43:23.837781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45839. [D 20:43:23.837795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45840. [D 20:43:23.837810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45841. [D 20:43:23.837825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45842. [D 20:43:23.837840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45843. [D 20:43:23.837854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45844. [D 20:43:23.837869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 45845. [D 20:43:23.837883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 45846. [D 20:43:23.837898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 45847. [D 20:43:23.837913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 45848. [D 20:43:23.837928] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 45849. [D 20:43:23.838054] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6892 [D 20:43:23.838113] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 32/70. [D 20:43:23.843447] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45849. [D 20:43:23.843474] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 33/70. [D 20:43:23.843557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.843580] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.843593] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.844136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45849. [D 20:43:23.844157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45850. [D 20:43:23.844172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45851. [D 20:43:23.844186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45852. [D 20:43:23.844201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45853. [D 20:43:23.844216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45854. [D 20:43:23.844230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45855. [D 20:43:23.844246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45856. [D 20:43:23.844271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45857. [D 20:43:23.844286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45858. [D 20:43:23.844313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45859. [D 20:43:23.844329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45860. [D 20:43:23.844352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45861. [D 20:43:23.844367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45862. [D 20:43:23.844393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45863. [D 20:43:23.844408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45864. [D 20:43:23.844423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45865. [D 20:43:23.844437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45866. [D 20:43:23.844452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45867. [D 20:43:23.844467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45868. [D 20:43:23.844499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45869. [D 20:43:23.844525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45870. [D 20:43:23.844550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45871. [D 20:43:23.844565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45872. [D 20:43:23.844580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45873. [D 20:43:23.844602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45874. [D 20:43:23.844617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45875. [D 20:43:23.844652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45876. [D 20:43:23.844668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45877. [D 20:43:23.844682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45878. [D 20:43:23.844705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45879. [D 20:43:23.844719] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45880. [D 20:43:23.846931] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:23.846950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.846963] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:23.847001] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6894 [D 20:43:23.847016] element 0: offset: 0x658610, size: 24 [D 20:43:23.847034] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 34/70. [D 20:43:23.855834] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 45880. [D 20:43:23.855861] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 35/70. [D 20:43:23.855966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:23.855987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:23.855999] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:23.859069] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6894 [D 20:43:23.859148] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 36/70. [D 20:43:23.859290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 45880. [D 20:43:23.859312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 45881. [D 20:43:23.859326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 45882. [D 20:43:23.859341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 45883. [D 20:43:23.859356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 45884. [D 20:43:23.859371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 45885. [D 20:43:23.859385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 45886. [D 20:43:23.859400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 45887. [D 20:43:23.859414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 45888. [D 20:43:23.859429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 45889. [D 20:43:23.859444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 45890. [D 20:43:23.859459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 45891. [D 20:43:23.859473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 45892. [D 20:43:23.859488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 45893. [D 20:43:23.859502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 45894. [D 20:43:23.859517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 45895. [D 20:43:23.859532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 45896. [D 20:43:23.859546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 45897. [D 20:43:23.859561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 45898. [D 20:43:23.859576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 45899. [D 20:43:23.859590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 45900. [D 20:43:23.859605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 45901. [D 20:43:23.859620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 45902. [D 20:43:23.859634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 45903. [D 20:43:23.859649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 45904. [D 20:43:23.859663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 45905. [D 20:43:24.136212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 45906. [D 20:43:24.136536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 45907. [D 20:43:24.136554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 45908. [D 20:43:24.136569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 45909. [D 20:43:24.136584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 45910. [D 20:43:24.136598] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 45911. [D 20:43:24.137689] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45911. [D 20:43:24.137712] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 37/70. [D 20:43:24.137731] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.142791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.142809] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:24.142854] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6899 [D 20:43:24.142870] element 0: offset: 0x61fa30, size: 24 [D 20:43:24.142886] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 38/70. [D 20:43:24.142927] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.142942] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.142955] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.142977] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6900 [D 20:43:24.142992] element 0: offset: 0x66e640, size: 24 [D 20:43:24.143006] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 39/70. [D 20:43:24.143030] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.143044] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.143057] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.143079] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6903 [D 20:43:24.143093] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.143108] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 40/70. [D 20:43:24.143143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.143158] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.143171] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.146878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.146953] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.146968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.147013] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6906 [D 20:43:24.147028] element 0: offset: 0x62fd10, size: 24 [D 20:43:24.147048] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 41/70. [D 20:43:24.156457] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6899 [D 20:43:24.156538] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 42/70. [D 20:43:24.156701] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6903 [D 20:43:24.156720] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 43/70. [D 20:43:24.156780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45911. [D 20:43:24.156788] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6900 [D 20:43:24.156814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 45912. [D 20:43:24.156882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 45913. [D 20:43:24.156896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 45914. [D 20:43:24.156912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 45915. [D 20:43:24.156927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 45916. [D 20:43:24.156941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45917. [D 20:43:24.156956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45918. [D 20:43:24.156971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45919. [D 20:43:24.156986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 45920. [D 20:43:24.157000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 45921. [D 20:43:24.157015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 45922. [D 20:43:24.157030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 45923. [D 20:43:24.157045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 45924. [D 20:43:24.157059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45925. [D 20:43:24.157074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45926. [D 20:43:24.157089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45927. [D 20:43:24.157104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45928. [D 20:43:24.157118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45929. [D 20:43:24.157133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45930. [D 20:43:24.157148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45931. [D 20:43:24.157163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45932. [D 20:43:24.157177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45933. [D 20:43:24.157192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45934. [D 20:43:24.157207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45935. [D 20:43:24.157221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45936. [D 20:43:24.157236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45937. [D 20:43:24.157251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45938. [D 20:43:24.157266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45939. [D 20:43:24.157280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45940. [D 20:43:24.157295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45941. [D 20:43:24.157310] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45942. [D 20:43:24.157328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45943. [D 20:43:24.157344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45944. [D 20:43:24.157391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45945. [D 20:43:24.157407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45946. [D 20:43:24.157421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45947. [D 20:43:24.157436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45948. [D 20:43:24.157450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45949. [D 20:43:24.157464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45950. [D 20:43:24.157483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45951. [D 20:43:24.157498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45952. [D 20:43:24.157512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45953. [D 20:43:24.157527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45954. [D 20:43:24.157541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45955. [D 20:43:24.157556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45956. [D 20:43:24.157570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45957. [D 20:43:24.157584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45958. [D 20:43:24.157599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45959. [D 20:43:24.157613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45960. [D 20:43:24.157628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45961. [D 20:43:24.157642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45962. [D 20:43:24.157657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45963. [D 20:43:24.157671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45964. [D 20:43:24.157686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45965. [D 20:43:24.157700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45966. [D 20:43:24.157714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45967. [D 20:43:24.157729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45968. [D 20:43:24.157744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45969. [D 20:43:24.157758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45970. [D 20:43:24.157772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45971. [D 20:43:24.157787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45972. [D 20:43:24.157802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45973. [D 20:43:24.157816] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45974. [D 20:43:24.157844] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 44/70. [D 20:43:24.157875] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6906 [D 20:43:24.157893] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 45/70. [D 20:43:24.163252] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 45974. [D 20:43:24.163280] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 46/70. [D 20:43:24.169070] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 45973. [D 20:43:24.169092] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 47/70. [D 20:43:24.169110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 45973. [D 20:43:24.169125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 45974. [D 20:43:24.169145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 45975. [D 20:43:24.169160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 45976. [D 20:43:24.169174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 45977. [D 20:43:24.169189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 45978. [D 20:43:24.169204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 45979. [D 20:43:24.169218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 45980. [D 20:43:24.169233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 45981. [D 20:43:24.169247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 45982. [D 20:43:24.169261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 45983. [D 20:43:24.169276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 45984. [D 20:43:24.169291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 45985. [D 20:43:24.169305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 45986. [D 20:43:24.169320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 45987. [D 20:43:24.169334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 45988. [D 20:43:24.169349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 45989. [D 20:43:24.169363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 45990. [D 20:43:24.169378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 45991. [D 20:43:24.169392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 45992. [D 20:43:24.169407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 45993. [D 20:43:24.169421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 45994. [D 20:43:24.169436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 45995. [D 20:43:24.169450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 45996. [D 20:43:24.169465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 45997. [D 20:43:24.169479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 45998. [D 20:43:24.169494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 45999. [D 20:43:24.169508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46000. [D 20:43:24.169522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46001. [D 20:43:24.169537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46002. [D 20:43:24.169551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46003. [D 20:43:24.169566] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46004. [D 20:43:24.169582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46005. [D 20:43:24.169597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46006. [D 20:43:24.169611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 46007. [D 20:43:24.169626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 46008. [D 20:43:24.169640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 46009. [D 20:43:24.169655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 46010. [D 20:43:24.169669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 46011. [D 20:43:24.169683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46012. [D 20:43:24.169698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46013. [D 20:43:24.169712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46014. [D 20:43:24.169727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 46015. [D 20:43:24.169741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 46016. [D 20:43:24.169755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 46017. [D 20:43:24.169770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 46018. [D 20:43:24.169784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 46019. [D 20:43:24.169798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46020. [D 20:43:24.169813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46021. [D 20:43:24.169827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46022. [D 20:43:24.169842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 46023. [D 20:43:24.169856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 46024. [D 20:43:24.169872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 46025. [D 20:43:24.169886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 46026. [D 20:43:24.169900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 46027. [D 20:43:24.169915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46028. [D 20:43:24.169929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46029. [D 20:43:24.169943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46030. [D 20:43:24.169958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 46031. [D 20:43:24.169972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 46032. [D 20:43:24.169986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 46033. [D 20:43:24.170001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 46034. [D 20:43:24.170015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 46035. [D 20:43:24.170030] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab619ea0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46036. [D 20:43:24.170104] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.170127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.170140] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.170166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.170179] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.170191] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.175033] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 46036. [D 20:43:24.175057] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 48/70. [D 20:43:24.180896] openib_check_cq: completed rdma wr_id 2aaaab619ea0, nic_wr_credit 46035. [D 20:43:24.180917] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 49/70. [D 20:43:24.180968] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.180991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.181003] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:24.181031] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.181044] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.181057] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:24.186641] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.186658] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.186670] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:24.186708] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6911 [D 20:43:24.186723] element 0: offset: 0x644640, size: 24 [D 20:43:24.186742] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 50/70. [D 20:43:24.186783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.186797] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.186810] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:24.186830] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6912 [D 20:43:24.186844] element 0: offset: 0x63c690, size: 24 [D 20:43:24.186863] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 51/70. [D 20:43:24.192194] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6911 [D 20:43:24.192222] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 52/70. [D 20:43:24.192792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46035. [D 20:43:24.192810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 46036. [D 20:43:24.192825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 46037. [D 20:43:24.192855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 46038. [D 20:43:24.192870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 46039. [D 20:43:24.192885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 46040. [D 20:43:24.192899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46041. [D 20:43:24.192914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46042. [D 20:43:24.192932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46043. [D 20:43:24.192947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 46044. [D 20:43:24.192961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 46045. [D 20:43:24.192976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 46046. [D 20:43:24.192991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 46047. [D 20:43:24.193006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 46048. [D 20:43:24.193020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46049. [D 20:43:24.193035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46050. [D 20:43:24.193049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46051. [D 20:43:24.193064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46052. [D 20:43:24.193078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46053. [D 20:43:24.193092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46054. [D 20:43:24.193107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46055. [D 20:43:24.193121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46056. [D 20:43:24.193136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46057. [D 20:43:24.193150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46058. [D 20:43:24.193164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46059. [D 20:43:24.193179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46060. [D 20:43:24.193193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46061. [D 20:43:24.193208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46062. [D 20:43:24.193222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46063. [D 20:43:24.193237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46064. [D 20:43:24.193252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46065. [D 20:43:24.193266] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46066. [D 20:43:24.195190] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.195258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.195271] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.195314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6915 [D 20:43:24.195330] element 0: offset: 0x62fd10, size: 24 [D 20:43:24.195350] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 53/70. [D 20:43:24.195424] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6912 [D 20:43:24.195452] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 54/70. [D 20:43:24.203797] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 46066. [D 20:43:24.203819] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 55/70. [D 20:43:24.203843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46066. [D 20:43:24.203859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46067. [D 20:43:24.203874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46068. [D 20:43:24.203888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46069. [D 20:43:24.203903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46070. [D 20:43:24.203918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46071. [D 20:43:24.203932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46072. [D 20:43:24.203947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46073. [D 20:43:24.203961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46074. [D 20:43:24.203976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46075. [D 20:43:24.203991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46076. [D 20:43:24.204005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46077. [D 20:43:24.204020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46078. [D 20:43:24.204034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46079. [D 20:43:24.204049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46080. [D 20:43:24.204063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46081. [D 20:43:24.204078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46082. [D 20:43:24.204092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46083. [D 20:43:24.204107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46084. [D 20:43:24.204127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46085. [D 20:43:24.204144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46086. [D 20:43:24.204158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46087. [D 20:43:24.204173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46088. [D 20:43:24.204188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46089. [D 20:43:24.204202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46090. [D 20:43:24.204217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46091. [D 20:43:24.204232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46092. [D 20:43:24.204246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46093. [D 20:43:24.204261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46094. [D 20:43:24.204276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46095. [D 20:43:24.204291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46096. [D 20:43:24.204305] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46097. [D 20:43:24.204369] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.204391] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.204404] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.207899] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6915 [D 20:43:24.207925] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 56/70. [D 20:43:24.213278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.213335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.213348] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.213392] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6919 [D 20:43:24.213407] element 0: offset: 0x644210, size: 24 [D 20:43:24.213427] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 57/70. [D 20:43:24.215532] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 46097. [D 20:43:24.215564] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 58/70. [D 20:43:24.215581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46097. [D 20:43:24.215605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46098. [D 20:43:24.215628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46099. [D 20:43:24.215643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46100. [D 20:43:24.215657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46101. [D 20:43:24.215672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46102. [D 20:43:24.215686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46103. [D 20:43:24.215700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46104. [D 20:43:24.215715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46105. [D 20:43:24.215730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46106. [D 20:43:24.215745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46107. [D 20:43:24.215759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46108. [D 20:43:24.215774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46109. [D 20:43:24.215792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46110. [D 20:43:24.215806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46111. [D 20:43:24.215821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46112. [D 20:43:24.215835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46113. [D 20:43:24.215849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46114. [D 20:43:24.215864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46115. [D 20:43:24.215878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46116. [D 20:43:24.215893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46117. [D 20:43:24.215907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46118. [D 20:43:24.215922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46119. [D 20:43:24.215936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46120. [D 20:43:24.215950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46121. [D 20:43:24.215965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46122. [D 20:43:24.215979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46123. [D 20:43:24.215994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46124. [D 20:43:24.216008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46125. [D 20:43:24.216023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46126. [D 20:43:24.216037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46127. [D 20:43:24.216051] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46128. [D 20:43:24.216103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.216128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.216140] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.219242] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6919 [D 20:43:24.219312] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 59/70. [D 20:43:24.225538] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.225558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.225570] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.225611] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6921 [D 20:43:24.225625] element 0: offset: 0x66e390, size: 24 [D 20:43:24.225644] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 60/70. [D 20:43:24.227377] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 46128. [D 20:43:24.227402] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 0/70. [D 20:43:24.227436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46128. [D 20:43:24.227452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 46129. [D 20:43:24.227467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 46130. [D 20:43:24.227482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 46131. [D 20:43:24.227497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 46132. [D 20:43:24.227511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 46133. [D 20:43:24.227526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46134. [D 20:43:24.227540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46135. [D 20:43:24.227555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46136. [D 20:43:24.227570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 46137. [D 20:43:24.227585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 46138. [D 20:43:24.227599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 46139. [D 20:43:24.227614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 46140. [D 20:43:24.227628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 46141. [D 20:43:24.227643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46142. [D 20:43:24.227658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46143. [D 20:43:24.227673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46144. [D 20:43:24.227687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 46145. [D 20:43:24.227702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 46146. [D 20:43:24.227716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 46147. [D 20:43:24.227731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 46148. [D 20:43:24.227746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 46149. [D 20:43:24.227761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46150. [D 20:43:24.227775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46151. [D 20:43:24.227793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46152. [D 20:43:24.227808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 46153. [D 20:43:24.227822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 46154. [D 20:43:24.227837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 46155. [D 20:43:24.227853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 46156. [D 20:43:24.227868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 46157. [D 20:43:24.227883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46158. [D 20:43:24.227898] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46159. [D 20:43:24.227953] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.227979] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.227991] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.230600] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6921 [D 20:43:24.230657] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 1/70. [D 20:43:24.237135] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.237155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.237168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.237208] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6924 [D 20:43:24.237224] element 0: offset: 0x658610, size: 24 [D 20:43:24.237241] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 2/70. [D 20:43:24.239087] openib_check_cq: completed rdma wr_id 2aaaab60c8e0, nic_wr_credit 46159. [D 20:43:24.239112] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 3/70. [D 20:43:24.239141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46159. [D 20:43:24.239157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46160. [D 20:43:24.239172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46161. [D 20:43:24.239187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46162. [D 20:43:24.239202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46163. [D 20:43:24.239217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46164. [D 20:43:24.239232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46165. [D 20:43:24.239246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46166. [D 20:43:24.239261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46167. [D 20:43:24.239276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46168. [D 20:43:24.239291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46169. [D 20:43:24.239305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46170. [D 20:43:24.239320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46171. [D 20:43:24.239335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46172. [D 20:43:24.239350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46173. [D 20:43:24.239364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46174. [D 20:43:24.239379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46175. [D 20:43:24.239395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46176. [D 20:43:24.239410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46177. [D 20:43:24.239424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46178. [D 20:43:24.239439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46179. [D 20:43:24.239454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46180. [D 20:43:24.239469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46181. [D 20:43:24.239483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46182. [D 20:43:24.239498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46183. [D 20:43:24.239513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46184. [D 20:43:24.239527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46185. [D 20:43:24.239542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46186. [D 20:43:24.239567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46187. [D 20:43:24.239590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46188. [D 20:43:24.239613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46189. [D 20:43:24.239628] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46190. [D 20:43:24.239695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.239723] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.239736] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.242478] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6924 [D 20:43:24.242557] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 4/70. [D 20:43:24.248825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.248843] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.248856] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.248899] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6928 [D 20:43:24.248914] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.248930] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 5/70. [D 20:43:24.250824] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 46190. [D 20:43:24.250849] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 6/70. [D 20:43:24.250879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46190. [D 20:43:24.250895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46191. [D 20:43:24.250910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46192. [D 20:43:24.250924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46193. [D 20:43:24.250939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46194. [D 20:43:24.250954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46195. [D 20:43:24.250970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46196. [D 20:43:24.250985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46197. [D 20:43:24.251000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46198. [D 20:43:24.251014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46199. [D 20:43:24.251029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46200. [D 20:43:24.251044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46201. [D 20:43:24.251059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46202. [D 20:43:24.251073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46203. [D 20:43:24.251088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46204. [D 20:43:24.251103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46205. [D 20:43:24.251118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46206. [D 20:43:24.251132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46207. [D 20:43:24.251147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46208. [D 20:43:24.251162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46209. [D 20:43:24.251187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46210. [D 20:43:24.251210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46211. [D 20:43:24.251225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46212. [D 20:43:24.251249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46213. [D 20:43:24.251263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46214. [D 20:43:24.251278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46215. [D 20:43:24.251293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46216. [D 20:43:24.251307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46217. [D 20:43:24.251322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46218. [D 20:43:24.251337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46219. [D 20:43:24.251352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46220. [D 20:43:24.251366] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46221. [D 20:43:24.251425] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.251450] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.251463] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.254078] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6928 [D 20:43:24.254137] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 7/70. [D 20:43:24.261009] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.261029] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.261042] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.261082] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6930 [D 20:43:24.261098] element 0: offset: 0x62fd10, size: 24 [D 20:43:24.261115] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 8/70. [D 20:43:24.262637] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 46221. [D 20:43:24.262662] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 9/70. [D 20:43:24.262692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46221. [D 20:43:24.262708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 46222. [D 20:43:24.262723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 46223. [D 20:43:24.262738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 46224. [D 20:43:24.262753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 46225. [D 20:43:24.262767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 46226. [D 20:43:24.262782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46227. [D 20:43:24.262797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46228. [D 20:43:24.262812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46229. [D 20:43:24.262826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 46230. [D 20:43:24.262841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 46231. [D 20:43:24.262856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 46232. [D 20:43:24.262871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 46233. [D 20:43:24.262885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 46234. [D 20:43:24.262900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46235. [D 20:43:24.262915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46236. [D 20:43:24.262929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46237. [D 20:43:24.262944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 46238. [D 20:43:24.262959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 46239. [D 20:43:24.262973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 46240. [D 20:43:24.262988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 46241. [D 20:43:24.263003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 46242. [D 20:43:24.263018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46243. [D 20:43:24.263032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46244. [D 20:43:24.263047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46245. [D 20:43:24.263073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 46246. [D 20:43:24.263088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 46247. [D 20:43:24.263112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 46248. [D 20:43:24.263135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 46249. [D 20:43:24.263150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 46250. [D 20:43:24.263174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46251. [D 20:43:24.263188] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46252. [D 20:43:24.263249] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.263277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.263290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.265917] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6930 [D 20:43:24.265980] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 10/70. [D 20:43:24.272361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.272381] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.272393] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.272434] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6933 [D 20:43:24.272449] element 0: offset: 0x644210, size: 24 [D 20:43:24.272465] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 11/70. [D 20:43:24.274366] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 46252. [D 20:43:24.274391] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 12/70. [D 20:43:24.274421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46252. [D 20:43:24.274437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46253. [D 20:43:24.274452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46254. [D 20:43:24.274467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46255. [D 20:43:24.274481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46256. [D 20:43:24.274496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46257. [D 20:43:24.274511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46258. [D 20:43:24.274526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46259. [D 20:43:24.274540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46260. [D 20:43:24.274555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46261. [D 20:43:24.274569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46262. [D 20:43:24.274584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46263. [D 20:43:24.274599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46264. [D 20:43:24.274613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46265. [D 20:43:24.274629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46266. [D 20:43:24.274644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46267. [D 20:43:24.274659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46268. [D 20:43:24.274673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46269. [D 20:43:24.274688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46270. [D 20:43:24.274703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46271. [D 20:43:24.274717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46272. [D 20:43:24.274732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46273. [D 20:43:24.274747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46274. [D 20:43:24.274762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46275. [D 20:43:24.274790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46276. [D 20:43:24.274814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46277. [D 20:43:24.274830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46278. [D 20:43:24.274853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46279. [D 20:43:24.274868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46280. [D 20:43:24.274883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46281. [D 20:43:24.274897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46282. [D 20:43:24.274912] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46283. [D 20:43:24.274969] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.274992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.275004] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.277582] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6933 [D 20:43:24.277643] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 13/70. [D 20:43:24.283942] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.283962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.283975] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.284015] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6937 [D 20:43:24.284030] element 0: offset: 0x63c690, size: 24 [D 20:43:24.284046] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 14/70. [D 20:43:24.286106] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 46283. [D 20:43:24.286131] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 15/70. [D 20:43:24.286161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46283. [D 20:43:24.286176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46284. [D 20:43:24.286192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46285. [D 20:43:24.286207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46286. [D 20:43:24.286222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46287. [D 20:43:24.286237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46288. [D 20:43:24.286251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46289. [D 20:43:24.286266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46290. [D 20:43:24.286281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46291. [D 20:43:24.286306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46292. [D 20:43:24.286330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46293. [D 20:43:24.286353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46294. [D 20:43:24.286368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46295. [D 20:43:24.286391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46296. [D 20:43:24.286406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46297. [D 20:43:24.286421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46298. [D 20:43:24.286435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46299. [D 20:43:24.286450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46300. [D 20:43:24.286465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46301. [D 20:43:24.286480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46302. [D 20:43:24.286495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46303. [D 20:43:24.286509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46304. [D 20:43:24.286524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46305. [D 20:43:24.286539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46306. [D 20:43:24.286553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46307. [D 20:43:24.286568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46308. [D 20:43:24.286583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46309. [D 20:43:24.286597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46310. [D 20:43:24.286612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46311. [D 20:43:24.286627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46312. [D 20:43:24.286641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46313. [D 20:43:24.286656] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46314. [D 20:43:24.286713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.286739] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.286751] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.289461] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6937 [D 20:43:24.289530] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 16/70. [D 20:43:24.296283] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.296303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.296316] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.296357] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6939 [D 20:43:24.296372] element 0: offset: 0x658610, size: 24 [D 20:43:24.296388] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 17/70. [D 20:43:24.297915] openib_check_cq: completed rdma wr_id 2aaaab6151c0, nic_wr_credit 46314. [D 20:43:24.297940] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 18/70. [D 20:43:24.297974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46314. [D 20:43:24.297990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 46315. [D 20:43:24.298005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 46316. [D 20:43:24.298020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 46317. [D 20:43:24.298034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 46318. [D 20:43:24.298049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 46319. [D 20:43:24.298063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46320. [D 20:43:24.298078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46321. [D 20:43:24.298093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46322. [D 20:43:24.298108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 46323. [D 20:43:24.298122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 46324. [D 20:43:24.298137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 46325. [D 20:43:24.298151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 46326. [D 20:43:24.298166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 46327. [D 20:43:24.298181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46328. [D 20:43:24.298196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46329. [D 20:43:24.298210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46330. [D 20:43:24.298225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 46331. [D 20:43:24.298239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 46332. [D 20:43:24.298254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 46333. [D 20:43:24.298269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 46334. [D 20:43:24.301092] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6939 [D 20:43:24.564493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 46335. [D 20:43:24.564516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46336. [D 20:43:24.564530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46337. [D 20:43:24.564544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46338. [D 20:43:24.564558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 46339. [D 20:43:24.564573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 46340. [D 20:43:24.564587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 46341. [D 20:43:24.564601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 46342. [D 20:43:24.564615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 46343. [D 20:43:24.564629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46344. [D 20:43:24.564643] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46345. [D 20:43:24.564682] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 19/70. [D 20:43:24.566689] openib_check_cq: completed rdma wr_id 2aaaab60c8e0, nic_wr_credit 46345. [D 20:43:24.566710] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 20/70. [D 20:43:24.566769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46345. [D 20:43:24.566784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46346. [D 20:43:24.566798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46347. [D 20:43:24.566813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46348. [D 20:43:24.566826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46349. [D 20:43:24.566840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46350. [D 20:43:24.566854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46351. [D 20:43:24.566868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46352. [D 20:43:24.566882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46353. [D 20:43:24.566896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46354. [D 20:43:24.566910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46355. [D 20:43:24.566924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46356. [D 20:43:24.566938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46357. [D 20:43:24.566952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46358. [D 20:43:24.566966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46359. [D 20:43:24.566982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46360. [D 20:43:24.566996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46361. [D 20:43:24.567009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46362. [D 20:43:24.567024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46363. [D 20:43:24.567038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46364. [D 20:43:24.567052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46365. [D 20:43:24.567069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46366. [D 20:43:24.567084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46367. [D 20:43:24.567097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46368. [D 20:43:24.567116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46369. [D 20:43:24.567130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46370. [D 20:43:24.567144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46371. [D 20:43:24.567161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46372. [D 20:43:24.567175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46373. [D 20:43:24.567189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46374. [D 20:43:24.567207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46375. [D 20:43:24.567222] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46376. [D 20:43:24.570550] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.570569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.570582] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.570624] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6942 [D 20:43:24.570639] element 0: offset: 0x636ca0, size: 24 [D 20:43:24.570655] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 21/70. [D 20:43:24.570701] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.570715] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.570728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.570751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.570765] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.570777] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.570796] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6945 [D 20:43:24.570810] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.570824] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 22/70. [D 20:43:24.570846] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.570860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.570872] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.572729] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 46376. [D 20:43:24.572749] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 23/70. [D 20:43:24.575828] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.575845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.575858] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.583389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.583423] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.583439] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.583481] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6949 [D 20:43:24.583497] element 0: offset: 0x66e390, size: 24 [D 20:43:24.583516] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 24/70. [D 20:43:24.583551] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.583567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.583580] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.583603] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6951 [D 20:43:24.583618] element 0: offset: 0x62fd10, size: 24 [D 20:43:24.583633] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 25/70. [D 20:43:24.587019] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6942 [D 20:43:24.587112] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 26/70. [D 20:43:24.587198] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6945 [D 20:43:24.587215] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 27/70. [D 20:43:24.588197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46376. [D 20:43:24.588290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46377. [D 20:43:24.588306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46378. [D 20:43:24.588321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46379. [D 20:43:24.588336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46380. [D 20:43:24.588350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46381. [D 20:43:24.588365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46382. [D 20:43:24.588380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46383. [D 20:43:24.588394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46384. [D 20:43:24.588409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46385. [D 20:43:24.588424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46386. [D 20:43:24.588438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46387. [D 20:43:24.588453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46388. [D 20:43:24.588467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46389. [D 20:43:24.588482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46390. [D 20:43:24.588496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46391. [D 20:43:24.588511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46392. [D 20:43:24.588525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46393. [D 20:43:24.588540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46394. [D 20:43:24.588555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46395. [D 20:43:24.588570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46396. [D 20:43:24.588585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46397. [D 20:43:24.588599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46398. [D 20:43:24.588614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46399. [D 20:43:24.588629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46400. [D 20:43:24.588644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46401. [D 20:43:24.588658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46402. [D 20:43:24.588673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46403. [D 20:43:24.588688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46404. [D 20:43:24.588702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46405. [D 20:43:24.588717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46406. [D 20:43:24.588732] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46407. [D 20:43:24.588751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46408. [D 20:43:24.588766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46409. [D 20:43:24.588780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46410. [D 20:43:24.588795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46411. [D 20:43:24.588810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46412. [D 20:43:24.588824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46413. [D 20:43:24.588839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46414. [D 20:43:24.588854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46415. [D 20:43:24.588868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46416. [D 20:43:24.588883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46417. [D 20:43:24.588898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46418. [D 20:43:24.588913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46419. [D 20:43:24.588927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46420. [D 20:43:24.588942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46421. [D 20:43:24.588956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46422. [D 20:43:24.588971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46423. [D 20:43:24.588987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46424. [D 20:43:24.589002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46425. [D 20:43:24.589017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46426. [D 20:43:24.589031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46427. [D 20:43:24.589046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46428. [D 20:43:24.589061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46429. [D 20:43:24.589075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46430. [D 20:43:24.589090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46431. [D 20:43:24.589104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46432. [D 20:43:24.589119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46433. [D 20:43:24.589134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46434. [D 20:43:24.589148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46435. [D 20:43:24.589163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46436. [D 20:43:24.589177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46437. [D 20:43:24.589192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46438. [D 20:43:24.589206] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46439. [D 20:43:24.596077] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6949 [D 20:43:24.596108] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 28/70. [D 20:43:24.596139] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6951 [D 20:43:24.596154] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 29/70. [D 20:43:24.599995] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 46439. [D 20:43:24.600075] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 30/70. [D 20:43:24.608744] openib_check_cq: completed rdma wr_id 2aaaab60c8e0, nic_wr_credit 46438. [D 20:43:24.608767] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 31/70. [D 20:43:24.608786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46438. [D 20:43:24.608802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 46439. [D 20:43:24.608817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 46440. [D 20:43:24.608831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 46441. [D 20:43:24.608846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 46442. [D 20:43:24.608860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 46443. [D 20:43:24.608875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46444. [D 20:43:24.608889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46445. [D 20:43:24.608905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46446. [D 20:43:24.608919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 46447. [D 20:43:24.608934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 46448. [D 20:43:24.608949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 46449. [D 20:43:24.608963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 46450. [D 20:43:24.608978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 46451. [D 20:43:24.608993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46452. [D 20:43:24.609007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46453. [D 20:43:24.609022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46454. [D 20:43:24.609037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 46455. [D 20:43:24.609051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 46456. [D 20:43:24.609066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 46457. [D 20:43:24.609080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 46458. [D 20:43:24.609095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 46459. [D 20:43:24.609110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46460. [D 20:43:24.609124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46461. [D 20:43:24.609138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46462. [D 20:43:24.609153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 46463. [D 20:43:24.609168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 46464. [D 20:43:24.609182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 46465. [D 20:43:24.609197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 46466. [D 20:43:24.609211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 46467. [D 20:43:24.609226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46468. [D 20:43:24.609240] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dc50 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46469. [D 20:43:24.609258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46470. [D 20:43:24.609273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46471. [D 20:43:24.609288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46472. [D 20:43:24.609302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46473. [D 20:43:24.609317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46474. [D 20:43:24.609333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46475. [D 20:43:24.609348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46476. [D 20:43:24.609363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46477. [D 20:43:24.609377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46478. [D 20:43:24.609392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46479. [D 20:43:24.609407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46480. [D 20:43:24.609421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46481. [D 20:43:24.609436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46482. [D 20:43:24.609451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46483. [D 20:43:24.609465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46484. [D 20:43:24.609480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46485. [D 20:43:24.609495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46486. [D 20:43:24.609509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46487. [D 20:43:24.609524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46488. [D 20:43:24.609538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46489. [D 20:43:24.609553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46490. [D 20:43:24.609568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46491. [D 20:43:24.609582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46492. [D 20:43:24.609597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46493. [D 20:43:24.609611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46494. [D 20:43:24.609626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46495. [D 20:43:24.609640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46496. [D 20:43:24.609655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46497. [D 20:43:24.609670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46498. [D 20:43:24.609684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46499. [D 20:43:24.609699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46500. [D 20:43:24.609714] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab619ea0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46501. [D 20:43:24.612916] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.612934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.612949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.612976] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.612990] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.613004] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.614688] openib_check_cq: completed rdma wr_id 2aaaab60dc50, nic_wr_credit 46501. [D 20:43:24.614706] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 32/70. [D 20:43:24.620562] openib_check_cq: completed rdma wr_id 2aaaab619ea0, nic_wr_credit 46500. [D 20:43:24.620579] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 33/70. [D 20:43:24.623761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.623779] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.623792] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:24.623816] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.623834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.623848] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:24.628143] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.628160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.628173] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:24.628213] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6955 [D 20:43:24.628229] element 0: offset: 0x66e640, size: 24 [D 20:43:24.628246] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 34/70. [D 20:43:24.628272] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.628287] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.628300] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:24.628322] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6957 [D 20:43:24.628349] element 0: offset: 0x644210, size: 24 [D 20:43:24.628373] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 35/70. [D 20:43:24.637574] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.637594] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.637609] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.637634] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6962 [D 20:43:24.637637] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 6955 [D 20:43:24.637740] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 36/70. [D 20:43:24.637791] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6957 [D 20:43:24.637807] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 37/70. [D 20:43:24.637655] element 0: offset: 0x63c690, size: 24 [D 20:43:24.637914] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 38/70. [D 20:43:24.637940] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.637955] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.637969] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.637993] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6963 [D 20:43:24.638008] element 0: offset: 0x658610, size: 24 [D 20:43:24.638023] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 39/70. [D 20:43:24.638060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46500. [D 20:43:24.638078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46501. [D 20:43:24.638093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46502. [D 20:43:24.638107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46503. [D 20:43:24.638123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46504. [D 20:43:24.638137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46505. [D 20:43:24.638153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46506. [D 20:43:24.638167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46507. [D 20:43:24.638182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46508. [D 20:43:24.638196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46509. [D 20:43:24.638211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46510. [D 20:43:24.638226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46511. [D 20:43:24.638240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46512. [D 20:43:24.638255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46513. [D 20:43:24.638269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46514. [D 20:43:24.638284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46515. [D 20:43:24.638299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46516. [D 20:43:24.638313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46517. [D 20:43:24.638328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46518. [D 20:43:24.638342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46519. [D 20:43:24.638357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46520. [D 20:43:24.638371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46521. [D 20:43:24.638386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46522. [D 20:43:24.638401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46523. [D 20:43:24.638415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46524. [D 20:43:24.638430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46525. [D 20:43:24.638444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46526. [D 20:43:24.638459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46527. [D 20:43:24.638474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46528. [D 20:43:24.638488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46529. [D 20:43:24.638503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46530. [D 20:43:24.638518] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614e70 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46531. [D 20:43:24.638534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46532. [D 20:43:24.638549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46533. [D 20:43:24.638564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46534. [D 20:43:24.638580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46535. [D 20:43:24.638594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46536. [D 20:43:24.638609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46537. [D 20:43:24.638624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46538. [D 20:43:24.638638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46539. [D 20:43:24.638653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46540. [D 20:43:24.638668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46541. [D 20:43:24.638682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46542. [D 20:43:24.638697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46543. [D 20:43:24.638712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46544. [D 20:43:24.638726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46545. [D 20:43:24.638741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46546. [D 20:43:24.638756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46547. [D 20:43:24.638770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46548. [D 20:43:24.638785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46549. [D 20:43:24.638800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46550. [D 20:43:24.638814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46551. [D 20:43:24.638829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46552. [D 20:43:24.638844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46553. [D 20:43:24.638858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46554. [D 20:43:24.638873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46555. [D 20:43:24.638887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46556. [D 20:43:24.638902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46557. [D 20:43:24.638917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46558. [D 20:43:24.638931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46559. [D 20:43:24.638946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46560. [D 20:43:24.638961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46561. [D 20:43:24.638975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46562. [D 20:43:24.638990] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46563. [D 20:43:24.646285] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6962 [D 20:43:24.646367] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 40/70. [D 20:43:24.646424] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6963 [D 20:43:24.646441] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 41/70. [D 20:43:24.649831] openib_check_cq: completed rdma wr_id 2aaaab614e70, nic_wr_credit 46563. [D 20:43:24.649858] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 42/70. [D 20:43:24.656407] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 46562. [D 20:43:24.656427] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 43/70. [D 20:43:24.656444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46562. [D 20:43:24.656472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 46563. [D 20:43:24.656487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 46564. [D 20:43:24.656502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 46565. [D 20:43:24.656517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 46566. [D 20:43:24.656544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 46567. [D 20:43:24.656571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46568. [D 20:43:24.656586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46569. [D 20:43:24.656600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46570. [D 20:43:24.656615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 46571. [D 20:43:24.656630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 46572. [D 20:43:24.656644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 46573. [D 20:43:24.656659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 46574. [D 20:43:24.656673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 46575. [D 20:43:24.656688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46576. [D 20:43:24.656703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46577. [D 20:43:24.656717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46578. [D 20:43:24.656732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 46579. [D 20:43:24.656747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 46580. [D 20:43:24.656761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 46581. [D 20:43:24.656776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 46582. [D 20:43:24.656791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 46583. [D 20:43:24.656805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46584. [D 20:43:24.656820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46585. [D 20:43:24.656836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46586. [D 20:43:24.656850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 46587. [D 20:43:24.656865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 46588. [D 20:43:24.656879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 46589. [D 20:43:24.656894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 46590. [D 20:43:24.656908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 46591. [D 20:43:24.656923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46592. [D 20:43:24.656937] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60dc50 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46593. [D 20:43:24.656954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46594. [D 20:43:24.656969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46595. [D 20:43:24.656983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46596. [D 20:43:24.656998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46597. [D 20:43:24.657012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46598. [D 20:43:24.657027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46599. [D 20:43:24.657041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46600. [D 20:43:24.657056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46601. [D 20:43:24.657070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46602. [D 20:43:24.657085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46603. [D 20:43:24.657100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46604. [D 20:43:24.657114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46605. [D 20:43:24.657129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46606. [D 20:43:24.657143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46607. [D 20:43:24.657158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46608. [D 20:43:24.657172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46609. [D 20:43:24.657187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46610. [D 20:43:24.657201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46611. [D 20:43:24.657216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46612. [D 20:43:24.657230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46613. [D 20:43:24.657245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46614. [D 20:43:24.657260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46615. [D 20:43:24.657275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46616. [D 20:43:24.657289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46617. [D 20:43:24.657304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46618. [D 20:43:24.657318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46619. [D 20:43:24.657333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46620. [D 20:43:24.657347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46621. [D 20:43:24.657362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46622. [D 20:43:24.657376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46623. [D 20:43:24.657391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46624. [D 20:43:24.657405] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cad0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46625. [D 20:43:24.657482] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.657505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.657519] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.657544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.657558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.657570] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.662362] openib_check_cq: completed rdma wr_id 2aaaab60dc50, nic_wr_credit 46625. [D 20:43:24.662385] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 44/70. [D 20:43:24.670727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.670750] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.670763] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.670807] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6967 [D 20:43:24.670823] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.670840] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 45/70. [D 20:43:24.670877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.670891] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.670903] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:24.670924] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6969 [D 20:43:24.670938] element 0: offset: 0x61fa30, size: 24 [D 20:43:24.670953] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 46/70. [D 20:43:24.673323] openib_check_cq: completed rdma wr_id 2aaaab60cad0, nic_wr_credit 46624. [D 20:43:24.673348] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 47/70. [D 20:43:24.673401] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.673421] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.673434] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:24.673541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.673556] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.673568] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.679663] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6969 [D 20:43:24.679743] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 48/70. [D 20:43:24.679823] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6967 [D 20:43:24.679857] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 49/70. [D 20:43:24.679887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46624. [D 20:43:24.679909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46625. [D 20:43:24.679924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46626. [D 20:43:24.679939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46627. [D 20:43:24.679954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46628. [D 20:43:24.679968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46629. [D 20:43:24.679983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46630. [D 20:43:24.680010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46631. [D 20:43:24.680033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46632. [D 20:43:24.680048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46633. [D 20:43:24.680064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46634. [D 20:43:24.680078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46635. [D 20:43:24.680093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46636. [D 20:43:24.680113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46637. [D 20:43:24.680140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46638. [D 20:43:24.680156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46639. [D 20:43:24.680171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46640. [D 20:43:24.680186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46641. [D 20:43:24.680201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46642. [D 20:43:24.680215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46643. [D 20:43:24.680230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46644. [D 20:43:24.680244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46645. [D 20:43:24.680259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46646. [D 20:43:24.680274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46647. [D 20:43:24.680288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46648. [D 20:43:24.680303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46649. [D 20:43:24.680318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46650. [D 20:43:24.680333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46651. [D 20:43:24.680347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46652. [D 20:43:24.680363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46653. [D 20:43:24.680378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46654. [D 20:43:24.680392] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cc00 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46655. [D 20:43:24.680410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46656. [D 20:43:24.680425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46657. [D 20:43:24.680439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46658. [D 20:43:24.680454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46659. [D 20:43:24.680468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46660. [D 20:43:24.680483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46661. [D 20:43:24.680498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46662. [D 20:43:24.680512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46663. [D 20:43:24.680527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46664. [D 20:43:24.680542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46665. [D 20:43:24.680557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46666. [D 20:43:24.680571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46667. [D 20:43:24.680586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46668. [D 20:43:24.680601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46669. [D 20:43:24.680615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46670. [D 20:43:24.680630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46671. [D 20:43:24.680644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46672. [D 20:43:24.680659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46673. [D 20:43:24.680674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46674. [D 20:43:24.680688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46675. [D 20:43:24.680703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46676. [D 20:43:24.680717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46677. [D 20:43:24.680732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46678. [D 20:43:24.680747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46679. [D 20:43:24.680762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46680. [D 20:43:24.680776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46681. [D 20:43:24.680791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46682. [D 20:43:24.680806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46683. [D 20:43:24.680821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46684. [D 20:43:24.680835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46685. [D 20:43:24.680850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46686. [D 20:43:24.680865] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609680 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46687. [D 20:43:24.685836] openib_check_cq: completed rdma wr_id 2aaaab60cc00, nic_wr_credit 46687. [D 20:43:24.685858] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 50/70. [D 20:43:24.693888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.693912] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.693925] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.693968] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6972 [D 20:43:24.693983] element 0: offset: 0x66e640, size: 24 [D 20:43:24.694000] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 51/70. [D 20:43:24.697466] openib_check_cq: completed rdma wr_id 2aaaab609680, nic_wr_credit 46686. [D 20:43:24.697492] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 52/70. [D 20:43:24.697556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.697576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.697589] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.697680] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.697695] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.697707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:24.700706] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6972 [D 20:43:24.700764] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 53/70. [D 20:43:24.702920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46686. [D 20:43:24.702945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46687. [D 20:43:24.702960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 46688. [D 20:43:24.702975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 46689. [D 20:43:24.702990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 46690. [D 20:43:24.703004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 46691. [D 20:43:24.703019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 46692. [D 20:43:24.703033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46693. [D 20:43:24.703048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46694. [D 20:43:24.703062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46695. [D 20:43:24.703077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 46696. [D 20:43:24.703092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 46697. [D 20:43:24.703106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 46698. [D 20:43:24.703122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 46699. [D 20:43:24.703137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 46700. [D 20:43:24.703152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46701. [D 20:43:24.703166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46702. [D 20:43:24.703181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46703. [D 20:43:24.703196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46704. [D 20:43:24.703210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46705. [D 20:43:24.703225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46706. [D 20:43:24.703252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46707. [D 20:43:24.703267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46708. [D 20:43:24.703282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46709. [D 20:43:24.703297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46710. [D 20:43:24.703312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46711. [D 20:43:24.703326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46712. [D 20:43:24.703341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46713. [D 20:43:24.703356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46714. [D 20:43:24.703371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46715. [D 20:43:24.703385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46716. [D 20:43:24.703400] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d900 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46717. [D 20:43:24.711185] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.711210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.711223] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:24.711265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6975 [D 20:43:24.711280] element 0: offset: 0x62fd10, size: 24 [D 20:43:24.711296] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 54/70. [D 20:43:24.713712] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:24.713730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.713743] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:24.713767] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6978 [D 20:43:24.713781] element 0: offset: 0x644640, size: 24 [D 20:43:24.713798] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 55/70. [D 20:43:24.714675] openib_check_cq: completed rdma wr_id 2aaaab60d900, nic_wr_credit 46717. [D 20:43:24.714701] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 56/70. [D 20:43:24.714852] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:24.714873] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:24.714886] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:24.720266] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6975 [D 20:43:24.720344] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 57/70. [D 20:43:24.721012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46717. [D 20:43:24.721037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46718. [D 20:43:24.721052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 46719. [D 20:43:24.721067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 46720. [D 20:43:24.721083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 46721. [D 20:43:24.721098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 46722. [D 20:43:24.721113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 46723. [D 20:43:24.721128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46724. [D 20:43:24.721148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46725. [D 20:43:24.721163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46726. [D 20:43:24.721183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 46727. [D 20:43:24.721129] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 6978 [D 20:43:24.721207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 46728. [D 20:43:24.721244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 46729. [D 20:43:24.721259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 46730. [D 20:43:24.721274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 46731. [D 20:43:24.721289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46732. [D 20:43:24.721303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46733. [D 20:43:24.721318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46734. [D 20:43:24.721333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 46735. [D 20:43:24.721347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 46736. [D 20:43:24.721362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 46737. [D 20:43:24.721377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 46738. [D 20:43:24.721392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 46739. [D 20:43:24.721406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46740. [D 20:43:24.721421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46741. [D 20:43:24.721436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46742. [D 20:43:24.721451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 46743. [D 20:43:25.022976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 46744. [D 20:43:25.023050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 46745. [D 20:43:25.023400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 46746. [D 20:43:25.023418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 46747. [D 20:43:25.023432] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609c00 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46748. [D 20:43:25.023819] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.023849] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.023862] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.023907] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6982 [D 20:43:25.023922] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:25.023942] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 58/70. [D 20:43:25.023977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.023991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.024004] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.024024] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6984 [D 20:43:25.024038] element 0: offset: 0x2aaaab60c1b0, size: 24 [D 20:43:25.024052] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 59/70. [D 20:43:25.024087] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 60/70. [D 20:43:25.024141] openib_check_cq: completed rdma wr_id 2aaaab609c00, nic_wr_credit 46748. [D 20:43:25.024166] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 0/70. [D 20:43:25.024259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 46748. [D 20:43:25.024274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 46749. [D 20:43:25.024290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46750. [D 20:43:25.024305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46751. [D 20:43:25.024315] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.024341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.024354] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.024320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46752. [D 20:43:25.024415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46753. [D 20:43:25.024430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46754. [D 20:43:25.024445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46755. [D 20:43:25.024460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46756. [D 20:43:25.024475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46757. [D 20:43:25.024489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46758. [D 20:43:25.024504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46759. [D 20:43:25.024519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46760. [D 20:43:25.024534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46761. [D 20:43:25.024552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46762. [D 20:43:25.024567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46763. [D 20:43:25.024581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46764. [D 20:43:25.024596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46765. [D 20:43:25.024611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46766. [D 20:43:25.024625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46767. [D 20:43:25.024640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46768. [D 20:43:25.024655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46769. [D 20:43:25.024670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46770. [D 20:43:25.024684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46771. [D 20:43:25.024699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46772. [D 20:43:25.024714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46773. [D 20:43:25.024729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46774. [D 20:43:25.024743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46775. [D 20:43:25.024758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46776. [D 20:43:25.024772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46777. [D 20:43:25.024787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46778. [D 20:43:25.024802] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c520 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46779. [D 20:43:25.030190] openib_check_cq: completed rdma wr_id 2aaaab60c520, nic_wr_credit 46779. [D 20:43:25.030215] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 1/70. [D 20:43:25.030710] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6982 [D 20:43:25.030783] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 2/70. [D 20:43:25.030855] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.030867] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6984 [D 20:43:25.030878] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.030889] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 3/70. [D 20:43:25.030896] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.036752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46779. [D 20:43:25.036776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 46780. [D 20:43:25.036791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 46781. [D 20:43:25.036806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 46782. [D 20:43:25.036821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 46783. [D 20:43:25.036835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 46784. [D 20:43:25.036850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46785. [D 20:43:25.036865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46786. [D 20:43:25.036879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46787. [D 20:43:25.036894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 46788. [D 20:43:25.036909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 46789. [D 20:43:25.036923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 46790. [D 20:43:25.036938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 46791. [D 20:43:25.036952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 46792. [D 20:43:25.036967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46793. [D 20:43:25.036982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46794. [D 20:43:25.036996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46795. [D 20:43:25.037011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46796. [D 20:43:25.037026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46797. [D 20:43:25.037040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46798. [D 20:43:25.037055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46799. [D 20:43:25.037070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46800. [D 20:43:25.037084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46801. [D 20:43:25.037099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46802. [D 20:43:25.037113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46803. [D 20:43:25.037128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46804. [D 20:43:25.037142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46805. [D 20:43:25.037157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46806. [D 20:43:25.037171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46807. [D 20:43:25.037186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46808. [D 20:43:25.037201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46809. [D 20:43:25.037227] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609be0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46810. [D 20:43:25.037244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46811. [D 20:43:25.037258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46812. [D 20:43:25.037273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46813. [D 20:43:25.037289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46814. [D 20:43:25.037304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46815. [D 20:43:25.037318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46816. [D 20:43:25.037332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46817. [D 20:43:25.037347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46818. [D 20:43:25.037361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46819. [D 20:43:25.037376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46820. [D 20:43:25.037391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46821. [D 20:43:25.037405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46822. [D 20:43:25.037420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46823. [D 20:43:25.037434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46824. [D 20:43:25.037449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46825. [D 20:43:25.037463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46826. [D 20:43:25.037478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46827. [D 20:43:25.037492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46828. [D 20:43:25.037507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46829. [D 20:43:25.037522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46830. [D 20:43:25.037536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46831. [D 20:43:25.037551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46832. [D 20:43:25.037565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46833. [D 20:43:25.037580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46834. [D 20:43:25.037594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46835. [D 20:43:25.037609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46836. [D 20:43:25.037623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46837. [D 20:43:25.037637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46838. [D 20:43:25.037652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46839. [D 20:43:25.037666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46840. [D 20:43:25.037681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46841. [D 20:43:25.037695] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c520 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46842. [D 20:43:25.040274] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.040293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.040307] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.040354] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6987 [D 20:43:25.040372] element 0: offset: 0x2aaaab6099b0, size: 24 [D 20:43:25.040396] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 4/70. [D 20:43:25.040424] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.040439] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.040453] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.040474] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6990 [D 20:43:25.040490] element 0: offset: 0x2aaaab609a00, size: 24 [D 20:43:25.040505] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 5/70. [D 20:43:25.043609] openib_check_cq: completed rdma wr_id 2aaaab609be0, nic_wr_credit 46842. [D 20:43:25.043631] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 6/70. [D 20:43:25.055102] openib_check_cq: completed rdma wr_id 2aaaab60c520, nic_wr_credit 46841. [D 20:43:25.055125] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 7/70. [D 20:43:25.056232] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.056257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.056271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.056387] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.056403] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.056415] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.062282] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6987 [D 20:43:25.062352] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 8/70. [D 20:43:25.062430] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6990 [D 20:43:25.062448] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 9/70. [D 20:43:25.065175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46841. [D 20:43:25.065202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46842. [D 20:43:25.065217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 46843. [D 20:43:25.065232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 46844. [D 20:43:25.065246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 46845. [D 20:43:25.065261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 46846. [D 20:43:25.065276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 46847. [D 20:43:25.065290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46848. [D 20:43:25.065305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46849. [D 20:43:25.065319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46850. [D 20:43:25.065334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 46851. [D 20:43:25.065348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 46852. [D 20:43:25.065363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 46853. [D 20:43:25.065377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 46854. [D 20:43:25.065392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 46855. [D 20:43:25.065406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46856. [D 20:43:25.065421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46857. [D 20:43:25.065448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46858. [D 20:43:25.065463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 46859. [D 20:43:25.065478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 46860. [D 20:43:25.065493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 46861. [D 20:43:25.065508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 46862. [D 20:43:25.065534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 46863. [D 20:43:25.065549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46864. [D 20:43:25.065564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46865. [D 20:43:25.065578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46866. [D 20:43:25.065593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 46867. [D 20:43:25.065608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 46868. [D 20:43:25.065622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 46869. [D 20:43:25.065637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 46870. [D 20:43:25.065651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 46871. [D 20:43:25.065671] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46872. [D 20:43:25.065688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 46873. [D 20:43:25.065703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 46874. [D 20:43:25.065718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46875. [D 20:43:25.065732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46876. [D 20:43:25.065747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 46877. [D 20:43:25.065761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 46878. [D 20:43:25.065776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 46879. [D 20:43:25.065791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 46880. [D 20:43:25.065806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 46881. [D 20:43:25.065820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 46882. [D 20:43:25.065835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 46883. [D 20:43:25.065851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 46884. [D 20:43:25.065865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 46885. [D 20:43:25.065880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 46886. [D 20:43:25.065894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 46887. [D 20:43:25.065909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 46888. [D 20:43:25.065924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 46889. [D 20:43:25.065938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 46890. [D 20:43:25.065953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 46891. [D 20:43:25.065968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 46892. [D 20:43:25.065982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 46893. [D 20:43:25.065997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 46894. [D 20:43:25.066011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 46895. [D 20:43:25.066026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 46896. [D 20:43:25.066040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 46897. [D 20:43:25.066055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 46898. [D 20:43:25.066069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 46899. [D 20:43:25.066084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 46900. [D 20:43:25.066099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 46901. [D 20:43:25.066113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 46902. [D 20:43:25.066128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 46903. [D 20:43:25.066142] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bfc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 46904. [D 20:43:25.067915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.067940] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.067954] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.067997] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6995 [D 20:43:25.068012] element 0: offset: 0x2aaaab60bef0, size: 24 [D 20:43:25.068028] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 10/70. [D 20:43:25.068067] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.068081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.068093] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.068113] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 6996 [D 20:43:25.068136] element 0: offset: 0x2aaaab60c620, size: 24 [D 20:43:25.068150] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 11/70. [D 20:43:25.071071] openib_check_cq: completed rdma wr_id 2aaaab60c9d0, nic_wr_credit 46904. [D 20:43:25.071098] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 12/70. [D 20:43:25.078587] openib_check_cq: completed rdma wr_id 2aaaab60bfc0, nic_wr_credit 46903. [D 20:43:25.078615] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 13/70. [D 20:43:25.078673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.078694] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.078707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.078820] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.078835] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.078847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.084199] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 6995 [D 20:43:25.084276] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 14/70. [D 20:43:25.084876] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 6996 [D 20:43:25.084905] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 15/70. [D 20:43:25.090464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46903. [D 20:43:25.090490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 46904. [D 20:43:25.090504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 46905. [D 20:43:25.090519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 46906. [D 20:43:25.090533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 46907. [D 20:43:25.090548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 46908. [D 20:43:25.090562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46909. [D 20:43:25.090577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46910. [D 20:43:25.090591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46911. [D 20:43:25.090606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 46912. [D 20:43:25.090621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 46913. [D 20:43:25.090635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 46914. [D 20:43:25.090650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 46915. [D 20:43:25.090664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 46916. [D 20:43:25.090679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46917. [D 20:43:25.090693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46918. [D 20:43:25.090708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46919. [D 20:43:25.090723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46920. [D 20:43:25.090737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46921. [D 20:43:25.090752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46922. [D 20:43:25.090779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46923. [D 20:43:25.090794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46924. [D 20:43:25.090810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46925. [D 20:43:25.090824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46926. [D 20:43:25.090839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46927. [D 20:43:25.090865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46928. [D 20:43:25.090880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46929. [D 20:43:25.090901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46930. [D 20:43:25.090916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46931. [D 20:43:25.090931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46932. [D 20:43:25.090945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46933. [D 20:43:25.090960] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d000 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46934. [D 20:43:25.090976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 46935. [D 20:43:25.090996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 46936. [D 20:43:25.091011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 46937. [D 20:43:25.091025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 46938. [D 20:43:25.091040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 46939. [D 20:43:25.091054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 46940. [D 20:43:25.091069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 46941. [D 20:43:25.091084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 46942. [D 20:43:25.091098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 46943. [D 20:43:25.091113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 46944. [D 20:43:25.091137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 46945. [D 20:43:25.091152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 46946. [D 20:43:25.091176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 46947. [D 20:43:25.091199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 46948. [D 20:43:25.091214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 46949. [D 20:43:25.091228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 46950. [D 20:43:25.091243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 46951. [D 20:43:25.091257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 46952. [D 20:43:25.091272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 46953. [D 20:43:25.091288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 46954. [D 20:43:25.091302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 46955. [D 20:43:25.091317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 46956. [D 20:43:25.091331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 46957. [D 20:43:25.091346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 46958. [D 20:43:25.091360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 46959. [D 20:43:25.091375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 46960. [D 20:43:25.091389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 46961. [D 20:43:25.091404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 46962. [D 20:43:25.091418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 46963. [D 20:43:25.091433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 46964. [D 20:43:25.091447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 46965. [D 20:43:25.091462] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c9d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 46966. [D 20:43:25.093246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.093271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.093285] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.093327] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7000 [D 20:43:25.093342] element 0: offset: 0x2aaaab60c390, size: 24 [D 20:43:25.093359] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 16/70. [D 20:43:25.093399] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.093413] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.093425] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.093445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7002 [D 20:43:25.093459] element 0: offset: 0x2aaaab60d420, size: 24 [D 20:43:25.093473] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 17/70. [D 20:43:25.096359] openib_check_cq: completed rdma wr_id 2aaaab60d000, nic_wr_credit 46966. [D 20:43:25.096381] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 18/70. [D 20:43:25.103840] openib_check_cq: completed rdma wr_id 2aaaab60c9d0, nic_wr_credit 46965. [D 20:43:25.103862] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 19/70. [D 20:43:25.103924] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.103946] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.103959] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.104075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.104090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.104103] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.108168] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7000 [D 20:43:25.108251] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 20/70. [D 20:43:25.108985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46965. [D 20:43:25.109011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46966. [D 20:43:25.109027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 46967. [D 20:43:25.109051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 46968. [D 20:43:25.109067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 46969. [D 20:43:25.109089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 46970. [D 20:43:25.109105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 46971. [D 20:43:25.109128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46972. [D 20:43:25.109143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46973. [D 20:43:25.109173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46974. [D 20:43:25.109198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 46975. [D 20:43:25.109213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 46976. [D 20:43:25.109238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 46977. [D 20:43:25.109253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 46978. [D 20:43:25.109280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 46979. [D 20:43:25.109296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46980. [D 20:43:25.109310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46981. [D 20:43:25.109336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46982. [D 20:43:25.109350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 46983. [D 20:43:25.109365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 46984. [D 20:43:25.109379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 46985. [D 20:43:25.109410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 46986. [D 20:43:25.109426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 46987. [D 20:43:25.109455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46988. [D 20:43:25.109480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46989. [D 20:43:25.109495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46990. [D 20:43:25.109524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 46991. [D 20:43:25.109539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 46992. [D 20:43:25.109553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 46993. [D 20:43:25.109568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 46994. [D 20:43:25.109582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 46995. [D 20:43:25.109602] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c2e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46996. [D 20:43:25.110195] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7002 [D 20:43:25.110250] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 21/70. [D 20:43:25.117056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.117076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.117090] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.117133] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7007 [D 20:43:25.117147] element 0: offset: 0x2aaaab60c370, size: 24 [D 20:43:25.117164] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 22/70. [D 20:43:25.117206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.117219] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.117231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.117252] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7008 [D 20:43:25.117266] element 0: offset: 0x2aaaab6099b0, size: 24 [D 20:43:25.117280] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 23/70. [D 20:43:25.120767] openib_check_cq: completed rdma wr_id 2aaaab60c2e0, nic_wr_credit 46996. [D 20:43:25.120803] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 24/70. [D 20:43:25.120835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 46996. [D 20:43:25.120851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 46997. [D 20:43:25.120866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 46998. [D 20:43:25.120886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 46999. [D 20:43:25.120901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 47000. [D 20:43:25.120915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 47001. [D 20:43:25.120930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 47002. [D 20:43:25.120945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47003. [D 20:43:25.120960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47004. [D 20:43:25.120975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47005. [D 20:43:25.120990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 47006. [D 20:43:25.121004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 47007. [D 20:43:25.121019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 47008. [D 20:43:25.121034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 47009. [D 20:43:25.121048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 47010. [D 20:43:25.121063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47011. [D 20:43:25.121078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47012. [D 20:43:25.121093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47013. [D 20:43:25.121108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 47014. [D 20:43:25.121124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 47015. [D 20:43:25.121139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 47016. [D 20:43:25.121154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 47017. [D 20:43:25.121169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 47018. [D 20:43:25.121183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47019. [D 20:43:25.121198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47020. [D 20:43:25.121213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47021. [D 20:43:25.121228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 47022. [D 20:43:25.121242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 47023. [D 20:43:25.121257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 47024. [D 20:43:25.121272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 47025. [D 20:43:25.121287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 47026. [D 20:43:25.121301] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609be0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47027. [D 20:43:25.121364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.121393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.121407] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.127156] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7007 [D 20:43:25.127222] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 25/70. [D 20:43:25.127305] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7008 [D 20:43:25.127307] openib_check_cq: completed rdma wr_id 2aaaab609be0, nic_wr_credit 47027. [D 20:43:25.127486] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 26/70. [D 20:43:25.127503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47027. [D 20:43:25.127518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 47028. [D 20:43:25.127532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 47029. [D 20:43:25.127547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 47030. [D 20:43:25.127561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 47031. [D 20:43:25.127576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 47032. [D 20:43:25.127590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47033. [D 20:43:25.127605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47034. [D 20:43:25.127619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47035. [D 20:43:25.127634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 47036. [D 20:43:25.127648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 47037. [D 20:43:25.127664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 47038. [D 20:43:25.127678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 47039. [D 20:43:25.127693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 47040. [D 20:43:25.127707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47041. [D 20:43:25.127722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47042. [D 20:43:25.127736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47043. [D 20:43:25.127750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47044. [D 20:43:25.127765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47045. [D 20:43:25.127779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47046. [D 20:43:25.127794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47047. [D 20:43:25.127808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47048. [D 20:43:25.127823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47049. [D 20:43:25.127841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47050. [D 20:43:25.127855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47051. [D 20:43:25.127870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47052. [D 20:43:25.127884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47053. [D 20:43:25.127899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47054. [D 20:43:25.127913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47055. [D 20:43:25.127928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47056. [D 20:43:25.127942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47057. [D 20:43:25.127957] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c2e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47058. [D 20:43:25.127986] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 27/70. [D 20:43:25.128052] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.128068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.128080] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.134331] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.134349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.134361] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.134401] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7011 [D 20:43:25.134416] element 0: offset: 0x2aaaab60c390, size: 24 [D 20:43:25.134434] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 28/70. [D 20:43:25.136883] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.136902] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.136915] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.136938] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7014 [D 20:43:25.136954] element 0: offset: 0x2aaaab60ffb0, size: 24 [D 20:43:25.136969] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 29/70. [D 20:43:25.139289] openib_check_cq: completed rdma wr_id 2aaaab60c2e0, nic_wr_credit 47058. [D 20:43:25.139316] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 30/70. [D 20:43:25.139343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47058. [D 20:43:25.139359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47059. [D 20:43:25.139374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47060. [D 20:43:25.139388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47061. [D 20:43:25.139404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47062. [D 20:43:25.139418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47063. [D 20:43:25.139433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47064. [D 20:43:25.139448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47065. [D 20:43:25.139463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47066. [D 20:43:25.139477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47067. [D 20:43:25.139492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47068. [D 20:43:25.139506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47069. [D 20:43:25.139521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47070. [D 20:43:25.139536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47071. [D 20:43:25.139551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47072. [D 20:43:25.139565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47073. [D 20:43:25.139580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47074. [D 20:43:25.139595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47075. [D 20:43:25.139609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47076. [D 20:43:25.139624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47077. [D 20:43:25.139639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47078. [D 20:43:25.139653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47079. [D 20:43:25.139668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47080. [D 20:43:25.139683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47081. [D 20:43:25.139698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47082. [D 20:43:25.139712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47083. [D 20:43:25.139727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47084. [D 20:43:25.139743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47085. [D 20:43:25.139758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47086. [D 20:43:25.139772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47087. [D 20:43:25.139786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47088. [D 20:43:25.139801] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025930 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47089. [D 20:43:25.139856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.139882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.139895] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.144166] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7011 [D 20:43:25.144193] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 31/70. [D 20:43:25.145552] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7014 [D 20:43:25.145569] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 32/70. [D 20:43:25.150174] openib_check_cq: completed rdma wr_id 2aaaab025930, nic_wr_credit 47089. [D 20:43:25.150196] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 33/70. [D 20:43:25.150286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.150344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.150358] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.154388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47089. [D 20:43:25.154414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47090. [D 20:43:25.154428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47091. [D 20:43:25.154443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47092. [D 20:43:25.154458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47093. [D 20:43:25.154472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47094. [D 20:43:25.154486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47095. [D 20:43:25.154501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47096. [D 20:43:25.154515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47097. [D 20:43:25.154530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47098. [D 20:43:25.154544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47099. [D 20:43:25.154573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47100. [D 20:43:25.154587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47101. [D 20:43:25.154602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47102. [D 20:43:25.154617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47103. [D 20:43:25.154631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47104. [D 20:43:25.154649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47105. [D 20:43:25.465746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47106. [D 20:43:25.465813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47107. [D 20:43:25.466260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47108. [D 20:43:25.466293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47109. [D 20:43:25.466308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47110. [D 20:43:25.466323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47111. [D 20:43:25.466337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47112. [D 20:43:25.466352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47113. [D 20:43:25.466367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47114. [D 20:43:25.466381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47115. [D 20:43:25.466396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47116. [D 20:43:25.466410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47117. [D 20:43:25.466425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47118. [D 20:43:25.466439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47119. [D 20:43:25.466454] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47120. [D 20:43:25.466483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 47121. [D 20:43:25.466499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 47122. [D 20:43:25.466513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 47123. [D 20:43:25.466528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 47124. [D 20:43:25.466611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 47125. [D 20:43:25.466639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 47126. [D 20:43:25.467104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 47127. [D 20:43:25.467136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47128. [D 20:43:25.467151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47129. [D 20:43:25.467165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47130. [D 20:43:25.467180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 47131. [D 20:43:25.467194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 47132. [D 20:43:25.467209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 47133. [D 20:43:25.467223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 47134. [D 20:43:25.467239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 47135. [D 20:43:25.467266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47136. [D 20:43:25.467281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47137. [D 20:43:25.467296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47138. [D 20:43:25.467311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 47139. [D 20:43:25.467325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 47140. [D 20:43:25.467340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 47141. [D 20:43:25.467354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 47142. [D 20:43:25.467369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 47143. [D 20:43:25.467430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47144. [D 20:43:25.467452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47145. [D 20:43:25.467516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47146. [D 20:43:25.467978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 47147. [D 20:43:25.467996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 47148. [D 20:43:25.468010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 47149. [D 20:43:25.468025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 47150. [D 20:43:25.468040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 47151. [D 20:43:25.468060] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025a80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47152. [D 20:43:25.468388] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.468413] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.468426] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.468468] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7019 [D 20:43:25.468483] element 0: offset: 0x2aaaab6099b0, size: 24 [D 20:43:25.468502] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 34/70. [D 20:43:25.468540] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.468553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.468566] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.468586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7020 [D 20:43:25.468600] element 0: offset: 0x2aaaab614e10, size: 24 [D 20:43:25.468614] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 35/70. [D 20:43:25.468829] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 47152. [D 20:43:25.468854] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 36/70. [D 20:43:25.474676] openib_check_cq: completed rdma wr_id 2aaaab025a80, nic_wr_credit 47151. [D 20:43:25.474702] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 37/70. [D 20:43:25.474760] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.474782] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.474794] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.474907] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.474923] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.474935] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.484010] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7019 [D 20:43:25.484097] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 38/70. [D 20:43:25.485557] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7020 [D 20:43:25.485630] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 39/70. [D 20:43:25.486355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47151. [D 20:43:25.486382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 47152. [D 20:43:25.486397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 47153. [D 20:43:25.486411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 47154. [D 20:43:25.486426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 47155. [D 20:43:25.486440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 47156. [D 20:43:25.486455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47157. [D 20:43:25.486469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47158. [D 20:43:25.486483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47159. [D 20:43:25.486498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 47160. [D 20:43:25.486512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 47161. [D 20:43:25.486527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 47162. [D 20:43:25.486541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 47163. [D 20:43:25.486555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 47164. [D 20:43:25.486570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47165. [D 20:43:25.486584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47166. [D 20:43:25.486599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47167. [D 20:43:25.486613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47168. [D 20:43:25.486628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47169. [D 20:43:25.486642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47170. [D 20:43:25.486657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47171. [D 20:43:25.486671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47172. [D 20:43:25.486685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47173. [D 20:43:25.486699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47174. [D 20:43:25.486714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47175. [D 20:43:25.486729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47176. [D 20:43:25.486743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47177. [D 20:43:25.486758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47178. [D 20:43:25.486772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47179. [D 20:43:25.486813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47180. [D 20:43:25.486828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47181. [D 20:43:25.486843] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47182. [D 20:43:25.486862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47183. [D 20:43:25.486878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47184. [D 20:43:25.486896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47185. [D 20:43:25.486911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47186. [D 20:43:25.486926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47187. [D 20:43:25.486941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47188. [D 20:43:25.486955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47189. [D 20:43:25.486970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47190. [D 20:43:25.486984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47191. [D 20:43:25.486999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47192. [D 20:43:25.487014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47193. [D 20:43:25.487028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47194. [D 20:43:25.487043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47195. [D 20:43:25.487057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47196. [D 20:43:25.487072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47197. [D 20:43:25.487086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47198. [D 20:43:25.487101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47199. [D 20:43:25.487115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47200. [D 20:43:25.487130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47201. [D 20:43:25.487144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47202. [D 20:43:25.487159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47203. [D 20:43:25.487174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47204. [D 20:43:25.487190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47205. [D 20:43:25.487204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47206. [D 20:43:25.487219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47207. [D 20:43:25.487233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47208. [D 20:43:25.487248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47209. [D 20:43:25.487263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47210. [D 20:43:25.487277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47211. [D 20:43:25.487292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47212. [D 20:43:25.487306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47213. [D 20:43:25.487321] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259f0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47214. [D 20:43:25.489130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.489155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.489168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.489211] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7024 [D 20:43:25.489226] element 0: offset: 0x2aaaab60ccc0, size: 24 [D 20:43:25.489241] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 40/70. [D 20:43:25.489283] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.489296] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.489309] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.489329] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7026 [D 20:43:25.489343] element 0: offset: 0x2aaaab60d390, size: 24 [D 20:43:25.489357] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 41/70. [D 20:43:25.492254] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47214. [D 20:43:25.492278] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 42/70. [D 20:43:25.499932] openib_check_cq: completed rdma wr_id 2aaaab0259f0, nic_wr_credit 47213. [D 20:43:25.499955] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 43/70. [D 20:43:25.500023] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.500046] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.500060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.500192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.500208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.500220] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.503270] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7024 [D 20:43:25.503341] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 44/70. [D 20:43:25.505401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47213. [D 20:43:25.505425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47214. [D 20:43:25.505440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47215. [D 20:43:25.505454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47216. [D 20:43:25.505469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47217. [D 20:43:25.505484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47218. [D 20:43:25.505498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47219. [D 20:43:25.505513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47220. [D 20:43:25.505527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47221. [D 20:43:25.505542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47222. [D 20:43:25.505556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47223. [D 20:43:25.505571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47224. [D 20:43:25.505586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47225. [D 20:43:25.505600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47226. [D 20:43:25.505614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47227. [D 20:43:25.505629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47228. [D 20:43:25.505643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47229. [D 20:43:25.505658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47230. [D 20:43:25.505672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47231. [D 20:43:25.505687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47232. [D 20:43:25.505701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47233. [D 20:43:25.505716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47234. [D 20:43:25.505731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47235. [D 20:43:25.505745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47236. [D 20:43:25.505759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47237. [D 20:43:25.505774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47238. [D 20:43:25.505788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47239. [D 20:43:25.505803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47240. [D 20:43:25.505817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47241. [D 20:43:25.505832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47242. [D 20:43:25.505846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47243. [D 20:43:25.505861] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47244. [D 20:43:25.511411] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7026 [D 20:43:25.511436] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 45/70. [D 20:43:25.513818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.513839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.513852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.513894] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7031 [D 20:43:25.513908] element 0: offset: 0x2aaaab6099b0, size: 24 [D 20:43:25.513925] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 46/70. [D 20:43:25.513963] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.513976] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.513989] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.514010] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7032 [D 20:43:25.514024] element 0: offset: 0x2aaaab614e10, size: 24 [D 20:43:25.514038] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 47/70. [D 20:43:25.515767] openib_check_cq: completed rdma wr_id 2aaaab0257c0, nic_wr_credit 47244. [D 20:43:25.515822] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 48/70. [D 20:43:25.515842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 47244. [D 20:43:25.515862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 47245. [D 20:43:25.515877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 47246. [D 20:43:25.515891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 47247. [D 20:43:25.515906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 47248. [D 20:43:25.515920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 47249. [D 20:43:25.515935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 47250. [D 20:43:25.515950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47251. [D 20:43:25.515964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47252. [D 20:43:25.515979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47253. [D 20:43:25.515993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 47254. [D 20:43:25.516008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 47255. [D 20:43:25.516022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 47256. [D 20:43:25.516036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 47257. [D 20:43:25.516051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 47258. [D 20:43:25.516065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47259. [D 20:43:25.516079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47260. [D 20:43:25.516094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47261. [D 20:43:25.516108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 47262. [D 20:43:25.516123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 47263. [D 20:43:25.516141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 47264. [D 20:43:25.516156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 47265. [D 20:43:25.516172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 47266. [D 20:43:25.516187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47267. [D 20:43:25.516202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47268. [D 20:43:25.516216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47269. [D 20:43:25.516231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 47270. [D 20:43:25.516246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 47271. [D 20:43:25.516260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 47272. [D 20:43:25.516274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 47273. [D 20:43:25.516289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 47274. [D 20:43:25.516303] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47275. [D 20:43:25.516370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.516390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.516403] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.520054] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7031 [D 20:43:25.520178] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 49/70. [D 20:43:25.521816] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 47275. [D 20:43:25.521921] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 50/70. [D 20:43:25.521942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47275. [D 20:43:25.521957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 47276. [D 20:43:25.522001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 47277. [D 20:43:25.522027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 47278. [D 20:43:25.522042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 47279. [D 20:43:25.522067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 47280. [D 20:43:25.522082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47281. [D 20:43:25.522108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47282. [D 20:43:25.522122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47283. [D 20:43:25.522137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 47284. [D 20:43:25.522169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 47285. [D 20:43:25.522196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 47286. [D 20:43:25.522211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 47287. [D 20:43:25.522241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 47288. [D 20:43:25.522267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47289. [D 20:43:25.522302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47290. [D 20:43:25.522317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47291. [D 20:43:25.522346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47292. [D 20:43:25.522374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47293. [D 20:43:25.522389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47294. [D 20:43:25.522420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47295. [D 20:43:25.522447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47296. [D 20:43:25.522462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47297. [D 20:43:25.522477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47298. [D 20:43:25.522501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47299. [D 20:43:25.522516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47300. [D 20:43:25.522544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47301. [D 20:43:25.522567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47302. [D 20:43:25.522582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47303. [D 20:43:25.522611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47304. [D 20:43:25.522637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47305. [D 20:43:25.522652] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47306. [D 20:43:25.522891] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.522914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.522927] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.526719] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7032 [D 20:43:25.526741] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 51/70. [D 20:43:25.533843] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47306. [D 20:43:25.533907] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 52/70. [D 20:43:25.533927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47306. [D 20:43:25.533943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47307. [D 20:43:25.533958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47308. [D 20:43:25.533972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47309. [D 20:43:25.533987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47310. [D 20:43:25.534002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47311. [D 20:43:25.534017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47312. [D 20:43:25.534031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47313. [D 20:43:25.534048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47314. [D 20:43:25.534063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47315. [D 20:43:25.534077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47316. [D 20:43:25.534092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47317. [D 20:43:25.534107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47318. [D 20:43:25.534121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47319. [D 20:43:25.534136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47320. [D 20:43:25.534150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47321. [D 20:43:25.534165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47322. [D 20:43:25.534179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47323. [D 20:43:25.534194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47324. [D 20:43:25.534209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47325. [D 20:43:25.534224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47326. [D 20:43:25.534238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47327. [D 20:43:25.534253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47328. [D 20:43:25.534267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47329. [D 20:43:25.534282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47330. [D 20:43:25.534297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47331. [D 20:43:25.534312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47332. [D 20:43:25.534326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47333. [D 20:43:25.534341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47334. [D 20:43:25.534356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47335. [D 20:43:25.534370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47336. [D 20:43:25.534385] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014930 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47337. [D 20:43:25.534439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.534459] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.534472] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:25.545250] openib_check_cq: completed rdma wr_id 2aaaab014930, nic_wr_credit 47337. [D 20:43:25.545276] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 53/70. [D 20:43:25.545341] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.545361] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.545374] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:25.559298] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.559317] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.559330] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:25.559373] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7037 [D 20:43:25.559388] element 0: offset: 0x2aaaab60d3e0, size: 24 [D 20:43:25.559405] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 54/70. [D 20:43:25.559441] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.559454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.559471] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:25.559498] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7038 [D 20:43:25.559512] element 0: offset: 0x2aaaab609a00, size: 24 [D 20:43:25.559526] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 55/70. [D 20:43:25.563007] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7037 [D 20:43:25.563093] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 56/70. [D 20:43:25.563161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47337. [D 20:43:25.563204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47338. [D 20:43:25.563219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47339. [D 20:43:25.563234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47340. [D 20:43:25.563249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47341. [D 20:43:25.563264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47342. [D 20:43:25.563278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47343. [D 20:43:25.563293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47344. [D 20:43:25.563308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47345. [D 20:43:25.563323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47346. [D 20:43:25.563337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47347. [D 20:43:25.563352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47348. [D 20:43:25.563366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47349. [D 20:43:25.563381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47350. [D 20:43:25.563396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47351. [D 20:43:25.563411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47352. [D 20:43:25.563425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47353. [D 20:43:25.563440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47354. [D 20:43:25.563455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47355. [D 20:43:25.563469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47356. [D 20:43:25.563484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47357. [D 20:43:25.563503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47358. [D 20:43:25.563518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47359. [D 20:43:25.563533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47360. [D 20:43:25.563547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47361. [D 20:43:25.563562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47362. [D 20:43:25.563577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47363. [D 20:43:25.563591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47364. [D 20:43:25.563606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47365. [D 20:43:25.563621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47366. [D 20:43:25.563635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47367. [D 20:43:25.563650] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0257c0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47368. [D 20:43:25.566802] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7038 [D 20:43:25.566885] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 57/70. [D 20:43:25.571115] openib_check_cq: completed rdma wr_id 2aaaab0257c0, nic_wr_credit 47368. [D 20:43:25.571139] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 58/70. [D 20:43:25.571155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47368. [D 20:43:25.571171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47369. [D 20:43:25.571186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47370. [D 20:43:25.571200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47371. [D 20:43:25.571215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47372. [D 20:43:25.571230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47373. [D 20:43:25.571245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47374. [D 20:43:25.571260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47375. [D 20:43:25.571274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47376. [D 20:43:25.571289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47377. [D 20:43:25.571304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47378. [D 20:43:25.571319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47379. [D 20:43:25.571334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47380. [D 20:43:25.571348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47381. [D 20:43:25.571363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47382. [D 20:43:25.571379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47383. [D 20:43:25.571394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47384. [D 20:43:25.571409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47385. [D 20:43:25.571424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47386. [D 20:43:25.571438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47387. [D 20:43:25.571453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47388. [D 20:43:25.571467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47389. [D 20:43:25.571482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47390. [D 20:43:25.571497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47391. [D 20:43:25.571511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47392. [D 20:43:25.571525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47393. [D 20:43:25.571540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47394. [D 20:43:25.571554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47395. [D 20:43:25.571569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47396. [D 20:43:25.571584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47397. [D 20:43:25.571598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47398. [D 20:43:25.571613] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47399. [D 20:43:25.571691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.571714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.571728] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:25.582854] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 47399. [D 20:43:25.582881] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 59/70. [D 20:43:25.582996] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.583016] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.583028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:25.593165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.593183] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.593196] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:25.593234] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7042 [D 20:43:25.593249] element 0: offset: 0x2aaaab60ccc0, size: 24 [D 20:43:25.593265] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 60/70. [D 20:43:25.595636] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.595693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.595706] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:25.595744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7044 [D 20:43:25.595760] element 0: offset: 0x2aaaab6099b0, size: 24 [D 20:43:25.595778] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 0/70. [D 20:43:25.596881] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7042 [D 20:43:25.596941] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 1/70. [D 20:43:25.596999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47399. [D 20:43:25.597026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47400. [D 20:43:25.597041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47401. [D 20:43:25.597055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47402. [D 20:43:25.597070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47403. [D 20:43:25.597085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47404. [D 20:43:25.597099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47405. [D 20:43:25.597114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47406. [D 20:43:25.597129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47407. [D 20:43:25.597143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47408. [D 20:43:25.597158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47409. [D 20:43:25.597172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47410. [D 20:43:25.597187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47411. [D 20:43:25.597202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47412. [D 20:43:25.597216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47413. [D 20:43:25.597231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47414. [D 20:43:25.597245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47415. [D 20:43:25.597260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47416. [D 20:43:25.597274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47417. [D 20:43:25.597288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47418. [D 20:43:25.597303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47419. [D 20:43:25.597317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47420. [D 20:43:25.597331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47421. [D 20:43:25.597346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47422. [D 20:43:25.597360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47423. [D 20:43:25.597375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47424. [D 20:43:25.597389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47425. [D 20:43:25.597403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47426. [D 20:43:25.597418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47427. [D 20:43:25.597433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47428. [D 20:43:25.597448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47429. [D 20:43:25.597463] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47430. [D 20:43:25.599989] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7044 [D 20:43:25.600056] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 2/70. [D 20:43:25.605206] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47430. [D 20:43:25.605233] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 3/70. [D 20:43:25.605256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47430. [D 20:43:25.605271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47431. [D 20:43:25.605286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47432. [D 20:43:25.605301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47433. [D 20:43:25.605315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47434. [D 20:43:25.605330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47435. [D 20:43:25.605344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47436. [D 20:43:25.605359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47437. [D 20:43:25.605373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47438. [D 20:43:25.605388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47439. [D 20:43:25.605402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47440. [D 20:43:25.605417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47441. [D 20:43:25.605431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47442. [D 20:43:25.605446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47443. [D 20:43:25.605460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47444. [D 20:43:25.605475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47445. [D 20:43:25.605489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47446. [D 20:43:25.605504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47447. [D 20:43:25.605518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47448. [D 20:43:25.605533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47449. [D 20:43:25.605547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47450. [D 20:43:25.605562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47451. [D 20:43:25.605576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47452. [D 20:43:25.605592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47453. [D 20:43:25.605606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47454. [D 20:43:25.605621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47455. [D 20:43:25.605635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47456. [D 20:43:25.605650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47457. [D 20:43:25.605664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47458. [D 20:43:25.605679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47459. [D 20:43:25.605693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47460. [D 20:43:25.605708] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47461. [D 20:43:25.605784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.605807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.605820] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:25.617057] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 47461. [D 20:43:25.617082] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 4/70. [D 20:43:25.617193] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.617213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.617226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:25.635213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.635231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.635244] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:25.635287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7049 [D 20:43:25.635302] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:25.635318] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 5/70. [D 20:43:25.635356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.635369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.635382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:25.635407] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7050 [D 20:43:25.635421] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:25.635435] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 6/70. [D 20:43:25.640181] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7049 [D 20:43:25.640212] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 7/70. [D 20:43:25.640270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47461. [D 20:43:25.640287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47462. [D 20:43:25.640302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47463. [D 20:43:25.640317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47464. [D 20:43:25.640332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47465. [D 20:43:25.640346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47466. [D 20:43:25.640361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47467. [D 20:43:25.640377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47468. [D 20:43:25.640391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47469. [D 20:43:25.640406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47470. [D 20:43:25.640421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47471. [D 20:43:25.640435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47472. [D 20:43:25.640450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47473. [D 20:43:25.640465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47474. [D 20:43:25.640479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47475. [D 20:43:25.640494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47476. [D 20:43:25.640508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47477. [D 20:43:25.640523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47478. [D 20:43:25.640538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47479. [D 20:43:25.640552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47480. [D 20:43:25.640567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47481. [D 20:43:25.640581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47482. [D 20:43:25.640596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47483. [D 20:43:25.640611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47484. [D 20:43:25.640625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47485. [D 20:43:25.640640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47486. [D 20:43:25.640655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47487. [D 20:43:25.640669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47488. [D 20:43:25.640684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47489. [D 20:43:25.640698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47490. [D 20:43:25.640713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47491. [D 20:43:25.640727] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014b60 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47492. [D 20:43:25.644028] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7050 [D 20:43:25.644047] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 8/70. [D 20:43:25.649392] openib_check_cq: completed rdma wr_id 2aaaab014b60, nic_wr_credit 47492. [D 20:43:25.649414] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 9/70. [D 20:43:25.649441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47492. [D 20:43:25.649458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47493. [D 20:43:25.649472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47494. [D 20:43:25.649487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47495. [D 20:43:25.649502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47496. [D 20:43:25.649516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47497. [D 20:43:25.649531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47498. [D 20:43:25.649546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47499. [D 20:43:25.649560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47500. [D 20:43:25.649575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47501. [D 20:43:25.649590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47502. [D 20:43:25.649604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47503. [D 20:43:25.649619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47504. [D 20:43:25.649634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47505. [D 20:43:25.649648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47506. [D 20:43:25.649663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47507. [D 20:43:25.649677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47508. [D 20:43:25.649692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47509. [D 20:43:25.649707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47510. [D 20:43:25.649721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47511. [D 20:43:25.649736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47512. [D 20:43:25.649751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47513. [D 20:43:25.649765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47514. [D 20:43:25.649780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47515. [D 20:43:25.649795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47516. [D 20:43:25.649809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47517. [D 20:43:25.649824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47518. [D 20:43:25.649838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47519. [D 20:43:25.649853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47520. [D 20:43:25.649868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47521. [D 20:43:25.649883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47522. [D 20:43:25.649898] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025800 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47523. [D 20:43:25.649979] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.650042] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.650055] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:25.656206] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.656223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.656236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:25.656276] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7053 [D 20:43:25.656291] element 0: offset: 0x2aaaab0257a0, size: 24 [D 20:43:25.656314] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 10/70. [D 20:43:25.661222] openib_check_cq: completed rdma wr_id 2aaaab025800, nic_wr_credit 47523. [D 20:43:25.661247] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 11/70. [D 20:43:25.661346] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.661366] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.661378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:25.662156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.662195] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.662208] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:25.662247] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7056 [D 20:43:25.662262] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:25.662281] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 12/70. [D 20:43:25.665624] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7056 [D 20:43:25.665650] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 13/70. [D 20:43:25.667929] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7053 [D 20:43:25.668149] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 14/70. [D 20:43:25.674660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47523. [D 20:43:25.674681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47524. [D 20:43:25.674696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47525. [D 20:43:25.674711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47526. [D 20:43:25.674725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47527. [D 20:43:25.674739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47528. [D 20:43:25.674754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47529. [D 20:43:25.674768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47530. [D 20:43:25.674783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47531. [D 20:43:25.674797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47532. [D 20:43:25.674822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47533. [D 20:43:25.674849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47534. [D 20:43:25.674864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47535. [D 20:43:25.916367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47536. [D 20:43:25.916423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47537. [D 20:43:25.916843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47538. [D 20:43:25.916860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47539. [D 20:43:25.916874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47540. [D 20:43:25.916889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47541. [D 20:43:25.916910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47542. [D 20:43:25.916924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47543. [D 20:43:25.916955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47544. [D 20:43:25.916969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47545. [D 20:43:25.916984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47546. [D 20:43:25.916998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47547. [D 20:43:25.917013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47548. [D 20:43:25.917030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47549. [D 20:43:25.917045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47550. [D 20:43:25.917072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47551. [D 20:43:25.917086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47552. [D 20:43:25.917101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47553. [D 20:43:25.917115] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02a050 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47554. [D 20:43:25.917232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47555. [D 20:43:25.917688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47556. [D 20:43:25.917703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 47557. [D 20:43:25.917718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 47558. [D 20:43:25.917732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 47559. [D 20:43:25.917752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 47560. [D 20:43:25.917767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 47561. [D 20:43:25.917793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47562. [D 20:43:25.917809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47563. [D 20:43:25.917823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47564. [D 20:43:25.917840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 47565. [D 20:43:25.917854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 47566. [D 20:43:25.917869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 47567. [D 20:43:25.917883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 47568. [D 20:43:25.917897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 47569. [D 20:43:25.917912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47570. [D 20:43:25.917926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47571. [D 20:43:25.917941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47572. [D 20:43:25.917955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47573. [D 20:43:25.917970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47574. [D 20:43:25.918051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47575. [D 20:43:25.918106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47576. [D 20:43:25.918572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47577. [D 20:43:25.918590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47578. [D 20:43:25.918604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47579. [D 20:43:25.918619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47580. [D 20:43:25.918633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47581. [D 20:43:25.918652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47582. [D 20:43:25.918667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47583. [D 20:43:25.918681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47584. [D 20:43:25.918709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47585. [D 20:43:25.918723] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0258f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47586. [D 20:43:25.920211] openib_check_cq: completed rdma wr_id 2aaaab02a050, nic_wr_credit 47586. [D 20:43:25.920233] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 15/70. [D 20:43:25.923652] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.923674] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.923688] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.923733] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7060 [D 20:43:25.923750] element 0: offset: 0x2aaaab02a0e0, size: 24 [D 20:43:25.923766] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 16/70. [D 20:43:25.923803] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.923817] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.923833] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.923855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7062 [D 20:43:25.923871] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:25.923889] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 17/70. [D 20:43:25.925989] openib_check_cq: completed rdma wr_id 2aaaab0258f0, nic_wr_credit 47585. [D 20:43:25.926009] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 18/70. [D 20:43:25.929112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.929128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.929142] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.929261] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.929277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.929290] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.935058] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7060 [D 20:43:25.935086] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 19/70. [D 20:43:25.935105] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7062 [D 20:43:25.935126] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 20/70. [D 20:43:25.936855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47585. [D 20:43:25.936873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47586. [D 20:43:25.936888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47587. [D 20:43:25.936902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47588. [D 20:43:25.936917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47589. [D 20:43:25.936931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47590. [D 20:43:25.936946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47591. [D 20:43:25.936960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47592. [D 20:43:25.936974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47593. [D 20:43:25.936989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47594. [D 20:43:25.937004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47595. [D 20:43:25.937018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47596. [D 20:43:25.937032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47597. [D 20:43:25.937047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47598. [D 20:43:25.937062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47599. [D 20:43:25.937076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47600. [D 20:43:25.937091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47601. [D 20:43:25.937105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47602. [D 20:43:25.937120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47603. [D 20:43:25.937135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47604. [D 20:43:25.937149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47605. [D 20:43:25.937164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47606. [D 20:43:25.937178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47607. [D 20:43:25.937192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47608. [D 20:43:25.937207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47609. [D 20:43:25.937221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47610. [D 20:43:25.937236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47611. [D 20:43:25.937250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47612. [D 20:43:25.937264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47613. [D 20:43:25.937290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47614. [D 20:43:25.937305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47615. [D 20:43:25.937320] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab026ef0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47616. [D 20:43:25.937337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47617. [D 20:43:25.937351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47618. [D 20:43:25.937366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47619. [D 20:43:25.937380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47620. [D 20:43:25.937394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47621. [D 20:43:25.937409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47622. [D 20:43:25.937423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47623. [D 20:43:25.937437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47624. [D 20:43:25.937452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47625. [D 20:43:25.937466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47626. [D 20:43:25.937480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47627. [D 20:43:25.937495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47628. [D 20:43:25.937509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47629. [D 20:43:25.937523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47630. [D 20:43:25.937538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47631. [D 20:43:25.937552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47632. [D 20:43:25.937566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47633. [D 20:43:25.937581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47634. [D 20:43:25.937596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47635. [D 20:43:25.937611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47636. [D 20:43:25.937625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47637. [D 20:43:25.937640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47638. [D 20:43:25.937654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47639. [D 20:43:25.937668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47640. [D 20:43:25.937683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47641. [D 20:43:25.937697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47642. [D 20:43:25.937711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47643. [D 20:43:25.937726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47644. [D 20:43:25.937740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47645. [D 20:43:25.937754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47646. [D 20:43:25.937769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47647. [D 20:43:25.937783] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029a10 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47648. [D 20:43:25.940182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.940253] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.940268] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.940314] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7066 [D 20:43:25.940329] element 0: offset: 0x2aaaab02a0c0, size: 24 [D 20:43:25.940351] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 21/70. [D 20:43:25.940389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.940403] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.940415] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.940436] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7068 [D 20:43:25.940450] element 0: offset: 0x2aaaab0298c0, size: 24 [D 20:43:25.940464] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 22/70. [D 20:43:25.942737] openib_check_cq: completed rdma wr_id 2aaaab026ef0, nic_wr_credit 47648. [D 20:43:25.942755] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 23/70. [D 20:43:25.950963] openib_check_cq: completed rdma wr_id 2aaaab029a10, nic_wr_credit 47647. [D 20:43:25.950994] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 24/70. [D 20:43:25.951056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.951074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.951089] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.951227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.951242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.951254] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.956272] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7066 [D 20:43:25.956298] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 25/70. [D 20:43:25.956531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47647. [D 20:43:25.956549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47648. [D 20:43:25.956564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 47649. [D 20:43:25.956579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 47650. [D 20:43:25.956593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 47651. [D 20:43:25.956608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 47652. [D 20:43:25.956623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 47653. [D 20:43:25.956637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47654. [D 20:43:25.956652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47655. [D 20:43:25.956666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47656. [D 20:43:25.956681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 47657. [D 20:43:25.956695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 47658. [D 20:43:25.956710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 47659. [D 20:43:25.956724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 47660. [D 20:43:25.956739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 47661. [D 20:43:25.956754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47662. [D 20:43:25.956768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47663. [D 20:43:25.956783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47664. [D 20:43:25.956797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47665. [D 20:43:25.956812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47666. [D 20:43:25.956826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47667. [D 20:43:25.956841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47668. [D 20:43:25.956855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47669. [D 20:43:25.956870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47670. [D 20:43:25.956885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47671. [D 20:43:25.956899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47672. [D 20:43:25.956913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47673. [D 20:43:25.956928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47674. [D 20:43:25.956942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47675. [D 20:43:25.956957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47676. [D 20:43:25.956973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47677. [D 20:43:25.956987] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029a10 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47678. [D 20:43:25.959989] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7068 [D 20:43:25.960007] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 26/70. [D 20:43:25.964796] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.964858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.964872] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.964918] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7073 [D 20:43:25.964934] element 0: offset: 0x691fe0, size: 24 [D 20:43:25.964953] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 27/70. [D 20:43:25.964999] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.965012] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.965025] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.965046] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7074 [D 20:43:25.965060] element 0: offset: 0x61fa30, size: 24 [D 20:43:25.965074] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 28/70. [D 20:43:25.966171] openib_check_cq: completed rdma wr_id 2aaaab029a10, nic_wr_credit 47678. [D 20:43:25.966189] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 29/70. [D 20:43:25.966207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47678. [D 20:43:25.966223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47679. [D 20:43:25.966237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47680. [D 20:43:25.966252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47681. [D 20:43:25.966266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47682. [D 20:43:25.966280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47683. [D 20:43:25.966294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47684. [D 20:43:25.966308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47685. [D 20:43:25.966323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47686. [D 20:43:25.966337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47687. [D 20:43:25.966351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47688. [D 20:43:25.966365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47689. [D 20:43:25.966379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47690. [D 20:43:25.966394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47691. [D 20:43:25.966408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47692. [D 20:43:25.966422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47693. [D 20:43:25.966436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47694. [D 20:43:25.966450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47695. [D 20:43:25.966467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47696. [D 20:43:25.966481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47697. [D 20:43:25.966495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47698. [D 20:43:25.966509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47699. [D 20:43:25.966523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47700. [D 20:43:25.966537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47701. [D 20:43:25.966551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47702. [D 20:43:25.966565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47703. [D 20:43:25.966579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47704. [D 20:43:25.966593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47705. [D 20:43:25.966607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47706. [D 20:43:25.966621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47707. [D 20:43:25.966635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47708. [D 20:43:25.966648] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47709. [D 20:43:25.969811] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.969826] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.969839] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:25.973412] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 47709. [D 20:43:25.973485] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 30/70. [D 20:43:25.974767] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7073 [D 20:43:25.974849] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 31/70. [D 20:43:25.974877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:25.974897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.974910] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:25.974960] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7074 [D 20:43:25.974984] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 32/70. [D 20:43:25.979271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47709. [D 20:43:25.979303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47710. [D 20:43:25.979326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47711. [D 20:43:25.979341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47712. [D 20:43:25.979364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47713. [D 20:43:25.979379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47714. [D 20:43:25.979406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47715. [D 20:43:25.979421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47716. [D 20:43:25.979451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47717. [D 20:43:25.979466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47718. [D 20:43:25.979493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47719. [D 20:43:25.979508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47720. [D 20:43:25.979533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47721. [D 20:43:25.979556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47722. [D 20:43:25.979571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47723. [D 20:43:25.979599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47724. [D 20:43:25.979623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47725. [D 20:43:25.979638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47726. [D 20:43:25.979666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47727. [D 20:43:25.979681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47728. [D 20:43:25.979709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47729. [D 20:43:25.979724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47730. [D 20:43:25.979749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47731. [D 20:43:25.979763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47732. [D 20:43:25.979778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47733. [D 20:43:25.979792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47734. [D 20:43:25.979806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47735. [D 20:43:25.979821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47736. [D 20:43:25.979836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47737. [D 20:43:25.979850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47738. [D 20:43:25.979865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47739. [D 20:43:25.979879] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47740. [D 20:43:25.979901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47741. [D 20:43:25.979915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47742. [D 20:43:25.979930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47743. [D 20:43:25.979944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47744. [D 20:43:25.979959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47745. [D 20:43:25.979974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47746. [D 20:43:25.979989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47747. [D 20:43:25.980003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47748. [D 20:43:25.980018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47749. [D 20:43:25.980032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47750. [D 20:43:25.980047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47751. [D 20:43:25.980061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47752. [D 20:43:25.980076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47753. [D 20:43:25.980090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47754. [D 20:43:25.980104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47755. [D 20:43:25.980119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47756. [D 20:43:25.980133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47757. [D 20:43:25.980461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47758. [D 20:43:25.980476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47759. [D 20:43:25.980495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47760. [D 20:43:25.980509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47761. [D 20:43:25.980524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47762. [D 20:43:25.980538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47763. [D 20:43:25.980553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47764. [D 20:43:25.980567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47765. [D 20:43:25.980581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47766. [D 20:43:25.980596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47767. [D 20:43:25.980610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47768. [D 20:43:25.980625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47769. [D 20:43:25.980639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47770. [D 20:43:25.980654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47771. [D 20:43:25.980668] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02a010 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47772. [D 20:43:25.980722] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.980741] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.980754] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:25.980794] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7077 [D 20:43:25.980809] element 0: offset: 0x636ca0, size: 24 [D 20:43:25.980829] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 33/70. [D 20:43:25.981987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:25.982002] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:25.982014] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:25.982034] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7080 [D 20:43:25.982048] element 0: offset: 0x658610, size: 24 [D 20:43:25.982062] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 34/70. [D 20:43:25.990946] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 47772. [D 20:43:25.990963] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 35/70. [D 20:43:25.997301] openib_check_cq: completed rdma wr_id 2aaaab02a010, nic_wr_credit 47771. [D 20:43:25.997319] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 36/70. [D 20:43:26.000427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.000443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.000456] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.000552] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.000567] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.000580] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.004034] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7080 [D 20:43:26.004122] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 37/70. [D 20:43:26.004520] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7077 [D 20:43:26.004542] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 38/70. [D 20:43:26.008738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47771. [D 20:43:26.008792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47772. [D 20:43:26.008807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47773. [D 20:43:26.008821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47774. [D 20:43:26.008835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47775. [D 20:43:26.008849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47776. [D 20:43:26.008863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47777. [D 20:43:26.008878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47778. [D 20:43:26.008891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47779. [D 20:43:26.008905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47780. [D 20:43:26.008919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47781. [D 20:43:26.008933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47782. [D 20:43:26.008947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47783. [D 20:43:26.008961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47784. [D 20:43:26.008975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47785. [D 20:43:26.008989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47786. [D 20:43:26.009005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47787. [D 20:43:26.009019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47788. [D 20:43:26.009034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47789. [D 20:43:26.009047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47790. [D 20:43:26.009062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47791. [D 20:43:26.009076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47792. [D 20:43:26.009090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47793. [D 20:43:26.009104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47794. [D 20:43:26.009117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47795. [D 20:43:26.009131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47796. [D 20:43:26.009145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47797. [D 20:43:26.009159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47798. [D 20:43:26.009173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47799. [D 20:43:26.009187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47800. [D 20:43:26.009201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47801. [D 20:43:26.009215] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47802. [D 20:43:26.009234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47803. [D 20:43:26.009249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47804. [D 20:43:26.009263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 47805. [D 20:43:26.009277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 47806. [D 20:43:26.009291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 47807. [D 20:43:26.009305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 47808. [D 20:43:26.009319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 47809. [D 20:43:26.009333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47810. [D 20:43:26.009347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47811. [D 20:43:26.009361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47812. [D 20:43:26.009375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 47813. [D 20:43:26.009389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 47814. [D 20:43:26.009403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 47815. [D 20:43:26.009418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 47816. [D 20:43:26.009432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 47817. [D 20:43:26.009446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47818. [D 20:43:26.009460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47819. [D 20:43:26.009474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47820. [D 20:43:26.009489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47821. [D 20:43:26.009502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47822. [D 20:43:26.009516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47823. [D 20:43:26.009531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47824. [D 20:43:26.009545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47825. [D 20:43:26.009559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47826. [D 20:43:26.009573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47827. [D 20:43:26.009587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47828. [D 20:43:26.009601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47829. [D 20:43:26.009615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47830. [D 20:43:26.009629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47831. [D 20:43:26.009643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47832. [D 20:43:26.009657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47833. [D 20:43:26.009671] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47834. [D 20:43:26.012169] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.012186] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.012199] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.012240] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7085 [D 20:43:26.012255] element 0: offset: 0x691f90, size: 24 [D 20:43:26.012273] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 39/70. [D 20:43:26.012301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.012314] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.012327] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.012347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7086 [D 20:43:26.012361] element 0: offset: 0x644640, size: 24 [D 20:43:26.012374] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 40/70. [D 20:43:26.014662] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 47834. [D 20:43:26.014678] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 41/70. [D 20:43:26.022891] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47833. [D 20:43:26.022920] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 42/70. [D 20:43:26.022980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.022999] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.023012] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.023123] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.023138] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.023150] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.026138] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7085 [D 20:43:26.026163] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 43/70. [D 20:43:26.028612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 47833. [D 20:43:26.028631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47834. [D 20:43:26.028647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47835. [D 20:43:26.028661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47836. [D 20:43:26.028676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47837. [D 20:43:26.028706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47838. [D 20:43:26.028722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47839. [D 20:43:26.028747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47840. [D 20:43:26.028763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47841. [D 20:43:26.028787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47842. [D 20:43:26.028802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47843. [D 20:43:26.028828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47844. [D 20:43:26.028853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47845. [D 20:43:26.028868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47846. [D 20:43:26.028894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47847. [D 20:43:26.028927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47848. [D 20:43:26.028942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47849. [D 20:43:26.028966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47850. [D 20:43:26.028981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47851. [D 20:43:26.029009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47852. [D 20:43:26.029038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47853. [D 20:43:26.029063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47854. [D 20:43:26.029077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47855. [D 20:43:26.029101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47856. [D 20:43:26.029129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47857. [D 20:43:26.029158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47858. [D 20:43:26.029174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47859. [D 20:43:26.029188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47860. [D 20:43:26.029214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47861. [D 20:43:26.029241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47862. [D 20:43:26.029256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47863. [D 20:43:26.029270] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47864. [D 20:43:26.031768] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7086 [D 20:43:26.031852] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 44/70. [D 20:43:26.036677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.036698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.036712] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.036755] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7090 [D 20:43:26.036770] element 0: offset: 0x61fa30, size: 24 [D 20:43:26.036786] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 45/70. [D 20:43:26.036825] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.036839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.036852] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.036873] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7092 [D 20:43:26.036887] element 0: offset: 0x62fd10, size: 24 [D 20:43:26.036904] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 46/70. [D 20:43:26.040352] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 47864. [D 20:43:26.040378] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 47/70. [D 20:43:26.040417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47864. [D 20:43:26.040433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47865. [D 20:43:26.040449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47866. [D 20:43:26.040464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47867. [D 20:43:26.040479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47868. [D 20:43:26.040493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47869. [D 20:43:26.040513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47870. [D 20:43:26.040528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47871. [D 20:43:26.040542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47872. [D 20:43:26.040558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47873. [D 20:43:26.040572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47874. [D 20:43:26.040587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 47875. [D 20:43:26.040601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 47876. [D 20:43:26.040618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 47877. [D 20:43:26.040632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 47878. [D 20:43:26.040647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 47879. [D 20:43:26.040662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 47880. [D 20:43:26.040677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 47881. [D 20:43:26.040691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 47882. [D 20:43:26.040706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 47883. [D 20:43:26.040721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 47884. [D 20:43:26.040736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 47885. [D 20:43:26.040751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 47886. [D 20:43:26.040765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 47887. [D 20:43:26.040780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 47888. [D 20:43:26.040795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 47889. [D 20:43:26.040810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 47890. [D 20:43:26.040825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 47891. [D 20:43:26.040839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 47892. [D 20:43:26.040855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 47893. [D 20:43:26.040869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 47894. [D 20:43:26.040884] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 47895. [D 20:43:26.040951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.040972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.040985] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.046363] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47895. [D 20:43:26.046389] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 48/70. [D 20:43:26.047150] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7090 [D 20:43:26.047402] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 49/70. [D 20:43:26.047501] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7092 [D 20:43:26.047519] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 50/70. [D 20:43:26.047788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.047811] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.047825] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.052204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 47895. [D 20:43:26.052226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 47896. [D 20:43:26.052241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 47897. [D 20:43:26.052257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 47898. [D 20:43:26.052272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 47899. [D 20:43:26.052286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 47900. [D 20:43:26.052301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 47901. [D 20:43:26.052326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 47902. [D 20:43:26.052349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 47903. [D 20:43:26.052364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 47904. [D 20:43:26.052378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 47905. [D 20:43:26.052392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 47906. [D 20:43:26.052406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 47907. [D 20:43:26.052420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 47908. [D 20:43:26.052435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 47909. [D 20:43:26.052448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 47910. [D 20:43:26.052462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 47911. [D 20:43:26.052477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 47912. [D 20:43:26.052491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 47913. [D 20:43:26.052505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 47914. [D 20:43:26.052519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 47915. [D 20:43:26.052533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 47916. [D 20:43:26.052547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 47917. [D 20:43:26.052561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 47918. [D 20:43:26.052575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 47919. [D 20:43:26.052589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 47920. [D 20:43:26.052604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 47921. [D 20:43:26.052618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 47922. [D 20:43:26.052631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 47923. [D 20:43:26.052646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 47924. [D 20:43:26.052673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 47925. [D 20:43:26.052688] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 47926. [D 20:43:26.052706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47927. [D 20:43:26.052721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47928. [D 20:43:26.052735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 47929. [D 20:43:26.052750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 47930. [D 20:43:26.052769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 47931. [D 20:43:26.052784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 47932. [D 20:43:26.052799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 47933. [D 20:43:26.052813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47934. [D 20:43:26.052826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47935. [D 20:43:26.052841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47936. [D 20:43:26.052855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 47937. [D 20:43:26.052869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 47938. [D 20:43:26.052883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 47939. [D 20:43:26.052897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 47940. [D 20:43:26.052911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 47941. [D 20:43:26.052925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47942. [D 20:43:26.052939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47943. [D 20:43:26.052953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47944. [D 20:43:26.052968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47945. [D 20:43:26.052982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47946. [D 20:43:26.052996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47947. [D 20:43:26.053010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47948. [D 20:43:26.053024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47949. [D 20:43:26.053038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47950. [D 20:43:26.053052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47951. [D 20:43:26.053066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47952. [D 20:43:26.053080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47953. [D 20:43:26.053094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47954. [D 20:43:26.053108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47955. [D 20:43:26.372463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47956. [D 20:43:26.372489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47957. [D 20:43:26.372507] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47958. [D 20:43:26.372534] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 47958. [D 20:43:26.372554] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 51/70. [D 20:43:26.372618] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.372645] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.372659] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.372702] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7096 [D 20:43:26.372718] element 0: offset: 0x636ca0, size: 24 [D 20:43:26.372737] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 52/70. [D 20:43:26.372772] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.372787] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.372801] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.372823] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7098 [D 20:43:26.372838] element 0: offset: 0x691fe0, size: 24 [D 20:43:26.372854] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 53/70. [D 20:43:26.373203] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 47957. [D 20:43:26.373223] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 54/70. [D 20:43:26.376176] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.376193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.376206] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.376314] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.376329] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.376342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.382391] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7096 [D 20:43:26.382499] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 55/70. [D 20:43:26.385620] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7098 [D 20:43:26.385639] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 56/70. [D 20:43:26.385813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47957. [D 20:43:26.385833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 47958. [D 20:43:26.385847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 47959. [D 20:43:26.385861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 47960. [D 20:43:26.385877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 47961. [D 20:43:26.385891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 47962. [D 20:43:26.385906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47963. [D 20:43:26.385924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47964. [D 20:43:26.385938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47965. [D 20:43:26.385953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 47966. [D 20:43:26.385971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 47967. [D 20:43:26.385985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 47968. [D 20:43:26.386000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 47969. [D 20:43:26.386017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 47970. [D 20:43:26.386031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47971. [D 20:43:26.386046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47972. [D 20:43:26.386063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47973. [D 20:43:26.386077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 47974. [D 20:43:26.386092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 47975. [D 20:43:26.386108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 47976. [D 20:43:26.386123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 47977. [D 20:43:26.386192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 47978. [D 20:43:26.386206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47979. [D 20:43:26.386220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47980. [D 20:43:26.386234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47981. [D 20:43:26.386248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 47982. [D 20:43:26.386262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 47983. [D 20:43:26.386276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 47984. [D 20:43:26.386291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 47985. [D 20:43:26.386304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 47986. [D 20:43:26.386319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47987. [D 20:43:26.386333] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47988. [D 20:43:26.386351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 47989. [D 20:43:26.386365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 47990. [D 20:43:26.386379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 47991. [D 20:43:26.386394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 47992. [D 20:43:26.386408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 47993. [D 20:43:26.386422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 47994. [D 20:43:26.386436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 47995. [D 20:43:26.386450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 47996. [D 20:43:26.386466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 47997. [D 20:43:26.386480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 47998. [D 20:43:26.386494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 47999. [D 20:43:26.386508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48000. [D 20:43:26.386522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48001. [D 20:43:26.386536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48002. [D 20:43:26.386550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48003. [D 20:43:26.386564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48004. [D 20:43:26.386578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48005. [D 20:43:26.386592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48006. [D 20:43:26.386606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48007. [D 20:43:26.386620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48008. [D 20:43:26.386634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48009. [D 20:43:26.386650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48010. [D 20:43:26.386665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48011. [D 20:43:26.386680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48012. [D 20:43:26.386698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48013. [D 20:43:26.386712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48014. [D 20:43:26.386727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48015. [D 20:43:26.386743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48016. [D 20:43:26.386758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48017. [D 20:43:26.386773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48018. [D 20:43:26.386789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48019. [D 20:43:26.386803] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48020. [D 20:43:26.391705] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48020. [D 20:43:26.391723] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 57/70. [D 20:43:26.392197] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.392231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.392245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.392275] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7102 [D 20:43:26.392291] element 0: offset: 0x629ef0, size: 24 [D 20:43:26.392309] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 58/70. [D 20:43:26.392340] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.392355] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.392369] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.392390] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7104 [D 20:43:26.392405] element 0: offset: 0x658610, size: 24 [D 20:43:26.392420] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 59/70. [D 20:43:26.398438] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48019. [D 20:43:26.398464] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 60/70. [D 20:43:26.401408] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.401424] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.401438] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.401558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.401574] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.401587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.407549] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7102 [D 20:43:26.407630] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 0/70. [D 20:43:26.407688] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7104 [D 20:43:26.407705] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 1/70. [D 20:43:26.410134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48019. [D 20:43:26.410160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48020. [D 20:43:26.410175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48021. [D 20:43:26.410190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48022. [D 20:43:26.410205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48023. [D 20:43:26.410220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48024. [D 20:43:26.410234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48025. [D 20:43:26.410249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48026. [D 20:43:26.410264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48027. [D 20:43:26.410279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48028. [D 20:43:26.410293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48029. [D 20:43:26.410308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48030. [D 20:43:26.410322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48031. [D 20:43:26.410337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48032. [D 20:43:26.410352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48033. [D 20:43:26.410366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48034. [D 20:43:26.410381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48035. [D 20:43:26.410396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48036. [D 20:43:26.410410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48037. [D 20:43:26.410426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48038. [D 20:43:26.410441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48039. [D 20:43:26.410456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48040. [D 20:43:26.410470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48041. [D 20:43:26.410485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48042. [D 20:43:26.410499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48043. [D 20:43:26.410528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48044. [D 20:43:26.410542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48045. [D 20:43:26.410557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48046. [D 20:43:26.410571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48047. [D 20:43:26.410586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48048. [D 20:43:26.410605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48049. [D 20:43:26.410619] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48050. [D 20:43:26.410637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48051. [D 20:43:26.410652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48052. [D 20:43:26.410667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48053. [D 20:43:26.410681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48054. [D 20:43:26.410696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48055. [D 20:43:26.410710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48056. [D 20:43:26.410725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48057. [D 20:43:26.410739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48058. [D 20:43:26.410754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48059. [D 20:43:26.410768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48060. [D 20:43:26.410783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48061. [D 20:43:26.410797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48062. [D 20:43:26.410812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48063. [D 20:43:26.410826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48064. [D 20:43:26.410841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48065. [D 20:43:26.410855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48066. [D 20:43:26.410871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48067. [D 20:43:26.410885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48068. [D 20:43:26.410900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48069. [D 20:43:26.410914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48070. [D 20:43:26.410929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48071. [D 20:43:26.410944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48072. [D 20:43:26.410958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48073. [D 20:43:26.410972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48074. [D 20:43:26.410987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48075. [D 20:43:26.411001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48076. [D 20:43:26.411016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48077. [D 20:43:26.411030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48078. [D 20:43:26.411045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48079. [D 20:43:26.411059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48080. [D 20:43:26.411074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48081. [D 20:43:26.411088] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48082. [D 20:43:26.416357] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.416377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.416390] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.416420] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7109 [D 20:43:26.416436] element 0: offset: 0x62fd10, size: 24 [D 20:43:26.416451] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 2/70. [D 20:43:26.416475] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.416489] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.416502] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.416523] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7110 [D 20:43:26.416538] element 0: offset: 0x5b0030, size: 24 [D 20:43:26.416553] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 3/70. [D 20:43:26.416636] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48082. [D 20:43:26.416654] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 4/70. [D 20:43:26.423294] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48081. [D 20:43:26.423316] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 5/70. [D 20:43:26.424159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.424176] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.424189] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.424312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.424328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.424342] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.427319] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7109 [D 20:43:26.427406] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 6/70. [D 20:43:26.429393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 48081. [D 20:43:26.429437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 48082. [D 20:43:26.429452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 48083. [D 20:43:26.429468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 48084. [D 20:43:26.429482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 48085. [D 20:43:26.429497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 48086. [D 20:43:26.429511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48087. [D 20:43:26.429526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48088. [D 20:43:26.429540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48089. [D 20:43:26.429555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 48090. [D 20:43:26.429570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 48091. [D 20:43:26.429584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 48092. [D 20:43:26.429599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 48093. [D 20:43:26.429613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 48094. [D 20:43:26.429628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48095. [D 20:43:26.429642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48096. [D 20:43:26.429657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48097. [D 20:43:26.429671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 48098. [D 20:43:26.429686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 48099. [D 20:43:26.429701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 48100. [D 20:43:26.429715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 48101. [D 20:43:26.429730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 48102. [D 20:43:26.429744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48103. [D 20:43:26.429759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48104. [D 20:43:26.429773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48105. [D 20:43:26.429788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 48106. [D 20:43:26.429802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 48107. [D 20:43:26.429817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 48108. [D 20:43:26.429831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 48109. [D 20:43:26.429850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 48110. [D 20:43:26.429865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48111. [D 20:43:26.429879] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48112. [D 20:43:26.434314] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7110 [D 20:43:26.434395] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 7/70. [D 20:43:26.437466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.437486] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.437500] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.437541] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7114 [D 20:43:26.437556] element 0: offset: 0x636ca0, size: 24 [D 20:43:26.437573] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 8/70. [D 20:43:26.437613] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.437628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.437640] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.437661] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7116 [D 20:43:26.437676] element 0: offset: 0x691fe0, size: 24 [D 20:43:26.437692] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 9/70. [D 20:43:26.439503] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48112. [D 20:43:26.439531] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 10/70. [D 20:43:26.439548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48112. [D 20:43:26.439564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48113. [D 20:43:26.439578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48114. [D 20:43:26.439593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48115. [D 20:43:26.439607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48116. [D 20:43:26.439622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48117. [D 20:43:26.439636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48118. [D 20:43:26.439651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48119. [D 20:43:26.439666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48120. [D 20:43:26.439680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48121. [D 20:43:26.439695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48122. [D 20:43:26.439710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48123. [D 20:43:26.439724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48124. [D 20:43:26.439739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48125. [D 20:43:26.439753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48126. [D 20:43:26.439768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48127. [D 20:43:26.439783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48128. [D 20:43:26.439799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48129. [D 20:43:26.439814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48130. [D 20:43:26.439828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48131. [D 20:43:26.439843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48132. [D 20:43:26.439857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48133. [D 20:43:26.439872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48134. [D 20:43:26.439886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48135. [D 20:43:26.439900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48136. [D 20:43:26.439918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48137. [D 20:43:26.439933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48138. [D 20:43:26.439947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48139. [D 20:43:26.439962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48140. [D 20:43:26.439976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48141. [D 20:43:26.439990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48142. [D 20:43:26.440005] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48143. [D 20:43:26.440072] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.440094] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.440106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.445500] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48143. [D 20:43:26.445526] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 11/70. [D 20:43:26.446814] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7114 [D 20:43:26.446898] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 12/70. [D 20:43:26.446926] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.446948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.446962] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.446985] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7116 [D 20:43:26.447007] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 13/70. [D 20:43:26.451464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48143. [D 20:43:26.451489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48144. [D 20:43:26.451504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48145. [D 20:43:26.451518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48146. [D 20:43:26.451533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48147. [D 20:43:26.451557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48148. [D 20:43:26.451580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48149. [D 20:43:26.451596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48150. [D 20:43:26.451610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48151. [D 20:43:26.451624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48152. [D 20:43:26.451639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48153. [D 20:43:26.451653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48154. [D 20:43:26.451668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48155. [D 20:43:26.451682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48156. [D 20:43:26.451697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48157. [D 20:43:26.451711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48158. [D 20:43:26.451725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48159. [D 20:43:26.451740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48160. [D 20:43:26.451754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48161. [D 20:43:26.451768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48162. [D 20:43:26.451783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48163. [D 20:43:26.451798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48164. [D 20:43:26.451812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48165. [D 20:43:26.451826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48166. [D 20:43:26.451841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48167. [D 20:43:26.451865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48168. [D 20:43:26.451880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48169. [D 20:43:26.451894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48170. [D 20:43:26.451909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48171. [D 20:43:26.451927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48172. [D 20:43:26.451941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48173. [D 20:43:26.451956] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48174. [D 20:43:26.451972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48175. [D 20:43:26.451987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48176. [D 20:43:26.452002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48177. [D 20:43:26.452016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48178. [D 20:43:26.452032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48179. [D 20:43:26.452046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48180. [D 20:43:26.452061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48181. [D 20:43:26.452075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48182. [D 20:43:26.452090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48183. [D 20:43:26.452105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48184. [D 20:43:26.452119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48185. [D 20:43:26.452133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48186. [D 20:43:26.452152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48187. [D 20:43:26.452167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48188. [D 20:43:26.452181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48189. [D 20:43:26.452196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48190. [D 20:43:26.452211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48191. [D 20:43:26.452226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48192. [D 20:43:26.452241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48193. [D 20:43:26.452256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48194. [D 20:43:26.452271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48195. [D 20:43:26.452287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48196. [D 20:43:26.452301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48197. [D 20:43:26.452320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48198. [D 20:43:26.452334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48199. [D 20:43:26.452350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48200. [D 20:43:26.452365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48201. [D 20:43:26.452380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48202. [D 20:43:26.452394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48203. [D 20:43:26.452409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48204. [D 20:43:26.452423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48205. [D 20:43:26.452438] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48206. [D 20:43:26.454092] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.454118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.454131] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.454174] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7120 [D 20:43:26.454189] element 0: offset: 0x644640, size: 24 [D 20:43:26.454206] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 14/70. [D 20:43:26.454246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.454260] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.454272] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.454293] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7122 [D 20:43:26.454307] element 0: offset: 0x6598d0, size: 24 [D 20:43:26.454321] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 15/70. [D 20:43:26.463175] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48206. [D 20:43:26.463205] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 16/70. [D 20:43:26.468963] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48205. [D 20:43:26.468979] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 17/70. [D 20:43:26.469048] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.469069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.469082] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.469199] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.469214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.469227] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.475917] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7120 [D 20:43:26.475999] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 18/70. [D 20:43:26.476076] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7122 [D 20:43:26.476093] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 19/70. [D 20:43:26.480537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 48205. [D 20:43:26.480564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 48206. [D 20:43:26.480579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 48207. [D 20:43:26.480593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 48208. [D 20:43:26.480608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 48209. [D 20:43:26.480622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 48210. [D 20:43:26.480637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48211. [D 20:43:26.480651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48212. [D 20:43:26.480666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48213. [D 20:43:26.480680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 48214. [D 20:43:26.480694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 48215. [D 20:43:26.480709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 48216. [D 20:43:26.480723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 48217. [D 20:43:26.480738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 48218. [D 20:43:26.480752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48219. [D 20:43:26.480767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48220. [D 20:43:26.480782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48221. [D 20:43:26.480796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 48222. [D 20:43:26.480811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 48223. [D 20:43:26.480825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 48224. [D 20:43:26.480840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 48225. [D 20:43:26.480867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 48226. [D 20:43:26.480882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48227. [D 20:43:26.480897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48228. [D 20:43:26.480911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48229. [D 20:43:26.480926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 48230. [D 20:43:26.480940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 48231. [D 20:43:26.480955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 48232. [D 20:43:26.480969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 48233. [D 20:43:26.480984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 48234. [D 20:43:26.480999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48235. [D 20:43:26.481013] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48236. [D 20:43:26.481029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48237. [D 20:43:26.481044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48238. [D 20:43:26.481059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48239. [D 20:43:26.481073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48240. [D 20:43:26.481087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48241. [D 20:43:26.481102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48242. [D 20:43:26.481116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48243. [D 20:43:26.481130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48244. [D 20:43:26.481145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48245. [D 20:43:26.481159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48246. [D 20:43:26.481173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48247. [D 20:43:26.481188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48248. [D 20:43:26.481203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48249. [D 20:43:26.481218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48250. [D 20:43:26.481232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48251. [D 20:43:26.481247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48252. [D 20:43:26.481261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48253. [D 20:43:26.481276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48254. [D 20:43:26.481290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48255. [D 20:43:26.481304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48256. [D 20:43:26.481319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48257. [D 20:43:26.481333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48258. [D 20:43:26.481347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48259. [D 20:43:26.481362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48260. [D 20:43:26.481376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48261. [D 20:43:26.481391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48262. [D 20:43:26.481405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48263. [D 20:43:26.481420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48264. [D 20:43:26.481434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48265. [D 20:43:26.481449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48266. [D 20:43:26.481463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48267. [D 20:43:26.481477] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48268. [D 20:43:26.483215] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.483239] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.483252] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.483299] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7126 [D 20:43:26.483314] element 0: offset: 0x61fa30, size: 24 [D 20:43:26.483330] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 20/70. [D 20:43:26.483469] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.483485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.483498] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.483521] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7128 [D 20:43:26.483535] element 0: offset: 0x658610, size: 24 [D 20:43:26.483550] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 21/70. [D 20:43:26.487402] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48268. [D 20:43:26.487430] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 22/70. [D 20:43:26.495908] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48267. [D 20:43:26.816143] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 23/70. [D 20:43:26.817528] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.817550] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.817563] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.817681] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.817696] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.817708] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.817730] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7132 [D 20:43:26.817744] element 0: offset: 0x5b0030, size: 24 [D 20:43:26.817759] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 24/70. [D 20:43:26.817788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.817802] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.817817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.826872] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7126 [D 20:43:26.826945] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 25/70. [D 20:43:26.826968] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.826994] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.827009] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.827028] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7128 [D 20:43:26.827050] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 26/70. [D 20:43:26.827055] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7134 [D 20:43:26.827079] element 0: offset: 0x626300, size: 24 [D 20:43:26.827098] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 27/70. [D 20:43:26.827100] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7132 [D 20:43:26.827140] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 28/70. [D 20:43:26.827197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48267. [D 20:43:26.827220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48268. [D 20:43:26.827235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48269. [D 20:43:26.827250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48270. [D 20:43:26.827264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48271. [D 20:43:26.827279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48272. [D 20:43:26.827293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48273. [D 20:43:26.827308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48274. [D 20:43:26.827322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48275. [D 20:43:26.827337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48276. [D 20:43:26.827351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48277. [D 20:43:26.827366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48278. [D 20:43:26.827380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48279. [D 20:43:26.827395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48280. [D 20:43:26.827409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48281. [D 20:43:26.827424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48282. [D 20:43:26.827438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48283. [D 20:43:26.827453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48284. [D 20:43:26.827467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48285. [D 20:43:26.827482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48286. [D 20:43:26.827496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48287. [D 20:43:26.827511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48288. [D 20:43:26.827525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48289. [D 20:43:26.827539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48290. [D 20:43:26.827554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48291. [D 20:43:26.827568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48292. [D 20:43:26.827582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48293. [D 20:43:26.827597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48294. [D 20:43:26.827611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48295. [D 20:43:26.827626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48296. [D 20:43:26.827640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48297. [D 20:43:26.827654] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0142f0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48298. [D 20:43:26.827671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48299. [D 20:43:26.827686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48300. [D 20:43:26.827701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48301. [D 20:43:26.827715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48302. [D 20:43:26.827729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48303. [D 20:43:26.827744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48304. [D 20:43:26.827758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48305. [D 20:43:26.827773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48306. [D 20:43:26.827787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48307. [D 20:43:26.827802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48308. [D 20:43:26.827816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48309. [D 20:43:26.827830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48310. [D 20:43:26.827846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48311. [D 20:43:26.827860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48312. [D 20:43:26.827875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48313. [D 20:43:26.827889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48314. [D 20:43:26.827903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48315. [D 20:43:26.827918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48316. [D 20:43:26.827936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48317. [D 20:43:26.827950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48318. [D 20:43:26.827965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48319. [D 20:43:26.827979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48320. [D 20:43:26.828008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48321. [D 20:43:26.828030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48322. [D 20:43:26.828054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48323. [D 20:43:26.828068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48324. [D 20:43:26.828083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48325. [D 20:43:26.828097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48326. [D 20:43:26.828112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48327. [D 20:43:26.828126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48328. [D 20:43:26.828141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48329. [D 20:43:26.828162] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48330. [D 20:43:26.828180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48331. [D 20:43:26.828195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 48332. [D 20:43:26.828210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 48333. [D 20:43:26.828225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 48334. [D 20:43:26.828240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 48335. [D 20:43:26.828254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 48336. [D 20:43:26.828269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48337. [E 20:43:26.828304] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 48338, block for 10 ms. [D 20:43:26.836001] openib_check_cq: completed rdma wr_id 2aaaab0142f0, nic_wr_credit 48337. [D 20:43:26.836024] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 29/70. [D 20:43:26.836040] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48336. [D 20:43:26.836055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48337. [D 20:43:26.836069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48338. [D 20:43:26.836084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 48339. [D 20:43:26.836099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 48340. [D 20:43:26.836113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 48341. [D 20:43:26.836127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 48342. [D 20:43:26.836142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 48343. [D 20:43:26.836159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48344. [D 20:43:26.836174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48345. [D 20:43:26.836188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48346. [D 20:43:26.836203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 48347. [D 20:43:26.836218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 48348. [D 20:43:26.836232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 48349. [D 20:43:26.836247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 48350. [D 20:43:26.836261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 48351. [D 20:43:26.836276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48352. [D 20:43:26.836290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48353. [D 20:43:26.836305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48354. [D 20:43:26.836325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 48355. [D 20:43:26.836340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 48356. [D 20:43:26.836357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 48357. [D 20:43:26.836371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 48358. [D 20:43:26.836386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 48359. [D 20:43:26.836401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48360. [D 20:43:26.836415] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036b80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48361. [D 20:43:26.844187] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7134 [D 20:43:26.844212] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 30/70. [D 20:43:26.844811] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48361. [D 20:43:26.844833] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 31/70. [D 20:43:26.848322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.848340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.848354] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.850703] openib_check_cq: completed rdma wr_id 2aaaab036b80, nic_wr_credit 48360. [D 20:43:26.850721] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 32/70. [D 20:43:26.851821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48360. [D 20:43:26.851836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48361. [D 20:43:26.851851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48362. [D 20:43:26.851866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48363. [D 20:43:26.851880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48364. [D 20:43:26.851895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48365. [D 20:43:26.851909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48366. [D 20:43:26.851923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48367. [D 20:43:26.851941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48368. [D 20:43:26.851956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48369. [D 20:43:26.851970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48370. [D 20:43:26.851985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48371. [D 20:43:26.852000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48372. [D 20:43:26.852014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48373. [D 20:43:26.852029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48374. [D 20:43:26.852043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48375. [D 20:43:26.852058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48376. [D 20:43:26.852072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48377. [D 20:43:26.852086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48378. [D 20:43:26.852101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48379. [D 20:43:26.852115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48380. [D 20:43:26.852129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48381. [D 20:43:26.852144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48382. [D 20:43:26.852163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48383. [D 20:43:26.852178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48384. [D 20:43:26.852192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48385. [D 20:43:26.852208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48386. [D 20:43:26.852223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48387. [D 20:43:26.852238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48388. [D 20:43:26.852248] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.852253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48389. [D 20:43:26.852327] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.852333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48390. [D 20:43:26.852350] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.852368] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014690 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48391. [D 20:43:26.852398] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.852415] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.852427] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:26.857738] openib_check_cq: completed rdma wr_id 2aaaab014690, nic_wr_credit 48391. [D 20:43:26.857761] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 33/70. [D 20:43:26.857813] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.857831] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.857844] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:26.868982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.868999] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.869012] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:26.869053] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7139 [D 20:43:26.869068] element 0: offset: 0x642000, size: 24 [D 20:43:26.869087] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 34/70. [D 20:43:26.871560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.871625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.871639] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:26.871682] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7142 [D 20:43:26.871698] element 0: offset: 0x644640, size: 24 [D 20:43:26.871716] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 35/70. [D 20:43:26.871761] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.871776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.871789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:26.871810] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7145 [D 20:43:26.871824] element 0: offset: 0x62fd10, size: 24 [D 20:43:26.871839] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 36/70. [D 20:43:26.871922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:26.871948] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.871960] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:26.871981] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7146 [D 20:43:26.871995] element 0: offset: 0x636ca0, size: 24 [D 20:43:26.872011] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 37/70. [D 20:43:26.876203] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7142 [D 20:43:26.876231] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 38/70. [D 20:43:26.876372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48391. [D 20:43:26.876390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48392. [D 20:43:26.876405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48393. [D 20:43:26.876421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48394. [D 20:43:26.876436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48395. [D 20:43:26.876451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48396. [D 20:43:26.876465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48397. [D 20:43:26.876480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48398. [D 20:43:26.876495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48399. [D 20:43:26.876510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48400. [D 20:43:26.876524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48401. [D 20:43:26.876539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48402. [D 20:43:26.876554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48403. [D 20:43:26.876568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48404. [D 20:43:26.876583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48405. [D 20:43:26.876598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48406. [D 20:43:26.876613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48407. [D 20:43:26.876627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48408. [D 20:43:26.876642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48409. [D 20:43:26.876657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48410. [D 20:43:26.876672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48411. [D 20:43:26.876686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48412. [D 20:43:26.876701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48413. [D 20:43:26.876716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48414. [D 20:43:26.876730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48415. [D 20:43:26.876745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48416. [D 20:43:26.876760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48417. [D 20:43:26.876774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48418. [D 20:43:26.876789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48419. [D 20:43:26.876804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48420. [D 20:43:26.876819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48421. [D 20:43:26.876833] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48422. [D 20:43:26.880691] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7139 [D 20:43:26.880743] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 39/70. [D 20:43:26.880803] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7145 [D 20:43:26.880822] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 40/70. [D 20:43:26.881162] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7146 [D 20:43:26.881181] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 41/70. [D 20:43:26.885173] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48422. [D 20:43:26.885198] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 42/70. [D 20:43:26.885216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48422. [D 20:43:26.885232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48423. [D 20:43:26.885247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48424. [D 20:43:26.885261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48425. [D 20:43:26.885276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48426. [D 20:43:26.885291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48427. [D 20:43:26.885305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48428. [D 20:43:26.885320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48429. [D 20:43:26.885334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48430. [D 20:43:26.885349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48431. [D 20:43:26.885364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48432. [D 20:43:26.885378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48433. [D 20:43:26.885393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48434. [D 20:43:26.885407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48435. [D 20:43:26.885422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48436. [D 20:43:26.885437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48437. [D 20:43:26.885451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48438. [D 20:43:26.885466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48439. [D 20:43:26.885481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48440. [D 20:43:26.885495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48441. [D 20:43:26.885510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48442. [D 20:43:26.885524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48443. [D 20:43:26.885539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48444. [D 20:43:26.885553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48445. [D 20:43:26.885570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48446. [D 20:43:26.885584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48447. [D 20:43:26.885599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48448. [D 20:43:26.885614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48449. [D 20:43:26.885628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48450. [D 20:43:26.885643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48451. [D 20:43:26.885657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48452. [D 20:43:26.885672] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48453. [D 20:43:26.885688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48454. [D 20:43:26.885703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 48455. [D 20:43:26.885718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 48456. [D 20:43:26.885732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 48457. [D 20:43:26.885747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 48458. [D 20:43:26.885761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 48459. [D 20:43:26.885776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48460. [D 20:43:26.885790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48461. [D 20:43:26.885805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48462. [D 20:43:26.885819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 48463. [D 20:43:26.885834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 48464. [D 20:43:26.885848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 48465. [D 20:43:26.885863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 48466. [D 20:43:26.885878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 48467. [D 20:43:26.885892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48468. [D 20:43:26.885907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48469. [D 20:43:26.885921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48470. [D 20:43:26.885936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 48471. [D 20:43:26.885950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 48472. [D 20:43:26.885965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 48473. [D 20:43:26.885980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 48474. [D 20:43:26.885995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 48475. [D 20:43:26.886010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48476. [D 20:43:26.886024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48477. [D 20:43:26.886039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48478. [D 20:43:26.886054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 48479. [D 20:43:26.886068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 48480. [D 20:43:26.886083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 48481. [D 20:43:26.886097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 48482. [D 20:43:26.886112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 48483. [D 20:43:26.886127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48484. [D 20:43:26.886141] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036b80 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48485. [D 20:43:26.886157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48486. [D 20:43:26.886173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48487. [D 20:43:26.886187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48488. [D 20:43:26.886202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48489. [D 20:43:26.886217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48490. [D 20:43:26.886232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48491. [E 20:43:26.886250] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 48492, block for 10 ms. [D 20:43:26.886282] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48491. [D 20:43:26.886298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48492. [E 20:43:26.886314] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 48493, block for 10 ms. [D 20:43:26.894792] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48492. [D 20:43:26.894814] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 43/70. [D 20:43:26.894829] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48491. [D 20:43:26.894844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48492. [D 20:43:26.894859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48493. [D 20:43:26.894873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48494. [D 20:43:26.894888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48495. [D 20:43:26.894903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48496. [D 20:43:26.894918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48497. [D 20:43:26.894933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48498. [D 20:43:26.894948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48499. [D 20:43:26.894962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48500. [D 20:43:26.894977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48501. [D 20:43:26.894992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48502. [D 20:43:26.895006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48503. [D 20:43:26.895021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48504. [D 20:43:26.895036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48505. [D 20:43:26.895051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48506. [D 20:43:26.895065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48507. [D 20:43:26.895080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48508. [D 20:43:26.895095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48509. [D 20:43:26.895109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48510. [D 20:43:26.895124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48511. [D 20:43:26.895139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48512. [D 20:43:26.895153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48513. [D 20:43:26.895168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48514. [D 20:43:26.895182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48515. [D 20:43:26.895197] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014470 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48516. [D 20:43:26.898332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.898350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.898364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:26.906366] openib_check_cq: completed rdma wr_id 2aaaab036b80, nic_wr_credit 48516. [D 20:43:26.906388] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 44/70. [D 20:43:26.911558] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.911575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.911588] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:26.918214] openib_check_cq: completed rdma wr_id 2aaaab014470, nic_wr_credit 48515. [D 20:43:26.918234] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 45/70. [D 20:43:26.921192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.921208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.921221] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:26.921243] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:26.921257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:26.921271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:27.045255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.045276] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.045290] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:27.045329] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7149 [D 20:43:27.045345] element 0: offset: 0x61fa30, size: 24 [D 20:43:27.045361] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 46/70. [D 20:43:27.052429] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.052493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.052507] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.052550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7152 [D 20:43:27.052565] element 0: offset: 0x644560, size: 24 [D 20:43:27.052587] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 47/70. [D 20:43:27.052636] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7149 [D 20:43:27.052715] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 48/70. [D 20:43:27.052857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 48515. [D 20:43:27.052880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 48516. [D 20:43:27.052895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 48517. [D 20:43:27.052909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 48518. [D 20:43:27.052923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 48519. [D 20:43:27.052937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 48520. [D 20:43:27.052951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 48521. [D 20:43:27.052965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48522. [D 20:43:27.052980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48523. [D 20:43:27.052994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48524. [D 20:43:27.053008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 48525. [D 20:43:27.053022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 48526. [D 20:43:27.053036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 48527. [D 20:43:27.053050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 48528. [D 20:43:27.053064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 48529. [D 20:43:27.053079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48530. [D 20:43:27.053093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48531. [D 20:43:27.053107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48532. [D 20:43:27.053121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 48533. [D 20:43:27.053135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 48534. [D 20:43:27.053149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 48535. [D 20:43:27.053163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 48536. [D 20:43:27.053179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 48537. [D 20:43:27.053194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48538. [D 20:43:27.053208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48539. [D 20:43:27.053222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48540. [D 20:43:27.053236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 48541. [D 20:43:27.053250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 48542. [D 20:43:27.053264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 48543. [D 20:43:27.053278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 48544. [D 20:43:27.053292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 48545. [D 20:43:27.053306] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48546. [D 20:43:27.059315] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7152 [D 20:43:27.059343] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 49/70. [D 20:43:27.060014] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48546. [D 20:43:27.060075] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 50/70. [D 20:43:27.060095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48546. [D 20:43:27.060111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48547. [D 20:43:27.060125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48548. [D 20:43:27.060139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48549. [D 20:43:27.060164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48550. [D 20:43:27.060178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48551. [D 20:43:27.060192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48552. [D 20:43:27.060206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48553. [D 20:43:27.060220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48554. [D 20:43:27.060234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48555. [D 20:43:27.060248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48556. [D 20:43:27.060262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48557. [D 20:43:27.060276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48558. [D 20:43:27.060290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48559. [D 20:43:27.060304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48560. [D 20:43:27.060318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48561. [D 20:43:27.060334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48562. [D 20:43:27.060348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48563. [D 20:43:27.060362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48564. [D 20:43:27.060376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48565. [D 20:43:27.060391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48566. [D 20:43:27.060405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48567. [D 20:43:27.060419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48568. [D 20:43:27.060433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48569. [D 20:43:27.060447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48570. [D 20:43:27.060461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48571. [D 20:43:27.060475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48572. [D 20:43:27.060489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48573. [D 20:43:27.060503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48574. [D 20:43:27.060517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48575. [D 20:43:27.060532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48576. [D 20:43:27.060545] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48577. [D 20:43:27.063667] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.063684] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.063697] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.070477] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48577. [D 20:43:27.070493] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 51/70. [D 20:43:27.072236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.072261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.072275] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.072318] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7156 [D 20:43:27.072334] element 0: offset: 0x636ca0, size: 24 [D 20:43:27.072350] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 52/70. [D 20:43:27.072386] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.072401] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.072414] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.072435] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7158 [D 20:43:27.072450] element 0: offset: 0x642000, size: 24 [D 20:43:27.072465] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 53/70. [D 20:43:27.072505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.072520] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.072533] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.072557] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.072571] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.072584] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.072606] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7162 [D 20:43:27.072621] element 0: offset: 0x644640, size: 24 [D 20:43:27.072638] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 54/70. [D 20:43:27.079078] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7158 [D 20:43:27.079157] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 55/70. [D 20:43:27.079297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 48577. [D 20:43:27.079317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 48578. [D 20:43:27.079331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 48579. [D 20:43:27.079345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 48580. [D 20:43:27.079359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 48581. [D 20:43:27.079374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 48582. [D 20:43:27.079388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 48583. [D 20:43:27.079402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48584. [D 20:43:27.079416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48585. [D 20:43:27.079429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48586. [D 20:43:27.079444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 48587. [D 20:43:27.079458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 48588. [D 20:43:27.079471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 48589. [D 20:43:27.079486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 48590. [D 20:43:27.079504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 48591. [D 20:43:27.079518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48592. [D 20:43:27.079532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48593. [D 20:43:27.079546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48594. [D 20:43:27.079560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 48595. [D 20:43:27.079574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 48596. [D 20:43:27.079588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 48597. [D 20:43:27.079603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 48598. [D 20:43:27.079617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 48599. [D 20:43:27.079632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48600. [D 20:43:27.079646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48601. [D 20:43:27.079660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48602. [D 20:43:27.079674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 48603. [D 20:43:27.079690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 48604. [D 20:43:27.079704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 48605. [D 20:43:27.079718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 48606. [D 20:43:27.079732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 48607. [D 20:43:27.079746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48608. [D 20:43:27.079836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.079907] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.079921] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.079974] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7164 [D 20:43:27.079991] element 0: offset: 0x6425f0, size: 24 [D 20:43:27.080010] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 56/70. [D 20:43:27.080014] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7156 [D 20:43:27.080048] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 57/70. [D 20:43:27.080067] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7162 [D 20:43:27.080083] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 58/70. [D 20:43:27.090983] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48608. [D 20:43:27.091001] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 59/70. [D 20:43:27.091024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48608. [D 20:43:27.091039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48609. [D 20:43:27.091053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48610. [D 20:43:27.091067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48611. [D 20:43:27.091081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48612. [D 20:43:27.091095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48613. [D 20:43:27.091109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48614. [D 20:43:27.091123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48615. [D 20:43:27.091137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48616. [D 20:43:27.091151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48617. [D 20:43:27.091164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48618. [D 20:43:27.091178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48619. [D 20:43:27.091192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48620. [D 20:43:27.091206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48621. [D 20:43:27.091220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48622. [D 20:43:27.091235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48623. [D 20:43:27.091249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48624. [D 20:43:27.091264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48625. [D 20:43:27.091278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48626. [D 20:43:27.091292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48627. [D 20:43:27.091307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48628. [D 20:43:27.091321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48629. [D 20:43:27.091340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48630. [D 20:43:27.091354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48631. [D 20:43:27.091368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48632. [D 20:43:27.091382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48633. [D 20:43:27.091396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48634. [D 20:43:27.091410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48635. [D 20:43:27.091423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48636. [D 20:43:27.091438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48637. [D 20:43:27.091451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48638. [D 20:43:27.091466] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48639. [D 20:43:27.091481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48640. [D 20:43:27.091496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48641. [D 20:43:27.091513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48642. [D 20:43:27.091528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48643. [D 20:43:27.091541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48644. [D 20:43:27.091556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48645. [D 20:43:27.091569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48646. [D 20:43:27.091584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48647. [D 20:43:27.091597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48648. [D 20:43:27.091613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48649. [D 20:43:27.091627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48650. [D 20:43:27.091641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48651. [D 20:43:27.091655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48652. [D 20:43:27.091669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48653. [D 20:43:27.091684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48654. [D 20:43:27.091698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48655. [D 20:43:27.091712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48656. [D 20:43:27.091727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48657. [D 20:43:27.091742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48658. [D 20:43:27.091756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48659. [D 20:43:27.091770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48660. [D 20:43:27.091784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48661. [D 20:43:27.091798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48662. [D 20:43:27.091812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48663. [D 20:43:27.091825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48664. [D 20:43:27.091839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48665. [D 20:43:27.091853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48666. [D 20:43:27.091867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48667. [D 20:43:27.091881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48668. [D 20:43:27.091895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48669. [D 20:43:27.091909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48670. [D 20:43:27.091923] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036b80 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48671. [D 20:43:27.091986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.092010] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.092024] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.098087] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7164 [D 20:43:27.098152] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 60/70. [D 20:43:27.102461] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.102483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.102496] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.102520] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7167 [D 20:43:27.102534] element 0: offset: 0x644560, size: 24 [D 20:43:27.102549] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 0/70. [D 20:43:27.102790] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48671. [D 20:43:27.102815] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 1/70. [D 20:43:27.114334] openib_check_cq: completed rdma wr_id 2aaaab036b80, nic_wr_credit 48670. [D 20:43:27.114357] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 2/70. [D 20:43:27.114389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48670. [D 20:43:27.114405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48671. [D 20:43:27.114434] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.280365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.280387] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.283505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48672. [D 20:43:27.283568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48673. [D 20:43:27.283582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48674. [D 20:43:27.283596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48675. [D 20:43:27.283611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48676. [D 20:43:27.283625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48677. [D 20:43:27.283643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48678. [D 20:43:27.283658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48679. [D 20:43:27.283672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48680. [D 20:43:27.283686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48681. [D 20:43:27.283701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48682. [D 20:43:27.283715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48683. [D 20:43:27.283731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48684. [D 20:43:27.283745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48685. [D 20:43:27.283759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48686. [D 20:43:27.283774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48687. [D 20:43:27.283788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48688. [D 20:43:27.283803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48689. [D 20:43:27.283817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48690. [D 20:43:27.283831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48691. [D 20:43:27.283850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48692. [D 20:43:27.283864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48693. [D 20:43:27.283879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48694. [D 20:43:27.283897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48695. [D 20:43:27.283912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48696. [D 20:43:27.283926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48697. [D 20:43:27.283944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48698. [D 20:43:27.283962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48699. [D 20:43:27.283977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48700. [D 20:43:27.284141] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48701. [D 20:43:27.287227] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7167 [D 20:43:27.287291] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 3/70. [D 20:43:27.287348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.287363] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.287376] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.287418] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7171 [D 20:43:27.287432] element 0: offset: 0x5b0030, size: 24 [D 20:43:27.287447] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 4/70. [D 20:43:27.287494] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.287508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.287520] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.287541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.287554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.287567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.287586] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7174 [D 20:43:27.287600] element 0: offset: 0x658610, size: 24 [D 20:43:27.287614] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 5/70. [D 20:43:27.289182] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48701. [D 20:43:27.289201] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 6/70. [D 20:43:27.289237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 48701. [D 20:43:27.289252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 48702. [D 20:43:27.289266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 48703. [D 20:43:27.289282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 48704. [D 20:43:27.289296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 48705. [D 20:43:27.289310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 48706. [D 20:43:27.289324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 48707. [D 20:43:27.289339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48708. [D 20:43:27.289353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48709. [D 20:43:27.289367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48710. [D 20:43:27.289381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 48711. [D 20:43:27.289395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 48712. [D 20:43:27.289409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 48713. [D 20:43:27.289423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 48714. [D 20:43:27.289437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 48715. [D 20:43:27.289452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48716. [D 20:43:27.289466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48717. [D 20:43:27.289480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48718. [D 20:43:27.289548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 48719. [D 20:43:27.289562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 48720. [D 20:43:27.289576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 48721. [D 20:43:27.289590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 48722. [D 20:43:27.289604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 48723. [D 20:43:27.289618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48724. [D 20:43:27.289632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48725. [D 20:43:27.289646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48726. [D 20:43:27.289660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 48727. [D 20:43:27.289674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 48728. [D 20:43:27.289688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 48729. [D 20:43:27.289702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 48730. [D 20:43:27.289716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 48731. [D 20:43:27.289731] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0142f0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48732. [D 20:43:27.292239] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.292255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.292268] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.295910] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7171 [D 20:43:27.296011] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 7/70. [D 20:43:27.296212] openib_check_cq: completed rdma wr_id 2aaaab0142f0, nic_wr_credit 48732. [D 20:43:27.296236] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 8/70. [D 20:43:27.296256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48732. [D 20:43:27.296273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48733. [D 20:43:27.296288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48734. [D 20:43:27.296303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48735. [D 20:43:27.296318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48736. [D 20:43:27.296332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48737. [D 20:43:27.296347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48738. [D 20:43:27.296362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48739. [D 20:43:27.296378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48740. [D 20:43:27.296393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48741. [D 20:43:27.296408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48742. [D 20:43:27.296423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48743. [D 20:43:27.296438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48744. [D 20:43:27.296453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48745. [D 20:43:27.296468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48746. [D 20:43:27.296483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48747. [D 20:43:27.296499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48748. [D 20:43:27.296513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48749. [D 20:43:27.296528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48750. [D 20:43:27.296543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48751. [D 20:43:27.296557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48752. [D 20:43:27.296571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48753. [D 20:43:27.296586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48754. [D 20:43:27.296600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48755. [D 20:43:27.296615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48756. [D 20:43:27.296629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48757. [D 20:43:27.296644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48758. [D 20:43:27.296658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48759. [D 20:43:27.296672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48760. [D 20:43:27.296687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48761. [D 20:43:27.296701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48762. [D 20:43:27.296716] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48763. [D 20:43:27.296792] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.296841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.296854] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.299655] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7174 [D 20:43:27.299678] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 9/70. [D 20:43:27.302044] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.302064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.302077] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.302116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7176 [D 20:43:27.302131] element 0: offset: 0x62fd10, size: 24 [D 20:43:27.302150] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 10/70. [D 20:43:27.302211] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48763. [D 20:43:27.302251] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 11/70. [D 20:43:27.302268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48763. [D 20:43:27.302283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48764. [D 20:43:27.302298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48765. [D 20:43:27.302312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48766. [D 20:43:27.302327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48767. [D 20:43:27.302341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48768. [D 20:43:27.302356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48769. [D 20:43:27.302370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48770. [D 20:43:27.302385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48771. [D 20:43:27.302399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48772. [D 20:43:27.302414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48773. [D 20:43:27.302428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48774. [D 20:43:27.302442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48775. [D 20:43:27.302456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48776. [D 20:43:27.302471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48777. [D 20:43:27.302485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48778. [D 20:43:27.302499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48779. [D 20:43:27.302514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48780. [D 20:43:27.302528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48781. [D 20:43:27.302542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48782. [D 20:43:27.302557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48783. [D 20:43:27.302571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48784. [D 20:43:27.302586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48785. [D 20:43:27.302600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48786. [D 20:43:27.302615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48787. [D 20:43:27.302629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48788. [D 20:43:27.302643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48789. [D 20:43:27.302658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48790. [D 20:43:27.302672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48791. [D 20:43:27.302687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48792. [D 20:43:27.302701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48793. [D 20:43:27.302715] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0256f0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48794. [D 20:43:27.302757] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.302775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.302787] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.305971] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7176 [D 20:43:27.306043] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 12/70. [D 20:43:27.308229] openib_check_cq: completed rdma wr_id 2aaaab0256f0, nic_wr_credit 48794. [D 20:43:27.308256] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 13/70. [D 20:43:27.308284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48794. [D 20:43:27.308300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48795. [D 20:43:27.308323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48796. [D 20:43:27.308338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48797. [D 20:43:27.308360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48798. [D 20:43:27.308375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48799. [D 20:43:27.308402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48800. [D 20:43:27.308418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48801. [D 20:43:27.308444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48802. [D 20:43:27.308466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48803. [D 20:43:27.308481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48804. [D 20:43:27.308495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48805. [D 20:43:27.308510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48806. [D 20:43:27.308539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48807. [D 20:43:27.308553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48808. [D 20:43:27.308582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48809. [D 20:43:27.308606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48810. [D 20:43:27.308621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48811. [D 20:43:27.308659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48812. [D 20:43:27.308682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48813. [D 20:43:27.308697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48814. [D 20:43:27.308711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48815. [D 20:43:27.308725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48816. [D 20:43:27.308740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48817. [D 20:43:27.308754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48818. [D 20:43:27.308768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48819. [D 20:43:27.308783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48820. [D 20:43:27.308797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48821. [D 20:43:27.308811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48822. [D 20:43:27.308825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48823. [D 20:43:27.308840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48824. [D 20:43:27.308854] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48825. [D 20:43:27.308918] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.308939] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.308952] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.308982] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.308995] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.309008] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.309044] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7179 [D 20:43:27.309059] element 0: offset: 0x61fa30, size: 24 [D 20:43:27.309078] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 14/70. [D 20:43:27.319300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.319318] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.319331] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.319353] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7182 [D 20:43:27.319367] element 0: offset: 0x626300, size: 24 [D 20:43:27.319381] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 15/70. [D 20:43:27.319404] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.319417] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.319430] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.319450] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7186 [D 20:43:27.319464] element 0: offset: 0x636ca0, size: 24 [D 20:43:27.319478] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 16/70. [D 20:43:27.319960] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48825. [D 20:43:27.319983] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 17/70. [D 20:43:27.323088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.323104] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.323117] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.326784] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7182 [D 20:43:27.326857] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 18/70. [D 20:43:27.327000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48825. [D 20:43:27.327021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48826. [D 20:43:27.327035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48827. [D 20:43:27.327050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48828. [D 20:43:27.327064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48829. [D 20:43:27.327078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48830. [D 20:43:27.327093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48831. [D 20:43:27.327107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48832. [D 20:43:27.327121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48833. [D 20:43:27.327136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48834. [D 20:43:27.327150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48835. [D 20:43:27.327164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48836. [D 20:43:27.327179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48837. [D 20:43:27.327193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48838. [D 20:43:27.327207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48839. [D 20:43:27.327222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48840. [D 20:43:27.327236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48841. [D 20:43:27.327250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48842. [D 20:43:27.327265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48843. [D 20:43:27.327279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48844. [D 20:43:27.327293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48845. [D 20:43:27.327308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48846. [D 20:43:27.327322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48847. [D 20:43:27.327336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48848. [D 20:43:27.327351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48849. [D 20:43:27.327365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48850. [D 20:43:27.327379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48851. [D 20:43:27.327394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48852. [D 20:43:27.327408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48853. [D 20:43:27.327423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48854. [D 20:43:27.327439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48855. [D 20:43:27.327454] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48856. [D 20:43:27.331823] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.331841] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.331854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.331895] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7188 [D 20:43:27.331910] element 0: offset: 0x691fe0, size: 24 [D 20:43:27.331925] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 19/70. [D 20:43:27.332131] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7179 [D 20:43:27.332154] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 20/70. [D 20:43:27.332170] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7186 [D 20:43:27.332185] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 21/70. [D 20:43:27.338720] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48856. [D 20:43:27.338796] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 22/70. [D 20:43:27.338819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 48856. [D 20:43:27.338835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 48857. [D 20:43:27.338850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 48858. [D 20:43:27.338865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 48859. [D 20:43:27.338879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 48860. [D 20:43:27.338894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 48861. [D 20:43:27.338908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 48862. [D 20:43:27.338923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48863. [D 20:43:27.338937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48864. [D 20:43:27.338951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48865. [D 20:43:27.338966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 48866. [D 20:43:27.338980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 48867. [D 20:43:27.338995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 48868. [D 20:43:27.339009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 48869. [D 20:43:27.339023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 48870. [D 20:43:27.339038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48871. [D 20:43:27.339052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48872. [D 20:43:27.339067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48873. [D 20:43:27.339081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 48874. [D 20:43:27.339096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 48875. [D 20:43:27.339111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 48876. [D 20:43:27.339125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 48877. [D 20:43:27.339139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 48878. [D 20:43:27.339154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48879. [D 20:43:27.339168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48880. [D 20:43:27.339183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48881. [D 20:43:27.339197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 48882. [D 20:43:27.339211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 48883. [D 20:43:27.339226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 48884. [D 20:43:27.339240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 48885. [D 20:43:27.339254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 48886. [D 20:43:27.339269] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48887. [D 20:43:27.339287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48888. [D 20:43:27.339301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48889. [D 20:43:27.339316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48890. [D 20:43:27.339330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48891. [D 20:43:27.339345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48892. [D 20:43:27.339359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48893. [D 20:43:27.339373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48894. [D 20:43:27.339388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48895. [D 20:43:27.339402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48896. [D 20:43:27.339416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48897. [D 20:43:27.339431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48898. [D 20:43:27.339445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48899. [D 20:43:27.339460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48900. [D 20:43:27.339474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48901. [D 20:43:27.339489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48902. [D 20:43:27.339503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48903. [D 20:43:27.339517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48904. [D 20:43:27.339533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48905. [D 20:43:27.339547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48906. [D 20:43:27.339562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48907. [D 20:43:27.339576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48908. [D 20:43:27.339590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48909. [D 20:43:27.339605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48910. [D 20:43:27.339619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48911. [D 20:43:27.339633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48912. [D 20:43:27.339647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48913. [D 20:43:27.339661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48914. [D 20:43:27.339676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48915. [D 20:43:27.339690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48916. [D 20:43:27.339704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48917. [D 20:43:27.339718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48918. [D 20:43:27.339733] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014690 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48919. [D 20:43:27.339798] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.339818] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.339831] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.342948] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7188 [D 20:43:27.343015] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 23/70. [D 20:43:27.347347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.347365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.347378] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.347418] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7191 [D 20:43:27.347432] element 0: offset: 0x642000, size: 24 [D 20:43:27.347449] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 24/70. [D 20:43:27.350695] openib_check_cq: completed rdma wr_id 2aaaab02a010, nic_wr_credit 48919. [D 20:43:27.350725] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 25/70. [D 20:43:27.362179] openib_check_cq: completed rdma wr_id 2aaaab014690, nic_wr_credit 48918. [D 20:43:27.362202] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 26/70. [D 20:43:27.362233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 48918. [D 20:43:27.362250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 48919. [D 20:43:27.362255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.362267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 48920. [D 20:43:27.362283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.362302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 48921. [D 20:43:27.362317] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.362337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 48922. [D 20:43:27.362366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 48923. [D 20:43:27.362381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 48924. [D 20:43:27.362396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 48925. [D 20:43:27.362411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 48926. [D 20:43:27.362426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 48927. [D 20:43:27.362440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 48928. [D 20:43:27.362455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 48929. [D 20:43:27.362469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 48930. [D 20:43:27.362484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 48931. [D 20:43:27.362498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 48932. [D 20:43:27.362513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 48933. [D 20:43:27.362527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 48934. [D 20:43:27.362542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 48935. [D 20:43:27.362556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 48936. [D 20:43:27.362571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 48937. [D 20:43:27.362585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 48938. [D 20:43:27.362600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 48939. [D 20:43:27.362614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 48940. [D 20:43:27.362629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 48941. [D 20:43:27.362643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 48942. [D 20:43:27.362658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 48943. [D 20:43:27.362673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 48944. [D 20:43:27.362687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 48945. [D 20:43:27.362713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 48946. [D 20:43:27.362736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 48947. [D 20:43:27.362751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 48948. [D 20:43:27.362766] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 48949. [D 20:43:27.362815] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.362834] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.362847] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.368461] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7191 [D 20:43:27.368484] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 27/70. [D 20:43:27.373514] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 48949. [D 20:43:27.373582] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 28/70. [D 20:43:27.373603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 48949. [D 20:43:27.373618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 48950. [D 20:43:27.373633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 48951. [D 20:43:27.373647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 48952. [D 20:43:27.373661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 48953. [D 20:43:27.373676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 48954. [D 20:43:27.373690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 48955. [D 20:43:27.373704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 48956. [D 20:43:27.373718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 48957. [D 20:43:27.373733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 48958. [D 20:43:27.373747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 48959. [D 20:43:27.373761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 48960. [D 20:43:27.373775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 48961. [D 20:43:27.373790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 48962. [D 20:43:27.373804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 48963. [D 20:43:27.373818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 48964. [D 20:43:27.373832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 48965. [D 20:43:27.373847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 48966. [D 20:43:27.373861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 48967. [D 20:43:27.373875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 48968. [D 20:43:27.373889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 48969. [D 20:43:27.373904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 48970. [D 20:43:27.373918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 48971. [D 20:43:27.373932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 48972. [D 20:43:27.373947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 48973. [D 20:43:27.373963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 48974. [D 20:43:27.373977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 48975. [D 20:43:27.373992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 48976. [D 20:43:27.374006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 48977. [D 20:43:27.374021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 48978. [D 20:43:27.374035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 48979. [D 20:43:27.374050] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014590 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 48980. [D 20:43:27.374106] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.374127] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.374140] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.380088] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.380106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.380119] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.380151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7195 [D 20:43:27.380166] element 0: offset: 0x658610, size: 24 [D 20:43:27.380181] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 29/70. [D 20:43:27.380212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.380226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.380238] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.380257] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7198 [D 20:43:27.380271] element 0: offset: 0x62fd10, size: 24 [D 20:43:27.380286] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 30/70. [D 20:43:27.382729] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.382747] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.382760] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.382783] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7200 [D 20:43:27.382797] element 0: offset: 0x644640, size: 24 [D 20:43:27.382812] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 31/70. [D 20:43:27.384751] openib_check_cq: completed rdma wr_id 2aaaab014590, nic_wr_credit 48980. [D 20:43:27.384773] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 32/70. [D 20:43:27.384932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.384954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.384966] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.388729] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7198 [D 20:43:27.388803] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 33/70. [D 20:43:27.391428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48980. [D 20:43:27.391538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48981. [D 20:43:27.391564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48982. [D 20:43:27.391580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48983. [D 20:43:27.391604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48984. [D 20:43:27.391619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48985. [D 20:43:27.391635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48986. [D 20:43:27.391661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48987. [D 20:43:27.391677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48988. [D 20:43:27.391701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48989. [D 20:43:27.391728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48990. [D 20:43:27.391743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48991. [D 20:43:27.391757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48992. [D 20:43:27.391772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48993. [D 20:43:27.391786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48994. [D 20:43:27.391801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48995. [D 20:43:27.391820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48996. [D 20:43:27.391835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48997. [D 20:43:27.391849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48998. [D 20:43:27.391864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48999. [D 20:43:27.391879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49000. [D 20:43:27.391893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49001. [D 20:43:27.391908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49002. [D 20:43:27.391922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49003. [D 20:43:27.391942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49004. [D 20:43:27.391956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49005. [D 20:43:27.391978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49006. [D 20:43:27.391993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49007. [D 20:43:27.392007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49008. [D 20:43:27.392021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49009. [D 20:43:27.392036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49010. [D 20:43:27.392050] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49011. [D 20:43:27.392229] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7195 [D 20:43:27.392258] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 34/70. [D 20:43:27.392284] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7200 [D 20:43:27.392303] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 35/70. [D 20:43:27.393354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.393375] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.393388] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.393429] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7203 [D 20:43:27.393444] element 0: offset: 0x6425f0, size: 24 [D 20:43:27.393460] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 36/70. [D 20:43:27.403288] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 49011. [D 20:43:27.403318] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 37/70. [D 20:43:27.403335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 49011. [D 20:43:27.403351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 49012. [D 20:43:27.403365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49013. [D 20:43:27.403380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49014. [D 20:43:27.403395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49015. [D 20:43:27.403409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49016. [D 20:43:27.403423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49017. [D 20:43:27.403438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49018. [D 20:43:27.403452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49019. [D 20:43:27.403466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49020. [D 20:43:27.403481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49021. [D 20:43:27.403495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49022. [D 20:43:27.403510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49023. [D 20:43:27.403524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49024. [D 20:43:27.403538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49025. [D 20:43:27.403553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49026. [D 20:43:27.403567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49027. [D 20:43:27.403581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49028. [D 20:43:27.403596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49029. [D 20:43:27.403610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49030. [D 20:43:27.403625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49031. [D 20:43:27.403639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49032. [D 20:43:27.403654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49033. [D 20:43:27.403668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49034. [D 20:43:27.403682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49035. [D 20:43:27.403698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49036. [D 20:43:27.403712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49037. [D 20:43:27.403727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49038. [D 20:43:27.403741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49039. [D 20:43:27.403756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49040. [D 20:43:27.403770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49041. [D 20:43:27.403785] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02a010 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49042. [D 20:43:27.403801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49043. [D 20:43:27.403815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49044. [D 20:43:27.403830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49045. [D 20:43:27.403845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49046. [D 20:43:27.403859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49047. [D 20:43:27.403874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49048. [D 20:43:27.403888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49049. [D 20:43:27.403902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49050. [D 20:43:27.403917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49051. [D 20:43:27.403931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49052. [D 20:43:27.403946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49053. [D 20:43:27.403961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49054. [D 20:43:27.403978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49055. [D 20:43:27.403992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49056. [D 20:43:27.404007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49057. [D 20:43:27.404021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49058. [D 20:43:27.404036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49059. [D 20:43:27.404050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49060. [D 20:43:27.404065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49061. [D 20:43:27.404079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49062. [D 20:43:27.404094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49063. [D 20:43:27.404108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49064. [D 20:43:27.404123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49065. [D 20:43:27.404138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49066. [D 20:43:27.404167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49067. [D 20:43:27.404183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49068. [D 20:43:27.404198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49069. [D 20:43:27.404212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49070. [D 20:43:27.404227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49071. [D 20:43:27.404241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49072. [D 20:43:27.404256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49073. [D 20:43:27.404271] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036b80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49074. [D 20:43:27.404333] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.404354] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.404367] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.407405] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7203 [D 20:43:27.407474] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 38/70. [D 20:43:27.414991] openib_check_cq: completed rdma wr_id 2aaaab02a010, nic_wr_credit 49074. [D 20:43:27.415027] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 39/70. [D 20:43:27.422194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.422218] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.422231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.422273] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7207 [D 20:43:27.422287] element 0: offset: 0x61fa30, size: 24 [D 20:43:27.422303] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 40/70. [D 20:43:27.426573] openib_check_cq: completed rdma wr_id 2aaaab036b80, nic_wr_credit 49073. [D 20:43:27.426598] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 41/70. [D 20:43:27.426626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49073. [D 20:43:27.426642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49074. [D 20:43:27.426671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 49075. [D 20:43:27.426686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 49076. [D 20:43:27.426711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 49077. [D 20:43:27.426735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 49078. [D 20:43:27.426750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 49079. [D 20:43:27.426765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49080. [D 20:43:27.426779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49081. [D 20:43:27.426796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49082. [D 20:43:27.426812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 49083. [D 20:43:27.426827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 49084. [D 20:43:27.426847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 49085. [D 20:43:27.426862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 49086. [D 20:43:27.426876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 49087. [D 20:43:27.426891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49088. [D 20:43:27.426905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49089. [D 20:43:27.426920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49090. [D 20:43:27.426934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49091. [D 20:43:27.426949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49092. [D 20:43:27.426963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49093. [D 20:43:27.426978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49094. [D 20:43:27.426992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49095. [D 20:43:27.427007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49096. [D 20:43:27.427021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49097. [D 20:43:27.427036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49098. [D 20:43:27.427050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49099. [D 20:43:27.427065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49100. [D 20:43:27.427079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49101. [D 20:43:27.427094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49102. [D 20:43:27.427108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49103. [D 20:43:27.427123] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0142f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49104. [D 20:43:27.427192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.427213] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.427226] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.427258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.427271] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.427283] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.430673] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7207 [D 20:43:27.430752] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 42/70. [D 20:43:27.438229] openib_check_cq: completed rdma wr_id 2aaaab0142f0, nic_wr_credit 49104. [D 20:43:27.438255] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 43/70. [D 20:43:27.438337] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.438360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.438367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49104. [D 20:43:27.438374] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.438391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49105. [D 20:43:27.438421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49106. [D 20:43:27.439023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49107. [D 20:43:27.439050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49108. [D 20:43:27.439071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49109. [D 20:43:27.439085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49110. [D 20:43:27.439100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49111. [D 20:43:27.439114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49112. [D 20:43:27.439129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49113. [D 20:43:27.439143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49114. [D 20:43:27.439158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49115. [D 20:43:27.439173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49116. [D 20:43:27.439187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49117. [D 20:43:27.439202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49118. [D 20:43:27.439216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49119. [D 20:43:27.439231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49120. [D 20:43:27.439246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49121. [D 20:43:27.439260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49122. [D 20:43:27.439275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49123. [D 20:43:27.439289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49124. [D 20:43:27.439304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49125. [D 20:43:27.439318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49126. [D 20:43:27.439333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49127. [D 20:43:27.439347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49128. [D 20:43:27.439362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49129. [D 20:43:27.439376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49130. [D 20:43:27.439391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49131. [D 20:43:27.439406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49132. [D 20:43:27.439422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49133. [D 20:43:27.439437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49134. [D 20:43:27.439451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49135. [D 20:43:27.444472] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.444493] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.444505] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.444545] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7210 [D 20:43:27.444559] element 0: offset: 0x691fe0, size: 24 [D 20:43:27.444576] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 44/70. [D 20:43:27.447035] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.447053] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.447066] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.447088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7213 [D 20:43:27.447102] element 0: offset: 0x642000, size: 24 [D 20:43:27.447117] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 45/70. [D 20:43:27.447150] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.447164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.447176] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.447195] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7215 [D 20:43:27.447210] element 0: offset: 0x644560, size: 24 [D 20:43:27.447224] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 46/70. [D 20:43:27.450116] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 49135. [D 20:43:27.450163] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 47/70. [D 20:43:27.450371] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.450392] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.450404] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.457006] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7215 [D 20:43:27.457090] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 48/70. [D 20:43:27.457239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49135. [D 20:43:27.457258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49136. [D 20:43:27.457274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 49137. [D 20:43:27.457288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 49138. [D 20:43:27.457303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 49139. [D 20:43:27.457317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 49140. [D 20:43:27.457332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 49141. [D 20:43:27.457346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49142. [D 20:43:27.457361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49143. [D 20:43:27.457375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49144. [D 20:43:27.457390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 49145. [D 20:43:27.457404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 49146. [D 20:43:27.457630] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7213 [D 20:43:27.715755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 49147. [D 20:43:27.715796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 49148. [D 20:43:27.716247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 49149. [D 20:43:27.716262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49150. [D 20:43:27.716277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49151. [D 20:43:27.716291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49152. [D 20:43:27.716320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49153. [D 20:43:27.716335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49154. [D 20:43:27.716350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49155. [D 20:43:27.716365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49156. [D 20:43:27.716379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49157. [D 20:43:27.716394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49158. [D 20:43:27.716408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49159. [D 20:43:27.716423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49160. [D 20:43:27.716438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49161. [D 20:43:27.716463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49162. [D 20:43:27.716479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49163. [D 20:43:27.716493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49164. [D 20:43:27.716508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49165. [D 20:43:27.716645] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49166. [D 20:43:27.717111] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 49/70. [D 20:43:27.717132] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7210 [D 20:43:27.717149] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 50/70. [D 20:43:27.717527] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.717592] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.717606] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.717650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7219 [D 20:43:27.717665] element 0: offset: 0x626300, size: 24 [D 20:43:27.717685] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 51/70. [D 20:43:27.719742] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 49166. [D 20:43:27.719769] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 52/70. [D 20:43:27.719866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49166. [D 20:43:27.719882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49167. [D 20:43:27.719902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49168. [D 20:43:27.719917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49169. [D 20:43:27.719931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49170. [D 20:43:27.719946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49171. [D 20:43:27.719960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49172. [D 20:43:27.719975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49173. [D 20:43:27.719993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49174. [D 20:43:27.720007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49175. [D 20:43:27.720022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49176. [D 20:43:27.720037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49177. [D 20:43:27.720051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49178. [D 20:43:27.720066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49179. [D 20:43:27.720081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49180. [D 20:43:27.720096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49181. [D 20:43:27.720110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49182. [D 20:43:27.720125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49183. [D 20:43:27.720139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49184. [D 20:43:27.719885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.720185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.720198] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.720158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49185. [D 20:43:27.720235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49186. [D 20:43:27.720251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49187. [D 20:43:27.720265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49188. [D 20:43:27.720280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49189. [D 20:43:27.720299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49190. [D 20:43:27.720313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49191. [D 20:43:27.720328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49192. [D 20:43:27.720343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49193. [D 20:43:27.720358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49194. [D 20:43:27.720375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49195. [D 20:43:27.720389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49196. [D 20:43:27.720404] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025810 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49197. [D 20:43:27.720422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 49198. [D 20:43:27.720437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 49199. [D 20:43:27.720452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49200. [D 20:43:27.720466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49201. [D 20:43:27.720481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49202. [D 20:43:27.720496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49203. [D 20:43:27.720510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49204. [D 20:43:27.720525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49205. [D 20:43:27.720539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49206. [D 20:43:27.720554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49207. [D 20:43:27.720568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49208. [D 20:43:27.720583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49209. [D 20:43:27.720598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49210. [D 20:43:27.720612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49211. [D 20:43:27.720627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49212. [D 20:43:27.720641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49213. [D 20:43:27.720656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49214. [D 20:43:27.720670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49215. [D 20:43:27.720685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49216. [D 20:43:27.720700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49217. [D 20:43:27.720714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49218. [D 20:43:27.720729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49219. [D 20:43:27.720743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49220. [D 20:43:27.720758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49221. [D 20:43:27.720773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49222. [D 20:43:27.720787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49223. [D 20:43:27.720803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49224. [D 20:43:27.720817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49225. [D 20:43:27.720832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49226. [D 20:43:27.720846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49227. [D 20:43:27.720861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49228. [D 20:43:27.720875] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036800 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49229. [D 20:43:27.723368] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7219 [D 20:43:27.723390] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 53/70. [D 20:43:27.725812] openib_check_cq: completed rdma wr_id 2aaaab025810, nic_wr_credit 49229. [D 20:43:27.725837] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 54/70. [D 20:43:27.728561] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.728605] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.728618] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.728662] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7221 [D 20:43:27.728677] element 0: offset: 0x6424d0, size: 24 [D 20:43:27.728696] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 55/70. [D 20:43:27.731610] openib_check_cq: completed rdma wr_id 2aaaab036800, nic_wr_credit 49228. [D 20:43:27.731636] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 56/70. [D 20:43:27.731652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49228. [D 20:43:27.731668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49229. [D 20:43:27.731682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49230. [D 20:43:27.731718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49231. [D 20:43:27.731733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49232. [D 20:43:27.731747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49233. [D 20:43:27.731765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49234. [D 20:43:27.731781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49235. [D 20:43:27.731796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49236. [D 20:43:27.731810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49237. [D 20:43:27.731824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49238. [D 20:43:27.731839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49239. [D 20:43:27.731853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49240. [D 20:43:27.731872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49241. [D 20:43:27.731888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49242. [D 20:43:27.731902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49243. [D 20:43:27.731916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49244. [D 20:43:27.731931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49245. [D 20:43:27.731946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49246. [D 20:43:27.731984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49247. [D 20:43:27.732002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49248. [D 20:43:27.732017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49249. [D 20:43:27.732031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49250. [D 20:43:27.732049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49251. [D 20:43:27.732063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49252. [D 20:43:27.732078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49253. [D 20:43:27.732092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49254. [D 20:43:27.732112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49255. [D 20:43:27.732126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49256. [D 20:43:27.732141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49257. [D 20:43:27.732160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49258. [D 20:43:27.732174] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036eb0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49259. [D 20:43:27.732262] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.732279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.732293] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.735536] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.735584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.735598] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.738855] openib_check_cq: completed rdma wr_id 2aaaab036eb0, nic_wr_credit 49259. [D 20:43:27.738938] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 57/70. [D 20:43:27.742336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.742356] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.742369] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.742425] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7221 [D 20:43:27.742448] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 58/70. [D 20:43:27.743793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49259. [D 20:43:27.743813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49260. [D 20:43:27.743841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 49261. [D 20:43:27.743856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 49262. [D 20:43:27.743871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 49263. [D 20:43:27.743885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 49264. [D 20:43:27.743900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 49265. [D 20:43:27.743915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49266. [D 20:43:27.743929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49267. [D 20:43:27.743943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49268. [D 20:43:27.743958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 49269. [D 20:43:27.743972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 49270. [D 20:43:27.743990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 49271. [D 20:43:27.744005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 49272. [D 20:43:27.744020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 49273. [D 20:43:27.744034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49274. [D 20:43:27.744066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49275. [D 20:43:27.744081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49276. [D 20:43:27.744095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49277. [D 20:43:27.744110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49278. [D 20:43:27.744127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49279. [D 20:43:27.744142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49280. [D 20:43:27.744162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49281. [D 20:43:27.744220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49282. [D 20:43:27.744329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49283. [D 20:43:27.744366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49284. [D 20:43:27.744395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49285. [D 20:43:27.744411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49286. [D 20:43:27.744426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49287. [D 20:43:27.744441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49288. [D 20:43:27.744458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49289. [D 20:43:27.744472] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49290. [D 20:43:27.749935] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49290. [D 20:43:27.749954] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 59/70. [D 20:43:27.752364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.752393] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.752406] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.752432] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7225 [D 20:43:27.752447] element 0: offset: 0x5b0030, size: 24 [D 20:43:27.752463] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 60/70. [D 20:43:27.752503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.752516] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.752529] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.755695] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.755751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.755765] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.755805] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7228 [D 20:43:27.755821] element 0: offset: 0x636ca0, size: 24 [D 20:43:27.755840] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 0/70. [D 20:43:27.755885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.755899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.755912] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:27.755933] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7231 [D 20:43:27.755948] element 0: offset: 0x61fa30, size: 24 [D 20:43:27.755962] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 1/70. [D 20:43:27.759891] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7225 [D 20:43:27.759976] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 2/70. [D 20:43:27.760091] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.760132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49290. [D 20:43:27.760198] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.760213] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7228 [D 20:43:27.760203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49291. [D 20:43:27.760220] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.760254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49292. [D 20:43:27.760290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49293. [D 20:43:27.760305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49294. [D 20:43:27.760316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7233 [D 20:43:27.760320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49295. [D 20:43:27.760342] element 0: offset: 0x632a90, size: 24 [D 20:43:27.760360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49296. [D 20:43:27.760392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49297. [D 20:43:27.760407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49298. [D 20:43:27.760422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49299. [D 20:43:27.760436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49300. [D 20:43:27.760451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49301. [D 20:43:27.760466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49302. [D 20:43:27.760480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49303. [D 20:43:27.760497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49304. [D 20:43:27.760512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49305. [D 20:43:27.760526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49306. [D 20:43:27.760541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49307. [D 20:43:27.760556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49308. [D 20:43:27.760570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49309. [D 20:43:27.760585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49310. [D 20:43:27.760600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49311. [D 20:43:27.760614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49312. [D 20:43:27.760628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49313. [D 20:43:27.760643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49314. [D 20:43:27.760658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49315. [D 20:43:27.760672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49316. [D 20:43:27.760686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49317. [D 20:43:27.760702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49318. [D 20:43:27.760716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49319. [D 20:43:27.760731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49320. [D 20:43:27.760746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029630 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49321. [D 20:43:27.763931] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 3/70. [D 20:43:27.763956] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7231 [D 20:43:27.763966] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 4/70. [D 20:43:27.764007] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 5/70. [D 20:43:27.767528] openib_check_cq: completed rdma wr_id 2aaaab029630, nic_wr_credit 49321. [D 20:43:27.767545] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 6/70. [D 20:43:27.767561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49321. [D 20:43:27.767576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49322. [D 20:43:27.767590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49323. [D 20:43:27.767605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49324. [D 20:43:27.767620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49325. [D 20:43:27.767634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49326. [D 20:43:27.767649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49327. [D 20:43:27.767664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49328. [D 20:43:27.767678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49329. [D 20:43:27.767693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49330. [D 20:43:27.767708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49331. [D 20:43:27.767722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49332. [D 20:43:27.767737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49333. [D 20:43:27.767751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49334. [D 20:43:27.767765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49335. [D 20:43:27.767780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49336. [D 20:43:27.767794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49337. [D 20:43:27.767809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49338. [D 20:43:27.767823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49339. [D 20:43:27.767838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49340. [D 20:43:27.767852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49341. [D 20:43:27.767867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49342. [D 20:43:27.767881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49343. [D 20:43:27.767896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49344. [D 20:43:27.767910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49345. [D 20:43:27.767925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49346. [D 20:43:27.767939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49347. [D 20:43:27.767954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49348. [D 20:43:27.767968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49349. [D 20:43:27.767983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49350. [D 20:43:27.768000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49351. [D 20:43:27.768015] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025810 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49352. [D 20:43:27.768031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49353. [D 20:43:27.768046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49354. [D 20:43:27.768060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49355. [D 20:43:27.768075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49356. [D 20:43:27.768090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49357. [D 20:43:27.768104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49358. [D 20:43:27.768119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49359. [D 20:43:27.768134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49360. [D 20:43:27.768148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49361. [D 20:43:27.768167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49362. [D 20:43:27.768182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49363. [D 20:43:27.768196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49364. [D 20:43:27.768211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49365. [D 20:43:27.768226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49366. [D 20:43:27.768241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49367. [D 20:43:27.768255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49368. [D 20:43:27.768270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49369. [D 20:43:27.768285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49370. [D 20:43:27.768299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49371. [D 20:43:27.768314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49372. [D 20:43:27.768329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49373. [D 20:43:27.768343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49374. [D 20:43:27.768358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49375. [D 20:43:27.768372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49376. [D 20:43:27.768387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49377. [D 20:43:27.768401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49378. [D 20:43:27.768416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49379. [D 20:43:27.768431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49380. [D 20:43:27.768445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49381. [D 20:43:27.768459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49382. [D 20:43:27.768474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49383. [D 20:43:27.768488] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036960 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49384. [D 20:43:27.768602] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.768625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.768638] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.775011] openib_check_cq: completed rdma wr_id 2aaaab025810, nic_wr_credit 49384. [D 20:43:27.775087] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 7/70. [D 20:43:27.776231] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7233 [D 20:43:27.776260] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 8/70. [D 20:43:27.776932] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.776950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.776962] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:27.776988] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7236 [D 20:43:27.777002] element 0: offset: 0x644560, size: 24 [D 20:43:27.777020] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 9/70. [D 20:43:27.784362] openib_check_cq: completed rdma wr_id 2aaaab036960, nic_wr_credit 49383. [D 20:43:27.784385] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 10/70. [D 20:43:27.784417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49383. [D 20:43:27.784433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49384. [D 20:43:27.784437] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.784454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 49385. [D 20:43:27.784474] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.784491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 49386. [D 20:43:27.784506] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:27.784525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 49387. [D 20:43:27.784554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 49388. [D 20:43:27.784569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 49389. [D 20:43:27.784584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49390. [D 20:43:27.784599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49391. [D 20:43:27.784613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49392. [D 20:43:27.784628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 49393. [D 20:43:27.784643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 49394. [D 20:43:27.784657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 49395. [D 20:43:27.784671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 49396. [D 20:43:27.784686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 49397. [D 20:43:27.784700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49398. [D 20:43:27.784715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49399. [D 20:43:27.784729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49400. [D 20:43:27.784744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49401. [D 20:43:27.784759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49402. [D 20:43:27.784775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49403. [D 20:43:27.784790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49404. [D 20:43:27.784804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49405. [D 20:43:27.784819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49406. [D 20:43:27.784834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49407. [D 20:43:27.784849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49408. [D 20:43:27.784863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49409. [D 20:43:27.784878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49410. [D 20:43:27.784892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49411. [D 20:43:27.784907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49412. [D 20:43:27.784922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49413. [D 20:43:27.784936] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029630 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49414. [D 20:43:27.784981] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.785003] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.785016] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:27.787635] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7236 [D 20:43:27.787692] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 11/70. [D 20:43:27.796221] openib_check_cq: completed rdma wr_id 2aaaab029630, nic_wr_credit 49414. [D 20:43:27.796248] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 12/70. [D 20:43:27.796265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49414. [D 20:43:27.796280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49415. [D 20:43:27.796295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49416. [D 20:43:27.796309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49417. [D 20:43:27.796324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49418. [D 20:43:27.796338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49419. [D 20:43:27.796353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49420. [D 20:43:27.796367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49421. [D 20:43:27.796382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49422. [D 20:43:27.796396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49423. [D 20:43:27.796411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49424. [D 20:43:27.796426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49425. [D 20:43:27.796440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49426. [D 20:43:27.796456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49427. [D 20:43:27.796470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49428. [D 20:43:27.796485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49429. [D 20:43:27.796499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49430. [D 20:43:27.796513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49431. [D 20:43:27.796528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49432. [D 20:43:27.796542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49433. [D 20:43:27.796556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49434. [D 20:43:27.796571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49435. [D 20:43:27.796585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49436. [D 20:43:27.796599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49437. [D 20:43:27.796614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49438. [D 20:43:27.796628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49439. [D 20:43:27.796643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49440. [D 20:43:27.796657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49441. [D 20:43:27.796671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49442. [D 20:43:27.796686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49443. [D 20:43:27.796700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49444. [D 20:43:27.796714] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0259c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49445. [D 20:43:27.796781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.796803] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.796816] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.807528] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.807546] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.807558] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.807598] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7240 [D 20:43:27.807613] element 0: offset: 0x644640, size: 24 [D 20:43:27.807632] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 13/70. [D 20:43:27.808071] openib_check_cq: completed rdma wr_id 2aaaab0259c0, nic_wr_credit 49445. [D 20:43:27.808095] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 14/70. [D 20:43:27.808203] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.808222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.808234] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.814332] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7240 [D 20:43:27.814354] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 15/70. [D 20:43:27.819918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49445. [D 20:43:27.819995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49446. [D 20:43:27.820011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49447. [D 20:43:27.820026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49448. [D 20:43:27.820041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49449. [D 20:43:27.820055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49450. [D 20:43:27.820070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49451. [D 20:43:27.820084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49452. [D 20:43:27.820099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49453. [D 20:43:27.820126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49454. [D 20:43:27.820141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49455. [D 20:43:27.820160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49456. [D 20:43:27.820175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49457. [D 20:43:27.820189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49458. [D 20:43:27.820204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49459. [D 20:43:27.820218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49460. [D 20:43:27.820233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49461. [D 20:43:27.820247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49462. [D 20:43:27.820262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49463. [D 20:43:27.820277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49464. [D 20:43:27.820291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49465. [D 20:43:27.820306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49466. [D 20:43:27.820320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49467. [D 20:43:27.820335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49468. [D 20:43:27.820349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49469. [D 20:43:27.820364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49470. [D 20:43:27.820379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49471. [D 20:43:27.820393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49472. [D 20:43:27.820408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49473. [D 20:43:27.820422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49474. [D 20:43:27.820437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49475. [D 20:43:27.820453] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036a80 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49476. [D 20:43:27.831882] openib_check_cq: completed rdma wr_id 2aaaab036a80, nic_wr_credit 49476. [D 20:43:27.831906] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 16/70. [D 20:43:27.832021] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.832041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.832054] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:27.832851] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.832867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.832879] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:27.832902] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7242 [D 20:43:27.832916] element 0: offset: 0x6425f0, size: 24 [D 20:43:27.832933] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 17/70. [D 20:43:27.835917] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7242 [D 20:43:27.835984] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 18/70. [D 20:43:27.840775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49476. [D 20:43:27.840801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49477. [D 20:43:27.840815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49478. [D 20:43:27.840830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49479. [D 20:43:27.840845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49480. [D 20:43:27.840860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49481. [D 20:43:27.840874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49482. [D 20:43:27.840889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49483. [D 20:43:27.840903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49484. [D 20:43:27.840918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49485. [D 20:43:27.840933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49486. [D 20:43:27.840947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49487. [D 20:43:27.840962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49488. [D 20:43:27.840977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49489. [D 20:43:27.840991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49490. [D 20:43:27.841006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49491. [D 20:43:27.841021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49492. [D 20:43:27.841035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49493. [D 20:43:27.841050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49494. [D 20:43:27.841066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49495. [D 20:43:27.841081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49496. [D 20:43:27.841095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49497. [D 20:43:27.841109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49498. [D 20:43:27.841124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49499. [D 20:43:27.841138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49500. [D 20:43:27.841153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49501. [D 20:43:27.841167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49502. [D 20:43:27.841182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49503. [D 20:43:27.841197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49504. [D 20:43:27.841211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49505. [D 20:43:27.841226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49506. [D 20:43:27.841240] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49507. [D 20:43:27.852385] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49507. [D 20:43:27.852407] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 19/70. [D 20:43:27.852522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.852545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.852558] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:27.951389] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.951408] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.951420] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:27.951456] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7245 [D 20:43:27.951470] element 0: offset: 0x6424d0, size: 24 [D 20:43:27.951487] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 20/70. [D 20:43:27.955132] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7245 [D 20:43:27.955205] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 21/70. [D 20:43:27.955273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49507. [D 20:43:27.955299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49508. [D 20:43:27.955314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49509. [D 20:43:27.955329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49510. [D 20:43:27.955343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49511. [D 20:43:27.955358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49512. [D 20:43:27.955372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49513. [D 20:43:27.955387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49514. [D 20:43:27.955403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49515. [D 20:43:27.955417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49516. [D 20:43:27.955432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49517. [D 20:43:27.955446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49518. [D 20:43:27.955461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49519. [D 20:43:27.955475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49520. [D 20:43:27.955490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49521. [D 20:43:27.955504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49522. [D 20:43:27.955518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49523. [D 20:43:27.955533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49524. [D 20:43:27.955548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49525. [D 20:43:27.955562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49526. [D 20:43:27.955577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49527. [D 20:43:27.955591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49528. [D 20:43:27.955605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49529. [D 20:43:27.955620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49530. [D 20:43:27.955634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49531. [D 20:43:27.955649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49532. [D 20:43:27.955663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49533. [D 20:43:27.955677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49534. [D 20:43:27.955702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49535. [D 20:43:27.955717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49536. [D 20:43:27.955731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49537. [D 20:43:27.955746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49538. [D 20:43:27.962364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:27.962388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.962401] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:27.962443] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7248 [D 20:43:27.962457] element 0: offset: 0x647db0, size: 24 [D 20:43:27.962473] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 22/70. [D 20:43:27.966538] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49538. [D 20:43:27.966562] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 23/70. [D 20:43:27.966677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:27.966697] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:27.966710] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:27.969954] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7248 [D 20:43:27.970029] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 24/70. [D 20:43:27.973036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49538. [D 20:43:27.973057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49539. [D 20:43:27.973072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49540. [D 20:43:27.973087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49541. [D 20:43:27.973102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49542. [D 20:43:27.973116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49543. [D 20:43:27.973131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49544. [D 20:43:27.973146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49545. [D 20:43:27.973160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49546. [D 20:43:27.973175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49547. [D 20:43:27.973190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49548. [D 20:43:27.973205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49549. [D 20:43:27.973219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49550. [D 20:43:27.973234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49551. [D 20:43:27.973249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49552. [D 20:43:27.973264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49553. [D 20:43:27.973278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49554. [D 20:43:27.973293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49555. [D 20:43:27.973308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49556. [D 20:43:27.973322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49557. [D 20:43:27.973337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49558. [D 20:43:27.973352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49559. [D 20:43:27.973367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49560. [D 20:43:27.973381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49561. [D 20:43:27.973396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49562. [D 20:43:27.973411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49563. [D 20:43:27.973426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49564. [D 20:43:28.154048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49565. [D 20:43:28.154076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49566. [D 20:43:28.154502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49567. [D 20:43:28.154520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49568. [D 20:43:28.154535] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49569. [D 20:43:28.154929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.154954] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.154968] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:28.155011] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7253 [D 20:43:28.155025] element 0: offset: 0x62fd10, size: 24 [D 20:43:28.155042] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 25/70. [D 20:43:28.155076] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.155090] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.155102] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.155123] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7254 [D 20:43:28.155137] element 0: offset: 0x691fe0, size: 24 [D 20:43:28.155154] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 26/70. [D 20:43:28.155181] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.155195] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.155207] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.155227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7257 [D 20:43:28.155241] element 0: offset: 0x632a90, size: 24 [D 20:43:28.155244] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49569. [D 20:43:28.155281] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 27/70. [D 20:43:28.155309] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 28/70. [D 20:43:28.155457] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.155472] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.155485] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.164356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.164422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.164435] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.164477] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7260 [D 20:43:28.164492] element 0: offset: 0x642000, size: 24 [D 20:43:28.164511] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 29/70. [D 20:43:28.164572] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7253 [D 20:43:28.164591] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 30/70. [D 20:43:28.164647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49569. [D 20:43:28.164674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 49570. [D 20:43:28.164689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 49571. [D 20:43:28.164704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 49572. [D 20:43:28.164719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 49573. [D 20:43:28.164734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 49574. [D 20:43:28.164746] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7254 [D 20:43:28.164749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49575. [D 20:43:28.164828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49576. [D 20:43:28.164843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49577. [D 20:43:28.164858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 49578. [D 20:43:28.164872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 49579. [D 20:43:28.164891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 49580. [D 20:43:28.164906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 49581. [D 20:43:28.164920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 49582. [D 20:43:28.164935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49583. [D 20:43:28.164950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49584. [D 20:43:28.164964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49585. [D 20:43:28.164979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49586. [D 20:43:28.164994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49587. [D 20:43:28.165008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49588. [D 20:43:28.165023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49589. [D 20:43:28.165038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49590. [D 20:43:28.165052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49591. [D 20:43:28.165067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49592. [D 20:43:28.165081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49593. [D 20:43:28.165096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49594. [D 20:43:28.165110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49595. [D 20:43:28.165125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49596. [D 20:43:28.165139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49597. [D 20:43:28.165154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49598. [D 20:43:28.165168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49599. [D 20:43:28.165183] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029630 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49600. [D 20:43:28.165216] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 31/70. [D 20:43:28.165248] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7257 [D 20:43:28.165264] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 32/70. [D 20:43:28.167899] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7260 [D 20:43:28.167956] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 33/70. [D 20:43:28.172357] openib_check_cq: completed rdma wr_id 2aaaab029630, nic_wr_credit 49600. [D 20:43:28.172384] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 34/70. [D 20:43:28.172402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49600. [D 20:43:28.172421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49601. [D 20:43:28.172435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49602. [D 20:43:28.172450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49603. [D 20:43:28.172464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49604. [D 20:43:28.172478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49605. [D 20:43:28.172493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49606. [D 20:43:28.172507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49607. [D 20:43:28.172522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49608. [D 20:43:28.172536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49609. [D 20:43:28.172551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49610. [D 20:43:28.172578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49611. [D 20:43:28.172593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49612. [D 20:43:28.172608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49613. [D 20:43:28.172622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49614. [D 20:43:28.172636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49615. [D 20:43:28.172651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49616. [D 20:43:28.172665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49617. [D 20:43:28.172680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49618. [D 20:43:28.172694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49619. [D 20:43:28.172708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49620. [D 20:43:28.172723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49621. [D 20:43:28.172737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49622. [D 20:43:28.172752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49623. [D 20:43:28.172766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49624. [D 20:43:28.172780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49625. [D 20:43:28.172795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49626. [D 20:43:28.172809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49627. [D 20:43:28.172823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49628. [D 20:43:28.172838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49629. [D 20:43:28.172852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49630. [D 20:43:28.172867] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001e80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49631. [D 20:43:28.172883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49632. [D 20:43:28.172898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49633. [D 20:43:28.172912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49634. [D 20:43:28.172927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49635. [D 20:43:28.172941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49636. [D 20:43:28.172956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49637. [D 20:43:28.172970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49638. [D 20:43:28.172985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49639. [D 20:43:28.172999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49640. [D 20:43:28.173014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49641. [D 20:43:28.173029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49642. [D 20:43:28.173043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49643. [D 20:43:28.173057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49644. [D 20:43:28.173072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49645. [D 20:43:28.173086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49646. [D 20:43:28.173101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49647. [D 20:43:28.173115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49648. [D 20:43:28.173130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49649. [D 20:43:28.173144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49650. [D 20:43:28.173159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49651. [D 20:43:28.173174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49652. [D 20:43:28.173188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49653. [D 20:43:28.173203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49654. [D 20:43:28.173217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49655. [D 20:43:28.173232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49656. [D 20:43:28.173247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49657. [D 20:43:28.173262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49658. [D 20:43:28.173276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49659. [D 20:43:28.173291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49660. [D 20:43:28.173305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49661. [D 20:43:28.173319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49662. [D 20:43:28.173334] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001fc0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49663. [D 20:43:28.173350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49664. [D 20:43:28.173365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49665. [D 20:43:28.173379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49666. [D 20:43:28.173394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49667. [D 20:43:28.173408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49668. [D 20:43:28.173423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49669. [E 20:43:28.173442] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 49670, block for 10 ms. [D 20:43:28.174268] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49669. [D 20:43:28.174290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49670. [E 20:43:28.174306] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 49671, block for 10 ms. [D 20:43:28.180386] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49670. [E 20:43:28.180409] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 49671, block for 10 ms. [D 20:43:28.182653] openib_check_cq: completed rdma wr_id 2aaaab001e80, nic_wr_credit 49670. [D 20:43:28.182687] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 35/70. [D 20:43:28.182702] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49669. [D 20:43:28.182717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49670. [D 20:43:28.182732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49671. [D 20:43:28.182750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49672. [D 20:43:28.182765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49673. [D 20:43:28.182779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49674. [D 20:43:28.182794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49675. [D 20:43:28.182809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49676. [D 20:43:28.182823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49677. [D 20:43:28.182838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49678. [D 20:43:28.182852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49679. [D 20:43:28.182867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49680. [D 20:43:28.182881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49681. [D 20:43:28.182896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49682. [D 20:43:28.182910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49683. [D 20:43:28.182925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49684. [D 20:43:28.182955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49685. [D 20:43:28.182980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49686. [D 20:43:28.182995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49687. [D 20:43:28.183010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49688. [D 20:43:28.183025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49689. [D 20:43:28.183039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49690. [D 20:43:28.183053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49691. [D 20:43:28.183068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49692. [D 20:43:28.183082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49693. [D 20:43:28.183097] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036b30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49694. [D 20:43:28.183173] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.183197] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.183210] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.183239] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.183252] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.183265] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.183302] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7264 [D 20:43:28.183317] element 0: offset: 0x658610, size: 24 [D 20:43:28.183333] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 36/70. [D 20:43:28.190694] openib_check_cq: completed rdma wr_id 2aaaab001fc0, nic_wr_credit 49694. [D 20:43:28.190722] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 37/70. [D 20:43:28.192892] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.192912] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.192925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.199853] openib_check_cq: completed rdma wr_id 2aaaab036b30, nic_wr_credit 49693. [D 20:43:28.199879] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 38/70. [D 20:43:28.199961] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.199980] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.199992] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.200073] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.200088] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.200101] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:28.203072] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7264 [D 20:43:28.203140] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 39/70. [D 20:43:28.205021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49693. [D 20:43:28.205045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 49694. [D 20:43:28.205060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 49695. [D 20:43:28.205075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 49696. [D 20:43:28.205089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 49697. [D 20:43:28.205104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 49698. [D 20:43:28.205118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49699. [D 20:43:28.205132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49700. [D 20:43:28.205147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49701. [D 20:43:28.205161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 49702. [D 20:43:28.205176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 49703. [D 20:43:28.205190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 49704. [D 20:43:28.205204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 49705. [D 20:43:28.205219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 49706. [D 20:43:28.205233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49707. [D 20:43:28.205248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49708. [D 20:43:28.205262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49709. [D 20:43:28.205277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49710. [D 20:43:28.205291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49711. [D 20:43:28.205305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49712. [D 20:43:28.205320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49713. [D 20:43:28.205334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49714. [D 20:43:28.205349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49715. [D 20:43:28.205363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49716. [D 20:43:28.205378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49717. [D 20:43:28.205392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49718. [D 20:43:28.205406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49719. [D 20:43:28.205421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49720. [D 20:43:28.205436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49721. [D 20:43:28.205451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49722. [D 20:43:28.205465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49723. [D 20:43:28.205480] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49724. [D 20:43:28.205531] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.205553] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.205566] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:28.205607] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7266 [D 20:43:28.205622] element 0: offset: 0x624380, size: 24 [D 20:43:28.205639] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 40/70. [D 20:43:28.210931] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49724. [D 20:43:28.210957] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 41/70. [D 20:43:28.211073] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.211093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.211106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:28.214096] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7266 [D 20:43:28.214161] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 42/70. [D 20:43:28.216570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49724. [D 20:43:28.216596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49725. [D 20:43:28.216611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49726. [D 20:43:28.216626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49727. [D 20:43:28.216641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49728. [D 20:43:28.216655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49729. [D 20:43:28.216670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49730. [D 20:43:28.216684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49731. [D 20:43:28.216699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49732. [D 20:43:28.216713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49733. [D 20:43:28.216728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49734. [D 20:43:28.216743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49735. [D 20:43:28.216757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49736. [D 20:43:28.216772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49737. [D 20:43:28.216787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49738. [D 20:43:28.216814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49739. [D 20:43:28.216829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49740. [D 20:43:28.216844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49741. [D 20:43:28.216860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49742. [D 20:43:28.216877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49743. [D 20:43:28.216891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49744. [D 20:43:28.216906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49745. [D 20:43:28.216920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49746. [D 20:43:28.216946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49747. [D 20:43:28.216961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49748. [D 20:43:28.216976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49749. [D 20:43:28.216991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49750. [D 20:43:28.217005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49751. [D 20:43:28.217020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49752. [D 20:43:28.217039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49753. [D 20:43:28.217054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49754. [D 20:43:28.217069] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001e80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49755. [D 20:43:28.217124] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.217148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.217161] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:28.217202] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7270 [D 20:43:28.217217] element 0: offset: 0x2aaaab60d720, size: 24 [D 20:43:28.217234] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 43/70. [D 20:43:28.219329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.219345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.219357] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.219379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7273 [D 20:43:28.219393] element 0: offset: 0x2aaaab60d740, size: 24 [D 20:43:28.219408] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 44/70. [D 20:43:28.219440] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.219454] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.219466] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.219486] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7276 [D 20:43:28.219500] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:28.219514] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 45/70. [D 20:43:28.223273] openib_check_cq: completed rdma wr_id 2aaaab001e80, nic_wr_credit 49755. [D 20:43:28.223296] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 46/70. [D 20:43:28.223474] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.223495] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.223507] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.229770] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7270 [D 20:43:28.229843] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 47/70. [D 20:43:28.229927] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7273 [D 20:43:28.229945] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 48/70. [D 20:43:28.230213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49755. [D 20:43:28.230287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49756. [D 20:43:28.230303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49757. [D 20:43:28.230318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49758. [D 20:43:28.230333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49759. [D 20:43:28.230348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49760. [D 20:43:28.230363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49761. [D 20:43:28.230377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49762. [D 20:43:28.230392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49763. [D 20:43:28.230407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49764. [D 20:43:28.230421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49765. [D 20:43:28.230436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49766. [D 20:43:28.230450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49767. [D 20:43:28.230465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49768. [D 20:43:28.230480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49769. [D 20:43:28.230494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49770. [D 20:43:28.230509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49771. [D 20:43:28.230523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49772. [D 20:43:28.230538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49773. [D 20:43:28.230553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49774. [D 20:43:28.230567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49775. [D 20:43:28.230582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49776. [D 20:43:28.230597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49777. [D 20:43:28.230611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49778. [D 20:43:28.230626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49779. [D 20:43:28.230640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49780. [D 20:43:28.230655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49781. [D 20:43:28.230671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49782. [D 20:43:28.230686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49783. [D 20:43:28.230700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49784. [D 20:43:28.230715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49785. [D 20:43:28.230730] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab029510 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49786. [D 20:43:28.230748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49787. [D 20:43:28.230763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49788. [D 20:43:28.230777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49789. [D 20:43:28.230792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49790. [D 20:43:28.230806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49791. [D 20:43:28.230821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49792. [D 20:43:28.230835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49793. [D 20:43:28.230850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49794. [D 20:43:28.230864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49795. [D 20:43:28.230879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49796. [D 20:43:28.230894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49797. [D 20:43:28.230908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49798. [D 20:43:28.230923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49799. [D 20:43:28.230937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49800. [D 20:43:28.230952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49801. [D 20:43:28.230966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49802. [D 20:43:28.230981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49803. [D 20:43:28.230995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49804. [D 20:43:28.231010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49805. [D 20:43:28.231025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49806. [D 20:43:28.231039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49807. [D 20:43:28.231054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49808. [D 20:43:28.231068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49809. [D 20:43:28.231083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49810. [D 20:43:28.231098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49811. [D 20:43:28.231113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49812. [D 20:43:28.231128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49813. [D 20:43:28.231142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49814. [D 20:43:28.231157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49815. [D 20:43:28.231171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49816. [D 20:43:28.231186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49817. [D 20:43:28.231200] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001e80 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49818. [D 20:43:28.231850] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.231872] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.231885] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.231927] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7278 [D 20:43:28.231942] element 0: offset: 0x2aaaab609ba0, size: 24 [D 20:43:28.231959] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 49/70. [D 20:43:28.237437] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7276 [D 20:43:28.237459] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 50/70. [D 20:43:28.242054] openib_check_cq: completed rdma wr_id 2aaaab029510, nic_wr_credit 49818. [D 20:43:28.242130] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 51/70. [D 20:43:28.253549] openib_check_cq: completed rdma wr_id 2aaaab001e80, nic_wr_credit 49817. [D 20:43:28.253572] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 52/70. [D 20:43:28.253634] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.253655] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.253654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49817. [D 20:43:28.253679] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.253698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 49818. [D 20:43:28.253727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 49819. [D 20:43:28.253743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 49820. [D 20:43:28.253757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 49821. [D 20:43:28.253772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 49822. [D 20:43:28.253787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49823. [D 20:43:28.253801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49824. [D 20:43:28.253816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49825. [D 20:43:28.253831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 49826. [D 20:43:28.253846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 49827. [D 20:43:28.253860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 49828. [D 20:43:28.253877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 49829. [D 20:43:28.253891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 49830. [D 20:43:28.253906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49831. [D 20:43:28.253921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49832. [D 20:43:28.253935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49833. [D 20:43:28.253950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49834. [D 20:43:28.253965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49835. [D 20:43:28.253979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49836. [D 20:43:28.253994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49837. [D 20:43:28.254009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49838. [D 20:43:28.254024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49839. [D 20:43:28.254051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49840. [D 20:43:28.254073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49841. [D 20:43:28.254088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49842. [D 20:43:28.254111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49843. [D 20:43:28.254127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49844. [D 20:43:28.254150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49845. [D 20:43:28.254165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49846. [D 20:43:28.254179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49847. [D 20:43:28.254194] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001fc0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49848. [D 20:43:28.254244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.254268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.254281] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.256884] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7278 [D 20:43:28.256946] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 53/70. [D 20:43:28.264200] openib_check_cq: completed rdma wr_id 2aaaab001fc0, nic_wr_credit 49848. [D 20:43:28.264226] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 54/70. [D 20:43:28.264303] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.264325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.264338] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:28.264860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 49848. [D 20:43:28.264880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 49849. [D 20:43:28.264895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49850. [D 20:43:28.264910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49851. [D 20:43:28.264936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49852. [D 20:43:28.264951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49853. [D 20:43:28.264966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49854. [D 20:43:28.264980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49855. [D 20:43:28.265011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49856. [D 20:43:28.265026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49857. [D 20:43:28.265048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49858. [D 20:43:28.265063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49859. [D 20:43:28.265086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49860. [D 20:43:28.265100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49861. [D 20:43:28.265129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49862. [D 20:43:28.265165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49863. [D 20:43:28.265190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49864. [D 20:43:28.265205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49865. [D 20:43:28.265220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49866. [D 20:43:28.265235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49867. [D 20:43:28.265268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49868. [D 20:43:28.265293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49869. [D 20:43:28.265307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49870. [D 20:43:28.265330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49871. [D 20:43:28.265345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49872. [D 20:43:28.265369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49873. [D 20:43:28.265384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49874. [D 20:43:28.265425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49875. [D 20:43:28.265441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 49876. [D 20:43:28.265456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 49877. [D 20:43:28.265470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 49878. [D 20:43:28.265485] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001e80 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 49879. [D 20:43:28.270291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.270314] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.270326] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:28.270367] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7282 [D 20:43:28.270382] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:28.270398] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 55/70. [D 20:43:28.272894] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.272911] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.272924] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.272946] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7285 [D 20:43:28.272960] element 0: offset: 0x2aaaab60c8e0, size: 24 [D 20:43:28.272979] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 56/70. [D 20:43:28.273011] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.273025] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.273038] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.273060] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7288 [D 20:43:28.273073] element 0: offset: 0x2aaaab60c430, size: 24 [D 20:43:28.273088] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 57/70. [D 20:43:28.276649] openib_check_cq: completed rdma wr_id 2aaaab001e80, nic_wr_credit 49879. [D 20:43:28.276763] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 58/70. [D 20:43:28.276937] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.276958] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.276970] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.279911] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7282 [D 20:43:28.279978] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 59/70. [D 20:43:28.282659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49879. [D 20:43:28.282684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49880. [D 20:43:28.282699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49881. [D 20:43:28.282714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49882. [D 20:43:28.282729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49883. [D 20:43:28.282743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49884. [D 20:43:28.282758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49885. [D 20:43:28.282773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49886. [D 20:43:28.282787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49887. [D 20:43:28.282802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49888. [D 20:43:28.282816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49889. [D 20:43:28.282831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49890. [D 20:43:28.282846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49891. [D 20:43:28.282860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49892. [D 20:43:28.282875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49893. [D 20:43:28.282891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49894. [D 20:43:28.282905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49895. [D 20:43:28.282920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49896. [D 20:43:28.282935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49897. [D 20:43:28.282949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49898. [D 20:43:28.282964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49899. [D 20:43:28.282979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49900. [D 20:43:28.282993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49901. [D 20:43:28.283008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49902. [D 20:43:28.283037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49903. [D 20:43:28.283052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49904. [D 20:43:28.283067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49905. [D 20:43:28.283081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49906. [D 20:43:28.283096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49907. [D 20:43:28.283111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49908. [D 20:43:28.283125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49909. [D 20:43:28.283140] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034f30 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49910. [D 20:43:28.283422] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7288 [D 20:43:28.283498] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 60/70. [D 20:43:28.285449] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.285469] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.285482] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.285523] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7290 [D 20:43:28.285538] element 0: offset: 0x2aaaab025b00, size: 24 [D 20:43:28.285554] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 0/70. [D 20:43:28.290883] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7285 [D 20:43:28.290961] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 1/70. [D 20:43:28.293131] openib_check_cq: completed rdma wr_id 2aaaab034f30, nic_wr_credit 49910. [D 20:43:28.293157] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 2/70. [D 20:43:28.293174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49910. [D 20:43:28.293189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 49911. [D 20:43:28.293204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 49912. [D 20:43:28.293218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 49913. [D 20:43:28.293233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 49914. [D 20:43:28.293248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 49915. [D 20:43:28.293263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49916. [D 20:43:28.293277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49917. [D 20:43:28.293292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49918. [D 20:43:28.293307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 49919. [D 20:43:28.293322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 49920. [D 20:43:28.293336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 49921. [D 20:43:28.293351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 49922. [D 20:43:28.293365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 49923. [D 20:43:28.293380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49924. [D 20:43:28.293395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49925. [D 20:43:28.293409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49926. [D 20:43:28.293424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49927. [D 20:43:28.293439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49928. [D 20:43:28.293453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49929. [D 20:43:28.293468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49930. [D 20:43:28.293483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49931. [D 20:43:28.293497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49932. [D 20:43:28.293512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49933. [D 20:43:28.293527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49934. [D 20:43:28.293541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49935. [D 20:43:28.293556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49936. [D 20:43:28.293571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49937. [D 20:43:28.293585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49938. [D 20:43:28.293600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49939. [D 20:43:28.293615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49940. [D 20:43:28.293629] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036dc0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49941. [D 20:43:28.293646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 49942. [D 20:43:28.293661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 49943. [D 20:43:28.293677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 49944. [D 20:43:28.293691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 49945. [D 20:43:28.293706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 49946. [D 20:43:28.293720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 49947. [D 20:43:28.293735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 49948. [D 20:43:28.293749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 49949. [D 20:43:28.293764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 49950. [D 20:43:28.293778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 49951. [D 20:43:28.293793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 49952. [D 20:43:28.293807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 49953. [D 20:43:28.293822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 49954. [D 20:43:28.293837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 49955. [D 20:43:28.293851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 49956. [D 20:43:28.293865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 49957. [D 20:43:28.293880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 49958. [D 20:43:28.293894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 49959. [D 20:43:28.293909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 49960. [D 20:43:28.293924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 49961. [D 20:43:28.293938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 49962. [D 20:43:28.293953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 49963. [D 20:43:28.293967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 49964. [D 20:43:28.293982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 49965. [D 20:43:28.293996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 49966. [D 20:43:28.294011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 49967. [D 20:43:28.294025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 49968. [D 20:43:28.294040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 49969. [D 20:43:28.294054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 49970. [D 20:43:28.294069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 49971. [D 20:43:28.294083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 49972. [D 20:43:28.608262] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab034fc0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 49973. [D 20:43:28.608287] openib_check_cq: completed rdma wr_id 2aaaab036dc0, nic_wr_credit 49973. [D 20:43:28.608302] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 3/70. [D 20:43:28.608532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.608556] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.608569] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.608636] openib_check_cq: completed rdma wr_id 2aaaab034fc0, nic_wr_credit 49972. [D 20:43:28.608661] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 4/70. [D 20:43:28.608666] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.608723] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.608736] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.608783] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7293 [D 20:43:28.608798] element 0: offset: 0x2aaaab025a90, size: 24 [D 20:43:28.608815] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 5/70. [D 20:43:28.608854] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.608867] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.608880] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.608901] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.608914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.608926] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.612536] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7290 [D 20:43:28.612563] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 6/70. [D 20:43:28.616031] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7293 [D 20:43:28.616058] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 7/70. [D 20:43:28.620278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 49972. [D 20:43:28.620302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 49973. [D 20:43:28.620317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 49974. [D 20:43:28.620347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 49975. [D 20:43:28.620370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 49976. [D 20:43:28.620385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 49977. [D 20:43:28.620816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 49978. [D 20:43:28.620834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 49979. [D 20:43:28.620849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 49980. [D 20:43:28.620863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 49981. [D 20:43:28.620878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 49982. [D 20:43:28.620892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 49983. [D 20:43:28.620907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 49984. [D 20:43:28.620921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 49985. [D 20:43:28.620935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 49986. [D 20:43:28.620950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 49987. [D 20:43:28.620965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 49988. [D 20:43:28.620979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 49989. [D 20:43:28.621083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 49990. [D 20:43:28.621100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 49991. [D 20:43:28.621115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 49992. [D 20:43:28.621129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 49993. [D 20:43:28.621152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 49994. [D 20:43:28.621167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 49995. [D 20:43:28.621232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 49996. [D 20:43:28.621292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 49997. [D 20:43:28.621686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 49998. [D 20:43:28.621703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 49999. [D 20:43:28.621718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50000. [D 20:43:28.621732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50001. [D 20:43:28.621746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50002. [D 20:43:28.621761] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02f8c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50003. [D 20:43:28.621778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50004. [D 20:43:28.621792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50005. [D 20:43:28.621807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50006. [D 20:43:28.621821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50007. [D 20:43:28.621836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50008. [D 20:43:28.621850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50009. [D 20:43:28.621865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50010. [D 20:43:28.621879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50011. [D 20:43:28.621893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50012. [D 20:43:28.621908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50013. [D 20:43:28.621922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50014. [D 20:43:28.621937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50015. [D 20:43:28.621952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50016. [D 20:43:28.621967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50017. [D 20:43:28.621981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50018. [D 20:43:28.622074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50019. [D 20:43:28.622091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50020. [D 20:43:28.622105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50021. [D 20:43:28.622124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50022. [D 20:43:28.622535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50023. [D 20:43:28.622552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50024. [D 20:43:28.622567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50025. [D 20:43:28.622581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50026. [D 20:43:28.622596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50027. [D 20:43:28.622610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50028. [D 20:43:28.622625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50029. [D 20:43:28.622639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50030. [D 20:43:28.622654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50031. [D 20:43:28.622668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50032. [D 20:43:28.622683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50033. [D 20:43:28.622697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50034. [D 20:43:28.622712] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036e60 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50035. [D 20:43:28.622975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.623036] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.623050] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.623095] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7297 [D 20:43:28.623110] element 0: offset: 0x2aaaab034d90, size: 24 [D 20:43:28.623130] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 8/70. [D 20:43:28.623164] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.623177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.623189] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.623210] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7300 [D 20:43:28.623223] element 0: offset: 0x2aaaab0146b0, size: 24 [D 20:43:28.623237] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 9/70. [D 20:43:28.626169] openib_check_cq: completed rdma wr_id 2aaaab02f8c0, nic_wr_credit 50035. [D 20:43:28.626195] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 10/70. [D 20:43:28.635628] openib_check_cq: completed rdma wr_id 2aaaab036e60, nic_wr_credit 50034. [D 20:43:28.635650] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 11/70. [D 20:43:28.635715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.635738] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.635751] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.635867] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.635882] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.635894] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.640234] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7297 [D 20:43:28.640259] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 12/70. [D 20:43:28.643372] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7300 [D 20:43:28.643395] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 13/70. [D 20:43:28.646581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50034. [D 20:43:28.646601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50035. [D 20:43:28.646615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50036. [D 20:43:28.646630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50037. [D 20:43:28.646645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50038. [D 20:43:28.646659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50039. [D 20:43:28.647156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50040. [D 20:43:28.647176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50041. [D 20:43:28.647191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50042. [D 20:43:28.647472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50043. [D 20:43:28.647489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50044. [D 20:43:28.647504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50045. [D 20:43:28.647543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50046. [D 20:43:28.647558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50047. [D 20:43:28.647573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50048. [D 20:43:28.647676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50049. [D 20:43:28.647691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50050. [D 20:43:28.647736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50051. [D 20:43:28.647751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50052. [D 20:43:28.647766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50053. [D 20:43:28.647780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50054. [D 20:43:28.647795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50055. [D 20:43:28.647809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50056. [D 20:43:28.647824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50057. [D 20:43:28.647839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50058. [D 20:43:28.647858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50059. [D 20:43:28.647873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50060. [D 20:43:28.647888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50061. [D 20:43:28.647902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50062. [D 20:43:28.647917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50063. [D 20:43:28.647952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50064. [D 20:43:28.647967] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50065. [D 20:43:28.647984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50066. [D 20:43:28.647999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 50067. [D 20:43:28.648024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 50068. [D 20:43:28.648055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 50069. [D 20:43:28.648070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 50070. [D 20:43:28.648084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 50071. [D 20:43:28.648098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50072. [D 20:43:28.648113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50073. [D 20:43:28.648127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50074. [D 20:43:28.648141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 50075. [D 20:43:28.648156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 50076. [D 20:43:28.648229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 50077. [D 20:43:28.648245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 50078. [D 20:43:28.648260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 50079. [D 20:43:28.648275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50080. [D 20:43:28.648289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50081. [D 20:43:28.648304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50082. [D 20:43:28.648319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50083. [D 20:43:28.648333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50084. [D 20:43:28.648348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50085. [D 20:43:28.648364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50086. [D 20:43:28.648378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50087. [D 20:43:28.648392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50088. [D 20:43:28.648407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50089. [D 20:43:28.648421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50090. [D 20:43:28.648436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50091. [D 20:43:28.648450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50092. [D 20:43:28.648464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50093. [D 20:43:28.648479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50094. [D 20:43:28.648493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50095. [D 20:43:28.648508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50096. [D 20:43:28.648522] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0141b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50097. [D 20:43:28.648591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.648647] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.648661] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.648704] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7303 [D 20:43:28.648719] element 0: offset: 0x2aaaab014240, size: 24 [D 20:43:28.648742] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 14/70. [D 20:43:28.648789] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.648802] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.648815] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.648835] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7305 [D 20:43:28.648849] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:28.648863] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 15/70. [D 20:43:28.658263] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50097. [D 20:43:28.658299] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 16/70. [D 20:43:28.665448] openib_check_cq: completed rdma wr_id 2aaaab0141b0, nic_wr_credit 50096. [D 20:43:28.665469] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 17/70. [D 20:43:28.665526] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.665545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.665559] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.665684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.665699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.665712] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.671610] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7303 [D 20:43:28.671637] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 18/70. [D 20:43:28.671658] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7305 [D 20:43:28.671680] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 19/70. [D 20:43:28.671839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 50096. [D 20:43:28.671855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 50097. [D 20:43:28.671871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50098. [D 20:43:28.671885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50099. [D 20:43:28.671900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50100. [D 20:43:28.671925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50101. [D 20:43:28.671940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50102. [D 20:43:28.671962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50103. [D 20:43:28.671976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50104. [D 20:43:28.672004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50105. [D 20:43:28.672026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50106. [D 20:43:28.672045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50107. [D 20:43:28.672072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50108. [D 20:43:28.672088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50109. [D 20:43:28.672102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50110. [D 20:43:28.672129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50111. [D 20:43:28.672144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50112. [D 20:43:28.672456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50113. [D 20:43:28.672476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50114. [D 20:43:28.672490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50115. [D 20:43:28.672504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50116. [D 20:43:28.672519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50117. [D 20:43:28.672533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50118. [D 20:43:28.672548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50119. [D 20:43:28.672562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50120. [D 20:43:28.672576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50121. [D 20:43:28.672590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50122. [D 20:43:28.672605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50123. [D 20:43:28.672619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50124. [D 20:43:28.672634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50125. [D 20:43:28.672648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50126. [D 20:43:28.672664] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50127. [D 20:43:28.672681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50128. [D 20:43:28.672695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50129. [D 20:43:28.672710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50130. [D 20:43:28.672724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50131. [D 20:43:28.672739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50132. [D 20:43:28.672753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50133. [D 20:43:28.672767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50134. [D 20:43:28.672781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50135. [D 20:43:28.672796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50136. [D 20:43:28.672810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50137. [D 20:43:28.672825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50138. [D 20:43:28.672839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50139. [D 20:43:28.672853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50140. [D 20:43:28.672867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50141. [D 20:43:28.672882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50142. [D 20:43:28.672896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50143. [D 20:43:28.672910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50144. [D 20:43:28.672924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50145. [D 20:43:28.672939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50146. [D 20:43:28.672953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50147. [D 20:43:28.672968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50148. [D 20:43:28.672982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50149. [D 20:43:28.672996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50150. [D 20:43:28.673010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50151. [D 20:43:28.673025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50152. [D 20:43:28.673039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50153. [D 20:43:28.673054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50154. [D 20:43:28.673068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50155. [D 20:43:28.673083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50156. [D 20:43:28.673097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50157. [D 20:43:28.673112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50158. [D 20:43:28.673126] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0146d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50159. [D 20:43:28.677896] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.677964] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.677978] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.678023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7309 [D 20:43:28.678039] element 0: offset: 0x644640, size: 24 [D 20:43:28.678058] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 20/70. [D 20:43:28.678103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.678117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.678129] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.678151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7312 [D 20:43:28.678165] element 0: offset: 0x62fd10, size: 24 [D 20:43:28.678179] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 21/70. [D 20:43:28.683629] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50159. [D 20:43:28.683672] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 22/70. [D 20:43:28.689973] openib_check_cq: completed rdma wr_id 2aaaab0146d0, nic_wr_credit 50158. [D 20:43:28.689995] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 23/70. [D 20:43:28.690058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.690080] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.690093] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.690207] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.690222] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.690234] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.696252] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7309 [D 20:43:28.696328] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 24/70. [D 20:43:28.696438] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7312 [D 20:43:28.696461] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 25/70. [D 20:43:28.701121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50158. [D 20:43:28.701145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50159. [D 20:43:28.701160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50160. [D 20:43:28.701175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50161. [D 20:43:28.701189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50162. [D 20:43:28.701204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50163. [D 20:43:28.701218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50164. [D 20:43:28.701233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50165. [D 20:43:28.701248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50166. [D 20:43:28.701263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50167. [D 20:43:28.701278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50168. [D 20:43:28.701293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50169. [D 20:43:28.701307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50170. [D 20:43:28.701321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50171. [D 20:43:28.701336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50172. [D 20:43:28.701351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50173. [D 20:43:28.701365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50174. [D 20:43:28.701379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50175. [D 20:43:28.701394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50176. [D 20:43:28.701408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50177. [D 20:43:28.701423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50178. [D 20:43:28.701437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50179. [D 20:43:28.701452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50180. [D 20:43:28.701466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50181. [D 20:43:28.701480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50182. [D 20:43:28.701505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50183. [D 20:43:28.701528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50184. [D 20:43:28.701543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50185. [D 20:43:28.701557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50186. [D 20:43:28.701572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50187. [D 20:43:28.701586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50188. [D 20:43:28.701601] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50189. [D 20:43:28.701630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50190. [D 20:43:28.701647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 50191. [D 20:43:28.701661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 50192. [D 20:43:28.701676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 50193. [D 20:43:28.701701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 50194. [D 20:43:28.701715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 50195. [D 20:43:28.701730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50196. [D 20:43:28.701746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50197. [D 20:43:28.701760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50198. [D 20:43:28.701775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 50199. [D 20:43:28.701789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 50200. [D 20:43:28.701803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 50201. [D 20:43:28.701818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 50202. [D 20:43:28.701832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 50203. [D 20:43:28.701847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50204. [D 20:43:28.701861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50205. [D 20:43:28.701875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50206. [D 20:43:28.701890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50207. [D 20:43:28.701905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50208. [D 20:43:28.701919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50209. [D 20:43:28.701933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50210. [D 20:43:28.701948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50211. [D 20:43:28.701962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50212. [D 20:43:28.701976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50213. [D 20:43:28.701991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50214. [D 20:43:28.702005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50215. [D 20:43:28.702019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50216. [D 20:43:28.702033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50217. [D 20:43:28.702048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50218. [D 20:43:28.702062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50219. [D 20:43:28.702077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50220. [D 20:43:28.702091] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab026fb0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50221. [D 20:43:28.702149] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.702173] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.702186] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.702228] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7315 [D 20:43:28.702243] element 0: offset: 0x624380, size: 24 [D 20:43:28.702261] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 26/70. [D 20:43:28.702293] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.702309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.702322] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.702341] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7317 [D 20:43:28.702355] element 0: offset: 0x658610, size: 24 [D 20:43:28.702369] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 27/70. [D 20:43:28.707184] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50221. [D 20:43:28.707211] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 28/70. [D 20:43:28.716426] openib_check_cq: completed rdma wr_id 2aaaab026fb0, nic_wr_credit 50220. [D 20:43:28.716447] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 29/70. [D 20:43:28.716507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.716527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.716540] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.716654] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.716669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.716681] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.722542] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7315 [D 20:43:28.722617] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 30/70. [D 20:43:28.722698] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7317 [D 20:43:28.722717] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 31/70. [D 20:43:28.722795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 50220. [D 20:43:28.722820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 50221. [D 20:43:28.722835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50222. [D 20:43:28.722850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50223. [D 20:43:28.722875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50224. [D 20:43:28.722890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50225. [D 20:43:28.722912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50226. [D 20:43:28.722927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50227. [D 20:43:28.722953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50228. [D 20:43:28.722968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50229. [D 20:43:28.722992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50230. [D 20:43:28.723007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50231. [D 20:43:28.723033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50232. [D 20:43:28.723048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50233. [D 20:43:28.723072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50234. [D 20:43:28.723086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50235. [D 20:43:28.723114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50236. [D 20:43:28.723138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50237. [D 20:43:28.723154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50238. [D 20:43:28.723180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50239. [D 20:43:28.723205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50240. [D 20:43:28.723221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50241. [D 20:43:28.723247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50242. [D 20:43:28.723270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50243. [D 20:43:28.723293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50244. [D 20:43:28.723308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50245. [D 20:43:28.723322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50246. [D 20:43:28.723337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50247. [D 20:43:28.723351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50248. [D 20:43:28.723366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50249. [D 20:43:28.723380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50250. [D 20:43:28.723395] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50251. [D 20:43:28.723411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50252. [D 20:43:28.723426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50253. [D 20:43:28.723441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50254. [D 20:43:28.723455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50255. [D 20:43:28.723470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50256. [D 20:43:28.723484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50257. [D 20:43:28.723499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50258. [D 20:43:28.723513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50259. [D 20:43:28.723527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50260. [D 20:43:28.723542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50261. [D 20:43:28.723556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50262. [D 20:43:28.723571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50263. [D 20:43:28.723586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50264. [D 20:43:28.723600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50265. [D 20:43:28.723614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50266. [D 20:43:28.723630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50267. [D 20:43:28.723644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50268. [D 20:43:28.723659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50269. [D 20:43:28.723674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50270. [D 20:43:28.723688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50271. [D 20:43:28.723703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50272. [D 20:43:28.723717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50273. [D 20:43:28.723732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50274. [D 20:43:28.723746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50275. [D 20:43:28.723761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50276. [D 20:43:28.723776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50277. [D 20:43:28.723790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50278. [D 20:43:28.723805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50279. [D 20:43:28.723819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50280. [D 20:43:28.723834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50281. [D 20:43:28.723848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50282. [D 20:43:28.723863] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab035140 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50283. [D 20:43:28.728898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.728920] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.728933] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.728974] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7321 [D 20:43:28.728989] element 0: offset: 0x636ca0, size: 24 [D 20:43:28.729008] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 32/70. [D 20:43:28.729049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.729063] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.729075] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.729096] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7324 [D 20:43:28.729110] element 0: offset: 0x641f50, size: 24 [D 20:43:28.729124] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 33/70. [D 20:43:28.734560] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50283. [D 20:43:28.734594] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 34/70. [D 20:43:28.741050] openib_check_cq: completed rdma wr_id 2aaaab035140, nic_wr_credit 50282. [D 20:43:28.741068] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 35/70. [D 20:43:28.741131] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.741152] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.741165] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:28.741275] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:28.741290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.741304] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:28.744151] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7321 [D 20:43:28.744231] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 36/70. [D 20:43:28.747006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50282. [D 20:43:28.747031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50283. [D 20:43:28.747047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50284. [D 20:43:28.747061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50285. [D 20:43:28.747076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50286. [D 20:43:28.747262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50287. [D 20:43:28.747581] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7324 [D 20:43:28.747669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50288. [D 20:43:28.747765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50289. [D 20:43:28.747781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50290. [D 20:43:28.747795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50291. [D 20:43:28.747810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50292. [D 20:43:28.747824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50293. [D 20:43:28.747839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50294. [D 20:43:28.747853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50295. [D 20:43:28.747867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50296. [D 20:43:28.747882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50297. [D 20:43:28.747896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50298. [D 20:43:28.747910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50299. [D 20:43:28.747925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50300. [D 20:43:28.747939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50301. [D 20:43:28.747954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50302. [D 20:43:28.747968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50303. [D 20:43:28.747983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50304. [D 20:43:28.747997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50305. [D 20:43:28.748011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50306. [D 20:43:28.748026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50307. [D 20:43:28.748040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50308. [D 20:43:28.748059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50309. [D 20:43:28.748074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50310. [D 20:43:28.748089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50311. [D 20:43:28.748103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50312. [D 20:43:28.748118] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50313. [D 20:43:28.748148] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 37/70. [D 20:43:28.752833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.752852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.752865] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:28.752908] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7327 [D 20:43:28.752923] element 0: offset: 0x5b0030, size: 24 [D 20:43:28.752940] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 38/70. [D 20:43:28.752980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:28.752994] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:28.753006] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:28.753026] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7329 [D 20:43:28.753040] element 0: offset: 0x644640, size: 24 [D 20:43:28.753057] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 39/70. [D 20:43:28.758741] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50313. [D 20:43:28.758778] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 40/70. [D 20:43:28.758805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50313. [D 20:43:28.758820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 50314. [D 20:43:28.758835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 50315. [D 20:43:28.758850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 50316. [D 20:43:28.758865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 50317. [D 20:43:28.758885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 50318. [D 20:43:28.758900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50319. [D 20:43:28.758914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50320. [D 20:43:28.758929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50321. [D 20:43:28.758943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 50322. [D 20:43:28.758958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 50323. [D 20:43:28.758972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 50324. [D 20:43:28.758987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 50325. [D 20:43:28.759002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 50326. [D 20:43:28.759016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50327. [D 20:43:28.759031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50328. [D 20:43:29.061999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50329. [D 20:43:29.062439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50330. [D 20:43:29.062456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50331. [D 20:43:29.062471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50332. [D 20:43:29.062485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50333. [D 20:43:29.062500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50334. [D 20:43:29.062530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50335. [D 20:43:29.062545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50336. [D 20:43:29.062559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50337. [D 20:43:29.062574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50338. [D 20:43:29.062588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50339. [D 20:43:29.062603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50340. [D 20:43:29.062617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50341. [D 20:43:29.062632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50342. [D 20:43:29.062646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50343. [D 20:43:29.062660] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001930 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50344. [D 20:43:29.062873] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.062896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.062910] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.063026] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.063041] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.063054] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.063077] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7332 [D 20:43:29.063091] element 0: offset: 0x62fd10, size: 24 [D 20:43:29.063107] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 41/70. [D 20:43:29.065372] openib_check_cq: completed rdma wr_id 2aaaab001930, nic_wr_credit 50344. [D 20:43:29.065396] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 42/70. [D 20:43:29.065546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.065604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.065617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.071468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.071523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.071537] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.071580] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7336 [D 20:43:29.071595] element 0: offset: 0x61fa30, size: 24 [D 20:43:29.071614] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 43/70. [D 20:43:29.075388] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7327 [D 20:43:29.075475] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 44/70. [D 20:43:29.075556] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7329 [D 20:43:29.075573] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 45/70. [D 20:43:29.075619] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7332 [D 20:43:29.075636] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 46/70. [D 20:43:29.076053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 50344. [D 20:43:29.076084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 50345. [D 20:43:29.076099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50346. [D 20:43:29.076114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50347. [D 20:43:29.076129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50348. [D 20:43:29.076143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50349. [D 20:43:29.076158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50350. [D 20:43:29.076177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50351. [D 20:43:29.076192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50352. [D 20:43:29.076207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50353. [D 20:43:29.076221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50354. [D 20:43:29.076236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50355. [D 20:43:29.076251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50356. [D 20:43:29.076265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50357. [D 20:43:29.076280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50358. [D 20:43:29.076294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50359. [D 20:43:29.076309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50360. [D 20:43:29.076324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50361. [D 20:43:29.076338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50362. [D 20:43:29.076353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50363. [D 20:43:29.076367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50364. [D 20:43:29.076382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50365. [D 20:43:29.076396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50366. [D 20:43:29.076411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50367. [D 20:43:29.076426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50368. [D 20:43:29.076440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50369. [D 20:43:29.076455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50370. [D 20:43:29.076470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50371. [D 20:43:29.076485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50372. [D 20:43:29.076500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50373. [D 20:43:29.076514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50374. [D 20:43:29.076529] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50375. [D 20:43:29.076546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50376. [D 20:43:29.076561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50377. [D 20:43:29.076575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50378. [D 20:43:29.076590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50379. [D 20:43:29.076605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50380. [D 20:43:29.076619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50381. [D 20:43:29.076634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50382. [D 20:43:29.076648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50383. [D 20:43:29.076662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50384. [D 20:43:29.076677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50385. [D 20:43:29.076691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50386. [D 20:43:29.076706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50387. [D 20:43:29.076721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50388. [D 20:43:29.076735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50389. [D 20:43:29.076750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50390. [D 20:43:29.076764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50391. [D 20:43:29.076779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50392. [D 20:43:29.076793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50393. [D 20:43:29.076808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50394. [D 20:43:29.076822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50395. [D 20:43:29.076837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50396. [D 20:43:29.076851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50397. [D 20:43:29.076866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50398. [D 20:43:29.076880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50399. [D 20:43:29.076896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50400. [D 20:43:29.076911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50401. [D 20:43:29.076926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50402. [D 20:43:29.076952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50403. [D 20:43:29.076967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50404. [D 20:43:29.076981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50405. [D 20:43:29.076996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50406. [D 20:43:29.077011] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab035140 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50407. [D 20:43:29.077028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50408. [D 20:43:29.077042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50409. [D 20:43:29.077057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50410. [D 20:43:29.077072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50411. [D 20:43:29.077086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50412. [D 20:43:29.077101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50413. [D 20:43:29.077116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50414. [E 20:43:29.077135] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50415, block for 10 ms. [D 20:43:29.078743] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7336 [D 20:43:29.087235] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50414. [D 20:43:29.087264] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 47/70. [D 20:43:29.087280] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50413. [D 20:43:29.087295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50414. [D 20:43:29.087310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50415. [D 20:43:29.087324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50416. [D 20:43:29.087339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50417. [D 20:43:29.087353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50418. [D 20:43:29.087368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50419. [D 20:43:29.087383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50420. [D 20:43:29.087397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50421. [D 20:43:29.087412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50422. [D 20:43:29.087426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50423. [D 20:43:29.087441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50424. [D 20:43:29.087455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50425. [D 20:43:29.087469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50426. [D 20:43:29.087484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50427. [D 20:43:29.087508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50428. [D 20:43:29.087531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50429. [D 20:43:29.087546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50430. [D 20:43:29.087560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50431. [D 20:43:29.087575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50432. [D 20:43:29.087589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50433. [D 20:43:29.087603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50434. [D 20:43:29.087618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50435. [D 20:43:29.087632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50436. [D 20:43:29.087646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50437. [D 20:43:29.087661] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab026fb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50438. [D 20:43:29.087696] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 48/70. [D 20:43:29.093150] openib_check_cq: completed rdma wr_id 2aaaab035140, nic_wr_credit 50438. [D 20:43:29.093175] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 49/70. [D 20:43:29.094296] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.094321] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.094335] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.098993] openib_check_cq: completed rdma wr_id 2aaaab026fb0, nic_wr_credit 50437. [D 20:43:29.099014] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 50/70. [D 20:43:29.099055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.099074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.099086] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:29.099112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.099125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.099138] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:29.100008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50437. [D 20:43:29.100028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 50438. [D 20:43:29.100043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 50439. [D 20:43:29.100057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 50440. [D 20:43:29.100075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 50441. [D 20:43:29.100089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 50442. [D 20:43:29.100104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50443. [D 20:43:29.100119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50444. [D 20:43:29.100134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50445. [D 20:43:29.100148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 50446. [D 20:43:29.100163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 50447. [D 20:43:29.100182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 50448. [D 20:43:29.100197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 50449. [D 20:43:29.100212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 50450. [D 20:43:29.100226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50451. [D 20:43:29.100241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50452. [D 20:43:29.100255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50453. [D 20:43:29.100270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50454. [D 20:43:29.100285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50455. [D 20:43:29.100299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50456. [D 20:43:29.100314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50457. [D 20:43:29.100329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50458. [D 20:43:29.100343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50459. [D 20:43:29.100358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50460. [D 20:43:29.100372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50461. [D 20:43:29.100387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50462. [D 20:43:29.100401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50463. [D 20:43:29.100416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50464. [D 20:43:29.100431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50465. [D 20:43:29.100445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50466. [D 20:43:29.100460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50467. [D 20:43:29.100475] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab0293b0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50468. [D 20:43:29.105964] openib_check_cq: completed rdma wr_id 2aaaab0293b0, nic_wr_credit 50468. [D 20:43:29.105982] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 51/70. [D 20:43:29.106049] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.106068] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.106081] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:29.125058] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.125074] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.125087] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:29.125127] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7338 [D 20:43:29.125142] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:29.125159] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 52/70. [D 20:43:29.128565] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7338 [D 20:43:29.128643] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 53/70. [D 20:43:29.128700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 50468. [D 20:43:29.128723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 50469. [D 20:43:29.128738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50470. [D 20:43:29.128753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50471. [D 20:43:29.128768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50472. [D 20:43:29.128783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50473. [D 20:43:29.128797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50474. [D 20:43:29.128812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50475. [D 20:43:29.128827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50476. [D 20:43:29.128841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50477. [D 20:43:29.128856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50478. [D 20:43:29.128871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50479. [D 20:43:29.128885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50480. [D 20:43:29.128900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50481. [D 20:43:29.128915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50482. [D 20:43:29.128929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50483. [D 20:43:29.128944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50484. [D 20:43:29.128959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50485. [D 20:43:29.128974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50486. [D 20:43:29.128988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50487. [D 20:43:29.129003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50488. [D 20:43:29.129018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50489. [D 20:43:29.129032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50490. [D 20:43:29.129047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50491. [D 20:43:29.129062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50492. [D 20:43:29.129077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50493. [D 20:43:29.129092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50494. [D 20:43:29.129107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50495. [D 20:43:29.129121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50496. [D 20:43:29.129136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50497. [D 20:43:29.129151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50498. [D 20:43:29.129165] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50499. [D 20:43:29.139401] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50499. [D 20:43:29.139420] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 54/70. [D 20:43:29.139553] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.139577] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.139590] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:29.232360] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.232384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.232399] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:29.232443] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7341 [D 20:43:29.232459] element 0: offset: 0x2aaaab609ba0, size: 24 [D 20:43:29.232477] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 55/70. [D 20:43:29.235743] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7341 [D 20:43:29.235769] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 56/70. [D 20:43:29.235827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 50499. [D 20:43:29.235844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 50500. [D 20:43:29.235859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50501. [D 20:43:29.235873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50502. [D 20:43:29.235887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50503. [D 20:43:29.235901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50504. [D 20:43:29.235916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50505. [D 20:43:29.235930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50506. [D 20:43:29.235944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50507. [D 20:43:29.235958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50508. [D 20:43:29.235972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50509. [D 20:43:29.235986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50510. [D 20:43:29.236000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50511. [D 20:43:29.236014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50512. [D 20:43:29.236030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50513. [D 20:43:29.236044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50514. [D 20:43:29.236058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50515. [D 20:43:29.236072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50516. [D 20:43:29.236087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50517. [D 20:43:29.236101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50518. [D 20:43:29.236115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50519. [D 20:43:29.236129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50520. [D 20:43:29.236143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50521. [D 20:43:29.236157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50522. [D 20:43:29.236175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50523. [D 20:43:29.236189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50524. [D 20:43:29.236204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50525. [D 20:43:29.236218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50526. [D 20:43:29.236232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50527. [D 20:43:29.236245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50528. [D 20:43:29.236259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50529. [D 20:43:29.236274] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50530. [D 20:43:29.247191] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50530. [D 20:43:29.247264] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 57/70. [D 20:43:29.248213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.248232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.248246] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:29.257246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.257267] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.257281] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:29.257320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7345 [D 20:43:29.257335] element 0: offset: 0x2aaaab60ca30, size: 24 [D 20:43:29.257351] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 58/70. [D 20:43:29.257384] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.257399] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.257411] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:29.257433] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7347 [D 20:43:29.257446] element 0: offset: 0x2aaaab014240, size: 24 [D 20:43:29.257464] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 59/70. [D 20:43:29.263057] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7347 [D 20:43:29.263129] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 60/70. [D 20:43:29.263281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 50530. [D 20:43:29.263309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 50531. [D 20:43:29.263325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50532. [D 20:43:29.263340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50533. [D 20:43:29.263355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50534. [D 20:43:29.263370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50535. [D 20:43:29.263385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50536. [D 20:43:29.263400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50537. [D 20:43:29.263416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50538. [D 20:43:29.263431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50539. [D 20:43:29.263445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50540. [D 20:43:29.263460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50541. [D 20:43:29.263476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50542. [D 20:43:29.263483] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7345 [D 20:43:29.263490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50543. [D 20:43:29.263523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50544. [D 20:43:29.263538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50545. [D 20:43:29.263552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50546. [D 20:43:29.263567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50547. [D 20:43:29.263581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50548. [D 20:43:29.263596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50549. [D 20:43:29.263610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50550. [D 20:43:29.263625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50551. [D 20:43:29.263639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50552. [D 20:43:29.263654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50553. [D 20:43:29.263669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50554. [D 20:43:29.263683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50555. [D 20:43:29.263698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50556. [D 20:43:29.263712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50557. [D 20:43:29.263727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50558. [D 20:43:29.263742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50559. [D 20:43:29.263757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50560. [D 20:43:29.263771] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50561. [D 20:43:29.263798] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 0/70. [D 20:43:29.274952] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50561. [D 20:43:29.274979] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 1/70. [D 20:43:29.274998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50561. [D 20:43:29.275014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50562. [D 20:43:29.275029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50563. [D 20:43:29.275044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50564. [D 20:43:29.275058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50565. [D 20:43:29.275073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50566. [D 20:43:29.275087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50567. [D 20:43:29.275102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50568. [D 20:43:29.275116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50569. [D 20:43:29.275130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50570. [D 20:43:29.275145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50571. [D 20:43:29.275159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50572. [D 20:43:29.275174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50573. [D 20:43:29.275188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50574. [D 20:43:29.275202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50575. [D 20:43:29.275217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50576. [D 20:43:29.275231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50577. [D 20:43:29.275246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50578. [D 20:43:29.275260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50579. [D 20:43:29.275275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50580. [D 20:43:29.275289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50581. [D 20:43:29.275304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50582. [D 20:43:29.275318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50583. [D 20:43:29.275333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50584. [D 20:43:29.275348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50585. [D 20:43:29.275363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50586. [D 20:43:29.275377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50587. [D 20:43:29.275392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50588. [D 20:43:29.275406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50589. [D 20:43:29.275421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50590. [D 20:43:29.275435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50591. [D 20:43:29.275450] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab027020 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50592. [D 20:43:29.275522] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.275544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.275557] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:29.281720] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.281737] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.281749] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:29.281788] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7351 [D 20:43:29.281803] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:29.281820] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 2/70. [D 20:43:29.281858] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.281872] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.281884] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:29.281905] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7353 [D 20:43:29.281919] element 0: offset: 0x2aaaab025a90, size: 24 [D 20:43:29.281934] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 3/70. [D 20:43:29.284220] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.284237] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.284250] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.284272] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7357 [D 20:43:29.284286] element 0: offset: 0x2aaaab001b60, size: 24 [D 20:43:29.284301] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 4/70. [D 20:43:29.285061] openib_check_cq: completed rdma wr_id 2aaaab027020, nic_wr_credit 50592. [D 20:43:29.285082] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 5/70. [D 20:43:29.288116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.288132] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.288145] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.291593] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7351 [D 20:43:29.291688] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 6/70. [D 20:43:29.291833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50592. [D 20:43:29.291854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50593. [D 20:43:29.291869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 50594. [D 20:43:29.291936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 50595. [D 20:43:29.291967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 50596. [D 20:43:29.291984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 50597. [D 20:43:29.291999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 50598. [D 20:43:29.292014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50599. [D 20:43:29.292028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50600. [D 20:43:29.292046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50601. [D 20:43:29.292061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 50602. [D 20:43:29.292083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 50603. [D 20:43:29.292099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 50604. [D 20:43:29.292114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 50605. [D 20:43:29.292129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 50606. [D 20:43:29.292143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50607. [D 20:43:29.292158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50608. [D 20:43:29.292186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50609. [D 20:43:29.292201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50610. [D 20:43:29.292216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50611. [D 20:43:29.292231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50612. [D 20:43:29.292245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50613. [D 20:43:29.292260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50614. [D 20:43:29.292274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50615. [D 20:43:29.292289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50616. [D 20:43:29.292304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50617. [D 20:43:29.292319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50618. [D 20:43:29.292333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50619. [D 20:43:29.292348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50620. [D 20:43:29.292362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50621. [D 20:43:29.292377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50622. [D 20:43:29.292391] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab002000 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50623. [D 20:43:29.292466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.292525] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.292539] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.292585] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7359 [D 20:43:29.292600] element 0: offset: 0x2aaaab036b60, size: 24 [D 20:43:29.292621] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 7/70. [D 20:43:29.296203] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7353 [D 20:43:29.296231] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 8/70. [D 20:43:29.296248] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7357 [D 20:43:29.296263] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 9/70. [D 20:43:29.303561] openib_check_cq: completed rdma wr_id 2aaaab002000, nic_wr_credit 50623. [D 20:43:29.303584] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 10/70. [D 20:43:29.303611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 50623. [D 20:43:29.303627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 50624. [D 20:43:29.303643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50625. [D 20:43:29.303658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50626. [D 20:43:29.303673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50627. [D 20:43:29.303688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50628. [D 20:43:29.303703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50629. [D 20:43:29.303718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50630. [D 20:43:29.303732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50631. [D 20:43:29.303747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50632. [D 20:43:29.303762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50633. [D 20:43:29.303776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50634. [D 20:43:29.303791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50635. [D 20:43:29.303805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50636. [D 20:43:29.303820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50637. [D 20:43:29.303834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50638. [D 20:43:29.303849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50639. [D 20:43:29.303864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50640. [D 20:43:29.303878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50641. [D 20:43:29.303893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50642. [D 20:43:29.303908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50643. [D 20:43:29.303922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50644. [D 20:43:29.303937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50645. [D 20:43:29.303951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50646. [D 20:43:29.303967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50647. [D 20:43:29.303982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50648. [D 20:43:29.303996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50649. [D 20:43:29.304011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50650. [D 20:43:29.304025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50651. [D 20:43:29.304040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50652. [D 20:43:29.304054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50653. [D 20:43:29.304069] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab035550 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50654. [D 20:43:29.304089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50655. [D 20:43:29.304104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50656. [D 20:43:29.304119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50657. [D 20:43:29.304134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50658. [D 20:43:29.304149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50659. [D 20:43:29.304163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50660. [D 20:43:29.304183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50661. [D 20:43:29.304198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50662. [D 20:43:29.304213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50663. [D 20:43:29.304228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50664. [D 20:43:29.304242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50665. [D 20:43:29.304257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50666. [D 20:43:29.304272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50667. [D 20:43:29.304287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50668. [D 20:43:29.304302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50669. [D 20:43:29.304316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50670. [D 20:43:29.304331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50671. [D 20:43:29.304345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50672. [D 20:43:29.304360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50673. [D 20:43:29.304375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50674. [D 20:43:29.304390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50675. [D 20:43:29.304405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50676. [D 20:43:29.304420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50677. [D 20:43:29.304435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50678. [D 20:43:29.304449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50679. [D 20:43:29.304463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50680. [D 20:43:29.304478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50681. [D 20:43:29.304492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50682. [D 20:43:29.304507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50683. [D 20:43:29.304521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50684. [D 20:43:29.304536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50685. [D 20:43:29.304550] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02ce70 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50686. [D 20:43:29.304622] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.304671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.304684] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.307315] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7359 [D 20:43:29.307373] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 11/70. [D 20:43:29.315429] openib_check_cq: completed rdma wr_id 2aaaab035550, nic_wr_credit 50686. [D 20:43:29.315456] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 12/70. [D 20:43:29.326986] openib_check_cq: completed rdma wr_id 2aaaab02ce70, nic_wr_credit 50685. [D 20:43:29.327008] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 13/70. [D 20:43:29.327071] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.327093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.327107] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:29.327135] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.327148] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.327160] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:29.331417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50685. [D 20:43:29.331443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50686. [D 20:43:29.331457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50687. [D 20:43:29.331472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50688. [D 20:43:29.331486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50689. [D 20:43:29.331500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50690. [D 20:43:29.331515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50691. [D 20:43:29.331529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50692. [D 20:43:29.331543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50693. [D 20:43:29.331559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50694. [D 20:43:29.331573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50695. [D 20:43:29.331588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50696. [D 20:43:29.331602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50697. [D 20:43:29.331617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50698. [D 20:43:29.331631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50699. [D 20:43:29.331646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50700. [D 20:43:29.331660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50701. [D 20:43:29.331675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50702. [D 20:43:29.331689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50703. [D 20:43:29.331704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50704. [D 20:43:29.331719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50705. [D 20:43:29.331733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50706. [D 20:43:29.331747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50707. [D 20:43:29.331762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50708. [D 20:43:29.331776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50709. [D 20:43:29.331791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50710. [D 20:43:29.331806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50711. [D 20:43:29.331820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50712. [D 20:43:29.331835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50713. [D 20:43:29.331849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50714. [D 20:43:29.331864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50715. [D 20:43:29.331878] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab002000 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50716. [D 20:43:29.338409] openib_check_cq: completed rdma wr_id 2aaaab002000, nic_wr_credit 50716. [D 20:43:29.338430] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 14/70. [D 20:43:29.338487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.338506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.338519] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:29.348073] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.348091] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.348104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:29.348142] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7364 [D 20:43:29.348156] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:29.348182] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 15/70. [D 20:43:29.348267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.348282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.348294] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:29.348315] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7367 [D 20:43:29.348329] element 0: offset: 0x2aaaab025a90, size: 24 [D 20:43:29.348343] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 16/70. [D 20:43:29.348428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.348443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.348456] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:29.348476] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7370 [D 20:43:29.348490] element 0: offset: 0x2aaaab014550, size: 24 [D 20:43:29.348506] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 17/70. [D 20:43:29.348585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.348600] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.348612] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.348633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7371 [D 20:43:29.348647] element 0: offset: 0x6253e0, size: 24 [D 20:43:29.348662] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 18/70. [D 20:43:29.352209] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7364 [D 20:43:29.352236] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 19/70. [D 20:43:29.352291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50716. [D 20:43:29.352308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50717. [D 20:43:29.352323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 50718. [D 20:43:29.352337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 50719. [D 20:43:29.352351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 50720. [D 20:43:29.352366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 50721. [D 20:43:29.352380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 50722. [D 20:43:29.352395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50723. [D 20:43:29.352410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50724. [D 20:43:29.352424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50725. [D 20:43:29.352438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 50726. [D 20:43:29.352453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 50727. [D 20:43:29.352468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 50728. [D 20:43:29.352482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 50729. [D 20:43:29.352496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 50730. [D 20:43:29.352511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50731. [D 20:43:29.352525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50732. [D 20:43:29.352540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50733. [D 20:43:29.352556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50734. [D 20:43:29.352570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50735. [D 20:43:29.352586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50736. [D 20:43:29.352600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50737. [D 20:43:29.352614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50738. [D 20:43:29.352629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50739. [D 20:43:29.352644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50740. [D 20:43:29.352658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50741. [D 20:43:29.352673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50742. [D 20:43:29.352687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50743. [D 20:43:29.352702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50744. [D 20:43:29.352717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50745. [D 20:43:29.352731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50746. [D 20:43:29.352746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50747. [D 20:43:29.356222] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7370 [D 20:43:29.356243] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 20/70. [D 20:43:29.358740] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7371 [D 20:43:29.358802] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 21/70. [D 20:43:29.359888] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7367 [D 20:43:29.359970] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 22/70. [D 20:43:29.360019] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50747. [D 20:43:29.360039] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 23/70. [D 20:43:29.360058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50747. [D 20:43:29.360074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50748. [D 20:43:29.360096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50749. [D 20:43:29.360111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50750. [D 20:43:29.360126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50751. [D 20:43:29.360141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50752. [D 20:43:29.360155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50753. [D 20:43:29.360186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50754. [D 20:43:29.360202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50755. [D 20:43:29.360217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50756. [D 20:43:29.513547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50757. [D 20:43:29.513621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50758. [D 20:43:29.514063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50759. [D 20:43:29.514080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50760. [D 20:43:29.514095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50761. [D 20:43:29.514109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50762. [D 20:43:29.514124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50763. [D 20:43:29.514143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50764. [D 20:43:29.514158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50765. [D 20:43:29.514172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50766. [D 20:43:29.514187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50767. [D 20:43:29.514214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50768. [D 20:43:29.514229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50769. [D 20:43:29.514244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50770. [D 20:43:29.514258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50771. [D 20:43:29.514273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50772. [D 20:43:29.514287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50773. [D 20:43:29.514302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50774. [D 20:43:29.514316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50775. [D 20:43:29.514388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50776. [D 20:43:29.514429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50777. [D 20:43:29.514876] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab002000 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50778. [D 20:43:29.514906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50779. [D 20:43:29.514921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50780. [D 20:43:29.514936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50781. [D 20:43:29.514950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50782. [D 20:43:29.514965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50783. [D 20:43:29.514979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50784. [D 20:43:29.514994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50785. [D 20:43:29.515011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50786. [D 20:43:29.515025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50787. [D 20:43:29.515040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50788. [D 20:43:29.515054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50789. [D 20:43:29.515069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50790. [D 20:43:29.515084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50791. [D 20:43:29.515098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50792. [D 20:43:29.515113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50793. [D 20:43:29.515127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50794. [D 20:43:29.515141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50795. [D 20:43:29.515156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50796. [D 20:43:29.515171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50797. [D 20:43:29.515240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50798. [D 20:43:29.515304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50799. [D 20:43:29.515703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50800. [D 20:43:29.515720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50801. [D 20:43:29.515734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50802. [D 20:43:29.515785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50803. [D 20:43:29.515800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50804. [D 20:43:29.515814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50805. [D 20:43:29.515829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50806. [D 20:43:29.515843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50807. [D 20:43:29.515857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50808. [D 20:43:29.515872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50809. [D 20:43:29.515890] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02e4f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50810. [D 20:43:29.515908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 50811. [D 20:43:29.515923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 50812. [D 20:43:29.515938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50813. [D 20:43:29.515952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50814. [D 20:43:29.515967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50815. [D 20:43:29.515981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50816. [E 20:43:29.516070] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50817, block for 10 ms. [D 20:43:29.516598] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50816. [D 20:43:29.516618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50817. [E 20:43:29.516650] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50818, block for 10 ms. [D 20:43:29.518151] openib_check_cq: completed rdma wr_id 2aaaab002000, nic_wr_credit 50817. [D 20:43:29.518173] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 24/70. [D 20:43:29.518188] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50816. [D 20:43:29.518202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50817. [D 20:43:29.518217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50818. [D 20:43:29.518232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50819. [D 20:43:29.518246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50820. [D 20:43:29.518261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50821. [D 20:43:29.518276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50822. [D 20:43:29.518290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50823. [D 20:43:29.518305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50824. [D 20:43:29.518319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50825. [D 20:43:29.518334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50826. [D 20:43:29.518348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50827. [D 20:43:29.518363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50828. [D 20:43:29.518377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50829. [D 20:43:29.518392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50830. [D 20:43:29.518407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50831. [D 20:43:29.518422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50832. [D 20:43:29.518436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50833. [D 20:43:29.518451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50834. [D 20:43:29.518471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50835. [D 20:43:29.518495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50836. [D 20:43:29.518589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50837. [D 20:43:29.518988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50838. [D 20:43:29.519006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50839. [D 20:43:29.519021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50840. [D 20:43:29.519035] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab013bc0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50841. [D 20:43:29.519446] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.519511] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.519525] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.519555] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.519569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.519581] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.519622] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7374 [D 20:43:29.519637] element 0: offset: 0x641f50, size: 24 [D 20:43:29.519657] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 25/70. [D 20:43:29.523737] openib_check_cq: completed rdma wr_id 2aaaab02e4f0, nic_wr_credit 50841. [D 20:43:29.523778] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 26/70. [D 20:43:29.525436] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.525458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.525471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.529636] openib_check_cq: completed rdma wr_id 2aaaab013bc0, nic_wr_credit 50840. [D 20:43:29.529662] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 27/70. [D 20:43:29.529716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.529735] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.529748] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:29.529853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.529868] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.529881] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:29.532922] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7374 [D 20:43:29.532946] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 28/70. [D 20:43:29.541397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50840. [D 20:43:29.541417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50841. [D 20:43:29.541432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 50842. [D 20:43:29.541447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 50843. [D 20:43:29.541461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 50844. [D 20:43:29.541476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 50845. [D 20:43:29.541491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 50846. [D 20:43:29.541505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50847. [D 20:43:29.541520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50848. [D 20:43:29.541534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50849. [D 20:43:29.541549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 50850. [D 20:43:29.541563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 50851. [D 20:43:29.541578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 50852. [D 20:43:29.541592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 50853. [D 20:43:29.541607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 50854. [D 20:43:29.541622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50855. [D 20:43:29.541636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50856. [D 20:43:29.541651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50857. [D 20:43:29.541665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50858. [D 20:43:29.541680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50859. [D 20:43:29.541694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50860. [D 20:43:29.541709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50861. [D 20:43:29.541724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50862. [D 20:43:29.541738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50863. [D 20:43:29.541753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50864. [D 20:43:29.541767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50865. [D 20:43:29.541782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50866. [D 20:43:29.541796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50867. [D 20:43:29.541811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50868. [D 20:43:29.541825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50869. [D 20:43:29.541840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50870. [D 20:43:29.541854] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50871. [D 20:43:29.541947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.542003] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.542017] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:29.542061] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7380 [D 20:43:29.542076] element 0: offset: 0x5b0030, size: 24 [D 20:43:29.542096] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 29/70. [D 20:43:29.542141] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.542155] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.542168] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:29.542190] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7381 [D 20:43:29.542204] element 0: offset: 0x61fa30, size: 24 [D 20:43:29.542221] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 30/70. [D 20:43:29.542247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.542261] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.542276] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.542295] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7383 [D 20:43:29.542309] element 0: offset: 0x658610, size: 24 [D 20:43:29.542323] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 31/70. [D 20:43:29.547305] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50871. [D 20:43:29.547332] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 32/70. [D 20:43:29.547521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.547542] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.547554] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.553398] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.553464] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.553478] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.553522] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7386 [D 20:43:29.553537] element 0: offset: 0x6253e0, size: 24 [D 20:43:29.553557] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 33/70. [D 20:43:29.557324] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7386 [D 20:43:29.557415] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 34/70. [D 20:43:29.557575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50871. [D 20:43:29.557600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50872. [D 20:43:29.557616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 50873. [D 20:43:29.557631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 50874. [D 20:43:29.557650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 50875. [D 20:43:29.557664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 50876. [D 20:43:29.557679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 50877. [D 20:43:29.557693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50878. [D 20:43:29.557708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50879. [D 20:43:29.557722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50880. [D 20:43:29.557737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 50881. [D 20:43:29.557752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 50882. [D 20:43:29.557767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 50883. [D 20:43:29.557781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 50884. [D 20:43:29.557796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 50885. [D 20:43:29.557810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50886. [D 20:43:29.557825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50887. [D 20:43:29.557839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50888. [D 20:43:29.557854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50889. [D 20:43:29.557869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50890. [D 20:43:29.557889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50891. [D 20:43:29.557904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50892. [D 20:43:29.557918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50893. [D 20:43:29.557933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50894. [D 20:43:29.557947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50895. [D 20:43:29.557962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50896. [D 20:43:29.557976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50897. [D 20:43:29.557991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50898. [D 20:43:29.558005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50899. [D 20:43:29.558020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50900. [D 20:43:29.558034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50901. [D 20:43:29.558049] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50902. [D 20:43:29.560339] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7380 [D 20:43:29.560417] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 35/70. [D 20:43:29.560448] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7383 [D 20:43:29.560465] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 36/70. [D 20:43:29.562171] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7381 [D 20:43:29.562191] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 37/70. [D 20:43:29.569377] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 50902. [D 20:43:29.569437] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 38/70. [D 20:43:29.569458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50902. [D 20:43:29.569473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50903. [D 20:43:29.569488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50904. [D 20:43:29.569503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50905. [D 20:43:29.569517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50906. [D 20:43:29.569532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50907. [D 20:43:29.569546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50908. [D 20:43:29.569561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50909. [D 20:43:29.569575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50910. [D 20:43:29.569590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50911. [D 20:43:29.569604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50912. [D 20:43:29.569619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50913. [D 20:43:29.569635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50914. [D 20:43:29.569650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50915. [D 20:43:29.569664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50916. [D 20:43:29.569679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50917. [D 20:43:29.569693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50918. [D 20:43:29.569708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50919. [D 20:43:29.569723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50920. [D 20:43:29.569737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50921. [D 20:43:29.569752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50922. [D 20:43:29.569766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50923. [D 20:43:29.569781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50924. [D 20:43:29.569796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50925. [D 20:43:29.569810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50926. [D 20:43:29.569825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50927. [D 20:43:29.569839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50928. [D 20:43:29.569854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50929. [D 20:43:29.569868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50930. [D 20:43:29.569883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50931. [D 20:43:29.569898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50932. [D 20:43:29.569912] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab002000 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50933. [D 20:43:29.569929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 50934. [D 20:43:29.569944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 50935. [D 20:43:29.569958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 50936. [D 20:43:29.569973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 50937. [D 20:43:29.569987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 50938. [D 20:43:29.570002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 50939. [D 20:43:29.570017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 50940. [D 20:43:29.570031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 50941. [D 20:43:29.570046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 50942. [D 20:43:29.570061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 50943. [D 20:43:29.570076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 50944. [D 20:43:29.570090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 50945. [D 20:43:29.570105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 50946. [D 20:43:29.570119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 50947. [D 20:43:29.570134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 50948. [D 20:43:29.570148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 50949. [D 20:43:29.570163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 50950. [D 20:43:29.570177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 50951. [D 20:43:29.570191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 50952. [D 20:43:29.570206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 50953. [D 20:43:29.570220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 50954. [D 20:43:29.570235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 50955. [D 20:43:29.570249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 50956. [D 20:43:29.570264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 50957. [D 20:43:29.570278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 50958. [D 20:43:29.570293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 50959. [D 20:43:29.570307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 50960. [D 20:43:29.570322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 50961. [D 20:43:29.570336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 50962. [D 20:43:29.570351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 50963. [D 20:43:29.570365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 50964. [D 20:43:29.570380] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab014740 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 50965. [D 20:43:29.570396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 50966. [D 20:43:29.570411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 50967. [D 20:43:29.570426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 50968. [D 20:43:29.570440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 50969. [D 20:43:29.570454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 50970. [D 20:43:29.570469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50971. [E 20:43:29.570489] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50972, block for 10 ms. [D 20:43:29.570521] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 50971. [D 20:43:29.570537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50972. [E 20:43:29.570553] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50973, block for 10 ms. [D 20:43:29.581129] openib_check_cq: completed rdma wr_id 2aaaab002000, nic_wr_credit 50972. [D 20:43:29.581151] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 39/70. [D 20:43:29.581166] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 50971. [D 20:43:29.581181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 50972. [D 20:43:29.581196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 50973. [D 20:43:29.581210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 50974. [D 20:43:29.581225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 50975. [D 20:43:29.581240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 50976. [D 20:43:29.581255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 50977. [D 20:43:29.581269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 50978. [D 20:43:29.581284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 50979. [D 20:43:29.581298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 50980. [D 20:43:29.581313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 50981. [D 20:43:29.581327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 50982. [D 20:43:29.581342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 50983. [D 20:43:29.581357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 50984. [D 20:43:29.581371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 50985. [D 20:43:29.581386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 50986. [D 20:43:29.581400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 50987. [D 20:43:29.581415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 50988. [D 20:43:29.581430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 50989. [D 20:43:29.581444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 50990. [D 20:43:29.581459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 50991. [D 20:43:29.581473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 50992. [D 20:43:29.581488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 50993. [D 20:43:29.581502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 50994. [D 20:43:29.581518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 50995. [D 20:43:29.581533] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab02e4f0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 50996. [D 20:43:29.581607] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.581628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.581641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.592697] openib_check_cq: completed rdma wr_id 2aaaab014740, nic_wr_credit 50996. [D 20:43:29.592723] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 40/70. [D 20:43:29.594898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.594917] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.594930] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:29.599670] openib_check_cq: completed rdma wr_id 2aaaab02e4f0, nic_wr_credit 50995. [D 20:43:29.599694] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 41/70. [D 20:43:29.599745] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.599764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.599777] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:29.599802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.599816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.599828] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:29.617256] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.617272] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.617285] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:29.617323] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7393 [D 20:43:29.617338] element 0: offset: 0x644640, size: 24 [D 20:43:29.617357] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 42/70. [D 20:43:29.617395] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.617409] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.617421] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:29.617441] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7394 [D 20:43:29.617455] element 0: offset: 0x62fd10, size: 24 [D 20:43:29.617471] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 43/70. [D 20:43:29.617560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.617575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.617588] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:29.617609] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7396 [D 20:43:29.617623] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:29.617639] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 44/70. [D 20:43:29.617713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.617729] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.617742] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.617762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7398 [D 20:43:29.617776] element 0: offset: 0x2aaaab014550, size: 24 [D 20:43:29.617792] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 45/70. [D 20:43:29.624327] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7393 [D 20:43:29.624417] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 46/70. [D 20:43:29.624582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50995. [D 20:43:29.624677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50996. [D 20:43:29.624693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50997. [D 20:43:29.624715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50998. [D 20:43:29.624730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50999. [D 20:43:29.624745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51000. [D 20:43:29.624760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51001. [D 20:43:29.624774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51002. [D 20:43:29.624789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51003. [D 20:43:29.624803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51004. [D 20:43:29.624818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51005. [D 20:43:29.624832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51006. [D 20:43:29.624846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51007. [D 20:43:29.624861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51008. [D 20:43:29.624876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51009. [D 20:43:29.624890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51010. [D 20:43:29.624905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51011. [D 20:43:29.624919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51012. [D 20:43:29.624934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51013. [D 20:43:29.624948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51014. [D 20:43:29.624963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51015. [D 20:43:29.624977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51016. [D 20:43:29.624991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51017. [D 20:43:29.625006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51018. [D 20:43:29.625021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51019. [D 20:43:29.625035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51020. [D 20:43:29.625050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51021. [D 20:43:29.625064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51022. [D 20:43:29.625078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51023. [D 20:43:29.625093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51024. [D 20:43:29.625107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51025. [D 20:43:29.625122] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab025840 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51026. [D 20:43:29.627436] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7394 [D 20:43:29.627499] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 47/70. [D 20:43:29.627565] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7398 [D 20:43:29.627583] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 48/70. [D 20:43:29.628871] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7396 [D 20:43:29.628896] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 49/70. [D 20:43:29.636244] openib_check_cq: completed rdma wr_id 2aaaab025840, nic_wr_credit 51026. [D 20:43:29.636277] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 50/70. [D 20:43:29.636295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51026. [D 20:43:29.636310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51027. [D 20:43:29.636324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51028. [D 20:43:29.636339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51029. [D 20:43:29.636354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51030. [D 20:43:29.636368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51031. [D 20:43:29.636382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51032. [D 20:43:29.636397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51033. [D 20:43:29.636411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51034. [D 20:43:29.636425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51035. [D 20:43:29.636440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51036. [D 20:43:29.636454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51037. [D 20:43:29.636469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51038. [D 20:43:29.636483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51039. [D 20:43:29.636497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51040. [D 20:43:29.636512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51041. [D 20:43:29.636526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51042. [D 20:43:29.636541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51043. [D 20:43:29.636555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51044. [D 20:43:29.636569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51045. [D 20:43:29.636584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51046. [D 20:43:29.636599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51047. [D 20:43:29.636613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51048. [D 20:43:29.636628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51049. [D 20:43:29.636643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51050. [D 20:43:29.636657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51051. [D 20:43:29.636672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51052. [D 20:43:29.636686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51053. [D 20:43:29.636700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51054. [D 20:43:29.636714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51055. [D 20:43:29.636729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51056. [D 20:43:29.636743] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab036af0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51057. [D 20:43:29.636759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51058. [D 20:43:29.636774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51059. [D 20:43:29.636789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51060. [D 20:43:29.636803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51061. [D 20:43:29.636817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51062. [D 20:43:29.636832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51063. [D 20:43:29.636846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51064. [D 20:43:29.636860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51065. [D 20:43:29.636874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51066. [D 20:43:29.636889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51067. [D 20:43:29.636903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51068. [D 20:43:29.636917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51069. [D 20:43:29.636932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51070. [D 20:43:29.636946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51071. [D 20:43:29.636960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51072. [D 20:43:29.636975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51073. [D 20:43:29.636989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51074. [D 20:43:29.637003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51075. [D 20:43:29.637018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51076. [D 20:43:29.637032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51077. [D 20:43:29.637046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51078. [D 20:43:29.637061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51079. [D 20:43:29.637076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51080. [D 20:43:29.637091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51081. [D 20:43:29.637105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51082. [D 20:43:29.637120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51083. [D 20:43:29.637135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51084. [D 20:43:29.637149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51085. [D 20:43:29.637163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51086. [D 20:43:29.637178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51087. [D 20:43:29.637192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51088. [D 20:43:29.637207] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab001d80 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51089. [D 20:43:29.637223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51090. [D 20:43:29.637238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51091. [D 20:43:29.637253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51092. [D 20:43:29.637267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51093. [D 20:43:29.637282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51094. [D 20:43:29.637297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51095. [E 20:43:29.637315] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51096, block for 10 ms. [D 20:43:29.637347] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51095. [D 20:43:29.637363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51096. [E 20:43:29.637379] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51097, block for 10 ms. [D 20:43:29.641994] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51096. [E 20:43:29.642057] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51097, block for 10 ms. [D 20:43:29.648110] openib_check_cq: completed rdma wr_id 2aaaab036af0, nic_wr_credit 51096. [D 20:43:29.648133] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 51/70. [D 20:43:29.648148] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51095. [D 20:43:29.648163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51096. [D 20:43:29.648189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51097. [D 20:43:29.648205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51098. [D 20:43:29.648219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51099. [D 20:43:29.648235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51100. [D 20:43:29.648249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51101. [D 20:43:29.648264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51102. [D 20:43:29.648279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51103. [D 20:43:29.648293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51104. [D 20:43:29.648308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51105. [D 20:43:29.648322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51106. [D 20:43:29.648337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51107. [D 20:43:29.648351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51108. [D 20:43:29.648366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51109. [D 20:43:29.648381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51110. [D 20:43:29.648395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51111. [D 20:43:29.648410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51112. [D 20:43:29.648424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51113. [D 20:43:29.648439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51114. [D 20:43:29.648453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51115. [D 20:43:29.648468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51116. [D 20:43:29.648483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51117. [D 20:43:29.648497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51118. [D 20:43:29.648512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51119. [D 20:43:29.648526] openib_post_sr_rdmaw: ibv_post_send wr_id 632a20 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51120. [D 20:43:29.648608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.648631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.648644] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.648675] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.648689] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.648701] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.648741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7402 [D 20:43:29.648756] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:29.648773] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 52/70. [D 20:43:29.659776] openib_check_cq: completed rdma wr_id 2aaaab001d80, nic_wr_credit 51120. [D 20:43:29.659802] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 53/70. [D 20:43:29.661991] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.662011] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.662024] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.954395] openib_check_cq: completed rdma wr_id 632a20, nic_wr_credit 51119. [D 20:43:29.954435] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 54/70. [D 20:43:29.954773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.954805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.954818] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.954848] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7404 [D 20:43:29.954862] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:29.954879] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 55/70. [D 20:43:29.954915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.954929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.954941] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.955022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.955036] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.955048] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.955068] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7407 [D 20:43:29.955082] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:29.955099] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 56/70. [D 20:43:29.955127] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.955141] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.955154] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.961376] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.961446] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.961460] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.961504] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7410 [D 20:43:29.961519] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:29.961539] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 57/70. [D 20:43:29.962666] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7402 [D 20:43:29.962718] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 58/70. [D 20:43:29.962802] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7404 [D 20:43:29.962822] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 59/70. [D 20:43:29.963378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51119. [D 20:43:29.963505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51120. [D 20:43:29.963523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51121. [D 20:43:29.963537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51122. [D 20:43:29.963552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51123. [D 20:43:29.963567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51124. [D 20:43:29.963585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51125. [D 20:43:29.963599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51126. [D 20:43:29.963614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51127. [D 20:43:29.963629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51128. [D 20:43:29.963643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51129. [D 20:43:29.963658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51130. [D 20:43:29.963673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51131. [D 20:43:29.963688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51132. [D 20:43:29.963727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51133. [D 20:43:29.963792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51134. [D 20:43:29.963807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51135. [D 20:43:29.963822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51136. [D 20:43:29.963837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51137. [D 20:43:29.963851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51138. [D 20:43:29.963866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51139. [D 20:43:29.963881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51140. [D 20:43:29.963896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51141. [D 20:43:29.963910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51142. [D 20:43:29.963925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51143. [D 20:43:29.963939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51144. [D 20:43:29.963954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51145. [D 20:43:29.963969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51146. [D 20:43:29.963984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51147. [D 20:43:29.963998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51148. [D 20:43:29.964013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51149. [D 20:43:29.964028] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51150. [D 20:43:29.964046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51151. [D 20:43:29.964062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51152. [D 20:43:29.964077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51153. [D 20:43:29.964091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51154. [D 20:43:29.964106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51155. [D 20:43:29.964127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51156. [D 20:43:29.964142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51157. [D 20:43:29.964156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51158. [D 20:43:29.964171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51159. [D 20:43:29.964198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51160. [D 20:43:29.964213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51161. [D 20:43:29.964228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51162. [D 20:43:29.964243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51163. [D 20:43:29.964257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51164. [D 20:43:29.964272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51165. [D 20:43:29.964287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51166. [D 20:43:29.964302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51167. [D 20:43:29.964316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51168. [D 20:43:29.964331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51169. [D 20:43:29.964346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51170. [D 20:43:29.964361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51171. [D 20:43:29.964376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51172. [D 20:43:29.964390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51173. [D 20:43:29.964405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51174. [D 20:43:29.964419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51175. [D 20:43:29.964434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51176. [D 20:43:29.964449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51177. [D 20:43:29.964464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51178. [D 20:43:29.964479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51179. [D 20:43:29.964493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51180. [D 20:43:29.964508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51181. [D 20:43:29.964523] openib_post_sr_rdmaw: ibv_post_send wr_id 632a20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51182. [D 20:43:29.966780] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7410 [D 20:43:29.966851] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 60/70. [D 20:43:29.969207] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7407 [D 20:43:29.969232] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 0/70. [D 20:43:29.973065] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51182. [D 20:43:29.973142] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 1/70. [D 20:43:29.981064] openib_check_cq: completed rdma wr_id 632a20, nic_wr_credit 51181. [D 20:43:29.981088] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 2/70. [D 20:43:29.981108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51181. [D 20:43:29.981124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51182. [D 20:43:29.981139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51183. [D 20:43:29.981153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51184. [D 20:43:29.981168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51185. [D 20:43:29.981182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51186. [D 20:43:29.981197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51187. [D 20:43:29.981211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51188. [D 20:43:29.981226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51189. [D 20:43:29.981241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51190. [D 20:43:29.981255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51191. [D 20:43:29.981270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51192. [D 20:43:29.981284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51193. [D 20:43:29.981299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51194. [D 20:43:29.981313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51195. [D 20:43:29.981327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51196. [D 20:43:29.981342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51197. [D 20:43:29.981356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51198. [D 20:43:29.981371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51199. [D 20:43:29.981386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51200. [D 20:43:29.981400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51201. [D 20:43:29.981415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51202. [D 20:43:29.981429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51203. [D 20:43:29.981444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51204. [D 20:43:29.981458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51205. [D 20:43:29.981473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51206. [D 20:43:29.981487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51207. [D 20:43:29.981502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51208. [D 20:43:29.981516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51209. [D 20:43:29.981531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51210. [D 20:43:29.981547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51211. [D 20:43:29.981562] openib_post_sr_rdmaw: ibv_post_send wr_id 64aca0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51212. [D 20:43:29.981579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51213. [D 20:43:29.981594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51214. [D 20:43:29.981609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51215. [D 20:43:29.981623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51216. [D 20:43:29.981638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51217. [D 20:43:29.981653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51218. [D 20:43:29.981667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51219. [D 20:43:29.981681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51220. [D 20:43:29.981696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51221. [D 20:43:29.981711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51222. [D 20:43:29.981725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51223. [D 20:43:29.981740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51224. [D 20:43:29.981754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51225. [D 20:43:29.981769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51226. [D 20:43:29.981783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51227. [D 20:43:29.981798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51228. [D 20:43:29.981812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51229. [D 20:43:29.981827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51230. [D 20:43:29.981841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51231. [D 20:43:29.981856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51232. [D 20:43:29.981871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51233. [D 20:43:29.981885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51234. [D 20:43:29.981900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51235. [D 20:43:29.981914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51236. [D 20:43:29.981929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51237. [D 20:43:29.981943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51238. [D 20:43:29.981958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51239. [D 20:43:29.981973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51240. [D 20:43:29.981988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51241. [D 20:43:29.982003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51242. [D 20:43:29.982018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51243. [D 20:43:29.982032] openib_post_sr_rdmaw: ibv_post_send wr_id 633c40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51244. [D 20:43:29.985166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.985184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.985198] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.985223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.985237] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.985250] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:29.987044] openib_check_cq: completed rdma wr_id 64aca0, nic_wr_credit 51244. [D 20:43:29.987059] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 3/70. [D 20:43:29.992897] openib_check_cq: completed rdma wr_id 633c40, nic_wr_credit 51243. [D 20:43:29.992917] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 4/70. [D 20:43:29.996126] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.996144] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.996158] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:29.996205] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7415 [D 20:43:29.996222] element 0: offset: 0x2aaaab025a90, size: 24 [D 20:43:29.996238] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 5/70. [D 20:43:29.996266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:29.996286] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.996299] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:29.996320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7416 [D 20:43:29.996335] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:29.996349] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 6/70. [D 20:43:29.996374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.996388] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.996401] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:29.996423] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:29.996437] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:29.996450] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.003146] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7416 [D 20:43:30.003227] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 7/70. [D 20:43:30.003339] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7415 [D 20:43:30.003362] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 8/70. [D 20:43:30.004707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51243. [D 20:43:30.004779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51244. [D 20:43:30.004795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51245. [D 20:43:30.004810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51246. [D 20:43:30.004848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51247. [D 20:43:30.004873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51248. [D 20:43:30.004889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51249. [D 20:43:30.004921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51250. [D 20:43:30.004937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51251. [D 20:43:30.004952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51252. [D 20:43:30.004979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51253. [D 20:43:30.005008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51254. [D 20:43:30.005023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51255. [D 20:43:30.005052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51256. [D 20:43:30.005079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51257. [D 20:43:30.005105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51258. [D 20:43:30.005129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51259. [D 20:43:30.005145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51260. [D 20:43:30.005172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51261. [D 20:43:30.005197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51262. [D 20:43:30.005213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51263. [D 20:43:30.005227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51264. [D 20:43:30.005242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51265. [D 20:43:30.005256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51266. [D 20:43:30.005300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51267. [D 20:43:30.005315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51268. [D 20:43:30.005361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51269. [D 20:43:30.005376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51270. [D 20:43:30.005395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51271. [D 20:43:30.005423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51272. [D 20:43:30.005438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51273. [D 20:43:30.005462] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51274. [D 20:43:30.005481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51275. [D 20:43:30.005511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51276. [D 20:43:30.005536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51277. [D 20:43:30.005551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51278. [D 20:43:30.005583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51279. [D 20:43:30.005609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51280. [D 20:43:30.005634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51281. [D 20:43:30.005649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51282. [D 20:43:30.005677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51283. [D 20:43:30.005700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51284. [D 20:43:30.005715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51285. [D 20:43:30.005742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51286. [D 20:43:30.005757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51287. [D 20:43:30.005775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51288. [D 20:43:30.005790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51289. [D 20:43:30.005803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51290. [D 20:43:30.005818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51291. [D 20:43:30.005833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51292. [D 20:43:30.005848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51293. [D 20:43:30.005862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51294. [D 20:43:30.005877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51295. [D 20:43:30.005891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51296. [D 20:43:30.005906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51297. [D 20:43:30.005921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51298. [D 20:43:30.005935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51299. [D 20:43:30.005949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51300. [D 20:43:30.005964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51301. [D 20:43:30.005978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51302. [D 20:43:30.005993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51303. [D 20:43:30.006008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51304. [D 20:43:30.006023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51305. [D 20:43:30.006037] openib_post_sr_rdmaw: ibv_post_send wr_id 64aca0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51306. [D 20:43:30.008233] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.008258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.008272] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.008316] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7420 [D 20:43:30.008331] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:30.008347] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 9/70. [D 20:43:30.008378] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.008392] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.008404] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.008424] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7422 [D 20:43:30.008438] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:30.008452] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 10/70. [D 20:43:30.016587] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51306. [D 20:43:30.016617] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 11/70. [D 20:43:30.028134] openib_check_cq: completed rdma wr_id 64aca0, nic_wr_credit 51305. [D 20:43:30.028171] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 12/70. [D 20:43:30.028278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.028299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.028312] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.028428] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.028443] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.028455] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.031653] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7420 [D 20:43:30.031740] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 13/70. [D 20:43:30.037472] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7422 [D 20:43:30.037497] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 14/70. [D 20:43:30.039158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51305. [D 20:43:30.039221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51306. [D 20:43:30.039237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51307. [D 20:43:30.039251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51308. [D 20:43:30.039290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51309. [D 20:43:30.039321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51310. [D 20:43:30.039363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51311. [D 20:43:30.039391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51312. [D 20:43:30.039420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51313. [D 20:43:30.039435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51314. [D 20:43:30.039461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51315. [D 20:43:30.039476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51316. [D 20:43:30.039506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51317. [D 20:43:30.039531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51318. [D 20:43:30.039548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51319. [D 20:43:30.039578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51320. [D 20:43:30.039593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51321. [D 20:43:30.039608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51322. [D 20:43:30.039623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51323. [D 20:43:30.039638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51324. [D 20:43:30.039690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51325. [D 20:43:30.039706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51326. [D 20:43:30.039721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51327. [D 20:43:30.039735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51328. [D 20:43:30.039779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51329. [D 20:43:30.039793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51330. [D 20:43:30.039820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51331. [D 20:43:30.039835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51332. [D 20:43:30.039849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51333. [D 20:43:30.039879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51334. [D 20:43:30.039894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51335. [D 20:43:30.039920] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51336. [D 20:43:30.039952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51337. [D 20:43:30.039968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51338. [D 20:43:30.039993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51339. [D 20:43:30.040008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51340. [D 20:43:30.040037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51341. [D 20:43:30.040065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51342. [D 20:43:30.040089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51343. [D 20:43:30.040104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51344. [D 20:43:30.040132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51345. [D 20:43:30.040147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51346. [D 20:43:30.040162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51347. [D 20:43:30.040184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51348. [D 20:43:30.040199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51349. [D 20:43:30.040218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51350. [D 20:43:30.040232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51351. [D 20:43:30.040247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51352. [D 20:43:30.040262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51353. [D 20:43:30.040276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51354. [D 20:43:30.040294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51355. [D 20:43:30.040308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51356. [D 20:43:30.040323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51357. [D 20:43:30.040338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51358. [D 20:43:30.040352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51359. [D 20:43:30.040367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51360. [D 20:43:30.040381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51361. [D 20:43:30.040396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51362. [D 20:43:30.040410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51363. [D 20:43:30.040425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51364. [D 20:43:30.040439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51365. [D 20:43:30.040454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51366. [D 20:43:30.040469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51367. [D 20:43:30.040483] openib_post_sr_rdmaw: ibv_post_send wr_id 633c40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51368. [D 20:43:30.040548] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.040571] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.040584] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.040626] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7426 [D 20:43:30.040641] element 0: offset: 0x2aaaab006450, size: 24 [D 20:43:30.040657] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 15/70. [D 20:43:30.050998] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51368. [D 20:43:30.051027] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 16/70. [D 20:43:30.062560] openib_check_cq: completed rdma wr_id 633c40, nic_wr_credit 51367. [D 20:43:30.062587] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 17/70. [D 20:43:30.062674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.062694] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.062707] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.062787] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.062804] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.062816] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.066100] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7426 [D 20:43:30.066176] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 18/70. [D 20:43:30.069119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51367. [D 20:43:30.069141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51368. [D 20:43:30.069156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51369. [D 20:43:30.069170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51370. [D 20:43:30.069185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51371. [D 20:43:30.069199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51372. [D 20:43:30.069226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51373. [D 20:43:30.069241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51374. [D 20:43:30.069269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51375. [D 20:43:30.069284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51376. [D 20:43:30.069309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51377. [D 20:43:30.069343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51378. [D 20:43:30.069358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51379. [D 20:43:30.069386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51380. [D 20:43:30.069414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51381. [D 20:43:30.069439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51382. [D 20:43:30.069461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51383. [D 20:43:30.069476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51384. [D 20:43:30.069490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51385. [D 20:43:30.069518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51386. [D 20:43:30.069533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51387. [D 20:43:30.069561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51388. [D 20:43:30.069577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51389. [D 20:43:30.069601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51390. [D 20:43:30.069616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51391. [D 20:43:30.069644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51392. [D 20:43:30.069660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51393. [D 20:43:30.069675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51394. [D 20:43:30.069693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51395. [D 20:43:30.069708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51396. [D 20:43:30.069726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51397. [D 20:43:30.069741] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51398. [D 20:43:30.075396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.075419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.075433] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.075481] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7429 [D 20:43:30.075496] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:30.075512] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 19/70. [D 20:43:30.075611] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.075627] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.075639] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.075662] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7431 [D 20:43:30.075676] element 0: offset: 0x2aaaab025a90, size: 24 [D 20:43:30.075691] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 20/70. [D 20:43:30.080905] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51398. [D 20:43:30.080929] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 21/70. [D 20:43:30.081084] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.081105] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.081118] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.084216] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7429 [D 20:43:30.084240] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 22/70. [D 20:43:30.086291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 51398. [D 20:43:30.086310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 51399. [D 20:43:30.086325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51400. [D 20:43:30.086340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51401. [D 20:43:30.086354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51402. [D 20:43:30.086369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51403. [D 20:43:30.086383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51404. [D 20:43:30.086408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51405. [D 20:43:30.086422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51406. [D 20:43:30.086451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51407. [D 20:43:30.086466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51408. [D 20:43:30.086502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51409. [D 20:43:30.086516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51410. [D 20:43:30.086548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51411. [D 20:43:30.086575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51412. [D 20:43:30.086590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51413. [D 20:43:30.086614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51414. [D 20:43:30.086629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51415. [D 20:43:30.086655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51416. [D 20:43:30.086669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51417. [D 20:43:30.086698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51418. [D 20:43:30.086714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51419. [D 20:43:30.086740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51420. [D 20:43:30.086768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51421. [D 20:43:30.086857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51422. [D 20:43:30.086948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51423. [D 20:43:30.086966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51424. [D 20:43:30.086981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51425. [D 20:43:30.086995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51426. [D 20:43:30.087010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51427. [D 20:43:30.087042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51428. [D 20:43:30.087057] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51429. [D 20:43:30.087149] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.087219] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.087233] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.087278] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7435 [D 20:43:30.087293] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:30.087314] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 23/70. [D 20:43:30.088345] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7431 [D 20:43:30.088370] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 24/70. [D 20:43:30.098039] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51429. [D 20:43:30.098058] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 25/70. [D 20:43:30.098074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51429. [D 20:43:30.098089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51430. [D 20:43:30.098116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51431. [D 20:43:30.098140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51432. [D 20:43:30.098160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51433. [D 20:43:30.098186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51434. [D 20:43:30.098201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51435. [D 20:43:30.098235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51436. [D 20:43:30.098250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51437. [D 20:43:30.098275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51438. [D 20:43:30.098303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51439. [D 20:43:30.098327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51440. [D 20:43:30.098342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51441. [D 20:43:30.098371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51442. [D 20:43:30.098387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51443. [D 20:43:30.098414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51444. [D 20:43:30.098441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51445. [D 20:43:30.098456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51446. [D 20:43:30.098480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51447. [D 20:43:30.098506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51448. [D 20:43:30.098521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51449. [D 20:43:30.098547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51450. [D 20:43:30.098572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51451. [D 20:43:30.098596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51452. [D 20:43:30.098618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51453. [D 20:43:30.098633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51454. [D 20:43:30.098648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51455. [D 20:43:30.098665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51456. [D 20:43:30.098679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51457. [D 20:43:30.098694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51458. [D 20:43:30.098713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51459. [D 20:43:30.098730] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51460. [D 20:43:30.098809] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.098860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.098873] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.102125] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7435 [D 20:43:30.102154] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 26/70. [D 20:43:30.109720] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51460. [D 20:43:30.109754] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 27/70. [D 20:43:30.109783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51460. [D 20:43:30.109799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 51461. [D 20:43:30.109825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 51462. [D 20:43:30.109841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 51463. [D 20:43:30.109873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 51464. [D 20:43:30.109902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 51465. [D 20:43:30.109930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51466. [D 20:43:30.109954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51467. [D 20:43:30.109977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51468. [D 20:43:30.109993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 51469. [D 20:43:30.110007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 51470. [D 20:43:30.110044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 51471. [D 20:43:30.110062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 51472. [D 20:43:30.110087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 51473. [D 20:43:30.110102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51474. [D 20:43:30.110131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51475. [D 20:43:30.110158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51476. [D 20:43:30.110185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51477. [D 20:43:30.110201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51478. [D 20:43:30.110226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51479. [D 20:43:30.110240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51480. [D 20:43:30.110255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51481. [D 20:43:30.110270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51482. [D 20:43:30.110285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51483. [D 20:43:30.110300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51484. [D 20:43:30.110314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51485. [D 20:43:30.413962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51486. [D 20:43:30.414017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51487. [D 20:43:30.414469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51488. [D 20:43:30.414486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51489. [D 20:43:30.414501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51490. [D 20:43:30.414515] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51491. [D 20:43:30.414890] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.414935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.414949] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.414978] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.414992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.415005] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.415045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7437 [D 20:43:30.415060] element 0: offset: 0x2aaaab02e2d0, size: 24 [D 20:43:30.415080] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 28/70. [D 20:43:30.415117] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.415130] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.415143] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.415163] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7440 [D 20:43:30.415178] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:30.415192] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 29/70. [D 20:43:30.415218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.415232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.415245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.415264] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7443 [D 20:43:30.415278] element 0: offset: 0x2aaaab006450, size: 24 [D 20:43:30.415294] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 30/70. [D 20:43:30.415392] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51491. [D 20:43:30.415417] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 31/70. [D 20:43:30.415572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.415591] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.415604] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.421510] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7437 [D 20:43:30.421537] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 32/70. [D 20:43:30.424588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51491. [D 20:43:30.424606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51492. [D 20:43:30.424621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51493. [D 20:43:30.424636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51494. [D 20:43:30.424651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51495. [D 20:43:30.424665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51496. [D 20:43:30.424680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51497. [D 20:43:30.424695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51498. [D 20:43:30.424709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51499. [D 20:43:30.424724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51500. [D 20:43:30.424739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51501. [D 20:43:30.424753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51502. [D 20:43:30.424768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51503. [D 20:43:30.424783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51504. [D 20:43:30.424797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51505. [D 20:43:30.424812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51506. [D 20:43:30.424826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51507. [D 20:43:30.424841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51508. [D 20:43:30.424856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51509. [D 20:43:30.424870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51510. [D 20:43:30.424885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51511. [D 20:43:30.424899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51512. [D 20:43:30.424914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51513. [D 20:43:30.424929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51514. [D 20:43:30.424943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51515. [D 20:43:30.424958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51516. [D 20:43:30.424972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51517. [D 20:43:30.424987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51518. [D 20:43:30.425001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51519. [D 20:43:30.425016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51520. [D 20:43:30.425030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51521. [D 20:43:30.425045] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51522. [D 20:43:30.428138] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7440 [D 20:43:30.428158] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 33/70. [D 20:43:30.428174] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7443 [D 20:43:30.428196] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 34/70. [D 20:43:30.430477] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51522. [D 20:43:30.430497] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 35/70. [D 20:43:30.430514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51522. [D 20:43:30.430528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51523. [D 20:43:30.430543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51524. [D 20:43:30.430557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51525. [D 20:43:30.430575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51526. [D 20:43:30.430590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51527. [D 20:43:30.430604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51528. [D 20:43:30.430618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51529. [D 20:43:30.430633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51530. [D 20:43:30.430647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51531. [D 20:43:30.430662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51532. [D 20:43:30.430676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51533. [D 20:43:30.430691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51534. [D 20:43:30.430705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51535. [D 20:43:30.430720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51536. [D 20:43:30.430734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51537. [D 20:43:30.430749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51538. [D 20:43:30.430763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51539. [D 20:43:30.430778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51540. [D 20:43:30.430792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51541. [D 20:43:30.430807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51542. [D 20:43:30.430821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51543. [D 20:43:30.430835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51544. [D 20:43:30.430850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51545. [D 20:43:30.430864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51546. [D 20:43:30.430879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51547. [D 20:43:30.430893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51548. [D 20:43:30.430908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51549. [D 20:43:30.430922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51550. [D 20:43:30.430937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51551. [D 20:43:30.430952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51552. [D 20:43:30.430966] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51553. [D 20:43:30.430983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51554. [D 20:43:30.430997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51555. [D 20:43:30.431012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51556. [D 20:43:30.431027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51557. [D 20:43:30.431041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51558. [D 20:43:30.431055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51559. [D 20:43:30.431070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51560. [D 20:43:30.431084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51561. [D 20:43:30.431099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51562. [D 20:43:30.431113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51563. [D 20:43:30.431128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51564. [D 20:43:30.431142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51565. [D 20:43:30.431157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51566. [D 20:43:30.431171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51567. [D 20:43:30.431185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51568. [D 20:43:30.431200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51569. [D 20:43:30.431215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51570. [D 20:43:30.431229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51571. [D 20:43:30.431244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51572. [D 20:43:30.431258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51573. [D 20:43:30.431273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51574. [D 20:43:30.431287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51575. [D 20:43:30.431301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51576. [D 20:43:30.431315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51577. [D 20:43:30.431329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51578. [D 20:43:30.431344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51579. [D 20:43:30.431359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51580. [D 20:43:30.431373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51581. [D 20:43:30.431388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51582. [D 20:43:30.431402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51583. [D 20:43:30.431417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51584. [D 20:43:30.431432] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51585. [D 20:43:30.431510] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.431568] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.431581] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.436400] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51585. [D 20:43:30.436425] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 36/70. [D 20:43:30.437053] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.437076] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.437088] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.437129] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7446 [D 20:43:30.437144] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:30.437164] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 37/70. [D 20:43:30.442917] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51584. [D 20:43:30.442945] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 38/70. [D 20:43:30.442997] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.443017] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.443031] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.443114] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.443128] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.443141] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.446056] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7446 [D 20:43:30.446083] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 39/70. [D 20:43:30.454769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 51584. [D 20:43:30.454790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 51585. [D 20:43:30.454805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51586. [D 20:43:30.454820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51587. [D 20:43:30.454834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51588. [D 20:43:30.454849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51589. [D 20:43:30.454864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51590. [D 20:43:30.454878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51591. [D 20:43:30.454929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51592. [D 20:43:30.454956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51593. [D 20:43:30.455005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51594. [D 20:43:30.455020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51595. [D 20:43:30.455036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51596. [D 20:43:30.455050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51597. [D 20:43:30.455065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51598. [D 20:43:30.455079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51599. [D 20:43:30.455094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51600. [D 20:43:30.455108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51601. [D 20:43:30.455123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51602. [D 20:43:30.455137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51603. [D 20:43:30.455152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51604. [D 20:43:30.455195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51605. [D 20:43:30.455213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51606. [D 20:43:30.455227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51607. [D 20:43:30.455241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51608. [D 20:43:30.455256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51609. [D 20:43:30.455270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51610. [D 20:43:30.455285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51611. [D 20:43:30.455299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51612. [D 20:43:30.455314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51613. [D 20:43:30.455329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51614. [D 20:43:30.455343] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51615. [D 20:43:30.460695] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51615. [D 20:43:30.460726] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 40/70. [D 20:43:30.460727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.460791] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.460805] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.460849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7450 [D 20:43:30.460864] element 0: offset: 0x2aaaab02e2d0, size: 24 [D 20:43:30.460884] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 41/70. [D 20:43:30.460927] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.460941] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.460954] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.460975] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7452 [D 20:43:30.460989] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:30.461004] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 42/70. [D 20:43:30.461043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.461057] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.461070] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.464679] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7450 [D 20:43:30.464726] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 43/70. [D 20:43:30.466635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51615. [D 20:43:30.466653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51616. [D 20:43:30.466668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51617. [D 20:43:30.466682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51618. [D 20:43:30.466697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51619. [D 20:43:30.466711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51620. [D 20:43:30.466725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51621. [D 20:43:30.466740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51622. [D 20:43:30.466754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51623. [D 20:43:30.466769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51624. [D 20:43:30.466783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51625. [D 20:43:30.466797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51626. [D 20:43:30.466812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51627. [D 20:43:30.466826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51628. [D 20:43:30.466840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51629. [D 20:43:30.466855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51630. [D 20:43:30.466869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51631. [D 20:43:30.466883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51632. [D 20:43:30.466897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51633. [D 20:43:30.466912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51634. [D 20:43:30.466926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51635. [D 20:43:30.466940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51636. [D 20:43:30.466955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51637. [D 20:43:30.466969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51638. [D 20:43:30.466983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51639. [D 20:43:30.466998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51640. [D 20:43:30.467012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51641. [D 20:43:30.467032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51642. [D 20:43:30.467047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51643. [D 20:43:30.467062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51644. [D 20:43:30.467076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51645. [D 20:43:30.467091] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51646. [D 20:43:30.467323] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.467390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.467404] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.467448] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7455 [D 20:43:30.467464] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:30.467484] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 44/70. [D 20:43:30.472266] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7452 [D 20:43:30.472293] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 45/70. [D 20:43:30.476586] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51646. [D 20:43:30.476660] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 46/70. [D 20:43:30.476680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51646. [D 20:43:30.476696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51647. [D 20:43:30.476711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51648. [D 20:43:30.476725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51649. [D 20:43:30.476739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51650. [D 20:43:30.476754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51651. [D 20:43:30.476768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51652. [D 20:43:30.476782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51653. [D 20:43:30.476796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51654. [D 20:43:30.476811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51655. [D 20:43:30.476825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51656. [D 20:43:30.476839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51657. [D 20:43:30.476853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51658. [D 20:43:30.476867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51659. [D 20:43:30.476882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51660. [D 20:43:30.476896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51661. [D 20:43:30.476910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51662. [D 20:43:30.476924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51663. [D 20:43:30.476940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51664. [D 20:43:30.476955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51665. [D 20:43:30.476969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51666. [D 20:43:30.476984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51667. [D 20:43:30.476998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51668. [D 20:43:30.477013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51669. [D 20:43:30.477027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51670. [D 20:43:30.477042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51671. [D 20:43:30.477056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51672. [D 20:43:30.477071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51673. [D 20:43:30.477085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51674. [D 20:43:30.477100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51675. [D 20:43:30.477115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51676. [D 20:43:30.477129] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51677. [D 20:43:30.477192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.477211] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.477224] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.480479] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7455 [D 20:43:30.480545] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 47/70. [D 20:43:30.488420] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51677. [D 20:43:30.488444] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 48/70. [D 20:43:30.488473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 51677. [D 20:43:30.488489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 51678. [D 20:43:30.488503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51679. [D 20:43:30.488518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51680. [D 20:43:30.488533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51681. [D 20:43:30.488548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51682. [D 20:43:30.488562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51683. [D 20:43:30.488577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51684. [D 20:43:30.488591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51685. [D 20:43:30.488606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51686. [D 20:43:30.488620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51687. [D 20:43:30.488641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51688. [D 20:43:30.488656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51689. [D 20:43:30.488670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51690. [D 20:43:30.488684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51691. [D 20:43:30.488699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51692. [D 20:43:30.488713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51693. [D 20:43:30.488727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51694. [D 20:43:30.488742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51695. [D 20:43:30.488756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51696. [D 20:43:30.488771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51697. [D 20:43:30.488785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51698. [D 20:43:30.488800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51699. [D 20:43:30.488814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51700. [D 20:43:30.488828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51701. [D 20:43:30.488842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51702. [D 20:43:30.488857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51703. [D 20:43:30.488871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51704. [D 20:43:30.488886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51705. [D 20:43:30.488900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51706. [D 20:43:30.488914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51707. [D 20:43:30.488929] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51708. [D 20:43:30.488992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.489013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.489026] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.500197] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51708. [D 20:43:30.500220] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 49/70. [D 20:43:30.500331] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.500352] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.500364] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:30.509481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.509499] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.509511] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:30.509549] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7459 [D 20:43:30.509564] element 0: offset: 0x2aaaab006450, size: 24 [D 20:43:30.509580] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 50/70. [D 20:43:30.509638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.509652] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.509665] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.509686] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7462 [D 20:43:30.509699] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:30.509714] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 51/70. [D 20:43:30.509861] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.509877] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.509889] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.509910] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7464 [D 20:43:30.509924] element 0: offset: 0x2aaaab02e2d0, size: 24 [D 20:43:30.509938] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 52/70. [D 20:43:30.516479] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7459 [D 20:43:30.516567] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 53/70. [D 20:43:30.516593] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7462 [D 20:43:30.516620] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 54/70. [D 20:43:30.516665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51708. [D 20:43:30.516683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51709. [D 20:43:30.516698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51710. [D 20:43:30.516712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51711. [D 20:43:30.516727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51712. [D 20:43:30.516741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51713. [D 20:43:30.516756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51714. [D 20:43:30.516770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51715. [D 20:43:30.516784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51716. [D 20:43:30.516799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51717. [D 20:43:30.516813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51718. [D 20:43:30.516828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51719. [D 20:43:30.516842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51720. [D 20:43:30.516857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51721. [D 20:43:30.516871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51722. [D 20:43:30.516886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51723. [D 20:43:30.516900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51724. [D 20:43:30.516915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51725. [D 20:43:30.516929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51726. [D 20:43:30.516944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51727. [D 20:43:30.516965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51728. [D 20:43:30.516979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51729. [D 20:43:30.516994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51730. [D 20:43:30.517009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51731. [D 20:43:30.517023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51732. [D 20:43:30.517038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51733. [D 20:43:30.517052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51734. [D 20:43:30.517067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51735. [D 20:43:30.517082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51736. [D 20:43:30.517096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51737. [D 20:43:30.517111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51738. [D 20:43:30.517126] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51739. [D 20:43:30.517143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51740. [D 20:43:30.517158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51741. [D 20:43:30.517173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51742. [D 20:43:30.517187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51743. [D 20:43:30.517202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51744. [D 20:43:30.517217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51745. [D 20:43:30.517231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51746. [D 20:43:30.517246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51747. [D 20:43:30.517260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51748. [D 20:43:30.517275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51749. [D 20:43:30.517290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51750. [D 20:43:30.517305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51751. [D 20:43:30.517319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51752. [D 20:43:30.517334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51753. [D 20:43:30.517348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51754. [D 20:43:30.517363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51755. [D 20:43:30.517378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51756. [D 20:43:30.517393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51757. [D 20:43:30.517407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51758. [D 20:43:30.517422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51759. [D 20:43:30.517437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51760. [D 20:43:30.517451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51761. [D 20:43:30.517466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51762. [D 20:43:30.517480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51763. [D 20:43:30.517495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51764. [D 20:43:30.517509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51765. [D 20:43:30.517524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51766. [D 20:43:30.517538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51767. [D 20:43:30.517553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51768. [D 20:43:30.517567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51769. [D 20:43:30.517582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51770. [D 20:43:30.517597] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51771. [D 20:43:30.521286] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7464 [D 20:43:30.521306] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 55/70. [D 20:43:30.525890] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51771. [D 20:43:30.525909] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 56/70. [D 20:43:30.537530] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51770. [D 20:43:30.537550] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 57/70. [D 20:43:30.537586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51770. [D 20:43:30.537602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51771. [D 20:43:30.537618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51772. [D 20:43:30.537633] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.537634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51773. [D 20:43:30.537712] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.537718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51774. [D 20:43:30.537734] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.537752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51775. [D 20:43:30.537780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51776. [D 20:43:30.537795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51777. [D 20:43:30.537810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51778. [D 20:43:30.537826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51779. [D 20:43:30.537840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51780. [D 20:43:30.537855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51781. [D 20:43:30.537870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51782. [D 20:43:30.537884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51783. [D 20:43:30.537898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51784. [D 20:43:30.537913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51785. [D 20:43:30.537928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51786. [D 20:43:30.537942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51787. [D 20:43:30.537957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51788. [D 20:43:30.537971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51789. [D 20:43:30.537986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51790. [D 20:43:30.538000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51791. [D 20:43:30.538015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51792. [D 20:43:30.538029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51793. [D 20:43:30.538044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51794. [D 20:43:30.538058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51795. [D 20:43:30.538073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51796. [D 20:43:30.538087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51797. [D 20:43:30.538102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51798. [D 20:43:30.538116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51799. [D 20:43:30.538131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51800. [D 20:43:30.538145] openib_post_sr_rdmaw: ibv_post_send wr_id 649bb0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51801. [D 20:43:30.538184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.538202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.538215] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.549489] openib_check_cq: completed rdma wr_id 649bb0, nic_wr_credit 51801. [D 20:43:30.549514] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 58/70. [D 20:43:30.549624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.549644] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.549657] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:30.551616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.551631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.551644] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:30.551686] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7469 [D 20:43:30.551701] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:30.551720] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 59/70. [D 20:43:30.551762] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.551776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.551789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.551808] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7470 [D 20:43:30.551827] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:30.551841] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 60/70. [D 20:43:30.557954] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7469 [D 20:43:30.557981] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 0/70. [D 20:43:30.558001] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7470 [D 20:43:30.558023] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 1/70. [D 20:43:30.563005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51801. [D 20:43:30.563022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51802. [D 20:43:30.563037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51803. [D 20:43:30.563052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51804. [D 20:43:30.563066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51805. [D 20:43:30.563081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51806. [D 20:43:30.563107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51807. [D 20:43:30.563122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51808. [D 20:43:30.563145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51809. [D 20:43:30.563160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51810. [D 20:43:30.563188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51811. [D 20:43:30.563212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51812. [D 20:43:30.563227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51813. [D 20:43:30.563254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51814. [D 20:43:30.563269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51815. [D 20:43:30.563292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51816. [D 20:43:30.563315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51817. [D 20:43:30.563330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51818. [D 20:43:30.563357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51819. [D 20:43:30.563380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51820. [D 20:43:30.563395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51821. [D 20:43:30.563419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51822. [D 20:43:30.563434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51823. [D 20:43:30.563462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51824. [D 20:43:30.563486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51825. [D 20:43:30.563500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51826. [D 20:43:30.563523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51827. [D 20:43:30.563538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51828. [D 20:43:30.563552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51829. [D 20:43:30.563579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51830. [D 20:43:30.563609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51831. [D 20:43:30.563632] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51832. [D 20:43:30.563649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51833. [D 20:43:30.563682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51834. [D 20:43:30.563707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51835. [D 20:43:30.563721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51836. [D 20:43:30.563745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51837. [D 20:43:30.563760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51838. [D 20:43:30.563789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51839. [D 20:43:30.563812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51840. [D 20:43:30.563827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51841. [D 20:43:30.563854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51842. [D 20:43:30.563869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51843. [D 20:43:30.563895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51844. [D 20:43:30.563917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51845. [D 20:43:30.563932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51846. [D 20:43:30.563955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51847. [D 20:43:30.563971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51848. [D 20:43:30.563985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51849. [D 20:43:30.563999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51850. [D 20:43:30.564015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51851. [D 20:43:30.564029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51852. [D 20:43:30.564044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51853. [D 20:43:30.564058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51854. [D 20:43:30.564073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51855. [D 20:43:30.564087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51856. [D 20:43:30.564102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51857. [D 20:43:30.564116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51858. [D 20:43:30.564130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51859. [D 20:43:30.564145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51860. [D 20:43:30.564162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51861. [D 20:43:30.564177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51862. [D 20:43:30.564198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51863. [D 20:43:30.564213] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51864. [D 20:43:30.564278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.564349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.564363] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.564406] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7474 [D 20:43:30.564420] element 0: offset: 0x2aaaab034960, size: 24 [D 20:43:30.564439] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 2/70. [D 20:43:30.564478] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.564491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.564504] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.564523] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7476 [D 20:43:30.564537] element 0: offset: 0x2aaaab02e2d0, size: 24 [D 20:43:30.564550] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 3/70. [D 20:43:30.574767] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51864. [D 20:43:30.574811] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 4/70. [D 20:43:30.586482] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51863. [D 20:43:30.586503] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 5/70. [D 20:43:30.586698] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.586718] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.586731] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.586754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.586767] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.586780] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.592255] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7474 [D 20:43:30.592280] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 6/70. [D 20:43:30.595313] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7476 [D 20:43:30.595332] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 7/70. [D 20:43:30.597547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51863. [D 20:43:30.597569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51864. [D 20:43:30.597584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 51865. [D 20:43:30.597598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 51866. [D 20:43:30.597613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 51867. [D 20:43:30.597627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 51868. [D 20:43:30.597974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 51869. [D 20:43:30.597990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51870. [D 20:43:30.598012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51871. [D 20:43:30.598027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51872. [D 20:43:30.598042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 51873. [D 20:43:30.598055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 51874. [D 20:43:30.598082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 51875. [D 20:43:30.598105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 51876. [D 20:43:30.598120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 51877. [D 20:43:30.598146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51878. [D 20:43:30.598161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51879. [D 20:43:30.598185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51880. [D 20:43:30.598199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51881. [D 20:43:30.598425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51882. [D 20:43:30.598440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51883. [D 20:43:30.598455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51884. [D 20:43:30.598470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51885. [D 20:43:30.598499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51886. [D 20:43:30.598514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51887. [D 20:43:30.598528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51888. [D 20:43:30.598543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51889. [D 20:43:30.598558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51890. [D 20:43:30.598575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51891. [D 20:43:30.598591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51892. [D 20:43:30.598605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51893. [D 20:43:30.598619] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51894. [D 20:43:30.598636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 51895. [D 20:43:30.598651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 51896. [D 20:43:30.598665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51897. [D 20:43:30.598679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51898. [D 20:43:30.598694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51899. [D 20:43:30.598708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51900. [D 20:43:30.598722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51901. [D 20:43:30.598737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51902. [D 20:43:30.598751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51903. [D 20:43:30.598765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51904. [D 20:43:30.598780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51905. [D 20:43:30.598794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51906. [D 20:43:30.598808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51907. [D 20:43:30.598823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 51908. [D 20:43:30.598837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 51909. [D 20:43:30.598851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 51910. [D 20:43:30.598865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 51911. [D 20:43:30.598880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 51912. [D 20:43:30.598894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 51913. [D 20:43:30.598908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 51914. [D 20:43:30.598923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 51915. [D 20:43:30.598937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 51916. [D 20:43:30.598951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 51917. [D 20:43:30.598965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 51918. [D 20:43:30.598980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 51919. [D 20:43:30.598994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 51920. [D 20:43:30.599009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 51921. [D 20:43:30.599023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 51922. [D 20:43:30.599037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 51923. [D 20:43:30.599052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 51924. [D 20:43:30.599066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 51925. [D 20:43:30.599080] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 51926. [D 20:43:30.599148] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.599217] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.599231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.599274] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7481 [D 20:43:30.599289] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:30.599308] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 8/70. [D 20:43:30.599353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.599367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.599379] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.599399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7482 [D 20:43:30.599413] element 0: offset: 0x2aaaab006450, size: 24 [D 20:43:30.599427] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 9/70. [D 20:43:30.609299] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51926. [D 20:43:30.609343] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 10/70. [D 20:43:30.621095] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51925. [D 20:43:30.621112] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 11/70. [D 20:43:30.621249] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.621270] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.621282] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.621391] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.621405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.621417] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.624589] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7481 [D 20:43:30.624614] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 12/70. [D 20:43:30.630521] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7482 [D 20:43:30.630588] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 13/70. [D 20:43:30.632222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51925. [D 20:43:30.632242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51926. [D 20:43:30.632257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51927. [D 20:43:30.632271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51928. [D 20:43:30.632286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51929. [D 20:43:30.632300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51930. [D 20:43:30.632315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51931. [D 20:43:30.632352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51932. [D 20:43:30.632383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51933. [D 20:43:30.632397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51934. [D 20:43:30.632424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51935. [D 20:43:30.632439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51936. [D 20:43:30.632463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51937. [D 20:43:30.632509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51938. [D 20:43:30.632536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51939. [D 20:43:30.632564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51940. [D 20:43:30.632580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51941. [D 20:43:30.632603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51942. [D 20:43:30.632617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51943. [D 20:43:30.632643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51944. [D 20:43:30.632658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51945. [D 20:43:30.632686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51946. [D 20:43:30.632711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51947. [D 20:43:30.632726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51948. [D 20:43:30.632754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51949. [D 20:43:30.632779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51950. [D 20:43:30.632793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51951. [D 20:43:30.632819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51952. [D 20:43:30.632833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51953. [D 20:43:30.632852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51954. [D 20:43:30.632866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51955. [D 20:43:30.632880] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51956. [D 20:43:30.632937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 51957. [D 20:43:30.632952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 51958. [D 20:43:30.632988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 51959. [D 20:43:30.633004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 51960. [D 20:43:30.633029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 51961. [D 20:43:30.848283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 51962. [D 20:43:30.848313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 51963. [D 20:43:30.848339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 51964. [D 20:43:30.848354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 51965. [D 20:43:30.848368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 51966. [D 20:43:30.848383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 51967. [D 20:43:30.848397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 51968. [D 20:43:30.848412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 51969. [D 20:43:30.848426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 51970. [D 20:43:30.848441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 51971. [D 20:43:30.848456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 51972. [D 20:43:30.848470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 51973. [D 20:43:30.848484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 51974. [D 20:43:30.848499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 51975. [D 20:43:30.848513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 51976. [D 20:43:30.848528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 51977. [D 20:43:30.848542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 51978. [D 20:43:30.848557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 51979. [D 20:43:30.849057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 51980. [D 20:43:30.849074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 51981. [D 20:43:30.849089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 51982. [D 20:43:30.849103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 51983. [D 20:43:30.849118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 51984. [D 20:43:30.849133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 51985. [D 20:43:30.849147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 51986. [D 20:43:30.849173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 51987. [D 20:43:30.849189] openib_post_sr_rdmaw: ibv_post_send wr_id 63c740 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 51988. [D 20:43:30.849210] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 51988. [D 20:43:30.849227] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 14/70. [D 20:43:30.853432] openib_check_cq: completed rdma wr_id 63c740, nic_wr_credit 51987. [D 20:43:30.853454] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 15/70. [D 20:43:30.856477] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.856495] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.856509] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.856552] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7486 [D 20:43:30.856569] element 0: offset: 0x2aaaab034140, size: 24 [D 20:43:30.856584] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 16/70. [D 20:43:30.856630] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.856650] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.856665] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.856685] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7488 [D 20:43:30.856699] element 0: offset: 0x2aaaab001e00, size: 24 [D 20:43:30.856714] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 17/70. [D 20:43:30.856749] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.856764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.856777] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.856800] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.856816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.856828] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.868034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.868100] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.868114] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.868157] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7493 [D 20:43:30.868178] element 0: offset: 0x2aaaab025bb0, size: 24 [D 20:43:30.868351] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 18/70. [D 20:43:30.868391] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.868406] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.868419] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.868442] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7494 [D 20:43:30.868457] element 0: offset: 0x2aaaab036f60, size: 24 [D 20:43:30.868472] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 19/70. [D 20:43:30.869378] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7488 [D 20:43:30.869458] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 20/70. [D 20:43:30.869712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 51987. [D 20:43:30.869738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 51988. [D 20:43:30.869753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 51989. [D 20:43:30.869767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 51990. [D 20:43:30.869781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 51991. [D 20:43:30.869795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 51992. [D 20:43:30.869810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 51993. [D 20:43:30.869824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 51994. [D 20:43:30.869838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 51995. [D 20:43:30.869852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 51996. [D 20:43:30.869866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 51997. [D 20:43:30.869881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 51998. [D 20:43:30.869895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 51999. [D 20:43:30.869910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52000. [D 20:43:30.869924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52001. [D 20:43:30.869938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52002. [D 20:43:30.869952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52003. [D 20:43:30.869966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52004. [D 20:43:30.869981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52005. [D 20:43:30.869995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52006. [D 20:43:30.870009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52007. [D 20:43:30.870023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52008. [D 20:43:30.870037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52009. [D 20:43:30.870052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52010. [D 20:43:30.870066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52011. [D 20:43:30.870080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52012. [D 20:43:30.870093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52013. [D 20:43:30.870107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52014. [D 20:43:30.870122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52015. [D 20:43:30.870136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52016. [D 20:43:30.870150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52017. [D 20:43:30.870164] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52018. [D 20:43:30.875870] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7486 [D 20:43:30.875896] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 21/70. [D 20:43:30.875917] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7493 [D 20:43:30.875933] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 22/70. [D 20:43:30.875951] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7494 [D 20:43:30.875966] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 23/70. [D 20:43:30.877520] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52018. [D 20:43:30.877599] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 24/70. [D 20:43:30.877622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52018. [D 20:43:30.877638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52019. [D 20:43:30.877653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52020. [D 20:43:30.877669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52021. [D 20:43:30.877684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52022. [D 20:43:30.877698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52023. [D 20:43:30.877713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52024. [D 20:43:30.877728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52025. [D 20:43:30.877742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52026. [D 20:43:30.877757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52027. [D 20:43:30.877772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52028. [D 20:43:30.877786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52029. [D 20:43:30.877801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52030. [D 20:43:30.877815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52031. [D 20:43:30.877830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52032. [D 20:43:30.877845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52033. [D 20:43:30.877859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52034. [D 20:43:30.877874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52035. [D 20:43:30.877889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52036. [D 20:43:30.877903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52037. [D 20:43:30.877918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52038. [D 20:43:30.877932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52039. [D 20:43:30.877947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52040. [D 20:43:30.877962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52041. [D 20:43:30.877976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52042. [D 20:43:30.877991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52043. [D 20:43:30.878005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52044. [D 20:43:30.878020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52045. [D 20:43:30.878035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52046. [D 20:43:30.878049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52047. [D 20:43:30.878064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52048. [D 20:43:30.878079] openib_post_sr_rdmaw: ibv_post_send wr_id 633c40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52049. [D 20:43:30.878097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52050. [D 20:43:30.878112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52051. [D 20:43:30.878127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52052. [D 20:43:30.878141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52053. [D 20:43:30.878156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52054. [D 20:43:30.878170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52055. [D 20:43:30.878185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52056. [D 20:43:30.878200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52057. [D 20:43:30.878214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52058. [D 20:43:30.878229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52059. [D 20:43:30.878244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52060. [D 20:43:30.878258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52061. [D 20:43:30.878273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52062. [D 20:43:30.878288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52063. [D 20:43:30.878302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52064. [D 20:43:30.878317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52065. [D 20:43:30.878331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52066. [D 20:43:30.878346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52067. [D 20:43:30.878360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52068. [D 20:43:30.878375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52069. [D 20:43:30.878390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52070. [D 20:43:30.878404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52071. [D 20:43:30.878419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52072. [D 20:43:30.878434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52073. [D 20:43:30.878448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52074. [D 20:43:30.878463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52075. [D 20:43:30.878478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52076. [D 20:43:30.878492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52077. [D 20:43:30.878507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52078. [D 20:43:30.878522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52079. [D 20:43:30.878537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52080. [D 20:43:30.878552] openib_post_sr_rdmaw: ibv_post_send wr_id 6391a0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52081. [D 20:43:30.878568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52082. [D 20:43:30.878583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52083. [D 20:43:30.878597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52084. [D 20:43:30.878612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52085. [D 20:43:30.878626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52086. [D 20:43:30.878641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52087. [E 20:43:30.878660] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52088, block for 10 ms. [D 20:43:30.878694] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52087. [D 20:43:30.878710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52088. [E 20:43:30.878726] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52089, block for 10 ms. [D 20:43:30.884147] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52088. [E 20:43:30.884168] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52089, block for 10 ms. [D 20:43:30.889312] openib_check_cq: completed rdma wr_id 633c40, nic_wr_credit 52088. [D 20:43:30.889335] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 25/70. [D 20:43:30.889350] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52087. [D 20:43:30.889365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52088. [D 20:43:30.889380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52089. [D 20:43:30.889395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52090. [D 20:43:30.889409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52091. [D 20:43:30.889424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52092. [D 20:43:30.889438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52093. [D 20:43:30.889453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52094. [D 20:43:30.889467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52095. [D 20:43:30.889482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52096. [D 20:43:30.889497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52097. [D 20:43:30.889512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52098. [D 20:43:30.889526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52099. [D 20:43:30.889542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52100. [D 20:43:30.889557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52101. [D 20:43:30.889571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52102. [D 20:43:30.889586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52103. [D 20:43:30.889600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52104. [D 20:43:30.889615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52105. [D 20:43:30.889630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52106. [D 20:43:30.889644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52107. [D 20:43:30.889659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52108. [D 20:43:30.889673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52109. [D 20:43:30.889688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52110. [D 20:43:30.889702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52111. [D 20:43:30.889717] openib_post_sr_rdmaw: ibv_post_send wr_id 62ff30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52112. [D 20:43:30.892271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.892293] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.892306] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.892336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.892349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.892361] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.892401] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7497 [D 20:43:30.892416] element 0: offset: 0x2aaaab006450, size: 24 [D 20:43:30.892434] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 26/70. [D 20:43:30.899043] openib_check_cq: completed rdma wr_id 6391a0, nic_wr_credit 52112. [D 20:43:30.899069] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 27/70. [D 20:43:30.900159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.900184] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.900197] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.904968] openib_check_cq: completed rdma wr_id 62ff30, nic_wr_credit 52111. [D 20:43:30.904993] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 28/70. [D 20:43:30.905056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.905075] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.905087] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.905175] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.905189] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.905202] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:30.911307] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7497 [D 20:43:30.911329] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 29/70. [D 20:43:30.916421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 52111. [D 20:43:30.916493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 52112. [D 20:43:30.916511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52113. [D 20:43:30.916526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52114. [D 20:43:30.916541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52115. [D 20:43:30.916556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52116. [D 20:43:30.916570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52117. [D 20:43:30.916585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52118. [D 20:43:30.916599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52119. [D 20:43:30.916614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52120. [D 20:43:30.916629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52121. [D 20:43:30.916643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52122. [D 20:43:30.916658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52123. [D 20:43:30.916673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52124. [D 20:43:30.916687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52125. [D 20:43:30.916702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52126. [D 20:43:30.916717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52127. [D 20:43:30.916731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52128. [D 20:43:30.916746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52129. [D 20:43:30.916761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52130. [D 20:43:30.916775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52131. [D 20:43:30.916790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52132. [D 20:43:30.916804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52133. [D 20:43:30.916819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52134. [D 20:43:30.916834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52135. [D 20:43:30.916848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52136. [D 20:43:30.916863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52137. [D 20:43:30.916877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52138. [D 20:43:30.916892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52139. [D 20:43:30.916907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52140. [D 20:43:30.916921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52141. [D 20:43:30.916937] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52142. [D 20:43:30.916987] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.917009] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.917022] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:30.917046] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7502 [D 20:43:30.917060] element 0: offset: 0x2aaaab034d20, size: 24 [D 20:43:30.917075] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 30/70. [D 20:43:30.917107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.917120] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.917133] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.917159] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7505 [D 20:43:30.917173] element 0: offset: 0x2aaaab018f60, size: 24 [D 20:43:30.917187] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 31/70. [D 20:43:30.917218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.917231] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.917244] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.917263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7506 [D 20:43:30.917277] element 0: offset: 0x2aaaab034960, size: 24 [D 20:43:30.917335] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 32/70. [D 20:43:30.922376] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52142. [D 20:43:30.922402] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 33/70. [D 20:43:30.922549] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.922569] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.922582] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.928526] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7502 [D 20:43:30.928601] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 34/70. [D 20:43:30.928680] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7505 [D 20:43:30.928697] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 35/70. [D 20:43:30.929088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52142. [D 20:43:30.929127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52143. [D 20:43:30.929154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52144. [D 20:43:30.929169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52145. [D 20:43:30.929193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52146. [D 20:43:30.929207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52147. [D 20:43:30.929234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52148. [D 20:43:30.929249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52149. [D 20:43:30.929273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52150. [D 20:43:30.929300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52151. [D 20:43:30.929315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52152. [D 20:43:30.929339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52153. [D 20:43:30.929353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52154. [D 20:43:30.929380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52155. [D 20:43:30.929396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52156. [D 20:43:30.929419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52157. [D 20:43:30.929434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52158. [D 20:43:30.929449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52159. [D 20:43:30.929464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52160. [D 20:43:30.929478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52161. [D 20:43:30.929493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52162. [D 20:43:30.929507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52163. [D 20:43:30.929522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52164. [D 20:43:30.929536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52165. [D 20:43:30.929551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52166. [D 20:43:30.929565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52167. [D 20:43:30.929580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52168. [D 20:43:30.929594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52169. [D 20:43:30.929609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52170. [D 20:43:30.929623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52171. [D 20:43:30.929638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52172. [D 20:43:30.929652] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52173. [D 20:43:30.929671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52174. [D 20:43:30.929686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52175. [D 20:43:30.929700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52176. [D 20:43:30.929715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52177. [D 20:43:30.929729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52178. [D 20:43:30.929744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52179. [D 20:43:30.929758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52180. [D 20:43:30.929773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52181. [D 20:43:30.929787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52182. [D 20:43:30.929802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52183. [D 20:43:30.929817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52184. [D 20:43:30.929832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52185. [D 20:43:30.929846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52186. [D 20:43:30.929860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52187. [D 20:43:30.929875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52188. [D 20:43:30.929889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52189. [D 20:43:30.929903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52190. [D 20:43:30.929918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52191. [D 20:43:30.929932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52192. [D 20:43:30.929947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52193. [D 20:43:30.929961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52194. [D 20:43:30.929976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52195. [D 20:43:30.929990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52196. [D 20:43:30.930005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52197. [D 20:43:30.930019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52198. [D 20:43:30.930033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52199. [D 20:43:30.930048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52200. [D 20:43:30.930062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52201. [D 20:43:30.930076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52202. [D 20:43:30.930091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52203. [D 20:43:30.930105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52204. [D 20:43:30.930120] openib_post_sr_rdmaw: ibv_post_send wr_id 633c40 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52205. [D 20:43:30.930175] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.930195] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.930208] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.930248] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7509 [D 20:43:30.930263] element 0: offset: 0x2aaaab023c10, size: 24 [D 20:43:30.930279] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 36/70. [D 20:43:30.936674] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7506 [D 20:43:30.936694] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 37/70. [D 20:43:30.940849] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52205. [D 20:43:30.940927] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 38/70. [D 20:43:30.952442] openib_check_cq: completed rdma wr_id 633c40, nic_wr_credit 52204. [D 20:43:30.952465] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 39/70. [D 20:43:30.952504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52204. [D 20:43:30.952521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52205. [D 20:43:30.952529] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.952537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52206. [D 20:43:30.952555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.952574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52207. [D 20:43:30.952588] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.952607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52208. [D 20:43:30.952635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52209. [D 20:43:30.952650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52210. [D 20:43:30.952665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52211. [D 20:43:30.952681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52212. [D 20:43:30.952696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52213. [D 20:43:30.952711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52214. [D 20:43:30.952726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52215. [D 20:43:30.952740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52216. [D 20:43:30.952755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52217. [D 20:43:30.952770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52218. [D 20:43:30.952785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52219. [D 20:43:30.952800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52220. [D 20:43:30.952814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52221. [D 20:43:30.952829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52222. [D 20:43:30.952844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52223. [D 20:43:30.952859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52224. [D 20:43:30.952874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52225. [D 20:43:30.952888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52226. [D 20:43:30.952903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52227. [D 20:43:30.952918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52228. [D 20:43:30.952933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52229. [D 20:43:30.952948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52230. [D 20:43:30.952962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52231. [D 20:43:30.952978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52232. [D 20:43:30.952993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52233. [D 20:43:30.953008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52234. [D 20:43:30.953022] openib_post_sr_rdmaw: ibv_post_send wr_id 66ded0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52235. [D 20:43:30.953074] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.953093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.953106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.955723] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7509 [D 20:43:30.955778] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 40/70. [D 20:43:30.962107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.962164] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.962178] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.962220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7513 [D 20:43:30.962235] element 0: offset: 0x2aaaab034140, size: 24 [D 20:43:30.962253] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 41/70. [D 20:43:30.963376] openib_check_cq: completed rdma wr_id 66ded0, nic_wr_credit 52235. [D 20:43:30.963403] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 42/70. [D 20:43:30.963538] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.963558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.963571] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.966535] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7513 [D 20:43:30.966600] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 43/70. [D 20:43:30.967766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 52235. [D 20:43:30.967792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 52236. [D 20:43:30.967807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52237. [D 20:43:30.967821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52238. [D 20:43:30.967836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52239. [D 20:43:30.968297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52240. [D 20:43:30.968328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52241. [D 20:43:30.968352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52242. [D 20:43:30.968375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52243. [D 20:43:30.968390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52244. [D 20:43:30.968404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52245. [D 20:43:30.968419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52246. [D 20:43:30.968433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52247. [D 20:43:30.968460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52248. [D 20:43:30.968484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52249. [D 20:43:30.968500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52250. [D 20:43:30.968514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52251. [D 20:43:30.968529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52252. [D 20:43:30.968543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52253. [D 20:43:30.968558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52254. [D 20:43:30.968572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52255. [D 20:43:30.968586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52256. [D 20:43:30.968600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52257. [D 20:43:30.968615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52258. [D 20:43:30.968629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52259. [D 20:43:30.968643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52260. [D 20:43:30.968658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52261. [D 20:43:30.968672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52262. [D 20:43:30.968686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52263. [D 20:43:30.968700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52264. [D 20:43:30.968715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52265. [D 20:43:30.968729] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52266. [D 20:43:30.968746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52267. [D 20:43:30.968761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52268. [D 20:43:30.968775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52269. [D 20:43:30.968789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52270. [D 20:43:30.968804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52271. [D 20:43:30.968818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52272. [D 20:43:30.968832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52273. [D 20:43:30.968847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52274. [D 20:43:30.968861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52275. [D 20:43:30.968875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52276. [D 20:43:30.968890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52277. [D 20:43:30.968904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52278. [D 20:43:30.968919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52279. [D 20:43:30.968934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52280. [D 20:43:30.968948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52281. [D 20:43:30.968963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52282. [D 20:43:30.968977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52283. [D 20:43:30.968992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52284. [D 20:43:30.969006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52285. [D 20:43:30.969021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52286. [D 20:43:30.969036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52287. [D 20:43:30.969050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52288. [D 20:43:30.969065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52289. [D 20:43:30.969080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52290. [D 20:43:30.969094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52291. [D 20:43:30.969109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52292. [D 20:43:30.969123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52293. [D 20:43:30.969138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52294. [D 20:43:30.969153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52295. [D 20:43:30.969167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52296. [D 20:43:30.969182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52297. [D 20:43:30.969196] openib_post_sr_rdmaw: ibv_post_send wr_id 6555f0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52298. [D 20:43:30.974895] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.974918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.974930] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:30.974972] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7516 [D 20:43:30.974987] element 0: offset: 0x644640, size: 24 [D 20:43:30.975004] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 44/70. [D 20:43:30.975043] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:30.975056] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.975069] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:30.975094] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7518 [D 20:43:30.975108] element 0: offset: 0x636ca0, size: 24 [D 20:43:30.975124] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 45/70. [D 20:43:30.979604] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52298. [D 20:43:30.979628] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 46/70. [D 20:43:30.991143] openib_check_cq: completed rdma wr_id 6555f0, nic_wr_credit 52297. [D 20:43:30.991170] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 47/70. [D 20:43:30.991235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.991255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.991268] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:30.991382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:30.991398] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:30.991410] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:30.995156] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7518 [D 20:43:30.995220] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 48/70. [D 20:43:30.997497] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7516 [D 20:43:30.997567] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 49/70. [D 20:43:31.002459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52297. [D 20:43:31.002486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52298. [D 20:43:31.002501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52299. [D 20:43:31.002516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52300. [D 20:43:31.002530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52301. [D 20:43:31.002545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52302. [D 20:43:31.002559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52303. [D 20:43:31.002574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52304. [D 20:43:31.002588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52305. [D 20:43:31.002602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52306. [D 20:43:31.002617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52307. [D 20:43:31.002631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52308. [D 20:43:31.002646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52309. [D 20:43:31.002660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52310. [D 20:43:31.002675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52311. [D 20:43:31.002689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52312. [D 20:43:31.002704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52313. [D 20:43:31.002718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52314. [D 20:43:31.002733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52315. [D 20:43:31.002747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52316. [D 20:43:31.002762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52317. [D 20:43:31.002776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52318. [D 20:43:31.002790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52319. [D 20:43:31.002805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52320. [D 20:43:31.292216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52321. [D 20:43:31.292246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52322. [D 20:43:31.292260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52323. [D 20:43:31.292274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52324. [D 20:43:31.292292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52325. [D 20:43:31.292306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52326. [D 20:43:31.292319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52327. [D 20:43:31.292334] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52328. [D 20:43:31.292357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52329. [D 20:43:31.292376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52330. [D 20:43:31.292390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52331. [D 20:43:31.292403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52332. [D 20:43:31.292419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52333. [D 20:43:31.292432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52334. [D 20:43:31.292446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52335. [D 20:43:31.292461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52336. [D 20:43:31.292475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52337. [D 20:43:31.292489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52338. [D 20:43:31.292503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52339. [D 20:43:31.292517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52340. [D 20:43:31.292531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52341. [D 20:43:31.292545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52342. [D 20:43:31.292559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52343. [D 20:43:31.292573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52344. [D 20:43:31.292587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52345. [D 20:43:31.292601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52346. [D 20:43:31.292614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52347. [D 20:43:31.292629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52348. [D 20:43:31.292643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52349. [D 20:43:31.292658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52350. [D 20:43:31.292672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52351. [D 20:43:31.292686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52352. [D 20:43:31.292700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52353. [D 20:43:31.292714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52354. [D 20:43:31.292728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52355. [D 20:43:31.292742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52356. [D 20:43:31.292756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52357. [D 20:43:31.292770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52358. [D 20:43:31.292784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52359. [D 20:43:31.292798] openib_post_sr_rdmaw: ibv_post_send wr_id 66e6f0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52360. [D 20:43:31.293868] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52360. [D 20:43:31.293889] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 50/70. [D 20:43:31.296235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.296254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.296267] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.296311] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7522 [D 20:43:31.296326] element 0: offset: 0x658610, size: 24 [D 20:43:31.296342] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 51/70. [D 20:43:31.296373] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.296387] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.296399] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:31.296420] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7524 [D 20:43:31.296433] element 0: offset: 0x66e010, size: 24 [D 20:43:31.296447] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 52/70. [D 20:43:31.299718] openib_check_cq: completed rdma wr_id 66e6f0, nic_wr_credit 52359. [D 20:43:31.299735] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 53/70. [D 20:43:31.300246] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.300277] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.300291] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:31.300421] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.300437] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.300450] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.303518] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7522 [D 20:43:31.303555] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 54/70. [D 20:43:31.305952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52359. [D 20:43:31.305945] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7524 [D 20:43:31.306016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 52360. [D 20:43:31.306877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 52361. [D 20:43:31.306892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 52362. [D 20:43:31.306908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 52363. [D 20:43:31.306922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 52364. [D 20:43:31.306940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52365. [D 20:43:31.306955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52366. [D 20:43:31.306969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52367. [D 20:43:31.306984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 52368. [D 20:43:31.306998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 52369. [D 20:43:31.307013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 52370. [D 20:43:31.307027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 52371. [D 20:43:31.307063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 52372. [D 20:43:31.307078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52373. [D 20:43:31.307092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52374. [D 20:43:31.307107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52375. [D 20:43:31.307121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 52376. [D 20:43:31.307136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 52377. [D 20:43:31.307150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 52378. [D 20:43:31.307165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 52379. [D 20:43:31.307179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 52380. [D 20:43:31.307194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52381. [D 20:43:31.307208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52382. [D 20:43:31.307223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52383. [D 20:43:31.307237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 52384. [D 20:43:31.307252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 52385. [D 20:43:31.307266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 52386. [D 20:43:31.307281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 52387. [D 20:43:31.307295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 52388. [D 20:43:31.307309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52389. [D 20:43:31.307324] openib_post_sr_rdmaw: ibv_post_send wr_id 66e6f0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52390. [D 20:43:31.307359] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 55/70. [D 20:43:31.312586] openib_check_cq: completed rdma wr_id 66e6f0, nic_wr_credit 52390. [D 20:43:31.312607] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 56/70. [D 20:43:31.312629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52390. [D 20:43:31.312644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52391. [D 20:43:31.312659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52392. [D 20:43:31.312675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52393. [D 20:43:31.312690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52394. [D 20:43:31.312704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52395. [D 20:43:31.312718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52396. [D 20:43:31.312732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52397. [D 20:43:31.312746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52398. [D 20:43:31.312760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52399. [D 20:43:31.312775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52400. [D 20:43:31.312789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52401. [D 20:43:31.312803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52402. [D 20:43:31.312817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52403. [D 20:43:31.312831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52404. [D 20:43:31.312845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52405. [D 20:43:31.312860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52406. [D 20:43:31.312873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52407. [D 20:43:31.312887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52408. [D 20:43:31.312901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52409. [D 20:43:31.312919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52410. [D 20:43:31.312935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52411. [D 20:43:31.312949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52412. [D 20:43:31.312963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52413. [D 20:43:31.312977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52414. [D 20:43:31.312991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52415. [D 20:43:31.313005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52416. [D 20:43:31.313020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52417. [D 20:43:31.313036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52418. [D 20:43:31.313050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52419. [D 20:43:31.313067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52420. [D 20:43:31.313086] openib_post_sr_rdmaw: ibv_post_send wr_id 6445b0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52421. [D 20:43:31.316245] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.316316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.316329] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.316369] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7527 [D 20:43:31.316384] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.316399] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 57/70. [D 20:43:31.316438] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.316452] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.316465] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.318578] openib_check_cq: completed rdma wr_id 6445b0, nic_wr_credit 52421. [D 20:43:31.318595] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 58/70. [D 20:43:31.320264] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.320282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.320294] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.328223] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7527 [D 20:43:31.328303] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 59/70. [D 20:43:31.328306] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.328340] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.328353] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.328375] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7532 [D 20:43:31.328389] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.328404] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 60/70. [D 20:43:31.328427] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.328440] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.328453] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.328472] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7533 [D 20:43:31.328486] element 0: offset: 0x658610, size: 24 [D 20:43:31.328500] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 0/70. [D 20:43:31.328527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52421. [D 20:43:31.328543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52422. [D 20:43:31.328557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52423. [D 20:43:31.328570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52424. [D 20:43:31.328584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52425. [D 20:43:31.328598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52426. [D 20:43:31.328612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52427. [D 20:43:31.328626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52428. [D 20:43:31.328640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52429. [D 20:43:31.328654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52430. [D 20:43:31.328669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52431. [D 20:43:31.328682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52432. [D 20:43:31.328696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52433. [D 20:43:31.328710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52434. [D 20:43:31.328724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52435. [D 20:43:31.328738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52436. [D 20:43:31.328752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52437. [D 20:43:31.328766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52438. [D 20:43:31.328780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52439. [D 20:43:31.328794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52440. [D 20:43:31.328808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52441. [D 20:43:31.328822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52442. [D 20:43:31.328837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52443. [D 20:43:31.328850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52444. [D 20:43:31.328865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52445. [D 20:43:31.328879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52446. [D 20:43:31.328893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52447. [D 20:43:31.328907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52448. [D 20:43:31.328921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52449. [D 20:43:31.328935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52450. [D 20:43:31.328949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52451. [D 20:43:31.328963] openib_post_sr_rdmaw: ibv_post_send wr_id 61e6c0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52452. [D 20:43:31.335517] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7533 [D 20:43:31.335581] openib_check_cq: completed rdma wr_id 61e6c0, nic_wr_credit 52452. [D 20:43:31.335658] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 1/70. [D 20:43:31.335698] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 2/70. [D 20:43:31.337062] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7532 [D 20:43:31.337123] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 3/70. [D 20:43:31.337156] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.337177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.337191] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.341414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52452. [D 20:43:31.341444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52453. [D 20:43:31.341460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52454. [D 20:43:31.341475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52455. [D 20:43:31.341489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52456. [D 20:43:31.341504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52457. [D 20:43:31.341519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52458. [D 20:43:31.341533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52459. [D 20:43:31.341548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52460. [D 20:43:31.341562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52461. [D 20:43:31.341577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52462. [D 20:43:31.341591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52463. [D 20:43:31.341606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52464. [D 20:43:31.341620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52465. [D 20:43:31.341635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52466. [D 20:43:31.341650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52467. [D 20:43:31.341664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52468. [D 20:43:31.341679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52469. [D 20:43:31.341693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52470. [D 20:43:31.341708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52471. [D 20:43:31.341722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52472. [D 20:43:31.341737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52473. [D 20:43:31.341751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52474. [D 20:43:31.341766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52475. [D 20:43:31.341781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52476. [D 20:43:31.341795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52477. [D 20:43:31.341809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52478. [D 20:43:31.341824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52479. [D 20:43:31.341838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52480. [D 20:43:31.341853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52481. [D 20:43:31.341868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52482. [D 20:43:31.341883] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d620 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52483. [D 20:43:31.341901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 52484. [D 20:43:31.341916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 52485. [D 20:43:31.341931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 52486. [D 20:43:31.341945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 52487. [D 20:43:31.341959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 52488. [D 20:43:31.341974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 52489. [D 20:43:31.341988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52490. [D 20:43:31.342002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52491. [D 20:43:31.342017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52492. [D 20:43:31.342031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 52493. [D 20:43:31.342046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 52494. [D 20:43:31.342060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 52495. [D 20:43:31.342075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 52496. [D 20:43:31.342089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 52497. [D 20:43:31.342104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52498. [D 20:43:31.342118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52499. [D 20:43:31.342132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52500. [D 20:43:31.342147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 52501. [D 20:43:31.342161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 52502. [D 20:43:31.342176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 52503. [D 20:43:31.342190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 52504. [D 20:43:31.342204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 52505. [D 20:43:31.342219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52506. [D 20:43:31.342233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52507. [D 20:43:31.342248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52508. [D 20:43:31.342262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 52509. [D 20:43:31.342277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 52510. [D 20:43:31.342292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 52511. [D 20:43:31.342306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 52512. [D 20:43:31.342321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 52513. [D 20:43:31.342335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52514. [D 20:43:31.342350] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52515. [D 20:43:31.351968] openib_check_cq: completed rdma wr_id 2aaaab60d620, nic_wr_credit 52515. [D 20:43:31.351992] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 4/70. [D 20:43:31.357813] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 52514. [D 20:43:31.357835] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 5/70. [D 20:43:31.357888] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.357908] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.357920] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.357947] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.357960] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.357973] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:31.370523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.370539] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.370552] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:31.370590] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7537 [D 20:43:31.370605] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.370622] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 6/70. [D 20:43:31.370666] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.370680] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.370693] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.370713] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7540 [D 20:43:31.370727] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.370741] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 7/70. [D 20:43:31.376677] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7537 [D 20:43:31.376704] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 8/70. [D 20:43:31.376725] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7540 [D 20:43:31.376745] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 9/70. [D 20:43:31.376775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52514. [D 20:43:31.376791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52515. [D 20:43:31.376806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52516. [D 20:43:31.376821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52517. [D 20:43:31.376835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52518. [D 20:43:31.376850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52519. [D 20:43:31.376864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52520. [D 20:43:31.376879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52521. [D 20:43:31.376893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52522. [D 20:43:31.376909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52523. [D 20:43:31.376923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52524. [D 20:43:31.376937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52525. [D 20:43:31.376952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52526. [D 20:43:31.376967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52527. [D 20:43:31.376981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52528. [D 20:43:31.376996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52529. [D 20:43:31.377010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52530. [D 20:43:31.377025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52531. [D 20:43:31.377039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52532. [D 20:43:31.377054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52533. [D 20:43:31.377069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52534. [D 20:43:31.377083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52535. [D 20:43:31.377098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52536. [D 20:43:31.377112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52537. [D 20:43:31.377127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52538. [D 20:43:31.377141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52539. [D 20:43:31.377156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52540. [D 20:43:31.377170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52541. [D 20:43:31.377185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52542. [D 20:43:31.377199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52543. [D 20:43:31.377214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52544. [D 20:43:31.377228] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52545. [D 20:43:31.377245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52546. [D 20:43:31.377260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 52547. [D 20:43:31.377275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 52548. [D 20:43:31.377289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 52549. [D 20:43:31.377304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 52550. [D 20:43:31.377318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 52551. [D 20:43:31.377339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52552. [D 20:43:31.377354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52553. [D 20:43:31.377368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52554. [D 20:43:31.377383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 52555. [D 20:43:31.377397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 52556. [D 20:43:31.377412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 52557. [D 20:43:31.377426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 52558. [D 20:43:31.377451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 52559. [D 20:43:31.377475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52560. [D 20:43:31.377497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52561. [D 20:43:31.377512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52562. [D 20:43:31.377527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 52563. [D 20:43:31.377541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 52564. [D 20:43:31.377556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 52565. [D 20:43:31.377570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 52566. [D 20:43:31.377584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 52567. [D 20:43:31.377608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52568. [D 20:43:31.377622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52569. [D 20:43:31.377650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52570. [D 20:43:31.377665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 52571. [D 20:43:31.377679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 52572. [D 20:43:31.377704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 52573. [D 20:43:31.377719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 52574. [D 20:43:31.377747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 52575. [D 20:43:31.377771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52576. [D 20:43:31.377793] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609ba0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52577. [D 20:43:31.387739] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 52577. [D 20:43:31.387761] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 10/70. [D 20:43:31.399424] openib_check_cq: completed rdma wr_id 2aaaab609ba0, nic_wr_credit 52576. [D 20:43:31.399446] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 11/70. [D 20:43:31.399523] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.399586] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.399600] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.399633] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.399646] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.399659] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:31.412893] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.412910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.412922] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:31.412961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7542 [D 20:43:31.412976] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.412995] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 12/70. [D 20:43:31.416238] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7542 [D 20:43:31.416305] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 13/70. [D 20:43:31.416540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52576. [D 20:43:31.416566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52577. [D 20:43:31.416581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52578. [D 20:43:31.416595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52579. [D 20:43:31.416610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52580. [D 20:43:31.416624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52581. [D 20:43:31.416638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52582. [D 20:43:31.416652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52583. [D 20:43:31.416667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52584. [D 20:43:31.416681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52585. [D 20:43:31.416695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52586. [D 20:43:31.416710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52587. [D 20:43:31.416724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52588. [D 20:43:31.416738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52589. [D 20:43:31.416752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52590. [D 20:43:31.416767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52591. [D 20:43:31.416781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52592. [D 20:43:31.416795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52593. [D 20:43:31.416809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52594. [D 20:43:31.416824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52595. [D 20:43:31.416838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52596. [D 20:43:31.416852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52597. [D 20:43:31.416867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52598. [D 20:43:31.416882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52599. [D 20:43:31.416896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52600. [D 20:43:31.416911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52601. [D 20:43:31.416925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52602. [D 20:43:31.416940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52603. [D 20:43:31.416954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52604. [D 20:43:31.416968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52605. [D 20:43:31.416983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52606. [D 20:43:31.416997] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52607. [D 20:43:31.427084] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 52607. [D 20:43:31.427106] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 14/70. [D 20:43:31.427180] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.427201] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.427214] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:31.433881] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.433898] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.433910] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:31.433946] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7545 [D 20:43:31.433961] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.433977] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 15/70. [D 20:43:31.437019] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7545 [D 20:43:31.437092] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 16/70. [D 20:43:31.437200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 52607. [D 20:43:31.437226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 52608. [D 20:43:31.437241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52609. [D 20:43:31.437256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52610. [D 20:43:31.437270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52611. [D 20:43:31.437285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52612. [D 20:43:31.437299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52613. [D 20:43:31.437314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52614. [D 20:43:31.437328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52615. [D 20:43:31.437343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52616. [D 20:43:31.437357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52617. [D 20:43:31.437373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52618. [D 20:43:31.437387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52619. [D 20:43:31.437402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52620. [D 20:43:31.437416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52621. [D 20:43:31.437431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52622. [D 20:43:31.437445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52623. [D 20:43:31.437460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52624. [D 20:43:31.437474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52625. [D 20:43:31.437489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52626. [D 20:43:31.437503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52627. [D 20:43:31.437518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52628. [D 20:43:31.437532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52629. [D 20:43:31.437560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52630. [D 20:43:31.437576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52631. [D 20:43:31.437590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52632. [D 20:43:31.437613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52633. [D 20:43:31.437628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52634. [D 20:43:31.437642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52635. [D 20:43:31.437657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52636. [D 20:43:31.437672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52637. [D 20:43:31.437757] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d620 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52638. [D 20:43:31.437822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.437845] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.437858] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.437898] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7548 [D 20:43:31.437913] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.437931] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 17/70. [D 20:43:31.447542] openib_check_cq: completed rdma wr_id 2aaaab60d620, nic_wr_credit 52638. [D 20:43:31.447568] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 18/70. [D 20:43:31.447677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.447696] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.447709] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.450634] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7548 [D 20:43:31.450695] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 19/70. [D 20:43:31.455432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52638. [D 20:43:31.455458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52639. [D 20:43:31.455473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52640. [D 20:43:31.455488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52641. [D 20:43:31.455502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52642. [D 20:43:31.455517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52643. [D 20:43:31.455531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52644. [D 20:43:31.455546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52645. [D 20:43:31.455560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52646. [D 20:43:31.455575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52647. [D 20:43:31.455590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52648. [D 20:43:31.455604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52649. [D 20:43:31.455619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52650. [D 20:43:31.455633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52651. [D 20:43:31.455647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52652. [D 20:43:31.455662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52653. [D 20:43:31.455676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52654. [D 20:43:31.455691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52655. [D 20:43:31.455706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52656. [D 20:43:31.455720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52657. [D 20:43:31.455735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52658. [D 20:43:31.455749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52659. [D 20:43:31.455764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52660. [D 20:43:31.455779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52661. [D 20:43:31.455793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52662. [D 20:43:31.455807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52663. [D 20:43:31.455822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52664. [D 20:43:31.455837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52665. [D 20:43:31.455851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52666. [D 20:43:31.455866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52667. [D 20:43:31.455881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52668. [D 20:43:31.455895] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52669. [D 20:43:31.456134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.456157] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.456170] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.456220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7551 [D 20:43:31.456235] element 0: offset: 0x658610, size: 24 [D 20:43:31.456253] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 20/70. [D 20:43:31.463929] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 52669. [D 20:43:31.463955] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 21/70. [D 20:43:31.464064] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.464084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.464097] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.466998] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7551 [D 20:43:31.467057] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 22/70. [D 20:43:31.470447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 52669. [D 20:43:31.470472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 52670. [D 20:43:31.470487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52671. [D 20:43:31.470502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52672. [D 20:43:31.470516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52673. [D 20:43:31.470531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52674. [D 20:43:31.470545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52675. [D 20:43:31.470560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52676. [D 20:43:31.470574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52677. [D 20:43:31.470589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52678. [D 20:43:31.470604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52679. [D 20:43:31.470618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52680. [D 20:43:31.470633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52681. [D 20:43:31.470648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52682. [D 20:43:31.470662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52683. [D 20:43:31.470677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52684. [D 20:43:31.470691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52685. [D 20:43:31.470706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52686. [D 20:43:31.470721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52687. [D 20:43:31.470736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52688. [D 20:43:31.470750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52689. [D 20:43:31.470765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52690. [D 20:43:31.470779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52691. [D 20:43:31.470794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52692. [D 20:43:31.470808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52693. [D 20:43:31.470823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52694. [D 20:43:31.470837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52695. [D 20:43:31.470851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52696. [D 20:43:31.470866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52697. [D 20:43:31.470880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52698. [D 20:43:31.470895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52699. [D 20:43:31.470921] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52700. [D 20:43:31.471099] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.471123] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.471136] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.471177] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7554 [D 20:43:31.471192] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.471308] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 23/70. [D 20:43:31.479040] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 52700. [D 20:43:31.479066] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 24/70. [D 20:43:31.479174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.479194] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.479207] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.482131] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7554 [D 20:43:31.482192] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 25/70. [D 20:43:31.485041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52700. [D 20:43:31.485067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52701. [D 20:43:31.485082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52702. [D 20:43:31.485096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52703. [D 20:43:31.485111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52704. [D 20:43:31.485126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52705. [D 20:43:31.485140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52706. [D 20:43:31.485156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52707. [D 20:43:31.485170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52708. [D 20:43:31.485185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52709. [D 20:43:31.485200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52710. [D 20:43:31.485215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52711. [D 20:43:31.485229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52712. [D 20:43:31.485244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52713. [D 20:43:31.485258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52714. [D 20:43:31.485273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52715. [D 20:43:31.485288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52716. [D 20:43:31.485302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52717. [D 20:43:31.485317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52718. [D 20:43:31.485332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52719. [D 20:43:31.485346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52720. [D 20:43:31.485361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52721. [D 20:43:31.485376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52722. [D 20:43:31.485390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52723. [D 20:43:31.485405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52724. [D 20:43:31.485420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52725. [D 20:43:31.485434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52726. [D 20:43:31.485449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52727. [D 20:43:31.485463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52728. [D 20:43:31.485478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52729. [D 20:43:31.485493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52730. [D 20:43:31.485507] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52731. [D 20:43:31.485685] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.485709] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.485722] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.485764] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7558 [D 20:43:31.485779] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.485796] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 26/70. [D 20:43:31.485835] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.491853] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 52731. [D 20:43:31.733117] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.733152] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 27/70. [D 20:43:31.733186] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.733222] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7560 [D 20:43:31.733237] element 0: offset: 0x66e290, size: 24 [D 20:43:31.733286] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 28/70. [D 20:43:31.733379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.733394] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.733407] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:31.733428] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7564 [D 20:43:31.733442] element 0: offset: 0x66e2b0, size: 24 [D 20:43:31.733457] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 29/70. [D 20:43:31.733491] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.733505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.733518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:31.740134] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.740208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.740224] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:31.740266] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7566 [D 20:43:31.740281] element 0: offset: 0x6302e0, size: 24 [D 20:43:31.740300] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 30/70. [D 20:43:31.743296] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7558 [D 20:43:31.743354] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 31/70. [D 20:43:31.743449] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7560 [D 20:43:31.743466] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 32/70. [D 20:43:31.743524] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7564 [D 20:43:31.743541] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 33/70. [D 20:43:31.744046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52731. [D 20:43:31.744086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52732. [D 20:43:31.744102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52733. [D 20:43:31.744117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52734. [D 20:43:31.744131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52735. [D 20:43:31.744146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52736. [D 20:43:31.744161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52737. [D 20:43:31.744175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52738. [D 20:43:31.744190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52739. [D 20:43:31.745549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52740. [D 20:43:31.745565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52741. [D 20:43:31.745579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52742. [D 20:43:31.745594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52743. [D 20:43:31.745609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52744. [D 20:43:31.745636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52745. [D 20:43:31.745651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52746. [D 20:43:31.745665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52747. [D 20:43:31.745680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52748. [D 20:43:31.745695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52749. [D 20:43:31.745710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52750. [D 20:43:31.745724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52751. [D 20:43:31.745739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52752. [D 20:43:31.745753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52753. [D 20:43:31.745768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52754. [D 20:43:31.745782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52755. [D 20:43:31.745797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52756. [D 20:43:31.745811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52757. [D 20:43:31.745826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52758. [D 20:43:31.745840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52759. [D 20:43:31.745855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52760. [D 20:43:31.745869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52761. [D 20:43:31.745884] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52762. [D 20:43:31.745902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 52763. [D 20:43:31.745917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 52764. [D 20:43:31.745932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52765. [D 20:43:31.745946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52766. [D 20:43:31.745961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52767. [D 20:43:31.745975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52768. [D 20:43:31.745990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52769. [D 20:43:31.746004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52770. [D 20:43:31.746019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52771. [D 20:43:31.746034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52772. [D 20:43:31.746049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52773. [D 20:43:31.746063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52774. [D 20:43:31.746078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52775. [D 20:43:31.746092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52776. [D 20:43:31.746107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52777. [D 20:43:31.746121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52778. [D 20:43:31.746136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52779. [D 20:43:31.746151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52780. [D 20:43:31.746165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52781. [D 20:43:31.746180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52782. [D 20:43:31.746194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52783. [D 20:43:31.746209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52784. [D 20:43:31.746223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52785. [D 20:43:31.746238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52786. [D 20:43:31.746252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52787. [D 20:43:31.746267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52788. [D 20:43:31.746281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52789. [D 20:43:31.746296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52790. [D 20:43:31.746310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52791. [D 20:43:31.746325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52792. [D 20:43:31.746339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52793. [D 20:43:31.746354] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6098d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52794. [D 20:43:31.746371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52795. [D 20:43:31.746386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52796. [D 20:43:31.746400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52797. [D 20:43:31.746415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52798. [D 20:43:31.746429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52799. [D 20:43:31.746444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52800. [D 20:43:31.746458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52801. [E 20:43:31.746479] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52802, block for 10 ms. [D 20:43:31.746604] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7566 [D 20:43:31.754082] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 52801. [D 20:43:31.754111] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 34/70. [D 20:43:31.754127] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52800. [D 20:43:31.754142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52801. [D 20:43:31.754157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52802. [D 20:43:31.754172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52803. [D 20:43:31.754187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52804. [D 20:43:31.754201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52805. [D 20:43:31.754216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52806. [D 20:43:31.754230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52807. [D 20:43:31.754245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52808. [D 20:43:31.754259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52809. [D 20:43:31.754274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52810. [D 20:43:31.754289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52811. [D 20:43:31.754304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52812. [D 20:43:31.754318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52813. [D 20:43:31.754333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52814. [D 20:43:31.754347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52815. [D 20:43:31.754362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52816. [D 20:43:31.754377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52817. [D 20:43:31.754391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52818. [D 20:43:31.754406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52819. [D 20:43:31.754420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52820. [D 20:43:31.754435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52821. [D 20:43:31.754449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52822. [D 20:43:31.754464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52823. [D 20:43:31.754479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52824. [D 20:43:31.754493] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52825. [D 20:43:31.754530] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 35/70. [D 20:43:31.759894] openib_check_cq: completed rdma wr_id 2aaaab6098d0, nic_wr_credit 52825. [D 20:43:31.759920] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 36/70. [D 20:43:31.764300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.764320] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.764334] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:31.765759] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 52824. [D 20:43:31.765777] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 37/70. [D 20:43:31.766231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52824. [D 20:43:31.766246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52825. [D 20:43:31.766260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52826. [D 20:43:31.766275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52827. [D 20:43:31.766289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52828. [D 20:43:31.766304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52829. [D 20:43:31.766318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52830. [D 20:43:31.766332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52831. [D 20:43:31.766347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52832. [D 20:43:31.766361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52833. [D 20:43:31.766376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52834. [D 20:43:31.766390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52835. [D 20:43:31.766404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52836. [D 20:43:31.766419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52837. [D 20:43:31.766433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52838. [D 20:43:31.766447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52839. [D 20:43:31.766462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52840. [D 20:43:31.766476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52841. [D 20:43:31.766490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52842. [D 20:43:31.766505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52843. [D 20:43:31.766519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52844. [D 20:43:31.766534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52845. [D 20:43:31.766548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52846. [D 20:43:31.766562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52847. [D 20:43:31.766577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52848. [D 20:43:31.766633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52849. [D 20:43:31.766662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52850. [D 20:43:31.766677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52851. [D 20:43:31.766691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52852. [D 20:43:31.766706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52853. [D 20:43:31.766720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52854. [D 20:43:31.766734] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609b90 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52855. [D 20:43:31.768210] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.768229] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.768243] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.768267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.768281] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.768294] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.772200] openib_check_cq: completed rdma wr_id 2aaaab609b90, nic_wr_credit 52855. [D 20:43:31.772218] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 38/70. [D 20:43:31.775200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.775215] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.775228] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:31.786589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.786608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.786621] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:31.786660] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7571 [D 20:43:31.786675] element 0: offset: 0x62fd10, size: 24 [D 20:43:31.786691] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 39/70. [D 20:43:31.786715] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.786734] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.786747] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.786768] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7574 [D 20:43:31.786782] element 0: offset: 0x658610, size: 24 [D 20:43:31.786796] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 40/70. [D 20:43:31.786818] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.786832] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.786845] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.786865] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7577 [D 20:43:31.786879] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.786893] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 41/70. [D 20:43:31.786915] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.786929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.786942] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:31.786961] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7578 [D 20:43:31.786975] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.786989] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 42/70. [D 20:43:31.792253] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7571 [D 20:43:31.792344] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 43/70. [D 20:43:31.792486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52855. [D 20:43:31.792514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52856. [D 20:43:31.792529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52857. [D 20:43:31.792544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52858. [D 20:43:31.792559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52859. [D 20:43:31.792574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52860. [D 20:43:31.792588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52861. [D 20:43:31.792603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52862. [D 20:43:31.792617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52863. [D 20:43:31.792632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52864. [D 20:43:31.792647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52865. [D 20:43:31.792662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52866. [D 20:43:31.792676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52867. [D 20:43:31.792691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52868. [D 20:43:31.792705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52869. [D 20:43:31.792720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52870. [D 20:43:31.792735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52871. [D 20:43:31.792749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52872. [D 20:43:31.792778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52873. [D 20:43:31.792792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52874. [D 20:43:31.792807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52875. [D 20:43:31.792823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 52876. [D 20:43:31.792837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 52877. [D 20:43:31.792852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 52878. [D 20:43:31.792866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 52879. [D 20:43:31.792887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 52880. [D 20:43:31.792906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 52881. [D 20:43:31.792923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 52882. [D 20:43:31.792938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 52883. [D 20:43:31.792955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 52884. [D 20:43:31.792970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 52885. [D 20:43:31.792984] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609b90 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 52886. [D 20:43:31.799607] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7574 [D 20:43:31.799699] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 44/70. [D 20:43:31.799762] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7578 [D 20:43:31.799780] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 45/70. [D 20:43:31.800379] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7577 [D 20:43:31.800397] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 46/70. [D 20:43:31.804094] openib_check_cq: completed rdma wr_id 2aaaab609b90, nic_wr_credit 52886. [D 20:43:31.804172] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 47/70. [D 20:43:31.804204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 52886. [D 20:43:31.804221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 52887. [D 20:43:31.804240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 52888. [D 20:43:31.804255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 52889. [D 20:43:31.804270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 52890. [D 20:43:31.804284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 52891. [D 20:43:31.804299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 52892. [D 20:43:31.804313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52893. [D 20:43:31.804328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52894. [D 20:43:31.804342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52895. [D 20:43:31.804357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 52896. [D 20:43:31.804372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 52897. [D 20:43:31.804386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 52898. [D 20:43:31.804401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 52899. [D 20:43:31.804415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 52900. [D 20:43:31.804430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52901. [D 20:43:31.804444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52902. [D 20:43:31.804459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52903. [D 20:43:31.804473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 52904. [D 20:43:31.804488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 52905. [D 20:43:31.804503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 52906. [D 20:43:31.804519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 52907. [D 20:43:31.804534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 52908. [D 20:43:31.804548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52909. [D 20:43:31.804563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52910. [D 20:43:31.804578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52911. [D 20:43:31.804592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 52912. [D 20:43:31.804607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 52913. [D 20:43:31.804622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 52914. [D 20:43:31.804636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 52915. [D 20:43:31.804651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 52916. [D 20:43:31.804665] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609c20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52917. [D 20:43:31.804683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 52918. [D 20:43:31.804698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 52919. [D 20:43:31.804713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 52920. [D 20:43:31.804727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 52921. [D 20:43:31.804742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 52922. [D 20:43:31.804757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 52923. [D 20:43:31.804771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 52924. [D 20:43:31.804786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 52925. [D 20:43:31.804801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 52926. [D 20:43:31.804815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 52927. [D 20:43:31.804830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 52928. [D 20:43:31.804844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 52929. [D 20:43:31.804859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 52930. [D 20:43:31.804874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 52931. [D 20:43:31.804888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 52932. [D 20:43:31.804903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 52933. [D 20:43:31.804917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 52934. [D 20:43:31.804932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 52935. [D 20:43:31.804948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 52936. [D 20:43:31.804962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 52937. [D 20:43:31.804977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 52938. [D 20:43:31.804992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 52939. [D 20:43:31.805006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 52940. [D 20:43:31.805021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 52941. [D 20:43:31.805035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 52942. [D 20:43:31.805050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 52943. [D 20:43:31.805064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 52944. [D 20:43:31.805079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 52945. [D 20:43:31.805093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 52946. [D 20:43:31.805108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 52947. [D 20:43:31.805122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 52948. [D 20:43:31.805136] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609ae0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 52949. [D 20:43:31.805153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52950. [D 20:43:31.805168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52951. [D 20:43:31.805183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52952. [D 20:43:31.805197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52953. [D 20:43:31.805212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52954. [D 20:43:31.805226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52955. [E 20:43:31.805245] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52956, block for 10 ms. [D 20:43:31.805278] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52955. [D 20:43:31.805294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52956. [E 20:43:31.805310] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52957, block for 10 ms. [D 20:43:31.812080] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52956. [E 20:43:31.812102] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52957, block for 10 ms. [D 20:43:31.816011] openib_check_cq: completed rdma wr_id 2aaaab609c20, nic_wr_credit 52956. [D 20:43:31.816031] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 48/70. [D 20:43:31.816046] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52955. [D 20:43:31.816062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52956. [D 20:43:31.816077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52957. [D 20:43:31.816092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52958. [D 20:43:31.816107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52959. [D 20:43:31.816121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52960. [D 20:43:31.816136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52961. [D 20:43:31.816151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52962. [D 20:43:31.816165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52963. [D 20:43:31.816180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52964. [D 20:43:31.816199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52965. [D 20:43:31.816214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52966. [D 20:43:31.816233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52967. [D 20:43:31.816247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52968. [D 20:43:31.816262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52969. [D 20:43:31.816277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52970. [D 20:43:31.816291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52971. [D 20:43:31.816306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52972. [D 20:43:31.816321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52973. [D 20:43:31.816335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52974. [D 20:43:31.816350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52975. [D 20:43:31.816364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52976. [D 20:43:31.816379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52977. [D 20:43:31.816394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52978. [D 20:43:31.816409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52979. [D 20:43:31.816423] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6098f0 to 10.1.4.240:43806 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52980. [D 20:43:31.816509] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.816532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.816545] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:31.816583] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.816597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.816609] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:31.816647] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7581 [D 20:43:31.816662] element 0: offset: 0x641f50, size: 24 [D 20:43:31.816681] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 49/70. [D 20:43:31.827684] openib_check_cq: completed rdma wr_id 2aaaab609ae0, nic_wr_credit 52980. [D 20:43:31.827712] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 50/70. [D 20:43:31.829899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.829918] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.829931] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:31.835141] openib_check_cq: completed rdma wr_id 2aaaab6098f0, nic_wr_credit 52979. [D 20:43:31.835166] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 51/70. [D 20:43:31.835223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.835245] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.835258] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.835346] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.835360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.835373] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.839032] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7581 [D 20:43:31.839111] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 52/70. [D 20:43:31.848191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 52979. [D 20:43:31.848220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 52980. [D 20:43:31.848238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 52981. [D 20:43:31.848252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 52982. [D 20:43:31.848267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 52983. [D 20:43:31.848281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 52984. [D 20:43:31.848296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 52985. [D 20:43:31.848311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 52986. [D 20:43:31.848325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 52987. [D 20:43:31.848340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 52988. [D 20:43:31.848355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 52989. [D 20:43:31.848369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 52990. [D 20:43:31.848384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 52991. [D 20:43:31.848398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 52992. [D 20:43:31.848413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 52993. [D 20:43:31.848427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 52994. [D 20:43:31.848442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 52995. [D 20:43:31.848457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 52996. [D 20:43:31.848471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 52997. [D 20:43:31.848486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 52998. [D 20:43:31.848502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 52999. [D 20:43:31.848516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53000. [D 20:43:31.848531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53001. [D 20:43:31.848545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53002. [D 20:43:31.848560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53003. [D 20:43:31.848575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53004. [D 20:43:31.848589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53005. [D 20:43:31.848604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53006. [D 20:43:31.848619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53007. [D 20:43:31.848633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53008. [D 20:43:31.848648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53009. [D 20:43:31.848662] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53010. [D 20:43:31.850994] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.851018] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.851031] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.851074] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7586 [D 20:43:31.851088] element 0: offset: 0x643c90, size: 24 [D 20:43:31.851106] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 53/70. [D 20:43:31.851145] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.851159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.851171] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.851191] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7587 [D 20:43:31.851205] element 0: offset: 0x658610, size: 24 [D 20:43:31.851224] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 54/70. [D 20:43:31.854095] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53010. [D 20:43:31.854120] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 55/70. [D 20:43:31.854288] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.854309] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.854321] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.857838] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7586 [D 20:43:31.857926] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 56/70. [D 20:43:31.859881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53010. [D 20:43:31.859931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53011. [D 20:43:31.859946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53012. [D 20:43:31.859961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53013. [D 20:43:31.859976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53014. [D 20:43:31.859990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53015. [D 20:43:31.860010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53016. [D 20:43:31.860025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53017. [D 20:43:31.860040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53018. [D 20:43:31.860054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53019. [D 20:43:31.860069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53020. [D 20:43:31.860083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53021. [D 20:43:31.860097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53022. [D 20:43:31.860112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53023. [D 20:43:31.860126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53024. [D 20:43:31.860140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53025. [D 20:43:31.860155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53026. [D 20:43:31.860169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53027. [D 20:43:31.860184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53028. [D 20:43:31.860206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53029. [D 20:43:31.860221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53030. [D 20:43:31.860258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53031. [D 20:43:31.860284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53032. [D 20:43:31.860300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53033. [D 20:43:31.860327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53034. [D 20:43:31.860342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53035. [D 20:43:31.860368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53036. [D 20:43:31.860382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53037. [D 20:43:31.860397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53038. [D 20:43:31.860429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53039. [D 20:43:31.860444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53040. [D 20:43:31.860469] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53041. [D 20:43:31.862507] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.862576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.862590] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.862633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7590 [D 20:43:31.862648] element 0: offset: 0x636ca0, size: 24 [D 20:43:31.862670] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 57/70. [D 20:43:31.863871] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7587 [D 20:43:31.863945] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 58/70. [D 20:43:31.871501] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53041. [D 20:43:31.871528] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 59/70. [D 20:43:31.871552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53041. [D 20:43:31.871568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53042. [D 20:43:31.871583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53043. [D 20:43:31.871599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53044. [D 20:43:31.871614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53045. [D 20:43:31.871629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53046. [D 20:43:31.871644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53047. [D 20:43:31.871658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53048. [D 20:43:31.871673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53049. [D 20:43:31.871689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53050. [D 20:43:31.871703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53051. [D 20:43:31.871718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53052. [D 20:43:31.871733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53053. [D 20:43:31.871748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53054. [D 20:43:31.871763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53055. [D 20:43:31.871778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53056. [D 20:43:31.871792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53057. [D 20:43:31.871807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53058. [D 20:43:31.871822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53059. [D 20:43:31.871837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53060. [D 20:43:31.871852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53061. [D 20:43:31.871867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53062. [D 20:43:31.871882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53063. [D 20:43:31.871897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53064. [D 20:43:31.871926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53065. [D 20:43:31.871941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53066. [D 20:43:31.871955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53067. [D 20:43:31.871972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53068. [D 20:43:31.871996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53069. [D 20:43:31.872011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53070. [D 20:43:31.872026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53071. [D 20:43:31.872042] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53072. [D 20:43:31.872160] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.872185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.872236] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.875106] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7590 [D 20:43:31.875168] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 60/70. [D 20:43:31.877642] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53072. [D 20:43:31.877664] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 0/70. [D 20:43:31.877682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53072. [D 20:43:31.877697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53073. [D 20:43:31.877712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53074. [D 20:43:31.877727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53075. [D 20:43:31.877741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53076. [D 20:43:31.877769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53077. [D 20:43:31.877784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53078. [D 20:43:31.877808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53079. [D 20:43:31.877823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53080. [D 20:43:31.877850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53081. [D 20:43:31.877865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53082. [D 20:43:31.877899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53083. [D 20:43:31.877923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53084. [D 20:43:31.877952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53085. [D 20:43:31.877966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53086. [D 20:43:31.877992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53087. [D 20:43:31.878007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53088. [D 20:43:31.878036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53089. [D 20:43:31.878063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53090. [D 20:43:31.878090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53091. [D 20:43:31.878108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53092. [D 20:43:31.878134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53093. [D 20:43:31.878163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53094. [D 20:43:31.878177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53095. [D 20:43:31.878207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53096. [D 20:43:31.878222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53097. [D 20:43:31.878237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53098. [D 20:43:31.878252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53099. [D 20:43:31.878267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53100. [D 20:43:31.878282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53101. [D 20:43:31.878296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53102. [D 20:43:31.878311] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53103. [D 20:43:31.878396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.878419] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.878432] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:31.884546] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.884564] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.884577] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:31.884616] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7594 [D 20:43:31.884630] element 0: offset: 0x62fd10, size: 24 [D 20:43:31.884647] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 1/70. [D 20:43:31.887035] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:31.887053] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.887066] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:31.887088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7596 [D 20:43:31.887102] element 0: offset: 0x5b0030, size: 24 [D 20:43:31.887118] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 2/70. [D 20:43:31.889455] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53103. [D 20:43:31.889479] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 3/70. [D 20:43:31.889656] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:31.889676] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:31.889689] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:31.895613] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7594 [D 20:43:31.895688] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 4/70. [D 20:43:31.895746] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7596 [D 20:43:31.895763] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 5/70. [D 20:43:31.896018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53103. [D 20:43:31.896053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53104. [D 20:43:31.896068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53105. [D 20:43:31.896096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53106. [D 20:43:31.896111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53107. [D 20:43:31.896135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53108. [D 20:43:31.896150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53109. [D 20:43:31.896177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53110. [D 20:43:31.896193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53111. [D 20:43:31.896211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53112. [D 20:43:31.896226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53113. [D 20:43:31.896244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53114. [D 20:43:31.896262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53115. [D 20:43:31.896277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53116. [D 20:43:31.896291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53117. [D 20:43:31.896306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53118. [D 20:43:31.896320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53119. [D 20:43:31.896335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53120. [D 20:43:31.896350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53121. [D 20:43:31.896364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53122. [D 20:43:31.896379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53123. [D 20:43:31.896394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53124. [D 20:43:31.896408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53125. [D 20:43:31.896423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53126. [D 20:43:31.896438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53127. [D 20:43:31.896452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53128. [D 20:43:31.896467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53129. [D 20:43:31.896481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53130. [D 20:43:31.896496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53131. [D 20:43:31.896511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53132. [D 20:43:31.896526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53133. [D 20:43:31.896540] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53134. [D 20:43:32.188262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53135. [D 20:43:32.188287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53136. [D 20:43:32.188303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53137. [D 20:43:32.188317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53138. [D 20:43:32.188331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53139. [D 20:43:32.188349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53140. [D 20:43:32.188363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53141. [D 20:43:32.188377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53142. [D 20:43:32.188391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53143. [D 20:43:32.188409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53144. [D 20:43:32.188423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53145. [D 20:43:32.188437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53146. [D 20:43:32.188450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53147. [D 20:43:32.188464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53148. [D 20:43:32.188478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53149. [D 20:43:32.188492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53150. [D 20:43:32.188506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53151. [D 20:43:32.188520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53152. [D 20:43:32.188534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53153. [D 20:43:32.188549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53154. [D 20:43:32.188563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53155. [D 20:43:32.188577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53156. [D 20:43:32.188595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53157. [D 20:43:32.188609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53158. [D 20:43:32.188623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53159. [D 20:43:32.188636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53160. [D 20:43:32.188654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53161. [D 20:43:32.188668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53162. [D 20:43:32.188682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53163. [D 20:43:32.188701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53164. [D 20:43:32.188715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53165. [D 20:43:32.188728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53166. [D 20:43:32.188835] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53166. [D 20:43:32.188852] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 6/70. [D 20:43:32.192201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.192221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.192234] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.192277] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7599 [D 20:43:32.192292] element 0: offset: 0x67efc0, size: 24 [D 20:43:32.192307] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 7/70. [D 20:43:32.192343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.192356] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.192368] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.192389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7602 [D 20:43:32.192402] element 0: offset: 0x61fa30, size: 24 [D 20:43:32.192416] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 8/70. [D 20:43:32.194324] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53165. [D 20:43:32.194343] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 9/70. [D 20:43:32.197374] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.197390] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.197404] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.197505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.197543] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.197555] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.203433] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7599 [D 20:43:32.203509] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 10/70. [D 20:43:32.206295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53165. [D 20:43:32.206315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53166. [D 20:43:32.206330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53167. [D 20:43:32.206344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53168. [D 20:43:32.206358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53169. [D 20:43:32.206371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53170. [D 20:43:32.206386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53171. [D 20:43:32.206399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53172. [D 20:43:32.206413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53173. [D 20:43:32.206427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53174. [D 20:43:32.206441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53175. [D 20:43:32.206455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53176. [D 20:43:32.206470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53177. [D 20:43:32.206483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53178. [D 20:43:32.206497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53179. [D 20:43:32.206511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53180. [D 20:43:32.206525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53181. [D 20:43:32.206539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53182. [D 20:43:32.206553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53183. [D 20:43:32.206567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53184. [D 20:43:32.206581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53185. [D 20:43:32.206595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53186. [D 20:43:32.206609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53187. [D 20:43:32.206622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53188. [D 20:43:32.206636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53189. [D 20:43:32.206650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53190. [D 20:43:32.206664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53191. [D 20:43:32.206678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53192. [D 20:43:32.206692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53193. [D 20:43:32.206705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53194. [D 20:43:32.206719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53195. [D 20:43:32.206733] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53196. [D 20:43:32.208238] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7602 [D 20:43:32.208285] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 11/70. [D 20:43:32.212200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.212226] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.212240] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.212280] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7607 [D 20:43:32.212295] element 0: offset: 0x6302e0, size: 24 [D 20:43:32.212187] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53196. [D 20:43:32.212324] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 12/70. [D 20:43:32.212340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 53196. [D 20:43:32.212354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 53197. [D 20:43:32.212368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 53198. [D 20:43:32.212382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 53199. [D 20:43:32.212398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 53200. [D 20:43:32.212412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 53201. [D 20:43:32.212426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 53202. [D 20:43:32.212439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 53203. [D 20:43:32.212453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 53204. [D 20:43:32.212467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 53205. [D 20:43:32.212481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 53206. [D 20:43:32.212495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 53207. [D 20:43:32.212509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 53208. [D 20:43:32.212523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 53209. [D 20:43:32.212537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 53210. [D 20:43:32.212551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 53211. [D 20:43:32.212565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 53212. [D 20:43:32.212578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 53213. [D 20:43:32.212593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 53214. [D 20:43:32.212606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 53215. [D 20:43:32.212620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 53216. [D 20:43:32.212634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 53217. [D 20:43:32.212648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 53218. [D 20:43:32.212662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 53219. [D 20:43:32.212676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 53220. [D 20:43:32.212690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 53221. [D 20:43:32.212704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 53222. [D 20:43:32.212718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 53223. [D 20:43:32.212731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 53224. [D 20:43:32.212745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 53225. [D 20:43:32.212759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 53226. [D 20:43:32.212773] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 53227. [D 20:43:32.212794] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 13/70. [D 20:43:32.212828] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.212842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.212854] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.212875] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7608 [D 20:43:32.212888] element 0: offset: 0x641f50, size: 24 [D 20:43:32.212902] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 14/70. [D 20:43:32.216200] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.216216] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.216228] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.218393] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.218418] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.218432] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.218488] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7611 [D 20:43:32.218504] element 0: offset: 0x658610, size: 24 [D 20:43:32.218523] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 15/70. [D 20:43:32.222649] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53227. [D 20:43:32.222674] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 16/70. [D 20:43:32.225711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.225728] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.225742] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.232094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.232114] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.232127] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.232151] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7614 [D 20:43:32.232166] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.232181] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 17/70. [D 20:43:32.235494] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7607 [D 20:43:32.235520] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 18/70. [D 20:43:32.235541] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7608 [D 20:43:32.235557] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 19/70. [D 20:43:32.235572] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7611 [D 20:43:32.235587] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 20/70. [D 20:43:32.235713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53227. [D 20:43:32.235734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53228. [D 20:43:32.235749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53229. [D 20:43:32.235764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53230. [D 20:43:32.235779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53231. [D 20:43:32.235794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53232. [D 20:43:32.235809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53233. [D 20:43:32.235824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53234. [D 20:43:32.235839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53235. [D 20:43:32.235853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53236. [D 20:43:32.235868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53237. [D 20:43:32.235884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53238. [D 20:43:32.235899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53239. [D 20:43:32.235914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53240. [D 20:43:32.235928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53241. [D 20:43:32.235943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53242. [D 20:43:32.235957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53243. [D 20:43:32.235972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53244. [D 20:43:32.235987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53245. [D 20:43:32.236002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53246. [D 20:43:32.236016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53247. [D 20:43:32.236031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53248. [D 20:43:32.236046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53249. [D 20:43:32.236060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53250. [D 20:43:32.236075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53251. [D 20:43:32.236089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53252. [D 20:43:32.236104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53253. [D 20:43:32.236119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53254. [D 20:43:32.236133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53255. [D 20:43:32.236148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53256. [D 20:43:32.236163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53257. [D 20:43:32.236177] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53258. [D 20:43:32.236195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53259. [D 20:43:32.236217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53260. [D 20:43:32.236233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53261. [D 20:43:32.236247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53262. [D 20:43:32.236266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53263. [D 20:43:32.236280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53264. [D 20:43:32.236295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53265. [D 20:43:32.236309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53266. [D 20:43:32.236325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53267. [D 20:43:32.236340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53268. [D 20:43:32.236354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53269. [D 20:43:32.236369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53270. [D 20:43:32.236384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53271. [D 20:43:32.236399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53272. [D 20:43:32.236414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53273. [D 20:43:32.236428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53274. [D 20:43:32.236443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53275. [D 20:43:32.236458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53276. [D 20:43:32.236473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53277. [D 20:43:32.236488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53278. [D 20:43:32.236502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53279. [D 20:43:32.236517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53280. [D 20:43:32.236532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53281. [D 20:43:32.236547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53282. [D 20:43:32.236562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53283. [D 20:43:32.236577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53284. [D 20:43:32.236591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53285. [D 20:43:32.236606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53286. [D 20:43:32.236621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53287. [D 20:43:32.236636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53288. [D 20:43:32.236650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53289. [D 20:43:32.236666] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53290. [D 20:43:32.236682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53291. [D 20:43:32.236697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53292. [D 20:43:32.236712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53293. [D 20:43:32.236727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53294. [D 20:43:32.236742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53295. [D 20:43:32.236757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53296. [D 20:43:32.236772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53297. [E 20:43:32.236791] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 53298, block for 10 ms. [D 20:43:32.238374] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7614 [D 20:43:32.245698] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53297. [D 20:43:32.245720] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 21/70. [D 20:43:32.245735] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53296. [D 20:43:32.245750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53297. [D 20:43:32.245765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53298. [D 20:43:32.245780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53299. [D 20:43:32.245795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53300. [D 20:43:32.245809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53301. [D 20:43:32.245824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53302. [D 20:43:32.245838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53303. [D 20:43:32.245853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53304. [D 20:43:32.245868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53305. [D 20:43:32.245883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53306. [D 20:43:32.245897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53307. [D 20:43:32.245912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53308. [D 20:43:32.245926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53309. [D 20:43:32.245941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53310. [D 20:43:32.245956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53311. [D 20:43:32.245970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53312. [D 20:43:32.245985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53313. [D 20:43:32.245999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53314. [D 20:43:32.246014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53315. [D 20:43:32.246029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53316. [D 20:43:32.246043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53317. [D 20:43:32.246058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53318. [D 20:43:32.246072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53319. [D 20:43:32.246088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53320. [D 20:43:32.246103] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53321. [D 20:43:32.249770] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 22/70. [D 20:43:32.256467] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53321. [D 20:43:32.256487] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 23/70. [D 20:43:32.261763] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.261781] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.261795] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.263309] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 53320. [D 20:43:32.263327] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 24/70. [D 20:43:32.264212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 53320. [D 20:43:32.264229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 53321. [D 20:43:32.264245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 53322. [D 20:43:32.264263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 53323. [D 20:43:32.264271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.264278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 53324. [D 20:43:32.264351] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.264357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 53325. [D 20:43:32.264373] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.264391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 53326. [D 20:43:32.264422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 53327. [D 20:43:32.264420] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.264447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 53328. [D 20:43:32.264462] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.264480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 53329. [D 20:43:32.264495] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.264514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 53330. [D 20:43:32.264543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 53331. [D 20:43:32.264559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 53332. [D 20:43:32.264573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 53333. [D 20:43:32.264588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 53334. [D 20:43:32.264602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 53335. [D 20:43:32.264617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 53336. [D 20:43:32.264631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 53337. [D 20:43:32.264646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 53338. [D 20:43:32.264661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 53339. [D 20:43:32.264676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 53340. [D 20:43:32.264691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 53341. [D 20:43:32.264705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 53342. [D 20:43:32.264720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 53343. [D 20:43:32.264735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 53344. [D 20:43:32.264749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 53345. [D 20:43:32.264764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 53346. [D 20:43:32.264779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 53347. [D 20:43:32.264793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 53348. [D 20:43:32.264808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 53349. [D 20:43:32.264822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 53350. [D 20:43:32.264837] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6098d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 53351. [D 20:43:32.270254] openib_check_cq: completed rdma wr_id 2aaaab6098d0, nic_wr_credit 53351. [D 20:43:32.270272] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 25/70. [D 20:43:32.270326] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.270346] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.270358] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:32.281318] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.281335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.281348] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:32.281389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7620 [D 20:43:32.281404] element 0: offset: 0x636ca0, size: 24 [D 20:43:32.281431] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 26/70. [D 20:43:32.281478] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.281491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.281504] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.281524] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7622 [D 20:43:32.281538] element 0: offset: 0x6339f0, size: 24 [D 20:43:32.281554] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 27/70. [D 20:43:32.281651] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.281666] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.281679] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.281699] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7624 [D 20:43:32.281713] element 0: offset: 0x62fd10, size: 24 [D 20:43:32.281729] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 28/70. [D 20:43:32.287620] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.287684] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.287698] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.287737] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7626 [D 20:43:32.287752] element 0: offset: 0x641f50, size: 24 [D 20:43:32.287773] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 29/70. [D 20:43:32.290898] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7620 [D 20:43:32.290924] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 30/70. [D 20:43:32.290940] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7622 [D 20:43:32.290955] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 31/70. [D 20:43:32.291101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53351. [D 20:43:32.291123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53352. [D 20:43:32.291138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53353. [D 20:43:32.291153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53354. [D 20:43:32.291168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53355. [D 20:43:32.291182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53356. [D 20:43:32.291196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53357. [D 20:43:32.291211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53358. [D 20:43:32.291225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53359. [D 20:43:32.291240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53360. [D 20:43:32.291254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53361. [D 20:43:32.291269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53362. [D 20:43:32.291283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53363. [D 20:43:32.291298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53364. [D 20:43:32.291312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53365. [D 20:43:32.291327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53366. [D 20:43:32.291341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53367. [D 20:43:32.291356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53368. [D 20:43:32.291370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53369. [D 20:43:32.291385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53370. [D 20:43:32.291399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53371. [D 20:43:32.291414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53372. [D 20:43:32.291428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53373. [D 20:43:32.291443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53374. [D 20:43:32.291457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53375. [D 20:43:32.291472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53376. [D 20:43:32.291487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53377. [D 20:43:32.291502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53378. [D 20:43:32.291516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53379. [D 20:43:32.291531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53380. [D 20:43:32.291546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53381. [D 20:43:32.291560] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53382. [D 20:43:32.291577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53383. [D 20:43:32.291592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53384. [D 20:43:32.291607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53385. [D 20:43:32.291621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53386. [D 20:43:32.291636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53387. [D 20:43:32.291651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53388. [D 20:43:32.291665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53389. [D 20:43:32.291680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53390. [D 20:43:32.291695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53391. [D 20:43:32.291709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53392. [D 20:43:32.291724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53393. [D 20:43:32.291739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53394. [D 20:43:32.291753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53395. [D 20:43:32.291768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53396. [D 20:43:32.291783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53397. [D 20:43:32.291797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53398. [D 20:43:32.291812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53399. [D 20:43:32.291827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53400. [D 20:43:32.291842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53401. [D 20:43:32.291856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53402. [D 20:43:32.291872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53403. [D 20:43:32.291886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53404. [D 20:43:32.291974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53405. [D 20:43:32.291993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53406. [D 20:43:32.292008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53407. [D 20:43:32.292023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53408. [D 20:43:32.292038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53409. [D 20:43:32.292395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53410. [D 20:43:32.292414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53411. [D 20:43:32.292428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53412. [D 20:43:32.292443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53413. [D 20:43:32.292458] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53414. [D 20:43:32.293864] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7624 [D 20:43:32.293882] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 32/70. [D 20:43:32.293901] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7626 [D 20:43:32.293916] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 33/70. [D 20:43:32.302745] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53414. [D 20:43:32.302767] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 34/70. [D 20:43:32.314449] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53413. [D 20:43:32.314466] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 35/70. [D 20:43:32.314495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53413. [D 20:43:32.314511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53414. [D 20:43:32.314526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53415. [D 20:43:32.314541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53416. [D 20:43:32.314556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53417. [D 20:43:32.314571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53418. [D 20:43:32.314586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53419. [D 20:43:32.314601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53420. [D 20:43:32.314616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53421. [D 20:43:32.314631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53422. [D 20:43:32.314646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53423. [D 20:43:32.314660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53424. [D 20:43:32.314675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53425. [D 20:43:32.314690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53426. [D 20:43:32.314705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53427. [D 20:43:32.314720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53428. [D 20:43:32.314735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53429. [D 20:43:32.314750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53430. [D 20:43:32.314765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53431. [D 20:43:32.314780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53432. [D 20:43:32.314794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53433. [D 20:43:32.314809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53434. [D 20:43:32.314824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53435. [D 20:43:32.314838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53436. [D 20:43:32.314853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53437. [D 20:43:32.314868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53438. [D 20:43:32.314883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53439. [D 20:43:32.314898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53440. [D 20:43:32.314912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53441. [D 20:43:32.314927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53442. [D 20:43:32.314942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53443. [D 20:43:32.314957] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53444. [D 20:43:32.314973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 53445. [D 20:43:32.314988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 53446. [D 20:43:32.315003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 53447. [D 20:43:32.315018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 53448. [D 20:43:32.315033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 53449. [D 20:43:32.315048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 53450. [D 20:43:32.315062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 53451. [D 20:43:32.315077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 53452. [D 20:43:32.315092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 53453. [D 20:43:32.315107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 53454. [D 20:43:32.315122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 53455. [D 20:43:32.315137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 53456. [D 20:43:32.315152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 53457. [D 20:43:32.315167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 53458. [D 20:43:32.315182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 53459. [D 20:43:32.315196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 53460. [D 20:43:32.315211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 53461. [D 20:43:32.315226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 53462. [D 20:43:32.315240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 53463. [D 20:43:32.315255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 53464. [D 20:43:32.315285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 53465. [D 20:43:32.315300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 53466. [D 20:43:32.315314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 53467. [D 20:43:32.315330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 53468. [D 20:43:32.315344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 53469. [D 20:43:32.315359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 53470. [D 20:43:32.315374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 53471. [D 20:43:32.315389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 53472. [D 20:43:32.315403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 53473. [D 20:43:32.315430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 53474. [D 20:43:32.315445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 53475. [D 20:43:32.315459] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6098d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 53476. [D 20:43:32.316267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.316332] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.316346] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.316372] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.316385] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.316397] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.321124] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 53476. [D 20:43:32.321150] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 36/70. [D 20:43:32.327164] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.327185] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.327198] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.327239] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7630 [D 20:43:32.327254] element 0: offset: 0x61fa30, size: 24 [D 20:43:32.327274] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 37/70. [D 20:43:32.332651] openib_check_cq: completed rdma wr_id 2aaaab6098d0, nic_wr_credit 53475. [D 20:43:32.332678] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 38/70. [D 20:43:32.332732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.332752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.332765] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.332853] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.332868] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.332880] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.335898] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7630 [D 20:43:32.335957] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 39/70. [D 20:43:32.338071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53475. [D 20:43:32.338096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53476. [D 20:43:32.338111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53477. [D 20:43:32.338125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53478. [D 20:43:32.338140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53479. [D 20:43:32.338657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53480. [D 20:43:32.338679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53481. [D 20:43:32.338694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53482. [D 20:43:32.338709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53483. [D 20:43:32.338724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53484. [D 20:43:32.338738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53485. [D 20:43:32.338753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53486. [D 20:43:32.338768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53487. [D 20:43:32.338782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53488. [D 20:43:32.338797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53489. [D 20:43:32.338812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53490. [D 20:43:32.338826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53491. [D 20:43:32.338841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53492. [D 20:43:32.338856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53493. [D 20:43:32.338871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53494. [D 20:43:32.338885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53495. [D 20:43:32.338900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53496. [D 20:43:32.338915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53497. [D 20:43:32.338929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53498. [D 20:43:32.338945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53499. [D 20:43:32.338960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53500. [D 20:43:32.338975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53501. [D 20:43:32.338989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53502. [D 20:43:32.339004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53503. [D 20:43:32.339019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53504. [D 20:43:32.339033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53505. [D 20:43:32.339048] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53506. [D 20:43:32.344743] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.344766] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.344779] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.344825] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7633 [D 20:43:32.344840] element 0: offset: 0x6472e0, size: 24 [D 20:43:32.344999] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 40/70. [D 20:43:32.345042] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.345055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.345068] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.345090] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7635 [D 20:43:32.345104] element 0: offset: 0x636ca0, size: 24 [D 20:43:32.345118] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 41/70. [D 20:43:32.349949] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53506. [D 20:43:32.349985] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 42/70. [D 20:43:32.350147] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.350168] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.350180] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.356012] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7633 [D 20:43:32.356085] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 43/70. [D 20:43:32.356166] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7635 [D 20:43:32.356186] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 44/70. [D 20:43:32.356238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53506. [D 20:43:32.356267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53507. [D 20:43:32.356293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53508. [D 20:43:32.356316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53509. [D 20:43:32.356331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53510. [D 20:43:32.356357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53511. [D 20:43:32.356373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53512. [D 20:43:32.356387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53513. [D 20:43:32.356411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53514. [D 20:43:32.660427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53515. [D 20:43:32.660569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53516. [D 20:43:32.660585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53517. [D 20:43:32.660599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53518. [D 20:43:32.660614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53519. [D 20:43:32.660628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53520. [D 20:43:32.660641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53521. [D 20:43:32.660656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53522. [D 20:43:32.660670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53523. [D 20:43:32.660684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53524. [D 20:43:32.660698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53525. [D 20:43:32.660712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53526. [D 20:43:32.660726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53527. [D 20:43:32.660740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53528. [D 20:43:32.660754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53529. [D 20:43:32.660768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53530. [D 20:43:32.660782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53531. [D 20:43:32.660797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53532. [D 20:43:32.660810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53533. [D 20:43:32.660824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53534. [D 20:43:32.660838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53535. [D 20:43:32.660852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53536. [D 20:43:32.660866] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53537. [D 20:43:32.660891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53538. [D 20:43:32.660905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53539. [D 20:43:32.660919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53540. [D 20:43:32.660933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53541. [D 20:43:32.660947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53542. [D 20:43:32.660961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53543. [D 20:43:32.660976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53544. [D 20:43:32.660990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53545. [D 20:43:32.661005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53546. [D 20:43:32.661019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53547. [D 20:43:32.661033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53548. [D 20:43:32.661048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53549. [D 20:43:32.661062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53550. [D 20:43:32.661076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53551. [D 20:43:32.661090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53552. [D 20:43:32.661104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53553. [D 20:43:32.661119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53554. [D 20:43:32.661133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53555. [D 20:43:32.661147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53556. [D 20:43:32.661161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53557. [D 20:43:32.661176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53558. [D 20:43:32.661190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53559. [D 20:43:32.661204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53560. [D 20:43:32.661218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53561. [D 20:43:32.661233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53562. [D 20:43:32.661247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53563. [D 20:43:32.661261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53564. [D 20:43:32.661275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53565. [D 20:43:32.661290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53566. [D 20:43:32.661304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53567. [D 20:43:32.661318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53568. [D 20:43:32.661332] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53569. [D 20:43:32.664497] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.664515] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.664528] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.664572] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7639 [D 20:43:32.664588] element 0: offset: 0x66dc10, size: 24 [D 20:43:32.664606] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 45/70. [D 20:43:32.664638] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.664651] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.664664] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:32.664685] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7641 [D 20:43:32.664699] element 0: offset: 0x6302e0, size: 24 [D 20:43:32.664713] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 46/70. [D 20:43:32.664802] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53569. [D 20:43:32.664819] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 47/70. [D 20:43:32.670639] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53568. [D 20:43:32.670662] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 48/70. [D 20:43:32.673538] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.673555] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.673567] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:32.673677] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.673692] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.673704] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.679962] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7641 [D 20:43:32.680025] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 49/70. [D 20:43:32.681773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 53568. [D 20:43:32.681794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 53569. [D 20:43:32.681808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 53570. [D 20:43:32.681822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 53571. [D 20:43:32.681836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 53572. [D 20:43:32.681850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 53573. [D 20:43:32.681864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 53574. [D 20:43:32.681878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 53575. [D 20:43:32.681891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 53576. [D 20:43:32.681905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 53577. [D 20:43:32.681919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 53578. [D 20:43:32.681933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 53579. [D 20:43:32.681947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 53580. [D 20:43:32.681961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 53581. [D 20:43:32.681975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 53582. [D 20:43:32.681989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 53583. [D 20:43:32.682002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 53584. [D 20:43:32.682016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 53585. [D 20:43:32.682030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 53586. [D 20:43:32.682045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 53587. [D 20:43:32.682059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 53588. [D 20:43:32.682074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 53589. [D 20:43:32.682088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 53590. [D 20:43:32.682103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 53591. [D 20:43:32.682117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 53592. [D 20:43:32.682132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 53593. [D 20:43:32.682146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 53594. [D 20:43:32.682160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 53595. [D 20:43:32.682175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 53596. [D 20:43:32.682189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 53597. [D 20:43:32.682204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 53598. [D 20:43:32.682218] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 53599. [D 20:43:32.685327] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.685345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.685358] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.685399] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7644 [D 20:43:32.685414] element 0: offset: 0x641f50, size: 24 [D 20:43:32.685430] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 50/70. [D 20:43:32.685617] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7639 [D 20:43:32.685637] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 51/70. [D 20:43:32.690433] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53599. [D 20:43:32.690453] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 52/70. [D 20:43:32.690474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 53599. [D 20:43:32.690489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 53600. [D 20:43:32.690503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 53601. [D 20:43:32.690518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 53602. [D 20:43:32.690532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 53603. [D 20:43:32.690547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 53604. [D 20:43:32.690561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53605. [D 20:43:32.690576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53606. [D 20:43:32.690590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53607. [D 20:43:32.690604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 53608. [D 20:43:32.690620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 53609. [D 20:43:32.690634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 53610. [D 20:43:32.690649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 53611. [D 20:43:32.690663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 53612. [D 20:43:32.690677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53613. [D 20:43:32.690691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53614. [D 20:43:32.690706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53615. [D 20:43:32.690720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 53616. [D 20:43:32.690734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 53617. [D 20:43:32.690749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 53618. [D 20:43:32.690763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 53619. [D 20:43:32.690777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 53620. [D 20:43:32.690792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53621. [D 20:43:32.690806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53622. [D 20:43:32.690820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53623. [D 20:43:32.690835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 53624. [D 20:43:32.690849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 53625. [D 20:43:32.690863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 53626. [D 20:43:32.690878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 53627. [D 20:43:32.690892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 53628. [D 20:43:32.690906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53629. [D 20:43:32.690921] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53630. [D 20:43:32.692281] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.692297] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.692309] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.699414] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53630. [D 20:43:32.699472] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 53/70. [D 20:43:32.702580] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.702596] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.702609] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:32.702650] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7647 [D 20:43:32.702665] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.702681] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 54/70. [D 20:43:32.702727] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.702743] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.702756] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:32.702833] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7644 [D 20:43:32.702854] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 55/70. [D 20:43:32.706148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53630. [D 20:43:32.706218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53631. [D 20:43:32.706236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53632. [D 20:43:32.706250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53633. [D 20:43:32.706265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53634. [D 20:43:32.706279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53635. [D 20:43:32.706294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53636. [D 20:43:32.706312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53637. [D 20:43:32.706327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53638. [D 20:43:32.706341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53639. [D 20:43:32.706356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53640. [D 20:43:32.706370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53641. [D 20:43:32.706385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53642. [D 20:43:32.706482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53643. [D 20:43:32.706497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53644. [D 20:43:32.706512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53645. [D 20:43:32.706526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53646. [D 20:43:32.706541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53647. [D 20:43:32.706555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53648. [D 20:43:32.706570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53649. [D 20:43:32.706584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53650. [D 20:43:32.706599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53651. [D 20:43:32.706613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53652. [D 20:43:32.706628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53653. [D 20:43:32.706642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53654. [D 20:43:32.706657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53655. [D 20:43:32.706671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53656. [D 20:43:32.706686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53657. [D 20:43:32.706701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53658. [D 20:43:32.706715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53659. [D 20:43:32.706730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53660. [D 20:43:32.706744] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53661. [D 20:43:32.709955] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7647 [D 20:43:32.709981] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 56/70. [D 20:43:32.712115] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53661. [D 20:43:32.712132] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 57/70. [D 20:43:32.712148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53661. [D 20:43:32.712163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53662. [D 20:43:32.712177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53663. [D 20:43:32.712192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53664. [D 20:43:32.712211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53665. [D 20:43:32.712225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53666. [D 20:43:32.712239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53667. [D 20:43:32.712254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53668. [D 20:43:32.712268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53669. [D 20:43:32.712283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53670. [D 20:43:32.712298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53671. [D 20:43:32.712312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53672. [D 20:43:32.712326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53673. [D 20:43:32.712341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53674. [D 20:43:32.712355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53675. [D 20:43:32.712369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53676. [D 20:43:32.712384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53677. [D 20:43:32.712398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53678. [D 20:43:32.712412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53679. [D 20:43:32.712427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53680. [D 20:43:32.712441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53681. [D 20:43:32.712456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53682. [D 20:43:32.712470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53683. [D 20:43:32.712484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53684. [D 20:43:32.712498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53685. [D 20:43:32.712512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53686. [D 20:43:32.712526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53687. [D 20:43:32.712540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53688. [D 20:43:32.712554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53689. [D 20:43:32.712568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53690. [D 20:43:32.712582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53691. [D 20:43:32.712596] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53692. [D 20:43:32.715747] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.715763] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.715776] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.718200] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53692. [D 20:43:32.718264] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 58/70. [D 20:43:32.718337] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.718356] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.718369] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:32.725166] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.725182] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.725194] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:32.725231] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7651 [D 20:43:32.725246] element 0: offset: 0x6472e0, size: 24 [D 20:43:32.725263] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 59/70. [D 20:43:32.725301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.725315] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.725327] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.725347] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7653 [D 20:43:32.725361] element 0: offset: 0x636ca0, size: 24 [D 20:43:32.725375] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 60/70. [D 20:43:32.731361] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7651 [D 20:43:32.731434] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 0/70. [D 20:43:32.731509] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7653 [D 20:43:32.731527] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 1/70. [D 20:43:32.731591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 53692. [D 20:43:32.731619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 53693. [D 20:43:32.731634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 53694. [D 20:43:32.731649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 53695. [D 20:43:32.731665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 53696. [D 20:43:32.731679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 53697. [D 20:43:32.731693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 53698. [D 20:43:32.731708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53699. [D 20:43:32.731722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53700. [D 20:43:32.731736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53701. [D 20:43:32.731751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 53702. [D 20:43:32.731765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 53703. [D 20:43:32.731779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 53704. [D 20:43:32.731794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 53705. [D 20:43:32.731808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 53706. [D 20:43:32.731822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53707. [D 20:43:32.731837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53708. [D 20:43:32.731851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53709. [D 20:43:32.731865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 53710. [D 20:43:32.731880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 53711. [D 20:43:32.731894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 53712. [D 20:43:32.731908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 53713. [D 20:43:32.731922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 53714. [D 20:43:32.731937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53715. [D 20:43:32.731951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53716. [D 20:43:32.731965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53717. [D 20:43:32.731980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 53718. [D 20:43:32.731994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 53719. [D 20:43:32.732008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 53720. [D 20:43:32.732023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 53721. [D 20:43:32.732037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 53722. [D 20:43:32.732051] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53723. [D 20:43:32.732069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53724. [D 20:43:32.732084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53725. [D 20:43:32.732099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53726. [D 20:43:32.732113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53727. [D 20:43:32.732127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53728. [D 20:43:32.732142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53729. [D 20:43:32.732156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53730. [D 20:43:32.732170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53731. [D 20:43:32.732184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53732. [D 20:43:32.732199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53733. [D 20:43:32.732217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53734. [D 20:43:32.732232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53735. [D 20:43:32.732246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53736. [D 20:43:32.732261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53737. [D 20:43:32.732275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53738. [D 20:43:32.732293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53739. [D 20:43:32.732308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53740. [D 20:43:32.732322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53741. [D 20:43:32.732337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53742. [D 20:43:32.732351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53743. [D 20:43:32.732366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53744. [D 20:43:32.732380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53745. [D 20:43:32.732394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53746. [D 20:43:32.732409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53747. [D 20:43:32.732423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53748. [D 20:43:32.732437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53749. [D 20:43:32.732452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53750. [D 20:43:32.732466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53751. [D 20:43:32.732481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53752. [D 20:43:32.732495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53753. [D 20:43:32.732510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53754. [D 20:43:32.732525] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53755. [D 20:43:32.743410] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53755. [D 20:43:32.743433] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 2/70. [D 20:43:32.753188] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53754. [D 20:43:32.753204] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 3/70. [D 20:43:32.753276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.753299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.753311] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.753336] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.753349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.753362] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:32.766192] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.766208] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.766221] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:32.766257] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7657 [D 20:43:32.766273] element 0: offset: 0x6302e0, size: 24 [D 20:43:32.766289] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 4/70. [D 20:43:32.766331] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.766345] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.766357] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.766378] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7659 [D 20:43:32.766392] element 0: offset: 0x61fa30, size: 24 [D 20:43:32.766406] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 5/70. [D 20:43:32.772256] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7657 [D 20:43:32.772290] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 6/70. [D 20:43:32.772426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53754. [D 20:43:32.772444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53755. [D 20:43:32.772459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 53756. [D 20:43:32.772474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 53757. [D 20:43:32.772489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 53758. [D 20:43:32.772504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 53759. [D 20:43:32.772518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 53760. [D 20:43:32.772532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53761. [D 20:43:32.772547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53762. [D 20:43:32.772561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53763. [D 20:43:32.772575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 53764. [D 20:43:32.772590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 53765. [D 20:43:32.772604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 53766. [D 20:43:32.772625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 53767. [D 20:43:32.772639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 53768. [D 20:43:32.772653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53769. [D 20:43:32.772668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53770. [D 20:43:32.772682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53771. [D 20:43:32.772696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 53772. [D 20:43:32.772710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 53773. [D 20:43:32.772724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 53774. [D 20:43:32.772739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 53775. [D 20:43:32.772753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 53776. [D 20:43:32.772767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53777. [D 20:43:32.772781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53778. [D 20:43:32.772795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53779. [D 20:43:32.772810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 53780. [D 20:43:32.772824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 53781. [D 20:43:32.772838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 53782. [D 20:43:32.772852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 53783. [D 20:43:32.772866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 53784. [D 20:43:32.772880] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d140 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53785. [D 20:43:32.775856] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7659 [D 20:43:32.775872] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 7/70. [D 20:43:32.784114] openib_check_cq: completed rdma wr_id 2aaaab60d140, nic_wr_credit 53785. [D 20:43:32.784136] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 8/70. [D 20:43:32.784173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53785. [D 20:43:32.784188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53786. [D 20:43:32.784203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53787. [D 20:43:32.784223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53788. [D 20:43:32.784237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53789. [D 20:43:32.784251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53790. [D 20:43:32.784265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53791. [D 20:43:32.784285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53792. [D 20:43:32.784299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53793. [D 20:43:32.784313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53794. [D 20:43:32.784328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53795. [D 20:43:32.784342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53796. [D 20:43:32.784357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53797. [D 20:43:32.784371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53798. [D 20:43:32.784386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53799. [D 20:43:32.784400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53800. [D 20:43:32.784414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53801. [D 20:43:32.784429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53802. [D 20:43:32.784443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53803. [D 20:43:32.784458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53804. [D 20:43:32.784472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53805. [D 20:43:32.784487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53806. [D 20:43:32.784501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53807. [D 20:43:32.784516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53808. [D 20:43:32.784530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53809. [D 20:43:32.784544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53810. [D 20:43:32.784559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53811. [D 20:43:32.784573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53812. [D 20:43:32.784588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53813. [D 20:43:32.784602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53814. [D 20:43:32.784617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53815. [D 20:43:32.784631] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609a30 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53816. [D 20:43:32.784711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.784778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.784791] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.791204] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.791221] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.791234] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.791275] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7662 [D 20:43:32.791292] element 0: offset: 0x641f50, size: 24 [D 20:43:32.791313] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 9/70. [D 20:43:32.792330] openib_check_cq: completed rdma wr_id 2aaaab609a30, nic_wr_credit 53816. [D 20:43:32.792355] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 10/70. [D 20:43:32.792446] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.792465] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.792478] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.795467] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7662 [D 20:43:32.795490] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 11/70. [D 20:43:32.798869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 53816. [D 20:43:32.798888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 53817. [D 20:43:32.798903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 53818. [D 20:43:32.798917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 53819. [D 20:43:32.798932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 53820. [D 20:43:32.798946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 53821. [D 20:43:32.798960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 53822. [D 20:43:32.798975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53823. [D 20:43:32.798989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53824. [D 20:43:32.799003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53825. [D 20:43:32.799018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 53826. [D 20:43:32.799032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 53827. [D 20:43:32.799047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 53828. [D 20:43:32.799061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 53829. [D 20:43:32.799075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 53830. [D 20:43:32.799090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53831. [D 20:43:32.799104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53832. [D 20:43:32.799118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53833. [D 20:43:32.799132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 53834. [D 20:43:32.799147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 53835. [D 20:43:32.799161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 53836. [D 20:43:32.799176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 53837. [D 20:43:32.799190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 53838. [D 20:43:32.799204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53839. [D 20:43:32.799219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53840. [D 20:43:32.799234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53841. [D 20:43:32.799248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 53842. [D 20:43:32.799262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 53843. [D 20:43:32.799277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 53844. [D 20:43:32.799291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 53845. [D 20:43:32.799305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 53846. [D 20:43:32.799319] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d480 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53847. [D 20:43:32.799572] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.799621] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.799634] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.799676] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7665 [D 20:43:32.799691] element 0: offset: 0x2aaaab610080, size: 24 [D 20:43:32.799710] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 12/70. [D 20:43:32.810573] openib_check_cq: completed rdma wr_id 2aaaab60d480, nic_wr_credit 53847. [D 20:43:32.810597] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 13/70. [D 20:43:32.810713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.810735] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.810747] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.813894] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7665 [D 20:43:32.813918] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 14/70. [D 20:43:32.816660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53847. [D 20:43:32.816679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53848. [D 20:43:32.816693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 53849. [D 20:43:32.816707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 53850. [D 20:43:32.816722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 53851. [D 20:43:32.816736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 53852. [D 20:43:32.816750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 53853. [D 20:43:32.816765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53854. [D 20:43:32.816779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53855. [D 20:43:32.816793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53856. [D 20:43:32.816808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 53857. [D 20:43:32.816822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 53858. [D 20:43:32.816836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 53859. [D 20:43:32.816851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 53860. [D 20:43:32.816866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 53861. [D 20:43:32.816880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53862. [D 20:43:32.816895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53863. [D 20:43:32.816909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53864. [D 20:43:32.816924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 53865. [D 20:43:32.816938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 53866. [D 20:43:32.816953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 53867. [D 20:43:32.816967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 53868. [D 20:43:32.816981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 53869. [D 20:43:32.816995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53870. [D 20:43:32.817010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53871. [D 20:43:32.817024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53872. [D 20:43:32.817039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 53873. [D 20:43:32.817053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 53874. [D 20:43:32.817068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 53875. [D 20:43:32.817082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 53876. [D 20:43:32.817096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 53877. [D 20:43:32.817111] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6100a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53878. [D 20:43:32.817335] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:32.817389] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.817403] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:32.817445] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7668 [D 20:43:32.817461] element 0: offset: 0x2aaaab610130, size: 24 [D 20:43:32.817480] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 15/70. [D 20:43:32.828401] openib_check_cq: completed rdma wr_id 2aaaab6100a0, nic_wr_credit 53878. [D 20:43:32.828425] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 16/70. [D 20:43:32.828533] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:32.828554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:32.828567] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:32.831619] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7668 [D 20:43:32.831642] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 17/70. [D 20:43:32.835180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 53878. [D 20:43:32.835197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 53879. [D 20:43:33.156054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 53880. [D 20:43:33.156080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 53881. [D 20:43:33.156094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 53882. [D 20:43:33.156109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 53883. [D 20:43:33.156123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 53884. [D 20:43:33.156138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 53885. [D 20:43:33.156152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 53886. [D 20:43:33.156167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 53887. [D 20:43:33.156181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 53888. [D 20:43:33.156196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 53889. [D 20:43:33.156213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 53890. [D 20:43:33.156227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 53891. [D 20:43:33.156241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 53892. [D 20:43:33.156256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 53893. [D 20:43:33.156270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 53894. [D 20:43:33.156284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 53895. [D 20:43:33.156299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 53896. [D 20:43:33.156317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 53897. [D 20:43:33.156331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 53898. [D 20:43:33.156345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 53899. [D 20:43:33.156360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 53900. [D 20:43:33.156374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 53901. [D 20:43:33.156388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 53902. [D 20:43:33.156402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 53903. [D 20:43:33.156417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 53904. [D 20:43:33.156431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 53905. [D 20:43:33.156445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 53906. [D 20:43:33.156459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 53907. [D 20:43:33.156474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 53908. [D 20:43:33.156489] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6100a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 53909. [D 20:43:33.157850] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.157899] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.157913] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.157956] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7671 [D 20:43:33.157971] element 0: offset: 0x2aaaab60d6b0, size: 24 [D 20:43:33.157993] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 18/70. [D 20:43:33.158034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.158048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.158060] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.158080] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7675 [D 20:43:33.158094] element 0: offset: 0x2aaaab60d6d0, size: 24 [D 20:43:33.158108] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 19/70. [D 20:43:33.158130] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.158143] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.158155] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.158177] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7677 [D 20:43:33.158191] element 0: offset: 0x2aaaab609c50, size: 24 [D 20:43:33.158205] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 20/70. [D 20:43:33.161736] openib_check_cq: completed rdma wr_id 2aaaab6100a0, nic_wr_credit 53909. [D 20:43:33.161759] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 21/70. [D 20:43:33.164332] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.164353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.164365] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.171100] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.171125] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.171138] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.171185] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7680 [D 20:43:33.171201] element 0: offset: 0x2aaaab60d460, size: 24 [D 20:43:33.171216] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 22/70. [D 20:43:33.174754] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7671 [D 20:43:33.174778] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 23/70. [D 20:43:33.174795] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7677 [D 20:43:33.174810] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 24/70. [D 20:43:33.174830] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7675 [D 20:43:33.174844] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 25/70. [D 20:43:33.175598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53909. [D 20:43:33.175622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53910. [D 20:43:33.175636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 53911. [D 20:43:33.175651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 53912. [D 20:43:33.175665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 53913. [D 20:43:33.175679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 53914. [D 20:43:33.175694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 53915. [D 20:43:33.175708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53916. [D 20:43:33.175722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53917. [D 20:43:33.175736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53918. [D 20:43:33.175751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 53919. [D 20:43:33.175765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 53920. [D 20:43:33.175779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 53921. [D 20:43:33.175793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 53922. [D 20:43:33.175807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 53923. [D 20:43:33.175822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53924. [D 20:43:33.175836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53925. [D 20:43:33.175850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53926. [D 20:43:33.175864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 53927. [D 20:43:33.175878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 53928. [D 20:43:33.175893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 53929. [D 20:43:33.175907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 53930. [D 20:43:33.175921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 53931. [D 20:43:33.175935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53932. [D 20:43:33.175949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53933. [D 20:43:33.175963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53934. [D 20:43:33.175977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 53935. [D 20:43:33.175991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 53936. [D 20:43:33.176005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 53937. [D 20:43:33.176020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 53938. [D 20:43:33.176034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 53939. [D 20:43:33.176048] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53940. [D 20:43:33.176065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 53941. [D 20:43:33.176080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 53942. [D 20:43:33.176094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 53943. [D 20:43:33.176108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 53944. [D 20:43:33.176122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 53945. [D 20:43:33.176137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 53946. [D 20:43:33.176151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 53947. [D 20:43:33.176165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 53948. [D 20:43:33.176180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 53949. [D 20:43:33.176195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 53950. [D 20:43:33.176212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 53951. [D 20:43:33.176226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 53952. [D 20:43:33.176241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 53953. [D 20:43:33.176255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 53954. [D 20:43:33.176269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 53955. [D 20:43:33.176284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 53956. [D 20:43:33.176298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 53957. [D 20:43:33.176316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 53958. [D 20:43:33.176331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 53959. [D 20:43:33.176345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 53960. [D 20:43:33.176359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 53961. [D 20:43:33.176374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 53962. [D 20:43:33.176388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 53963. [D 20:43:33.176402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 53964. [D 20:43:33.176417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 53965. [D 20:43:33.176431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 53966. [D 20:43:33.176445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 53967. [D 20:43:33.176460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 53968. [D 20:43:33.176474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 53969. [D 20:43:33.176488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 53970. [D 20:43:33.176502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 53971. [D 20:43:33.176517] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c720 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 53972. [D 20:43:33.176533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53973. [D 20:43:33.176548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 53974. [D 20:43:33.176563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 53975. [D 20:43:33.176577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 53976. [D 20:43:33.176592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 53977. [D 20:43:33.176606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 53978. [D 20:43:33.176621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53979. [E 20:43:33.176640] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 53980, block for 10 ms. [D 20:43:33.177687] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7680 [D 20:43:33.182071] openib_check_cq: completed rdma wr_id 2aaaab6151d0, nic_wr_credit 53979. [D 20:43:33.182098] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 26/70. [D 20:43:33.182113] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53978. [D 20:43:33.182127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53979. [D 20:43:33.182142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53980. [D 20:43:33.182156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 53981. [D 20:43:33.182170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 53982. [D 20:43:33.182185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 53983. [D 20:43:33.182199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 53984. [D 20:43:33.182213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 53985. [D 20:43:33.182227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53986. [D 20:43:33.182241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53987. [D 20:43:33.182255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53988. [D 20:43:33.182270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 53989. [D 20:43:33.182284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 53990. [D 20:43:33.182298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 53991. [D 20:43:33.182312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 53992. [D 20:43:33.182326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 53993. [D 20:43:33.182341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53994. [D 20:43:33.182355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53995. [D 20:43:33.182369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53996. [D 20:43:33.182383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 53997. [D 20:43:33.182397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 53998. [D 20:43:33.182411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 53999. [D 20:43:33.182425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54000. [D 20:43:33.182439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54001. [D 20:43:33.182453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54002. [D 20:43:33.182468] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab613a70 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54003. [D 20:43:33.182498] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 27/70. [D 20:43:33.187864] openib_check_cq: completed rdma wr_id 2aaaab60c720, nic_wr_credit 54003. [D 20:43:33.187889] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 28/70. [D 20:43:33.192300] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.192325] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.192377] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.193709] openib_check_cq: completed rdma wr_id 2aaaab613a70, nic_wr_credit 54002. [D 20:43:33.193733] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 29/70. [D 20:43:33.193783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.193805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.193817] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.193843] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.193857] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.193869] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:33.195464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54002. [D 20:43:33.195485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54003. [D 20:43:33.195500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54004. [D 20:43:33.195514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54005. [D 20:43:33.195528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54006. [D 20:43:33.195542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54007. [D 20:43:33.195557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54008. [D 20:43:33.195571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54009. [D 20:43:33.195585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54010. [D 20:43:33.195599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54011. [D 20:43:33.195613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54012. [D 20:43:33.195627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54013. [D 20:43:33.195642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54014. [D 20:43:33.195656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54015. [D 20:43:33.195670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54016. [D 20:43:33.195684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54017. [D 20:43:33.195699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54018. [D 20:43:33.195713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54019. [D 20:43:33.195727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54020. [D 20:43:33.195742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54021. [D 20:43:33.195756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54022. [D 20:43:33.195770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54023. [D 20:43:33.195784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54024. [D 20:43:33.195799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54025. [D 20:43:33.195813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54026. [D 20:43:33.195827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54027. [D 20:43:33.195842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54028. [D 20:43:33.195856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54029. [D 20:43:33.195871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54030. [D 20:43:33.195885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54031. [D 20:43:33.195899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54032. [D 20:43:33.195913] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615080 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54033. [D 20:43:33.201423] openib_check_cq: completed rdma wr_id 2aaaab615080, nic_wr_credit 54033. [D 20:43:33.201440] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 30/70. [D 20:43:33.201503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.201523] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.201536] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:33.211446] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.211463] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.211476] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:33.211515] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7685 [D 20:43:33.211530] element 0: offset: 0x2aaaab609c50, size: 24 [D 20:43:33.211547] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 31/70. [D 20:43:33.211658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.211673] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.211686] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.211706] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7689 [D 20:43:33.211720] element 0: offset: 0x2aaaab60c8c0, size: 24 [D 20:43:33.211734] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 32/70. [D 20:43:33.211771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.211785] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.211798] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.211818] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7690 [D 20:43:33.211832] element 0: offset: 0x2aaaab60c7a0, size: 24 [D 20:43:33.211847] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 33/70. [D 20:43:33.216365] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7685 [D 20:43:33.216394] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 34/70. [D 20:43:33.216443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54033. [D 20:43:33.216461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54034. [D 20:43:33.216475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54035. [D 20:43:33.216490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54036. [D 20:43:33.216504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54037. [D 20:43:33.216519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54038. [D 20:43:33.216533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54039. [D 20:43:33.216547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54040. [D 20:43:33.216561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54041. [D 20:43:33.216575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54042. [D 20:43:33.216590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54043. [D 20:43:33.216604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54044. [D 20:43:33.216618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54045. [D 20:43:33.216633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54046. [D 20:43:33.216647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54047. [D 20:43:33.216661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54048. [D 20:43:33.216675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54049. [D 20:43:33.216689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54050. [D 20:43:33.216704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54051. [D 20:43:33.216718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54052. [D 20:43:33.216732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54053. [D 20:43:33.216746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54054. [D 20:43:33.216760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54055. [D 20:43:33.216774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54056. [D 20:43:33.216789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54057. [D 20:43:33.216803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54058. [D 20:43:33.216817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54059. [D 20:43:33.216831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54060. [D 20:43:33.216846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54061. [D 20:43:33.216861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54062. [D 20:43:33.216874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54063. [D 20:43:33.216889] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54064. [D 20:43:33.220031] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7689 [D 20:43:33.220055] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 35/70. [D 20:43:33.220626] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.220646] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.220659] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.220691] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7692 [D 20:43:33.220706] element 0: offset: 0x2aaaab615190, size: 24 [D 20:43:33.220722] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 36/70. [D 20:43:33.223559] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7690 [D 20:43:33.223582] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 37/70. [D 20:43:33.225292] openib_check_cq: completed rdma wr_id 2aaaab6151b0, nic_wr_credit 54064. [D 20:43:33.225309] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 38/70. [D 20:43:33.225331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54064. [D 20:43:33.225347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54065. [D 20:43:33.225361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54066. [D 20:43:33.225375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54067. [D 20:43:33.225390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54068. [D 20:43:33.225403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54069. [D 20:43:33.225417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54070. [D 20:43:33.225432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54071. [D 20:43:33.225445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54072. [D 20:43:33.225459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54073. [D 20:43:33.225474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54074. [D 20:43:33.225487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54075. [D 20:43:33.225501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54076. [D 20:43:33.225515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54077. [D 20:43:33.225529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54078. [D 20:43:33.225543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54079. [D 20:43:33.225557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54080. [D 20:43:33.225571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54081. [D 20:43:33.225586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54082. [D 20:43:33.225601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54083. [D 20:43:33.225615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54084. [D 20:43:33.225629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54085. [D 20:43:33.225643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54086. [D 20:43:33.225657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54087. [D 20:43:33.225671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54088. [D 20:43:33.225685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54089. [D 20:43:33.225699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54090. [D 20:43:33.225713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54091. [D 20:43:33.225727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54092. [D 20:43:33.225741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54093. [D 20:43:33.225755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54094. [D 20:43:33.225769] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c620 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54095. [D 20:43:33.225785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54096. [D 20:43:33.225799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54097. [D 20:43:33.225813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54098. [D 20:43:33.225827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54099. [D 20:43:33.225841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54100. [D 20:43:33.225855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54101. [D 20:43:33.225869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54102. [D 20:43:33.225883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54103. [D 20:43:33.225898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54104. [D 20:43:33.225911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54105. [D 20:43:33.225926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54106. [D 20:43:33.225939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54107. [D 20:43:33.225954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54108. [D 20:43:33.225967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54109. [D 20:43:33.225982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54110. [D 20:43:33.225996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54111. [D 20:43:33.226010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54112. [D 20:43:33.226025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54113. [D 20:43:33.226039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54114. [D 20:43:33.226053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54115. [D 20:43:33.226067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54116. [D 20:43:33.226081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54117. [D 20:43:33.226095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54118. [D 20:43:33.226109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54119. [D 20:43:33.226123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54120. [D 20:43:33.226137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54121. [D 20:43:33.226151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54122. [D 20:43:33.226165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54123. [D 20:43:33.226179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54124. [D 20:43:33.226193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54125. [D 20:43:33.226207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54126. [D 20:43:33.226221] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab613930 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54127. [D 20:43:33.229325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.229341] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.229354] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.232276] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7692 [D 20:43:33.232299] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 39/70. [D 20:43:33.237098] openib_check_cq: completed rdma wr_id 2aaaab60c620, nic_wr_credit 54127. [D 20:43:33.237114] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 40/70. [D 20:43:33.248749] openib_check_cq: completed rdma wr_id 2aaaab613930, nic_wr_credit 54126. [D 20:43:33.248770] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 41/70. [D 20:43:33.251401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54126. [D 20:43:33.251416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54127. [D 20:43:33.251430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54128. [D 20:43:33.251445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54129. [D 20:43:33.251459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54130. [D 20:43:33.251473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54131. [D 20:43:33.251488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54132. [D 20:43:33.251503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54133. [D 20:43:33.251517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54134. [D 20:43:33.251531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54135. [D 20:43:33.251545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54136. [D 20:43:33.251560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54137. [D 20:43:33.251574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54138. [D 20:43:33.251588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54139. [D 20:43:33.251602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54140. [D 20:43:33.251616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54141. [D 20:43:33.251630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54142. [D 20:43:33.251644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54143. [D 20:43:33.251659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54144. [D 20:43:33.251673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54145. [D 20:43:33.251687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54146. [D 20:43:33.251701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54147. [D 20:43:33.251716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54148. [D 20:43:33.251730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54149. [D 20:43:33.251744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54150. [D 20:43:33.251758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54151. [D 20:43:33.251783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54152. [D 20:43:33.251798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54153. [D 20:43:33.251812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54154. [D 20:43:33.251826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54155. [D 20:43:33.251840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54156. [D 20:43:33.251854] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151b0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54157. [D 20:43:33.254898] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.254914] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.254927] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.254946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.254960] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.254972] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:33.260225] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.260244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.260257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.260281] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7695 [D 20:43:33.260295] element 0: offset: 0x2aaaab609c50, size: 24 [D 20:43:33.260322] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 42/70. [D 20:43:33.260344] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.260357] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.260370] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.260389] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7698 [D 20:43:33.260404] element 0: offset: 0x2aaaab60c7a0, size: 24 [D 20:43:33.260418] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 43/70. [D 20:43:33.263134] openib_check_cq: completed rdma wr_id 2aaaab6151b0, nic_wr_credit 54157. [D 20:43:33.263154] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 44/70. [D 20:43:33.264687] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.264752] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.264765] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.270543] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7695 [D 20:43:33.270610] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 45/70. [D 20:43:33.270692] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7698 [D 20:43:33.270710] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 46/70. [D 20:43:33.274162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 54157. [D 20:43:33.274187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 54158. [D 20:43:33.274202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54159. [D 20:43:33.274216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54160. [D 20:43:33.274230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54161. [D 20:43:33.274245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54162. [D 20:43:33.274259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54163. [D 20:43:33.274273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54164. [D 20:43:33.274287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54165. [D 20:43:33.274301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54166. [D 20:43:33.274316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54167. [D 20:43:33.274330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54168. [D 20:43:33.274344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54169. [D 20:43:33.274358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54170. [D 20:43:33.274372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54171. [D 20:43:33.274386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54172. [D 20:43:33.274400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54173. [D 20:43:33.274415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54174. [D 20:43:33.274430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54175. [D 20:43:33.274444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54176. [D 20:43:33.274458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54177. [D 20:43:33.274472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54178. [D 20:43:33.274486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54179. [D 20:43:33.274500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54180. [D 20:43:33.274514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54181. [D 20:43:33.274529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54182. [D 20:43:33.274543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54183. [D 20:43:33.274557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54184. [D 20:43:33.274571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54185. [D 20:43:33.274585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54186. [D 20:43:33.274599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54187. [D 20:43:33.274613] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151b0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54188. [D 20:43:33.274630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54189. [D 20:43:33.274644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54190. [D 20:43:33.274658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54191. [D 20:43:33.274672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54192. [D 20:43:33.274687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54193. [D 20:43:33.274700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54194. [D 20:43:33.274715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54195. [D 20:43:33.274729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54196. [D 20:43:33.274743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54197. [D 20:43:33.274757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54198. [D 20:43:33.274771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54199. [D 20:43:33.274785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54200. [D 20:43:33.274799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54201. [D 20:43:33.274813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54202. [D 20:43:33.274828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54203. [D 20:43:33.274842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54204. [D 20:43:33.274856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54205. [D 20:43:33.274871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54206. [D 20:43:33.274885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54207. [D 20:43:33.274899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54208. [D 20:43:33.274913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54209. [D 20:43:33.274928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54210. [D 20:43:33.274942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54211. [D 20:43:33.274956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54212. [D 20:43:33.274970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54213. [D 20:43:33.274984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54214. [D 20:43:33.274999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54215. [D 20:43:33.275024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54216. [D 20:43:33.275047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54217. [D 20:43:33.275069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54218. [D 20:43:33.275083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54219. [D 20:43:33.275097] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54220. [D 20:43:33.276885] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.276910] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.276923] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.276966] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7702 [D 20:43:33.276982] element 0: offset: 0x2aaaab6053d0, size: 24 [D 20:43:33.276998] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 47/70. [D 20:43:33.277037] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.277051] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.277064] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.277085] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7705 [D 20:43:33.277099] element 0: offset: 0x2aaaab60c600, size: 24 [D 20:43:33.277113] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 48/70. [D 20:43:33.285774] openib_check_cq: completed rdma wr_id 2aaaab6151b0, nic_wr_credit 54220. [D 20:43:33.285799] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 49/70. [D 20:43:33.294732] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54219. [D 20:43:33.294754] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 50/70. [D 20:43:33.294817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.294839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.294852] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.294966] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.294981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.294995] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.300301] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7702 [D 20:43:33.300371] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 51/70. [D 20:43:33.300847] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7705 [D 20:43:33.300873] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 52/70. [D 20:43:33.306839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54219. [D 20:43:33.306865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54220. [D 20:43:33.306879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54221. [D 20:43:33.306894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54222. [D 20:43:33.306908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54223. [D 20:43:33.306923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54224. [D 20:43:33.306936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54225. [D 20:43:33.306951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54226. [D 20:43:33.306965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54227. [D 20:43:33.306979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54228. [D 20:43:33.306993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54229. [D 20:43:33.307007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54230. [D 20:43:33.307022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54231. [D 20:43:33.307036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54232. [D 20:43:33.307050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54233. [D 20:43:33.307064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54234. [D 20:43:33.307078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54235. [D 20:43:33.307093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54236. [D 20:43:33.307107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54237. [D 20:43:33.307121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54238. [D 20:43:33.307135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54239. [D 20:43:33.307149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54240. [D 20:43:33.307164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54241. [D 20:43:33.307178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54242. [D 20:43:33.307192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54243. [D 20:43:33.307206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54244. [D 20:43:33.307221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54245. [D 20:43:33.307235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54246. [D 20:43:33.307249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54247. [D 20:43:33.307264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54248. [D 20:43:33.307278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54249. [D 20:43:33.307292] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54250. [D 20:43:33.307308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54251. [D 20:43:33.307322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54252. [D 20:43:33.307337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54253. [D 20:43:33.307351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54254. [D 20:43:33.307365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54255. [D 20:43:33.307379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54256. [D 20:43:33.307393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54257. [D 20:43:33.307407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54258. [D 20:43:33.307421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54259. [D 20:43:33.307436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54260. [D 20:43:33.307450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54261. [D 20:43:33.307464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54262. [D 20:43:33.307478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54263. [D 20:43:33.307492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54264. [D 20:43:33.307506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54265. [D 20:43:33.307520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54266. [D 20:43:33.307535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54267. [D 20:43:33.307549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54268. [D 20:43:33.307563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54269. [D 20:43:33.307577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54270. [D 20:43:33.307591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54271. [D 20:43:33.307606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54272. [D 20:43:33.307620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54273. [D 20:43:33.307634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54274. [D 20:43:33.307649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54275. [D 20:43:33.307663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54276. [D 20:43:33.307677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54277. [D 20:43:33.307691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54278. [D 20:43:33.307706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54279. [D 20:43:33.307720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54280. [D 20:43:33.307734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54281. [D 20:43:33.307748] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6151b0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54282. [D 20:43:33.309601] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.309625] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.309638] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.309680] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7707 [D 20:43:33.309695] element 0: offset: 0x2aaaab60c8c0, size: 24 [D 20:43:33.309716] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 53/70. [D 20:43:33.318504] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54282. [D 20:43:33.318530] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 54/70. [D 20:43:33.327413] openib_check_cq: completed rdma wr_id 2aaaab6151b0, nic_wr_credit 54281. [D 20:43:33.327435] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 55/70. [D 20:43:33.327494] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.327515] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.327530] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.327617] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.327632] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.327645] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:33.330541] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7707 [D 20:43:33.330604] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 56/70. [D 20:43:33.332958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54281. [D 20:43:33.332983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54282. [D 20:43:33.332998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54283. [D 20:43:33.333012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54284. [D 20:43:33.333026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54285. [D 20:43:33.333041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54286. [D 20:43:33.333055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54287. [D 20:43:33.333069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54288. [D 20:43:33.333084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54289. [D 20:43:33.333098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54290. [D 20:43:33.629084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54291. [D 20:43:33.629105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54292. [D 20:43:33.629120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54293. [D 20:43:33.629134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54294. [D 20:43:33.629148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54295. [D 20:43:33.629162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54296. [D 20:43:33.629176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54297. [D 20:43:33.629191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54298. [D 20:43:33.629205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54299. [D 20:43:33.629219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54300. [D 20:43:33.629233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54301. [D 20:43:33.629247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54302. [D 20:43:33.629261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54303. [D 20:43:33.629276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54304. [D 20:43:33.629290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54305. [D 20:43:33.629304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54306. [D 20:43:33.629799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54307. [D 20:43:33.629816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54308. [D 20:43:33.629830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54309. [D 20:43:33.629844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54310. [D 20:43:33.629858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54311. [D 20:43:33.629873] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54312. [D 20:43:33.630079] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.630105] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.630118] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.630160] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7711 [D 20:43:33.630175] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:33.630192] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 57/70. [D 20:43:33.630226] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.630240] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.630252] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.630272] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7714 [D 20:43:33.630286] element 0: offset: 0x2aaaab025d00, size: 24 [D 20:43:33.630301] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 58/70. [D 20:43:33.630329] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.630343] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.630356] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.630376] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7716 [D 20:43:33.630390] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:33.630404] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 59/70. [D 20:43:33.633288] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54312. [D 20:43:33.633314] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 60/70. [D 20:43:33.633487] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.633509] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.633522] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.645201] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.645223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.645236] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.645265] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7719 [D 20:43:33.645280] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:33.645295] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 0/70. [D 20:43:33.645410] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7711 [D 20:43:33.645438] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 1/70. [D 20:43:33.645455] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7714 [D 20:43:33.645470] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 2/70. [D 20:43:33.645486] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7716 [D 20:43:33.645500] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 3/70. [D 20:43:33.646535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54312. [D 20:43:33.646557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54313. [D 20:43:33.646571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54314. [D 20:43:33.646586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54315. [D 20:43:33.646600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54316. [D 20:43:33.646614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54317. [D 20:43:33.646628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54318. [D 20:43:33.646642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54319. [D 20:43:33.646656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54320. [D 20:43:33.646670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54321. [D 20:43:33.646684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54322. [D 20:43:33.646698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54323. [D 20:43:33.646712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54324. [D 20:43:33.646726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54325. [D 20:43:33.646740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54326. [D 20:43:33.646753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54327. [D 20:43:33.646768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54328. [D 20:43:33.646782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54329. [D 20:43:33.646796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54330. [D 20:43:33.646810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54331. [D 20:43:33.646825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54332. [D 20:43:33.646839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54333. [D 20:43:33.646854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54334. [D 20:43:33.646868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54335. [D 20:43:33.646882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54336. [D 20:43:33.646896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54337. [D 20:43:33.646911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54338. [D 20:43:33.646925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54339. [D 20:43:33.646939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54340. [D 20:43:33.646953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54341. [D 20:43:33.646968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54342. [D 20:43:33.646982] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54343. [D 20:43:33.646998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54344. [D 20:43:33.647013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54345. [D 20:43:33.647027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54346. [D 20:43:33.647041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54347. [D 20:43:33.647056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54348. [D 20:43:33.647070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54349. [D 20:43:33.647084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54350. [D 20:43:33.647099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54351. [D 20:43:33.647113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54352. [D 20:43:33.647127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54353. [D 20:43:33.647142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54354. [D 20:43:33.647156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54355. [D 20:43:33.647170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54356. [D 20:43:33.647185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54357. [D 20:43:33.647199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54358. [D 20:43:33.647213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54359. [D 20:43:33.647248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54360. [D 20:43:33.647263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54361. [D 20:43:33.647277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54362. [D 20:43:33.647291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54363. [D 20:43:33.647327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54364. [D 20:43:33.647341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54365. [D 20:43:33.647355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54366. [D 20:43:33.647369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54367. [D 20:43:33.647383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54368. [D 20:43:33.647401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54369. [D 20:43:33.647415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54370. [D 20:43:33.647429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54371. [D 20:43:33.647444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54372. [D 20:43:33.647458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54373. [D 20:43:33.647472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54374. [D 20:43:33.647486] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54375. [D 20:43:33.647502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54376. [D 20:43:33.647516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54377. [D 20:43:33.647530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54378. [D 20:43:33.647545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54379. [D 20:43:33.647559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54380. [D 20:43:33.647573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54381. [D 20:43:33.647587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54382. [E 20:43:33.647604] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54383, block for 10 ms. [D 20:43:33.656246] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54382. [D 20:43:33.656341] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 4/70. [D 20:43:33.656360] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54381. [D 20:43:33.656379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54382. [D 20:43:33.656394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54383. [D 20:43:33.656408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54384. [D 20:43:33.656423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54385. [D 20:43:33.656437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54386. [D 20:43:33.656454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54387. [D 20:43:33.656468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54388. [D 20:43:33.656482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54389. [D 20:43:33.656496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54390. [D 20:43:33.656511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54391. [D 20:43:33.656525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54392. [D 20:43:33.656540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54393. [D 20:43:33.656556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54394. [D 20:43:33.656571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54395. [D 20:43:33.656585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54396. [D 20:43:33.656600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54397. [D 20:43:33.656614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54398. [D 20:43:33.656628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54399. [D 20:43:33.656643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54400. [D 20:43:33.656657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54401. [D 20:43:33.656671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54402. [D 20:43:33.656686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54403. [D 20:43:33.656700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54404. [D 20:43:33.656714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54405. [D 20:43:33.656728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bfa0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54406. [D 20:43:33.662031] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 54406. [D 20:43:33.662101] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 5/70. [D 20:43:33.663137] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.663163] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.663177] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.667108] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7719 [D 20:43:33.667152] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 6/70. [D 20:43:33.667892] openib_check_cq: completed rdma wr_id 2aaaab60bfa0, nic_wr_credit 54405. [D 20:43:33.667943] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 7/70. [D 20:43:33.668001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.668022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.668035] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.668055] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.668069] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.668081] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:33.668297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54405. [D 20:43:33.668318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54406. [D 20:43:33.668336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54407. [D 20:43:33.668351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54408. [D 20:43:33.668365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54409. [D 20:43:33.668380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54410. [D 20:43:33.668394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54411. [D 20:43:33.668408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54412. [D 20:43:33.668423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54413. [D 20:43:33.668437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54414. [D 20:43:33.668452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54415. [D 20:43:33.668466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54416. [D 20:43:33.668480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54417. [D 20:43:33.668495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54418. [D 20:43:33.668509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54419. [D 20:43:33.668523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54420. [D 20:43:33.668538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54421. [D 20:43:33.668552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54422. [D 20:43:33.668566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54423. [D 20:43:33.668581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54424. [D 20:43:33.668595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54425. [D 20:43:33.668610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54426. [D 20:43:33.668624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54427. [D 20:43:33.668638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54428. [D 20:43:33.668654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54429. [D 20:43:33.668669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54430. [D 20:43:33.668683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54431. [D 20:43:33.668697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54432. [D 20:43:33.668712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54433. [D 20:43:33.668726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54434. [D 20:43:33.668740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54435. [D 20:43:33.668754] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54436. [D 20:43:33.674246] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54436. [D 20:43:33.674272] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 8/70. [D 20:43:33.676227] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.676242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.676255] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:33.693354] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.693375] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.693388] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:33.693418] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7724 [D 20:43:33.693432] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:33.693447] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 9/70. [D 20:43:33.693495] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.693508] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.693524] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.693550] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7728 [D 20:43:33.693564] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:33.693581] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 10/70. [D 20:43:33.693604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.693617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.693634] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.693654] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7729 [D 20:43:33.693668] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:33.693682] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 11/70. [D 20:43:33.693728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.693742] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.693755] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.693775] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7731 [D 20:43:33.693789] element 0: offset: 0x2aaaab036cb0, size: 24 [D 20:43:33.693807] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 12/70. [D 20:43:33.706278] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7724 [D 20:43:33.706372] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 13/70. [D 20:43:33.706402] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7728 [D 20:43:33.706418] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 14/70. [D 20:43:33.706433] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7729 [D 20:43:33.706448] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 15/70. [D 20:43:33.706529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54436. [D 20:43:33.706548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54437. [D 20:43:33.706563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54438. [D 20:43:33.706577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54439. [D 20:43:33.706591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54440. [D 20:43:33.706606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54441. [D 20:43:33.706620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54442. [D 20:43:33.706634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54443. [D 20:43:33.706649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54444. [D 20:43:33.706663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54445. [D 20:43:33.706677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54446. [D 20:43:33.706692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54447. [D 20:43:33.706706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54448. [D 20:43:33.706720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54449. [D 20:43:33.706734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54450. [D 20:43:33.706749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54451. [D 20:43:33.706763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54452. [D 20:43:33.706777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54453. [D 20:43:33.706792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54454. [D 20:43:33.706806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54455. [D 20:43:33.706820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54456. [D 20:43:33.706834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54457. [D 20:43:33.706849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54458. [D 20:43:33.706863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54459. [D 20:43:33.706877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54460. [D 20:43:33.706891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54461. [D 20:43:33.706906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54462. [D 20:43:33.706920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54463. [D 20:43:33.706934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54464. [D 20:43:33.706949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54465. [D 20:43:33.706966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54466. [D 20:43:33.706980] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54467. [D 20:43:33.706997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54468. [D 20:43:33.707012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54469. [D 20:43:33.707026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54470. [D 20:43:33.707039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54471. [D 20:43:33.707053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54472. [D 20:43:33.707067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54473. [D 20:43:33.707081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54474. [D 20:43:33.707095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54475. [D 20:43:33.707109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54476. [D 20:43:33.707122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54477. [D 20:43:33.707136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54478. [D 20:43:33.707150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54479. [D 20:43:33.707164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54480. [D 20:43:33.707178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54481. [D 20:43:33.707192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54482. [D 20:43:33.707206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54483. [D 20:43:33.707219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54484. [D 20:43:33.707233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54485. [D 20:43:33.707247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54486. [D 20:43:33.707261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54487. [D 20:43:33.707275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54488. [D 20:43:33.707289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54489. [D 20:43:33.707302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54490. [D 20:43:33.707317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54491. [D 20:43:33.707330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54492. [D 20:43:33.707344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54493. [D 20:43:33.707358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54494. [D 20:43:33.707373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54495. [D 20:43:33.707387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54496. [D 20:43:33.707401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54497. [D 20:43:33.707416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54498. [D 20:43:33.707430] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54499. [D 20:43:33.707446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54500. [D 20:43:33.707461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54501. [D 20:43:33.707475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54502. [D 20:43:33.707489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54503. [D 20:43:33.707504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54504. [D 20:43:33.707518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54505. [D 20:43:33.707532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54506. [E 20:43:33.707551] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54507, block for 10 ms. [D 20:43:33.708935] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7731 [D 20:43:33.718302] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54506. [D 20:43:33.718330] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 16/70. [D 20:43:33.718347] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54505. [D 20:43:33.718364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54506. [D 20:43:33.718379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54507. [D 20:43:33.718393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54508. [D 20:43:33.718408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54509. [D 20:43:33.718422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54510. [D 20:43:33.718437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54511. [D 20:43:33.718451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54512. [D 20:43:33.718465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54513. [D 20:43:33.718480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54514. [D 20:43:33.718494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54515. [D 20:43:33.718509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54516. [D 20:43:33.718523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54517. [D 20:43:33.718537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54518. [D 20:43:33.718553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54519. [D 20:43:33.718568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54520. [D 20:43:33.718581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54521. [D 20:43:33.718596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54522. [D 20:43:33.718610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54523. [D 20:43:33.718624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54524. [D 20:43:33.718639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54525. [D 20:43:33.718653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54526. [D 20:43:33.718667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54527. [D 20:43:33.718682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54528. [D 20:43:33.718696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54529. [D 20:43:33.718710] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bfa0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54530. [D 20:43:33.720222] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 17/70. [D 20:43:33.729884] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 54530. [D 20:43:33.729907] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 18/70. [D 20:43:33.734075] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.734092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.734106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.735789] openib_check_cq: completed rdma wr_id 2aaaab60bfa0, nic_wr_credit 54529. [D 20:43:33.735810] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 19/70. [D 20:43:33.736201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54529. [D 20:43:33.736229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54530. [D 20:43:33.736245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54531. [D 20:43:33.736260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54532. [D 20:43:33.736275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54533. [D 20:43:33.736297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54534. [D 20:43:33.736276] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.736320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54535. [D 20:43:33.736397] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.736403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54536. [D 20:43:33.736420] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.736437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54537. [D 20:43:33.736466] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.736466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54538. [D 20:43:33.736491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.736509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54539. [D 20:43:33.736522] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:33.736541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54540. [D 20:43:33.736569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54541. [D 20:43:33.736584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54542. [D 20:43:33.736598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54543. [D 20:43:33.736613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54544. [D 20:43:33.736627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54545. [D 20:43:33.736641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54546. [D 20:43:33.736656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54547. [D 20:43:33.736670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54548. [D 20:43:33.736684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54549. [D 20:43:33.736699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54550. [D 20:43:33.736713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54551. [D 20:43:33.736727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54552. [D 20:43:33.736741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54553. [D 20:43:33.736756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54554. [D 20:43:33.736770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54555. [D 20:43:33.736784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54556. [D 20:43:33.736798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54557. [D 20:43:33.736813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54558. [D 20:43:33.736827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54559. [D 20:43:33.736841] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6150f0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54560. [D 20:43:33.742152] openib_check_cq: completed rdma wr_id 2aaaab6150f0, nic_wr_credit 54560. [D 20:43:33.742167] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 20/70. [D 20:43:33.742223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.742242] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.742254] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:33.753131] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.753146] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.753159] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:33.753198] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7736 [D 20:43:33.753213] element 0: offset: 0x2aaaab025f90, size: 24 [D 20:43:33.753235] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 21/70. [D 20:43:33.755804] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.755861] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.755875] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:33.755914] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7740 [D 20:43:33.755929] element 0: offset: 0x2aaaab027160, size: 24 [D 20:43:33.755948] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 22/70. [D 20:43:33.755990] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.756004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.756016] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:33.756037] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7741 [D 20:43:33.756051] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:33.756065] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 23/70. [D 20:43:33.756622] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7736 [D 20:43:33.756648] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 24/70. [D 20:43:33.756838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54560. [D 20:43:33.756864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54561. [D 20:43:33.756879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54562. [D 20:43:33.756889] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.756916] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.756901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54563. [D 20:43:33.756958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54564. [D 20:43:33.756972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54565. [D 20:43:33.756986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54566. [D 20:43:33.757001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54567. [D 20:43:33.757015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54568. [D 20:43:33.757029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54569. [D 20:43:33.757043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54570. [D 20:43:33.757058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54571. [D 20:43:33.757072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54572. [D 20:43:33.757086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54573. [D 20:43:33.757100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54574. [D 20:43:33.757114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54575. [D 20:43:33.757128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54576. [D 20:43:33.757142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54577. [D 20:43:33.757157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54578. [D 20:43:33.757171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54579. [D 20:43:33.757186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54580. [D 20:43:33.757200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54581. [D 20:43:33.757215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54582. [D 20:43:33.757229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54583. [D 20:43:33.757243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54584. [D 20:43:33.757257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54585. [D 20:43:33.757271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54586. [D 20:43:33.757285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54587. [D 20:43:33.757299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54588. [D 20:43:33.757313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54589. [D 20:43:33.757328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54590. [D 20:43:33.757342] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54591. [D 20:43:33.756929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.760313] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7743 [D 20:43:33.760333] element 0: offset: 0x2aaaab025a40, size: 24 [D 20:43:33.760354] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 25/70. [D 20:43:33.763084] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7740 [D 20:43:33.763139] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 26/70. [D 20:43:33.763193] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7741 [D 20:43:33.763210] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 27/70. [D 20:43:33.767298] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54591. [D 20:43:33.767323] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 28/70. [D 20:43:33.767340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54591. [D 20:43:33.767354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54592. [D 20:43:33.767369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54593. [D 20:43:33.767383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54594. [D 20:43:33.767398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54595. [D 20:43:33.767412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54596. [D 20:43:33.767426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54597. [D 20:43:33.767440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54598. [D 20:43:33.767454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54599. [D 20:43:33.767468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54600. [D 20:43:33.767483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54601. [D 20:43:33.767498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54602. [D 20:43:33.767512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54603. [D 20:43:33.767527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54604. [D 20:43:33.767541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54605. [D 20:43:33.767555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54606. [D 20:43:33.767569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54607. [D 20:43:33.767584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54608. [D 20:43:33.767598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54609. [D 20:43:33.767612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54610. [D 20:43:33.767627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54611. [D 20:43:33.767641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54612. [D 20:43:33.767655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54613. [D 20:43:33.767669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54614. [D 20:43:33.767684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54615. [D 20:43:33.767698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54616. [D 20:43:33.767712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54617. [D 20:43:33.767726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54618. [D 20:43:33.767741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54619. [D 20:43:33.767755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54620. [D 20:43:33.767769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54621. [D 20:43:33.767783] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54622. [D 20:43:33.767799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54623. [D 20:43:33.767814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54624. [D 20:43:33.767828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54625. [D 20:43:33.767842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54626. [D 20:43:33.767857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54627. [D 20:43:33.767871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54628. [D 20:43:33.767885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54629. [D 20:43:33.767899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54630. [D 20:43:33.767914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54631. [D 20:43:33.767928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54632. [D 20:43:33.767943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54633. [D 20:43:33.767957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54634. [D 20:43:33.767971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54635. [D 20:43:33.767985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54636. [D 20:43:33.767999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54637. [D 20:43:33.768013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54638. [D 20:43:33.768028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54639. [D 20:43:33.768042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54640. [D 20:43:33.768056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54641. [D 20:43:33.768070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54642. [D 20:43:33.768085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54643. [D 20:43:33.768099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54644. [D 20:43:33.768113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54645. [D 20:43:33.768127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54646. [D 20:43:33.768141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54647. [D 20:43:33.768155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54648. [D 20:43:33.768170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54649. [D 20:43:33.768184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54650. [D 20:43:33.768198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54651. [D 20:43:33.768212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54652. [D 20:43:33.768232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54653. [D 20:43:33.768246] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bfa0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54654. [D 20:43:33.768321] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.768344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.768357] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.771459] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7743 [D 20:43:33.771527] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 29/70. [D 20:43:33.773672] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 54654. [D 20:43:33.773699] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 30/70. [D 20:43:33.775211] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:33.775236] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.775249] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:33.775291] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7746 [D 20:43:33.775306] element 0: offset: 0x2aaaab025ac0, size: 24 [D 20:43:33.775323] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 31/70. [D 20:43:33.785324] openib_check_cq: completed rdma wr_id 2aaaab60bfa0, nic_wr_credit 54653. [D 20:43:33.785350] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 32/70. [D 20:43:33.785368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54653. [D 20:43:33.785383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54654. [D 20:43:33.785397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54655. [D 20:43:33.785411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54656. [D 20:43:33.785426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54657. [D 20:43:33.785440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54658. [D 20:43:33.785454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54659. [D 20:43:33.785469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54660. [D 20:43:33.785483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54661. [D 20:43:33.785497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54662. [D 20:43:33.785512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54663. [D 20:43:33.785526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54664. [D 20:43:33.785540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54665. [D 20:43:33.785555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54666. [D 20:43:33.785569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54667. [D 20:43:33.785583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54668. [D 20:43:33.785598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54669. [D 20:43:33.785612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54670. [D 20:43:33.785626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54671. [D 20:43:33.785641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54672. [D 20:43:33.785655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54673. [D 20:43:33.785669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54674. [D 20:43:33.785684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54675. [D 20:43:33.785698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54676. [D 20:43:33.785712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54677. [D 20:43:33.785733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54678. [D 20:43:33.785747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54679. [D 20:43:33.785761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54680. [D 20:43:33.785775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54681. [D 20:43:33.785789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54682. [D 20:43:33.785803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54683. [D 20:43:33.785817] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54684. [D 20:43:33.785879] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.785900] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.785912] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:33.785933] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:33.785947] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:33.785959] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:33.789104] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7746 [D 20:43:33.789174] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 33/70. [D 20:43:33.797145] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54684. [D 20:43:33.797171] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 34/70. [D 20:43:33.797197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54684. [D 20:43:33.797212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54685. [D 20:43:33.797226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54686. [D 20:43:33.797241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54687. [D 20:43:33.797255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54688. [D 20:43:33.797270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54689. [D 20:43:33.797284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54690. [D 20:43:33.797298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54691. [D 20:43:33.797312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54692. [D 20:43:33.797327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54693. [D 20:43:33.797341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54694. [D 20:43:33.797356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54695. [D 20:43:33.797370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54696. [D 20:43:33.797384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54697. [D 20:43:33.797398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54698. [D 20:43:33.797413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54699. [D 20:43:34.079989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54700. [D 20:43:34.080013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54701. [D 20:43:34.080028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54702. [D 20:43:34.080043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54703. [D 20:43:34.080061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54704. [D 20:43:34.080075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54705. [D 20:43:34.080090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54706. [D 20:43:34.080104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54707. [D 20:43:34.080119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54708. [D 20:43:34.080133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54709. [D 20:43:34.080158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54710. [D 20:43:34.080173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54711. [D 20:43:34.080187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54712. [D 20:43:34.080202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54713. [D 20:43:34.081552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54714. [D 20:43:34.081576] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54715. [D 20:43:34.081640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.081665] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.081679] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.082930] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.082949] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.082961] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.082992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.083006] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.083018] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.083049] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7754 [D 20:43:34.083064] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:43:34.083081] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 35/70. [D 20:43:34.083112] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.083126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.083138] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.083158] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7755 [D 20:43:34.083172] element 0: offset: 0x2aaaab014800, size: 24 [D 20:43:34.083186] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 36/70. [D 20:43:34.083205] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7749 [D 20:43:34.083219] element 0: offset: 0x2aaaab0142c0, size: 24 [D 20:43:34.083233] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 37/70. [D 20:43:34.083264] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 54715. [D 20:43:34.083283] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 38/70. [D 20:43:34.086268] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.086285] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.086297] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.095147] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7754 [D 20:43:34.095222] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 39/70. [D 20:43:34.095314] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7755 [D 20:43:34.095322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54715. [D 20:43:34.095352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54716. [D 20:43:34.095367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54717. [D 20:43:34.095381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54718. [D 20:43:34.095395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54719. [D 20:43:34.095409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54720. [D 20:43:34.095423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54721. [D 20:43:34.095437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54722. [D 20:43:34.095451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54723. [D 20:43:34.095465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54724. [D 20:43:34.095479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54725. [D 20:43:34.095493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54726. [D 20:43:34.095508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54727. [D 20:43:34.095521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54728. [D 20:43:34.095535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54729. [D 20:43:34.095549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54730. [D 20:43:34.095563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54731. [D 20:43:34.095577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54732. [D 20:43:34.095591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54733. [D 20:43:34.095605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54734. [D 20:43:34.095619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54735. [D 20:43:34.095633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54736. [D 20:43:34.095647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54737. [D 20:43:34.095661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54738. [D 20:43:34.095675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54739. [D 20:43:34.095689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54740. [D 20:43:34.095703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54741. [D 20:43:34.095717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54742. [D 20:43:34.095731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54743. [D 20:43:34.095745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54744. [D 20:43:34.095801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54745. [D 20:43:34.095815] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54746. [D 20:43:34.095843] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 40/70. [D 20:43:34.095872] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7749 [D 20:43:34.095888] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 41/70. [D 20:43:34.101260] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54746. [D 20:43:34.101287] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 42/70. [D 20:43:34.101304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 54746. [D 20:43:34.101335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 54747. [D 20:43:34.101349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 54748. [D 20:43:34.101364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 54749. [D 20:43:34.101378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 54750. [D 20:43:34.101392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 54751. [D 20:43:34.101406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 54752. [D 20:43:34.101421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 54753. [D 20:43:34.101435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 54754. [D 20:43:34.101449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 54755. [D 20:43:34.101463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 54756. [D 20:43:34.101478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 54757. [D 20:43:34.101492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 54758. [D 20:43:34.101506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 54759. [D 20:43:34.101520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 54760. [D 20:43:34.101535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 54761. [D 20:43:34.101549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 54762. [D 20:43:34.101563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 54763. [D 20:43:34.101577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 54764. [D 20:43:34.101592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 54765. [D 20:43:34.101607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 54766. [D 20:43:34.101620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 54767. [D 20:43:34.101634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 54768. [D 20:43:34.101648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 54769. [D 20:43:34.101662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 54770. [D 20:43:34.101676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 54771. [D 20:43:34.101690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 54772. [D 20:43:34.101704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 54773. [D 20:43:34.101718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 54774. [D 20:43:34.101732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 54775. [D 20:43:34.101745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 54776. [D 20:43:34.101759] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 54777. [D 20:43:34.101775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 54778. [D 20:43:34.101789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 54779. [D 20:43:34.101803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54780. [D 20:43:34.101817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54781. [D 20:43:34.101831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54782. [D 20:43:34.101845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54783. [D 20:43:34.101859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54784. [D 20:43:34.101873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54785. [D 20:43:34.101886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54786. [D 20:43:34.101900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54787. [D 20:43:34.101914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54788. [D 20:43:34.101928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54789. [D 20:43:34.101942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54790. [D 20:43:34.101956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54791. [D 20:43:34.101970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54792. [D 20:43:34.101983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54793. [D 20:43:34.101997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54794. [D 20:43:34.102012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54795. [D 20:43:34.102026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54796. [D 20:43:34.102039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54797. [D 20:43:34.102053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54798. [D 20:43:34.102067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54799. [D 20:43:34.102081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54800. [D 20:43:34.102095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54801. [D 20:43:34.102109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54802. [D 20:43:34.102123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54803. [D 20:43:34.102137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54804. [D 20:43:34.102150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54805. [D 20:43:34.102164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54806. [D 20:43:34.102178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54807. [D 20:43:34.102192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54808. [D 20:43:34.102206] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614c20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54809. [D 20:43:34.102270] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.102290] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.102303] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.107274] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 54809. [D 20:43:34.107297] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 43/70. [D 20:43:34.109795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.109819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.109832] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.109871] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7759 [D 20:43:34.109886] element 0: offset: 0x2aaaab025f90, size: 24 [D 20:43:34.109907] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 44/70. [D 20:43:34.113842] openib_check_cq: completed rdma wr_id 2aaaab614c20, nic_wr_credit 54808. [D 20:43:34.113869] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 45/70. [D 20:43:34.113919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.113938] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.113951] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.114033] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.114047] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.114060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:34.117005] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7759 [D 20:43:34.117065] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 46/70. [D 20:43:34.119939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 54808. [D 20:43:34.119965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 54809. [D 20:43:34.119979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 54810. [D 20:43:34.119993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 54811. [D 20:43:34.120008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 54812. [D 20:43:34.120022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 54813. [D 20:43:34.120036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 54814. [D 20:43:34.120050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 54815. [D 20:43:34.120064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 54816. [D 20:43:34.120078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 54817. [D 20:43:34.120092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 54818. [D 20:43:34.120106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 54819. [D 20:43:34.120120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 54820. [D 20:43:34.120134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 54821. [D 20:43:34.120148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 54822. [D 20:43:34.120162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 54823. [D 20:43:34.120176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 54824. [D 20:43:34.120191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 54825. [D 20:43:34.120205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 54826. [D 20:43:34.120222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 54827. [D 20:43:34.120237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 54828. [D 20:43:34.120251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 54829. [D 20:43:34.120267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 54830. [D 20:43:34.120281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 54831. [D 20:43:34.120296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 54832. [D 20:43:34.120310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 54833. [D 20:43:34.120324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 54834. [D 20:43:34.120338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 54835. [D 20:43:34.120352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 54836. [D 20:43:34.120370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 54837. [D 20:43:34.120384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 54838. [D 20:43:34.120399] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 54839. [D 20:43:34.125964] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54839. [D 20:43:34.125985] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 47/70. [D 20:43:34.126066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.126088] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.126100] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.136792] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.136810] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.136823] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.136861] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7761 [D 20:43:34.136876] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:34.136893] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 48/70. [D 20:43:34.139875] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7761 [D 20:43:34.139941] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 49/70. [D 20:43:34.140080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 54839. [D 20:43:34.140106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 54840. [D 20:43:34.140121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 54841. [D 20:43:34.140135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 54842. [D 20:43:34.140149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 54843. [D 20:43:34.140163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 54844. [D 20:43:34.140178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 54845. [D 20:43:34.140192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 54846. [D 20:43:34.140206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 54847. [D 20:43:34.140224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 54848. [D 20:43:34.140238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 54849. [D 20:43:34.140252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 54850. [D 20:43:34.140267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 54851. [D 20:43:34.140281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 54852. [D 20:43:34.140295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 54853. [D 20:43:34.140309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 54854. [D 20:43:34.140323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 54855. [D 20:43:34.140338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 54856. [D 20:43:34.140352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 54857. [D 20:43:34.140369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 54858. [D 20:43:34.140385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 54859. [D 20:43:34.140399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 54860. [D 20:43:34.140413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 54861. [D 20:43:34.140427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 54862. [D 20:43:34.140441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 54863. [D 20:43:34.140455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 54864. [D 20:43:34.140469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 54865. [D 20:43:34.140483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 54866. [D 20:43:34.140497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 54867. [D 20:43:34.140511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 54868. [D 20:43:34.140525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 54869. [D 20:43:34.140539] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 54870. [D 20:43:34.151132] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54870. [D 20:43:34.151154] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 50/70. [D 20:43:34.151236] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.151258] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.151271] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.160977] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.160996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.161008] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.161046] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7764 [D 20:43:34.161061] element 0: offset: 0x2aaaab033950, size: 24 [D 20:43:34.161077] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 51/70. [D 20:43:34.164109] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7764 [D 20:43:34.164181] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 52/70. [D 20:43:34.164330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54870. [D 20:43:34.164355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54871. [D 20:43:34.164373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54872. [D 20:43:34.164388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54873. [D 20:43:34.164402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54874. [D 20:43:34.164416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54875. [D 20:43:34.164430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54876. [D 20:43:34.164444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54877. [D 20:43:34.164458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54878. [D 20:43:34.164474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54879. [D 20:43:34.164488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54880. [D 20:43:34.164502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54881. [D 20:43:34.164516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54882. [D 20:43:34.164530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54883. [D 20:43:34.164545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54884. [D 20:43:34.164559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54885. [D 20:43:34.164573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54886. [D 20:43:34.164588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54887. [D 20:43:34.164602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54888. [D 20:43:34.164616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54889. [D 20:43:34.164631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54890. [D 20:43:34.164645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54891. [D 20:43:34.164659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54892. [D 20:43:34.164673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54893. [D 20:43:34.164688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54894. [D 20:43:34.164702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54895. [D 20:43:34.164716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54896. [D 20:43:34.164730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54897. [D 20:43:34.164745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54898. [D 20:43:34.164759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54899. [D 20:43:34.164773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54900. [D 20:43:34.164787] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54901. [D 20:43:34.175137] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54901. [D 20:43:34.175159] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 53/70. [D 20:43:34.175240] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.175262] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.175275] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.185353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.185371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.185383] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.185420] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7767 [D 20:43:34.185435] element 0: offset: 0x2aaaab025a40, size: 24 [D 20:43:34.185453] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 54/70. [D 20:43:34.188459] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7767 [D 20:43:34.188527] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 55/70. [D 20:43:34.188667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54901. [D 20:43:34.188692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54902. [D 20:43:34.188707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54903. [D 20:43:34.188721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54904. [D 20:43:34.188735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54905. [D 20:43:34.188750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54906. [D 20:43:34.188764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54907. [D 20:43:34.188778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54908. [D 20:43:34.188793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54909. [D 20:43:34.188807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54910. [D 20:43:34.188821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54911. [D 20:43:34.188836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54912. [D 20:43:34.188850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54913. [D 20:43:34.188864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54914. [D 20:43:34.188878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54915. [D 20:43:34.188893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54916. [D 20:43:34.188907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54917. [D 20:43:34.188921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54918. [D 20:43:34.188936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54919. [D 20:43:34.188950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54920. [D 20:43:34.188965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54921. [D 20:43:34.188979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54922. [D 20:43:34.188993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54923. [D 20:43:34.189008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54924. [D 20:43:34.189022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54925. [D 20:43:34.189036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54926. [D 20:43:34.189050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54927. [D 20:43:34.189065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54928. [D 20:43:34.189080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54929. [D 20:43:34.189094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54930. [D 20:43:34.189108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54931. [D 20:43:34.189122] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54932. [D 20:43:34.199616] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54932. [D 20:43:34.199637] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 56/70. [D 20:43:34.199719] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.199740] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.199754] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.209417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.209434] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.209446] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.209483] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7770 [D 20:43:34.209497] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:43:34.209513] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 57/70. [D 20:43:34.212569] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7770 [D 20:43:34.212635] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 58/70. [D 20:43:34.212784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54932. [D 20:43:34.212809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54933. [D 20:43:34.212824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54934. [D 20:43:34.212838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54935. [D 20:43:34.212852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54936. [D 20:43:34.212866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54937. [D 20:43:34.212881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54938. [D 20:43:34.212895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54939. [D 20:43:34.212909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54940. [D 20:43:34.212923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54941. [D 20:43:34.212937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54942. [D 20:43:34.212952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54943. [D 20:43:34.212966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54944. [D 20:43:34.212980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54945. [D 20:43:34.212994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54946. [D 20:43:34.213008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54947. [D 20:43:34.213023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54948. [D 20:43:34.213038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54949. [D 20:43:34.213052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54950. [D 20:43:34.213066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54951. [D 20:43:34.213081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54952. [D 20:43:34.213095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54953. [D 20:43:34.213110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54954. [D 20:43:34.213124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54955. [D 20:43:34.213138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54956. [D 20:43:34.213152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54957. [D 20:43:34.213166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54958. [D 20:43:34.213180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54959. [D 20:43:34.213195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54960. [D 20:43:34.213209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54961. [D 20:43:34.213223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54962. [D 20:43:34.213237] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54963. [D 20:43:34.223694] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54963. [D 20:43:34.223716] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 59/70. [D 20:43:34.223796] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.223818] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.223831] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.240493] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.240512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.240525] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.240562] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7773 [D 20:43:34.240577] element 0: offset: 0x2aaaab025ac0, size: 24 [D 20:43:34.240593] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 60/70. [D 20:43:34.243862] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7773 [D 20:43:34.243937] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 0/70. [D 20:43:34.244088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54963. [D 20:43:34.244113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54964. [D 20:43:34.244128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54965. [D 20:43:34.244142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54966. [D 20:43:34.244157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54967. [D 20:43:34.244171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54968. [D 20:43:34.244186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 54969. [D 20:43:34.244200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 54970. [D 20:43:34.244214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 54971. [D 20:43:34.244231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 54972. [D 20:43:34.244246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 54973. [D 20:43:34.244260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 54974. [D 20:43:34.244274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 54975. [D 20:43:34.244288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 54976. [D 20:43:34.244303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 54977. [D 20:43:34.244317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 54978. [D 20:43:34.244331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 54979. [D 20:43:34.244345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 54980. [D 20:43:34.244360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 54981. [D 20:43:34.244377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 54982. [D 20:43:34.244392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 54983. [D 20:43:34.244406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 54984. [D 20:43:34.244420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 54985. [D 20:43:34.244434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 54986. [D 20:43:34.244448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 54987. [D 20:43:34.244463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 54988. [D 20:43:34.244477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 54989. [D 20:43:34.244491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 54990. [D 20:43:34.244505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 54991. [D 20:43:34.244520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 54992. [D 20:43:34.244534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 54993. [D 20:43:34.244548] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 54994. [D 20:43:34.254869] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 54994. [D 20:43:34.254888] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 1/70. [D 20:43:34.254970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.254992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.255005] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:34.263938] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.263957] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.263970] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:34.264008] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7776 [D 20:43:34.264023] element 0: offset: 0x2aaaab002010, size: 24 [D 20:43:34.264039] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 2/70. [D 20:43:34.267359] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7776 [D 20:43:34.267436] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 3/70. [D 20:43:34.267580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 54994. [D 20:43:34.267604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 54995. [D 20:43:34.267619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 54996. [D 20:43:34.267633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 54997. [D 20:43:34.267648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 54998. [D 20:43:34.267662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 54999. [D 20:43:34.267676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55000. [D 20:43:34.267690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55001. [D 20:43:34.267705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55002. [D 20:43:34.267719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55003. [D 20:43:34.267733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55004. [D 20:43:34.267748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55005. [D 20:43:34.267762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55006. [D 20:43:34.267776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55007. [D 20:43:34.267790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55008. [D 20:43:34.267805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55009. [D 20:43:34.267819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55010. [D 20:43:34.267833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55011. [D 20:43:34.267847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55012. [D 20:43:34.267862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55013. [D 20:43:34.267876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55014. [D 20:43:34.267890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55015. [D 20:43:34.267905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55016. [D 20:43:34.267919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55017. [D 20:43:34.267933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55018. [D 20:43:34.267948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55019. [D 20:43:34.267962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55020. [D 20:43:34.267977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55021. [D 20:43:34.267991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55022. [D 20:43:34.268005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55023. [D 20:43:34.268020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55024. [D 20:43:34.268034] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55025. [D 20:43:34.274892] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.274915] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.274929] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:34.274973] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7780 [D 20:43:34.274988] element 0: offset: 0x2aaaab014410, size: 24 [D 20:43:34.275004] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 4/70. [D 20:43:34.275041] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.275055] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.275068] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.275088] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7783 [D 20:43:34.275102] element 0: offset: 0x2aaaab014800, size: 24 [D 20:43:34.275116] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 5/70. [D 20:43:34.278446] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55025. [D 20:43:34.278470] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 6/70. [D 20:43:34.278617] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.278637] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.278650] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.284299] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7780 [D 20:43:34.284328] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 7/70. [D 20:43:34.284466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55025. [D 20:43:34.284485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55026. [D 20:43:34.284499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55027. [D 20:43:34.284514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55028. [D 20:43:34.284528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55029. [D 20:43:34.284543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55030. [D 20:43:34.284558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55031. [D 20:43:34.284572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55032. [D 20:43:34.284587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55033. [D 20:43:34.284601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55034. [D 20:43:34.284616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55035. [D 20:43:34.284631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55036. [D 20:43:34.284645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55037. [D 20:43:34.284660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55038. [D 20:43:34.284674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55039. [D 20:43:34.284689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55040. [D 20:43:34.284703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55041. [D 20:43:34.284717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55042. [D 20:43:34.284731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55043. [D 20:43:34.284745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55044. [D 20:43:34.284760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55045. [D 20:43:34.284774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55046. [D 20:43:34.284788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55047. [D 20:43:34.284802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55048. [D 20:43:34.284816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55049. [D 20:43:34.284831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55050. [D 20:43:34.284845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55051. [D 20:43:34.284859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55052. [D 20:43:34.284873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55053. [D 20:43:34.284887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55054. [D 20:43:34.284902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55055. [D 20:43:34.284916] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55056. [D 20:43:34.286788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.286858] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.286872] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.286915] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7785 [D 20:43:34.286930] element 0: offset: 0x2aaaab025f90, size: 24 [D 20:43:34.286953] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 8/70. [D 20:43:34.290645] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7783 [D 20:43:34.290673] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 9/70. [D 20:43:34.296231] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55056. [D 20:43:34.296248] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 10/70. [D 20:43:34.296278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55056. [D 20:43:34.296294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55057. [D 20:43:34.296309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55058. [D 20:43:34.296324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55059. [D 20:43:34.296338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55060. [D 20:43:34.296352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55061. [D 20:43:34.296367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55062. [D 20:43:34.296384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55063. [D 20:43:34.296399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55064. [D 20:43:34.296413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55065. [D 20:43:34.296427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55066. [D 20:43:34.296442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55067. [D 20:43:34.296456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55068. [D 20:43:34.296470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55069. [D 20:43:34.296485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55070. [D 20:43:34.296499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55071. [D 20:43:34.296513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55072. [D 20:43:34.296528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55073. [D 20:43:34.296542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55074. [D 20:43:34.296556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55075. [D 20:43:34.296571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55076. [D 20:43:34.296585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55077. [D 20:43:34.296600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55078. [D 20:43:34.296614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55079. [D 20:43:34.296628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55080. [D 20:43:34.296642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55081. [D 20:43:34.296657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55082. [D 20:43:34.296671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55083. [D 20:43:34.296685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55084. [D 20:43:34.296699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55085. [D 20:43:34.296714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55086. [D 20:43:34.299382] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7785 [D 20:43:34.525583] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55087. [D 20:43:34.525614] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 11/70. [D 20:43:34.525833] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.525900] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.525914] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.525946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.525960] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.525959] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55087. [D 20:43:34.526006] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 12/70. [D 20:43:34.525984] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.526050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 55087. [D 20:43:34.526070] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7788 [D 20:43:34.526069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 55088. [D 20:43:34.526478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55089. [D 20:43:34.526493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55090. [D 20:43:34.526507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55091. [D 20:43:34.526521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55092. [D 20:43:34.526535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55093. [D 20:43:34.526549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55094. [D 20:43:34.526563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55095. [D 20:43:34.526577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55096. [D 20:43:34.526591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55097. [D 20:43:34.526605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55098. [D 20:43:34.526618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55099. [D 20:43:34.526632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55100. [D 20:43:34.526646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55101. [D 20:43:34.526660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55102. [D 20:43:34.526674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55103. [D 20:43:34.526688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55104. [D 20:43:34.526702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55105. [D 20:43:34.526716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55106. [D 20:43:34.526730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55107. [D 20:43:34.526745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55108. [D 20:43:34.526759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55109. [D 20:43:34.526773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55110. [D 20:43:34.526787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55111. [D 20:43:34.526257] element 0: offset: 0x2aaaab0142c0, size: 24 [D 20:43:34.526807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55112. [D 20:43:34.527405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55113. [D 20:43:34.527424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55114. [D 20:43:34.527438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55115. [D 20:43:34.527452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55116. [D 20:43:34.527466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55117. [D 20:43:34.527481] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55118. [D 20:43:34.527633] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 13/70. [D 20:43:34.527684] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.527698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.527711] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.527734] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7791 [D 20:43:34.527748] element 0: offset: 0x2aaaab002070, size: 24 [D 20:43:34.527764] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 14/70. [D 20:43:34.527796] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.527810] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.527822] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.532245] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55118. [D 20:43:34.532268] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 15/70. [D 20:43:34.532404] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.532427] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.532440] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.540510] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7788 [D 20:43:34.540578] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 16/70. [D 20:43:34.540606] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7791 [D 20:43:34.540627] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 17/70. [D 20:43:34.540604] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.540716] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.540735] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.540804] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7795 [D 20:43:34.540818] element 0: offset: 0x2aaaab025a40, size: 24 [D 20:43:34.540718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55118. [D 20:43:34.540842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55119. [D 20:43:34.540857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55120. [D 20:43:34.540871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55121. [D 20:43:34.540886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55122. [D 20:43:34.540900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55123. [D 20:43:34.540915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55124. [D 20:43:34.540929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55125. [D 20:43:34.540943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55126. [D 20:43:34.540981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55127. [D 20:43:34.541003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55128. [D 20:43:34.541018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55129. [D 20:43:34.541032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55130. [D 20:43:34.541046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55131. [D 20:43:34.541061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55132. [D 20:43:34.541075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55133. [D 20:43:34.541097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55134. [D 20:43:34.541112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55135. [D 20:43:34.541126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55136. [D 20:43:34.541141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55137. [D 20:43:34.541155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55138. [D 20:43:34.541170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55139. [D 20:43:34.541184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55140. [D 20:43:34.541198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55141. [D 20:43:34.541213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55142. [D 20:43:34.541227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55143. [D 20:43:34.541242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55144. [D 20:43:34.541256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55145. [D 20:43:34.541270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55146. [D 20:43:34.541285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55147. [D 20:43:34.541299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55148. [D 20:43:34.541314] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55149. [D 20:43:34.541333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55150. [D 20:43:34.541349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55151. [D 20:43:34.541363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55152. [D 20:43:34.541381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55153. [D 20:43:34.541395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55154. [D 20:43:34.541409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55155. [D 20:43:34.541425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55156. [D 20:43:34.541439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55157. [D 20:43:34.541453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55158. [D 20:43:34.541468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55159. [D 20:43:34.541482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55160. [D 20:43:34.541497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55161. [D 20:43:34.541512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55162. [D 20:43:34.541526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55163. [D 20:43:34.541541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55164. [D 20:43:34.541555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55165. [D 20:43:34.541569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55166. [D 20:43:34.541584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55167. [D 20:43:34.541598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55168. [D 20:43:34.541613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55169. [D 20:43:34.541631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55170. [D 20:43:34.541693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55171. [D 20:43:34.541707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55172. [D 20:43:34.541721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55173. [D 20:43:34.541736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55174. [D 20:43:34.541750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55175. [D 20:43:34.541764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55176. [D 20:43:34.541779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55177. [D 20:43:34.541793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55178. [D 20:43:34.541807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55179. [D 20:43:34.541827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55180. [D 20:43:34.541842] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55181. [D 20:43:34.541863] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 18/70. [D 20:43:34.541899] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.541913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.541926] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.541949] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7797 [D 20:43:34.541963] element 0: offset: 0x2aaaab02e490, size: 24 [D 20:43:34.541977] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 19/70. [D 20:43:34.551840] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55181. [D 20:43:34.551862] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 20/70. [D 20:43:34.561320] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55180. [D 20:43:34.561351] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 21/70. [D 20:43:34.561418] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.561438] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.561451] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.561564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.561579] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.561592] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.567420] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7795 [D 20:43:34.567492] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 22/70. [D 20:43:34.567570] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7797 [D 20:43:34.567588] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 23/70. [D 20:43:34.572416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55180. [D 20:43:34.572443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55181. [D 20:43:34.572457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55182. [D 20:43:34.572472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55183. [D 20:43:34.572486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55184. [D 20:43:34.572500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55185. [D 20:43:34.572514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55186. [D 20:43:34.572528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55187. [D 20:43:34.572542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55188. [D 20:43:34.572556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55189. [D 20:43:34.572570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55190. [D 20:43:34.572584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55191. [D 20:43:34.572598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55192. [D 20:43:34.572612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55193. [D 20:43:34.572626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55194. [D 20:43:34.572640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55195. [D 20:43:34.572655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55196. [D 20:43:34.572669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55197. [D 20:43:34.572683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55198. [D 20:43:34.572698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55199. [D 20:43:34.572712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55200. [D 20:43:34.572727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55201. [D 20:43:34.572741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55202. [D 20:43:34.572755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55203. [D 20:43:34.572770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55204. [D 20:43:34.572784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55205. [D 20:43:34.572798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55206. [D 20:43:34.572813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55207. [D 20:43:34.572827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55208. [D 20:43:34.572841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55209. [D 20:43:34.572856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55210. [D 20:43:34.572870] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55211. [D 20:43:34.572887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55212. [D 20:43:34.572902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55213. [D 20:43:34.572916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55214. [D 20:43:34.572930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55215. [D 20:43:34.572945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55216. [D 20:43:34.572959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55217. [D 20:43:34.572973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55218. [D 20:43:34.572988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55219. [D 20:43:34.573002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55220. [D 20:43:34.573016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55221. [D 20:43:34.573031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55222. [D 20:43:34.573045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55223. [D 20:43:34.573061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55224. [D 20:43:34.573075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55225. [D 20:43:34.573089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55226. [D 20:43:34.573103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55227. [D 20:43:34.573117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55228. [D 20:43:34.573130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55229. [D 20:43:34.573144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55230. [D 20:43:34.573158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55231. [D 20:43:34.573172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55232. [D 20:43:34.573186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55233. [D 20:43:34.573200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55234. [D 20:43:34.573214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55235. [D 20:43:34.573228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55236. [D 20:43:34.573242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55237. [D 20:43:34.573256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55238. [D 20:43:34.573269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55239. [D 20:43:34.573283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55240. [D 20:43:34.573297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55241. [D 20:43:34.573311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55242. [D 20:43:34.573325] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55243. [D 20:43:34.575218] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.575241] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.575254] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.575298] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7801 [D 20:43:34.575313] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:43:34.575331] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 24/70. [D 20:43:34.575370] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.575384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.575396] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.575416] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7803 [D 20:43:34.575430] element 0: offset: 0x2aaaab025ac0, size: 24 [D 20:43:34.575446] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 25/70. [D 20:43:34.578304] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55243. [D 20:43:34.578332] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 26/70. [D 20:43:34.588137] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55242. [D 20:43:34.588159] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 27/70. [D 20:43:34.588224] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.588245] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.588258] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.588367] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.588382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.588395] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.592326] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7801 [D 20:43:34.592403] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 28/70. [D 20:43:34.593537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55242. [D 20:43:34.593561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55243. [D 20:43:34.593576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55244. [D 20:43:34.593591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55245. [D 20:43:34.593606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55246. [D 20:43:34.593620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55247. [D 20:43:34.593635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55248. [D 20:43:34.593649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55249. [D 20:43:34.593664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55250. [D 20:43:34.593679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55251. [D 20:43:34.593693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55252. [D 20:43:34.593708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55253. [D 20:43:34.593723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55254. [D 20:43:34.593737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55255. [D 20:43:34.593751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55256. [D 20:43:34.593766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55257. [D 20:43:34.593780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55258. [D 20:43:34.593795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55259. [D 20:43:34.593809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55260. [D 20:43:34.593824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55261. [D 20:43:34.593839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55262. [D 20:43:34.593853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55263. [D 20:43:34.593868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55264. [D 20:43:34.593882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55265. [D 20:43:34.593897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55266. [D 20:43:34.593912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55267. [D 20:43:34.593927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55268. [D 20:43:34.593941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55269. [D 20:43:34.593956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55270. [D 20:43:34.593970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55271. [D 20:43:34.593984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55272. [D 20:43:34.593999] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55273. [D 20:43:34.594376] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7803 [D 20:43:34.594430] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 29/70. [D 20:43:34.601779] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.601799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.601812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.601844] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55273. [D 20:43:34.601854] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7808 [D 20:43:34.601874] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 30/70. [D 20:43:34.601885] element 0: offset: 0x2aaaab002010, size: 24 [D 20:43:34.601918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55273. [D 20:43:34.601939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55274. [D 20:43:34.601954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55275. [D 20:43:34.601968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55276. [D 20:43:34.601983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55277. [D 20:43:34.601997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55278. [D 20:43:34.602011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55279. [D 20:43:34.602025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55280. [D 20:43:34.602040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55281. [D 20:43:34.602054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55282. [D 20:43:34.602069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55283. [D 20:43:34.602083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55284. [D 20:43:34.602097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55285. [D 20:43:34.602112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55286. [D 20:43:34.602126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55287. [D 20:43:34.602140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55288. [D 20:43:34.602156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55289. [D 20:43:34.602170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55290. [D 20:43:34.602184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55291. [D 20:43:34.602199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55292. [D 20:43:34.602213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55293. [D 20:43:34.602227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55294. [D 20:43:34.602242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55295. [D 20:43:34.602256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55296. [D 20:43:34.602270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55297. [D 20:43:34.602284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55298. [D 20:43:34.602299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55299. [D 20:43:34.602313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55300. [D 20:43:34.602327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55301. [D 20:43:34.602342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55302. [D 20:43:34.602356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55303. [D 20:43:34.602370] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55304. [D 20:43:34.602397] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 31/70. [D 20:43:34.602444] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.602460] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.602474] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.602515] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7809 [D 20:43:34.602529] element 0: offset: 0x2aaaab014800, size: 24 [D 20:43:34.602543] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 32/70. [D 20:43:34.602583] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.602597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.602610] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.607903] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55304. [D 20:43:34.607929] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 33/70. [D 20:43:34.608059] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.608078] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.608090] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.612269] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7808 [D 20:43:34.612350] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 34/70. [D 20:43:34.613773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55304. [D 20:43:34.613797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55305. [D 20:43:34.613812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55306. [D 20:43:34.613827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55307. [D 20:43:34.613841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55308. [D 20:43:34.613855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55309. [D 20:43:34.613869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55310. [D 20:43:34.613896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55311. [D 20:43:34.613911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55312. [D 20:43:34.613925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55313. [D 20:43:34.613939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55314. [D 20:43:34.613953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55315. [D 20:43:34.613968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55316. [D 20:43:34.613982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55317. [D 20:43:34.613997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55318. [D 20:43:34.614011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55319. [D 20:43:34.614025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55320. [D 20:43:34.614039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55321. [D 20:43:34.614054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55322. [D 20:43:34.614069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55323. [D 20:43:34.614083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55324. [D 20:43:34.614098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55325. [D 20:43:34.614112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55326. [D 20:43:34.614127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55327. [D 20:43:34.614142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55328. [D 20:43:34.614156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55329. [D 20:43:34.614164] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7809 [D 20:43:34.614171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55330. [D 20:43:34.614303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55331. [D 20:43:34.614317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55332. [D 20:43:34.614406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55333. [D 20:43:34.614427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55334. [D 20:43:34.614442] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55335. [D 20:43:34.614474] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 35/70. [D 20:43:34.614541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.614559] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.614572] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.614613] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7812 [D 20:43:34.614628] element 0: offset: 0x2aaaab025f90, size: 24 [D 20:43:34.614647] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 36/70. [D 20:43:34.616569] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.616585] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.616598] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.616620] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7815 [D 20:43:34.616634] element 0: offset: 0x2aaaab0142c0, size: 24 [D 20:43:34.616650] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 37/70. [D 20:43:34.625508] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55335. [D 20:43:34.625534] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 38/70. [D 20:43:34.625561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55335. [D 20:43:34.625577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55336. [D 20:43:34.625591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55337. [D 20:43:34.625605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55338. [D 20:43:34.625620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55339. [D 20:43:34.625635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55340. [D 20:43:34.625649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55341. [D 20:43:34.625664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55342. [D 20:43:34.625678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55343. [D 20:43:34.625693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55344. [D 20:43:34.625708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55345. [D 20:43:34.625722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55346. [D 20:43:34.625737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55347. [D 20:43:34.625751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55348. [D 20:43:34.625766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55349. [D 20:43:34.625780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55350. [D 20:43:34.625794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55351. [D 20:43:34.625808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55352. [D 20:43:34.625823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55353. [D 20:43:34.625838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55354. [D 20:43:34.625853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55355. [D 20:43:34.625867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55356. [D 20:43:34.625881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55357. [D 20:43:34.625895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55358. [D 20:43:34.625909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55359. [D 20:43:34.625924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55360. [D 20:43:34.625938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55361. [D 20:43:34.625952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55362. [D 20:43:34.625967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55363. [D 20:43:34.625981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55364. [D 20:43:34.625995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55365. [D 20:43:34.626009] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55366. [D 20:43:34.626066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.626089] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.626102] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.631888] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55366. [D 20:43:34.631910] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 39/70. [D 20:43:34.632056] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.632122] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.632135] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.632180] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7812 [D 20:43:34.632207] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 40/70. [D 20:43:34.632262] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7815 [D 20:43:34.632279] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 41/70. [D 20:43:34.637513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55366. [D 20:43:34.637537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55367. [D 20:43:34.637551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55368. [D 20:43:34.637565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55369. [D 20:43:34.637580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55370. [D 20:43:34.637594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55371. [D 20:43:34.637608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55372. [D 20:43:34.637622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55373. [D 20:43:34.637636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55374. [D 20:43:34.637652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55375. [D 20:43:34.637666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55376. [D 20:43:34.637680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55377. [D 20:43:34.637694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55378. [D 20:43:34.637708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55379. [D 20:43:34.637723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55380. [D 20:43:34.637737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55381. [D 20:43:34.637751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55382. [D 20:43:34.637765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55383. [D 20:43:34.637780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55384. [D 20:43:34.637794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55385. [D 20:43:34.637808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55386. [D 20:43:34.637822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55387. [D 20:43:34.637849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55388. [D 20:43:34.637864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55389. [D 20:43:34.637878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55390. [D 20:43:34.637893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55391. [D 20:43:34.637907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55392. [D 20:43:34.637921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55393. [D 20:43:34.637935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55394. [D 20:43:34.637954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55395. [D 20:43:34.637968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55396. [D 20:43:34.637982] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55397. [D 20:43:34.637999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55398. [D 20:43:34.638013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55399. [D 20:43:34.638028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55400. [D 20:43:34.638042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55401. [D 20:43:34.638056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55402. [D 20:43:34.638070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55403. [D 20:43:34.638086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55404. [D 20:43:34.638100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55405. [D 20:43:34.638114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55406. [D 20:43:34.638128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55407. [D 20:43:34.638142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55408. [D 20:43:34.638156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55409. [D 20:43:34.638170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55410. [D 20:43:34.638184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55411. [D 20:43:34.638198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55412. [D 20:43:34.638212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55413. [D 20:43:34.638227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55414. [D 20:43:34.638241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55415. [D 20:43:34.638255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55416. [D 20:43:34.638269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55417. [D 20:43:34.638283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55418. [D 20:43:34.638298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55419. [D 20:43:34.638312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55420. [D 20:43:34.638326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55421. [D 20:43:34.638340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55422. [D 20:43:34.638354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55423. [D 20:43:34.638368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55424. [D 20:43:34.638382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55425. [D 20:43:34.638396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55426. [D 20:43:34.638410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55427. [D 20:43:34.638424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55428. [D 20:43:34.638439] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d200 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55429. [D 20:43:34.638490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.638512] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.638524] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.638564] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7819 [D 20:43:34.638579] element 0: offset: 0x2aaaab033950, size: 24 [D 20:43:34.638600] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 42/70. [D 20:43:34.640163] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.640180] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.640192] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.640214] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7821 [D 20:43:34.640234] element 0: offset: 0x2aaaab025a40, size: 24 [D 20:43:34.640249] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 43/70. [D 20:43:34.649077] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55429. [D 20:43:34.649102] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 44/70. [D 20:43:34.656291] openib_check_cq: completed rdma wr_id 2aaaab60d200, nic_wr_credit 55428. [D 20:43:34.656310] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 45/70. [D 20:43:34.656365] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.656386] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.656399] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.656512] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.656527] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.656539] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:34.662712] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7819 [D 20:43:34.662793] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 46/70. [D 20:43:34.662874] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7821 [D 20:43:34.662892] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 47/70. [D 20:43:34.667854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55428. [D 20:43:34.667878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55429. [D 20:43:34.667892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55430. [D 20:43:34.667907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55431. [D 20:43:34.667922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55432. [D 20:43:34.667936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55433. [D 20:43:34.667950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55434. [D 20:43:34.667965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55435. [D 20:43:34.667979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55436. [D 20:43:34.667994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55437. [D 20:43:34.668008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55438. [D 20:43:34.668023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55439. [D 20:43:34.668037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55440. [D 20:43:34.668051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55441. [D 20:43:34.668066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55442. [D 20:43:34.668080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55443. [D 20:43:34.668094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55444. [D 20:43:34.983037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55445. [D 20:43:34.983061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55446. [D 20:43:34.983075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55447. [D 20:43:34.983090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55448. [D 20:43:34.983104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55449. [D 20:43:34.983119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55450. [D 20:43:34.983133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55451. [D 20:43:34.983148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55452. [D 20:43:34.983162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55453. [D 20:43:34.983176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55454. [D 20:43:34.983190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55455. [D 20:43:34.983205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55456. [D 20:43:34.983219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55457. [D 20:43:34.983233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55458. [D 20:43:34.983247] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55459. [D 20:43:34.983266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55460. [D 20:43:34.983280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55461. [D 20:43:34.983295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55462. [D 20:43:34.983309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55463. [D 20:43:34.983323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55464. [D 20:43:34.983338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55465. [D 20:43:34.983352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55466. [D 20:43:34.983366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55467. [D 20:43:34.983380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55468. [D 20:43:34.983395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55469. [D 20:43:34.983409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55470. [D 20:43:34.983423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55471. [D 20:43:34.983438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55472. [D 20:43:34.983452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55473. [D 20:43:34.983467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55474. [D 20:43:34.983481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55475. [D 20:43:34.983495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55476. [D 20:43:34.983510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55477. [D 20:43:34.983523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55478. [D 20:43:34.983538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55479. [D 20:43:34.983552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55480. [D 20:43:34.983566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55481. [D 20:43:34.983580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55482. [D 20:43:34.983594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55483. [D 20:43:34.983608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55484. [D 20:43:34.983622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55485. [D 20:43:34.983637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55486. [D 20:43:34.983651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55487. [D 20:43:34.983665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55488. [D 20:43:34.983679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55489. [D 20:43:34.983693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55490. [D 20:43:34.983707] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6136c0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55491. [D 20:43:34.985047] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.985071] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.985084] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:34.985127] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7825 [D 20:43:34.985142] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:34.985159] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 48/70. [D 20:43:34.985195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:34.985209] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.985221] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:34.985242] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7827 [D 20:43:34.985255] element 0: offset: 0x2aaaab025f40, size: 24 [D 20:43:34.985269] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 49/70. [D 20:43:34.985966] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55491. [D 20:43:34.985988] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 50/70. [D 20:43:34.991818] openib_check_cq: completed rdma wr_id 2aaaab6136c0, nic_wr_credit 55490. [D 20:43:34.991835] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 51/70. [D 20:43:34.994754] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.994770] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.994782] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:34.994886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:34.994901] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:34.994913] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.000653] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7825 [D 20:43:35.000726] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 52/70. [D 20:43:35.002628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55490. [D 20:43:35.002648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55491. [D 20:43:35.002662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55492. [D 20:43:35.002677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55493. [D 20:43:35.002691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55494. [D 20:43:35.002705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55495. [D 20:43:35.002720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55496. [D 20:43:35.002734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55497. [D 20:43:35.002748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55498. [D 20:43:35.002763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55499. [D 20:43:35.002777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55500. [D 20:43:35.002791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55501. [D 20:43:35.002805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55502. [D 20:43:35.002820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55503. [D 20:43:35.002834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55504. [D 20:43:35.002848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55505. [D 20:43:35.002862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55506. [D 20:43:35.002877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55507. [D 20:43:35.002891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55508. [D 20:43:35.002905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55509. [D 20:43:35.002922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55510. [D 20:43:35.002936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55511. [D 20:43:35.003042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55512. [D 20:43:35.003058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55513. [D 20:43:35.003073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55514. [D 20:43:35.003088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55515. [D 20:43:35.003103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55516. [D 20:43:35.003117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55517. [D 20:43:35.003131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55518. [D 20:43:35.003145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55519. [D 20:43:35.003159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55520. [D 20:43:35.003175] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55521. [D 20:43:35.008247] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.008265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.008278] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.008320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7832 [D 20:43:35.008335] element 0: offset: 0x2aaaab010740, size: 24 [D 20:43:35.008350] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 53/70. [D 20:43:35.008379] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.008392] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.008404] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:35.008425] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7833 [D 20:43:35.008439] element 0: offset: 0x2aaaab02cae0, size: 24 [D 20:43:35.008452] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 54/70. [D 20:43:35.008509] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55521. [D 20:43:35.008525] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 55/70. [D 20:43:35.011640] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.011657] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.011669] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:35.015169] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7827 [D 20:43:35.015234] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 56/70. [D 20:43:35.015314] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7833 [D 20:43:35.015331] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 57/70. [D 20:43:35.015387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55521. [D 20:43:35.015429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55522. [D 20:43:35.015444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55523. [D 20:43:35.015459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55524. [D 20:43:35.015474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55525. [D 20:43:35.015488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55526. [D 20:43:35.015502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55527. [D 20:43:35.015516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55528. [D 20:43:35.015530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55529. [D 20:43:35.015544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55530. [D 20:43:35.015559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55531. [D 20:43:35.015573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55532. [D 20:43:35.015587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55533. [D 20:43:35.015602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55534. [D 20:43:35.015616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55535. [D 20:43:35.015630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55536. [D 20:43:35.015644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55537. [D 20:43:35.015658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55538. [D 20:43:35.015673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55539. [D 20:43:35.015687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55540. [D 20:43:35.015701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55541. [D 20:43:35.015715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55542. [D 20:43:35.015730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55543. [D 20:43:35.015744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55544. [D 20:43:35.015758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55545. [D 20:43:35.015772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55546. [D 20:43:35.015786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55547. [D 20:43:35.015800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55548. [D 20:43:35.015815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55549. [D 20:43:35.015829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55550. [D 20:43:35.015843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55551. [D 20:43:35.015857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55552. [D 20:43:35.015875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55553. [D 20:43:35.015889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55554. [D 20:43:35.015904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55555. [D 20:43:35.015918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55556. [D 20:43:35.015932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55557. [D 20:43:35.015947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55558. [D 20:43:35.015961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55559. [D 20:43:35.015975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55560. [D 20:43:35.015990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55561. [D 20:43:35.016004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55562. [D 20:43:35.016019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55563. [D 20:43:35.016033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 55564. [D 20:43:35.016047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 55565. [D 20:43:35.016061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 55566. [D 20:43:35.016075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 55567. [D 20:43:35.016090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55568. [D 20:43:35.016104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55569. [D 20:43:35.016118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55570. [D 20:43:35.016132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 55571. [D 20:43:35.016146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 55572. [D 20:43:35.016161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 55573. [D 20:43:35.016175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 55574. [D 20:43:35.016189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 55575. [D 20:43:35.016203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55576. [D 20:43:35.016217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55577. [D 20:43:35.016235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55578. [D 20:43:35.016250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 55579. [D 20:43:35.016264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 55580. [D 20:43:35.016279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 55581. [D 20:43:35.016293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 55582. [D 20:43:35.016307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 55583. [D 20:43:35.016321] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab610080 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55584. [D 20:43:35.017165] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.017223] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.017237] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:35.017281] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7836 [D 20:43:35.017296] element 0: offset: 0x2aaaab014800, size: 24 [D 20:43:35.017315] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 58/70. [D 20:43:35.018090] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7832 [D 20:43:35.018130] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 59/70. [D 20:43:35.027191] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55584. [D 20:43:35.027218] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 60/70. [D 20:43:35.037713] openib_check_cq: completed rdma wr_id 2aaaab610080, nic_wr_credit 55583. [D 20:43:35.037732] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 0/70. [D 20:43:35.037748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55583. [D 20:43:35.037763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55584. [D 20:43:35.037778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55585. [D 20:43:35.037792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55586. [D 20:43:35.037807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55587. [D 20:43:35.037821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55588. [D 20:43:35.037836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55589. [D 20:43:35.037850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55590. [D 20:43:35.037865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55591. [D 20:43:35.037879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55592. [D 20:43:35.037894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55593. [D 20:43:35.037908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55594. [D 20:43:35.037922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55595. [D 20:43:35.037937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55596. [D 20:43:35.037951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55597. [D 20:43:35.037965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55598. [D 20:43:35.037980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55599. [D 20:43:35.037994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55600. [D 20:43:35.038009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55601. [D 20:43:35.038023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55602. [D 20:43:35.038037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55603. [D 20:43:35.038052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55604. [D 20:43:35.038066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55605. [D 20:43:35.038080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55606. [D 20:43:35.038095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55607. [D 20:43:35.038109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55608. [D 20:43:35.038124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55609. [D 20:43:35.038138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55610. [D 20:43:35.038153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55611. [D 20:43:35.038167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55612. [D 20:43:35.038182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55613. [D 20:43:35.038196] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcb0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55614. [D 20:43:35.038278] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.038303] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.038316] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:35.038339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.038353] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.038365] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.041782] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7836 [D 20:43:35.041867] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 1/70. [D 20:43:35.043680] openib_check_cq: completed rdma wr_id 2aaaab60fcb0, nic_wr_credit 55614. [D 20:43:35.043700] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 2/70. [D 20:43:35.043814] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.043835] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.043848] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.049256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55614. [D 20:43:35.049277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55615. [D 20:43:35.049291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55616. [D 20:43:35.049306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55617. [D 20:43:35.049320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55618. [D 20:43:35.049334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55619. [D 20:43:35.049348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55620. [D 20:43:35.049363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55621. [D 20:43:35.049377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55622. [D 20:43:35.049391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55623. [D 20:43:35.049405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55624. [D 20:43:35.049419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55625. [D 20:43:35.049433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55626. [D 20:43:35.049448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55627. [D 20:43:35.049462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55628. [D 20:43:35.049476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55629. [D 20:43:35.049491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55630. [D 20:43:35.049505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55631. [D 20:43:35.049519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55632. [D 20:43:35.049533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55633. [D 20:43:35.049548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55634. [D 20:43:35.049562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55635. [D 20:43:35.049576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55636. [D 20:43:35.049590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55637. [D 20:43:35.049604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55638. [D 20:43:35.049618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55639. [D 20:43:35.049632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55640. [D 20:43:35.049646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55641. [D 20:43:35.049660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55642. [D 20:43:35.049674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55643. [D 20:43:35.049688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55644. [D 20:43:35.049713] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55645. [D 20:43:35.054742] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.054764] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.054777] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.054817] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7840 [D 20:43:35.054832] element 0: offset: 0x2aaaab036e90, size: 24 [D 20:43:35.054849] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 3/70. [D 20:43:35.055474] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55645. [D 20:43:35.055494] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 4/70. [D 20:43:35.055599] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.055619] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.055632] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.058964] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7840 [D 20:43:35.059044] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 5/70. [D 20:43:35.061240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55645. [D 20:43:35.061262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55646. [D 20:43:35.061276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55647. [D 20:43:35.061290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55648. [D 20:43:35.061304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55649. [D 20:43:35.061320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55650. [D 20:43:35.061334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55651. [D 20:43:35.061349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55652. [D 20:43:35.061363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55653. [D 20:43:35.061390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55654. [D 20:43:35.061415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55655. [D 20:43:35.061439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55656. [D 20:43:35.061454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55657. [D 20:43:35.061468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55658. [D 20:43:35.061496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55659. [D 20:43:35.061511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55660. [D 20:43:35.061534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55661. [D 20:43:35.061549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55662. [D 20:43:35.061564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55663. [D 20:43:35.061590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55664. [D 20:43:35.061605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55665. [D 20:43:35.061634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55666. [D 20:43:35.061649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55667. [D 20:43:35.061675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55668. [D 20:43:35.061689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55669. [D 20:43:35.061704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55670. [D 20:43:35.061730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55671. [D 20:43:35.061746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55672. [D 20:43:35.061761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55673. [D 20:43:35.061787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55674. [D 20:43:35.061801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55675. [D 20:43:35.061815] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55676. [D 20:43:35.061939] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.061963] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.061976] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.062020] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7843 [D 20:43:35.062035] element 0: offset: 0x2aaaab025f90, size: 24 [D 20:43:35.062051] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 6/70. [D 20:43:35.062085] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.062099] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.062111] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.062132] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7846 [D 20:43:35.062146] element 0: offset: 0x2aaaab0142c0, size: 24 [D 20:43:35.062162] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 7/70. [D 20:43:35.064248] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.064266] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.064279] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:35.064301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7848 [D 20:43:35.064315] element 0: offset: 0x2aaaab0257f0, size: 24 [D 20:43:35.064331] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 8/70. [D 20:43:35.072932] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55676. [D 20:43:35.072958] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 9/70. [D 20:43:35.073138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.073159] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.073172] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:35.076363] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 686016, tag: 7843 [D 20:43:35.076447] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 10/70. [D 20:43:35.077506] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7846 [D 20:43:35.077567] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 11/70. [D 20:43:35.078978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 55676. [D 20:43:35.079005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 55677. [D 20:43:35.079020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 55678. [D 20:43:35.079034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 55679. [D 20:43:35.079049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 55680. [D 20:43:35.079063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 55681. [D 20:43:35.079078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 55682. [D 20:43:35.079092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55683. [D 20:43:35.079107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55684. [D 20:43:35.079121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55685. [D 20:43:35.079136] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 55686. [D 20:43:35.079152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55687. [D 20:43:35.079167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55688. [D 20:43:35.079182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55689. [D 20:43:35.079196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55690. [D 20:43:35.079211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55691. [D 20:43:35.079227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55692. [D 20:43:35.079242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55693. [D 20:43:35.079256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55694. [D 20:43:35.079270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55695. [D 20:43:35.079285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55696. [D 20:43:35.079299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55697. [D 20:43:35.079314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55698. [D 20:43:35.079328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55699. [D 20:43:35.079342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55700. [D 20:43:35.079357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55701. [D 20:43:35.079372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55702. [D 20:43:35.079386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55703. [D 20:43:35.079400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55704. [D 20:43:35.079415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55705. [D 20:43:35.079429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55706. [D 20:43:35.079444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55707. [D 20:43:35.079458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55708. [D 20:43:35.079472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55709. [D 20:43:35.079487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55710. [D 20:43:35.079501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55711. [D 20:43:35.079515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55712. [D 20:43:35.079530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55713. [D 20:43:35.079544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55714. [D 20:43:35.079558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55715. [D 20:43:35.079573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55716. [D 20:43:35.079587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55717. [D 20:43:35.079602] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d100 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55718. [D 20:43:35.081606] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.081631] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.081643] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:35.081686] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7851 [D 20:43:35.081702] element 0: offset: 0x2aaaab033950, size: 24 [D 20:43:35.081719] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 12/70. [D 20:43:35.082862] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55718. [D 20:43:35.082887] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 13/70. [D 20:43:35.089053] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7848 [D 20:43:35.089083] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 14/70. [D 20:43:35.094954] openib_check_cq: completed rdma wr_id 2aaaab60d100, nic_wr_credit 55717. [D 20:43:35.095026] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 15/70. [D 20:43:35.095048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55717. [D 20:43:35.095064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55718. [D 20:43:35.095078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55719. [D 20:43:35.095093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55720. [D 20:43:35.095121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55721. [D 20:43:35.095136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55722. [D 20:43:35.095150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55723. [D 20:43:35.095164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55724. [D 20:43:35.095178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55725. [D 20:43:35.095193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55726. [D 20:43:35.095207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55727. [D 20:43:35.095221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55728. [D 20:43:35.095236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55729. [D 20:43:35.095250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55730. [D 20:43:35.095264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55731. [D 20:43:35.095279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55732. [D 20:43:35.095293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55733. [D 20:43:35.095307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55734. [D 20:43:35.095322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55735. [D 20:43:35.095336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55736. [D 20:43:35.095350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55737. [D 20:43:35.095365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55738. [D 20:43:35.095379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55739. [D 20:43:35.095393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55740. [D 20:43:35.095410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55741. [D 20:43:35.095424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55742. [D 20:43:35.095438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55743. [D 20:43:35.095452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55744. [D 20:43:35.095467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55745. [D 20:43:35.095480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55746. [D 20:43:35.095495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55747. [D 20:43:35.095509] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609890 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55748. [D 20:43:35.095589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.095611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.095623] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:35.095647] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.095660] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.095673] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.098907] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7851 [D 20:43:35.098988] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 16/70. [D 20:43:35.107187] openib_check_cq: completed rdma wr_id 2aaaab609890, nic_wr_credit 55748. [D 20:43:35.107209] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 17/70. [D 20:43:35.107291] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.107312] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.107325] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.108848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55748. [D 20:43:35.108873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55749. [D 20:43:35.108888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55750. [D 20:43:35.108902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55751. [D 20:43:35.108917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55752. [D 20:43:35.108931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55753. [D 20:43:35.108945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55754. [D 20:43:35.108960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55755. [D 20:43:35.108974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55756. [D 20:43:35.108988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55757. [D 20:43:35.109003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55758. [D 20:43:35.109017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55759. [D 20:43:35.109031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55760. [D 20:43:35.109051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55761. [D 20:43:35.109066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55762. [D 20:43:35.109081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55763. [D 20:43:35.109095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55764. [D 20:43:35.109109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55765. [D 20:43:35.109124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55766. [D 20:43:35.109139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55767. [D 20:43:35.109153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55768. [D 20:43:35.109168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55769. [D 20:43:35.109182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55770. [D 20:43:35.109197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55771. [D 20:43:35.109211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55772. [D 20:43:35.109226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55773. [D 20:43:35.109240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55774. [D 20:43:35.109254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55775. [D 20:43:35.109269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55776. [D 20:43:35.109283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55777. [D 20:43:35.109298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55778. [D 20:43:35.109312] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c6e0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55779. [D 20:43:35.120468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.120491] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.120504] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.120543] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7857 [D 20:43:35.120558] element 0: offset: 0x2aaaab011950, size: 24 [D 20:43:35.120575] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 18/70. [D 20:43:35.120614] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.120629] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.120641] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.120662] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7858 [D 20:43:35.120676] element 0: offset: 0x2aaaab025ac0, size: 24 [D 20:43:35.120691] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 19/70. [D 20:43:35.120717] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.120731] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.120743] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:35.120762] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7860 [D 20:43:35.120776] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:35.120793] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 20/70. [D 20:43:35.121032] openib_check_cq: completed rdma wr_id 2aaaab60c6e0, nic_wr_credit 55779. [D 20:43:35.121056] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 21/70. [D 20:43:35.121191] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.121210] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.121223] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:35.121241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.121254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.121267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.124825] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7857 [D 20:43:35.124916] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 22/70. [D 20:43:35.126979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55779. [D 20:43:35.127026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f480c000 rkey 4a4004f nic_wr_credit 55780. [D 20:43:35.127041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f482c000 rkey 4a4004f nic_wr_credit 55781. [D 20:43:35.127056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f484c000 rkey 4a4004f nic_wr_credit 55782. [D 20:43:35.127070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f486c000 rkey 4a4004f nic_wr_credit 55783. [D 20:43:35.127085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f488c000 rkey 4a4004f nic_wr_credit 55784. [D 20:43:35.127099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ac000 rkey 4a4004f nic_wr_credit 55785. [D 20:43:35.127114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48cc000 rkey 4a4004f nic_wr_credit 55786. [D 20:43:35.127128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48ec000 rkey 4a4004f nic_wr_credit 55787. [D 20:43:35.127142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f490c000 rkey 4a4004f nic_wr_credit 55788. [D 20:43:35.127157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f492c000 rkey 4a4004f nic_wr_credit 55789. [D 20:43:35.127172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f494c000 rkey 4a4004f nic_wr_credit 55790. [D 20:43:35.127186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f496c000 rkey 4a4004f nic_wr_credit 55791. [D 20:43:35.127200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f498c000 rkey 4a4004f nic_wr_credit 55792. [D 20:43:35.127215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ac000 rkey 4a4004f nic_wr_credit 55793. [D 20:43:35.127229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49cc000 rkey 4a4004f nic_wr_credit 55794. [D 20:43:35.127244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49ec000 rkey 4a4004f nic_wr_credit 55795. [D 20:43:35.127258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 55796. [D 20:43:35.127273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 55797. [D 20:43:35.127287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 55798. [D 20:43:35.127302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 55799. [D 20:43:35.127317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 55800. [D 20:43:35.127331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aac000 rkey 4a4004f nic_wr_credit 55801. [D 20:43:35.127349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4acc000 rkey 4a4004f nic_wr_credit 55802. [D 20:43:35.127363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4aec000 rkey 4a4004f nic_wr_credit 55803. [D 20:43:35.127377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 55804. [D 20:43:35.127392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 55805. [D 20:43:35.127406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 55806. [D 20:43:35.127421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 55807. [D 20:43:35.127436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 55808. [D 20:43:35.127450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bac000 rkey 4a4004f nic_wr_credit 55809. [D 20:43:35.127464] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8e0 to 10.1.4.240:43806 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 55810. [D 20:43:35.129921] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.129992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.130006] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.130050] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7863 [D 20:43:35.130065] element 0: offset: 0x2aaaab014410, size: 24 [D 20:43:35.130085] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 23/70. [D 20:43:35.131311] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7860 [D 20:43:35.131371] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 24/70. [D 20:43:35.137035] openib_check_cq: completed rdma wr_id 2aaaab60c8e0, nic_wr_credit 55810. [D 20:43:35.137059] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 25/70. [D 20:43:35.137092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55810. [D 20:43:35.137107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55811. [D 20:43:35.137123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55812. [D 20:43:35.137137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55813. [D 20:43:35.137152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55814. [D 20:43:35.137166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55815. [D 20:43:35.137181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55816. [D 20:43:35.137195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55817. [D 20:43:35.137210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55818. [D 20:43:35.137225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55819. [D 20:43:35.137239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55820. [D 20:43:35.137254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55821. [D 20:43:35.137268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55822. [D 20:43:35.137283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55823. [D 20:43:35.137299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55824. [D 20:43:35.137314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55825. [D 20:43:35.137328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55826. [D 20:43:35.137343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55827. [D 20:43:35.137357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55828. [D 20:43:35.137372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55829. [D 20:43:35.137386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55830. [D 20:43:35.137401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55831. [D 20:43:35.137415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55832. [D 20:43:35.137430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55833. [D 20:43:35.137444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55834. [D 20:43:35.137459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55835. [D 20:43:35.137473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55836. [D 20:43:35.137488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55837. [D 20:43:35.137502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55838. [D 20:43:35.137516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55839. [D 20:43:35.137530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55840. [D 20:43:35.137545] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fbd0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55841. [D 20:43:35.137609] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.137640] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.137653] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.140315] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7863 [D 20:43:35.140376] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 26/70. [D 20:43:35.148823] openib_check_cq: completed rdma wr_id 2aaaab60fbd0, nic_wr_credit 55841. [D 20:43:35.148848] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 27/70. [D 20:43:35.148896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 55841. [D 20:43:35.148905] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.148913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 55842. [D 20:43:35.148934] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.148950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 55843. [D 20:43:35.148965] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.148983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 55844. [D 20:43:35.149012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 55845. [D 20:43:35.149028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 55846. [D 20:43:35.149027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7867 [D 20:43:35.149053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 55847. [D 20:43:35.149069] element 0: offset: 0x2aaaab02cae0, size: 24 [D 20:43:35.149086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 55848. [D 20:43:35.149115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 55849. [D 20:43:35.149129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 55850. [D 20:43:35.149143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 55851. [D 20:43:35.149157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 55852. [D 20:43:35.149171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 55853. [D 20:43:35.149185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 55854. [D 20:43:35.149199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 55855. [D 20:43:35.149213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 55856. [D 20:43:35.149227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 55857. [D 20:43:35.149241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 55858. [D 20:43:35.149255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 55859. [D 20:43:35.149269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 55860. [D 20:43:35.149283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 55861. [D 20:43:35.149297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 55862. [D 20:43:35.149311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 55863. [D 20:43:35.149325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 55864. [D 20:43:35.149339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 55865. [D 20:43:35.149353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 55866. [D 20:43:35.149367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 55867. [D 20:43:35.149381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 55868. [D 20:43:35.149395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 55869. [D 20:43:35.149409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 55870. [D 20:43:35.149423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 55871. [D 20:43:35.149438] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ffd0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 55872. [D 20:43:35.149463] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 28/70. [D 20:43:35.149517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.149532] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.149545] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.160664] openib_check_cq: completed rdma wr_id 2aaaab60ffd0, nic_wr_credit 55872. [D 20:43:35.160691] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 29/70. [D 20:43:35.160790] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.160810] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.160823] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.163707] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7867 [D 20:43:35.163764] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 30/70. [D 20:43:35.186879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 55872. [D 20:43:35.186904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 55873. [D 20:43:35.186919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 55874. [D 20:43:35.186933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 55875. [D 20:43:35.186947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 55876. [D 20:43:35.186961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 55877. [D 20:43:35.186976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55878. [D 20:43:35.186990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55879. [D 20:43:35.187004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55880. [D 20:43:35.187018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 55881. [D 20:43:35.187033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 55882. [D 20:43:35.187047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 55883. [D 20:43:35.187061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 55884. [D 20:43:35.187075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 55885. [D 20:43:35.187090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55886. [D 20:43:35.187104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55887. [D 20:43:35.187118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55888. [D 20:43:35.187132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 55889. [D 20:43:35.187146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 55890. [D 20:43:35.187161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 55891. [D 20:43:35.187175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 55892. [D 20:43:35.187189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 55893. [D 20:43:35.187204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55894. [D 20:43:35.187218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55895. [D 20:43:35.435944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55896. [D 20:43:35.435967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 55897. [D 20:43:35.435981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 55898. [D 20:43:35.435995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 55899. [D 20:43:35.436010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 55900. [D 20:43:35.436024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 55901. [D 20:43:35.436038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55902. [D 20:43:35.436052] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609790 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55903. [D 20:43:35.436198] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.436232] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.436245] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.436287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7869 [D 20:43:35.436303] element 0: offset: 0x2aaaab002010, size: 24 [D 20:43:35.436322] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 31/70. [D 20:43:35.436355] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.436369] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.436382] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:35.436403] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7872 [D 20:43:35.436417] element 0: offset: 0x2aaaab014800, size: 24 [D 20:43:35.436434] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 32/70. [D 20:43:35.437600] openib_check_cq: completed rdma wr_id 2aaaab609790, nic_wr_credit 55903. [D 20:43:35.437625] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 33/70. [D 20:43:35.437781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.437801] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.437814] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:35.444314] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 188096, tag: 7872 [D 20:43:35.444342] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 34/70. [D 20:43:35.448245] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7869 [D 20:43:35.448270] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 35/70. [D 20:43:35.448598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55903. [D 20:43:35.448618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55904. [D 20:43:35.448632] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fbd0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 55905. [D 20:43:35.448648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55906. [D 20:43:35.448663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 55907. [D 20:43:35.448677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 55908. [D 20:43:35.448691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 55909. [D 20:43:35.448705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 55910. [D 20:43:35.448720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 55911. [D 20:43:35.448734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 55912. [D 20:43:35.448748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 55913. [D 20:43:35.448763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 55914. [D 20:43:35.448777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 55915. [D 20:43:35.448791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 55916. [D 20:43:35.448806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 55917. [D 20:43:35.448820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 55918. [D 20:43:35.448834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 55919. [D 20:43:35.448849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 55920. [D 20:43:35.448863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 55921. [D 20:43:35.448878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 55922. [D 20:43:35.448916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 55923. [D 20:43:35.448977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 55924. [D 20:43:35.448992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 55925. [D 20:43:35.449006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 55926. [D 20:43:35.449020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 55927. [D 20:43:35.449034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 55928. [D 20:43:35.449049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 55929. [D 20:43:35.449063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 55930. [D 20:43:35.449077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 55931. [D 20:43:35.449092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 55932. [D 20:43:35.449106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 55933. [D 20:43:35.449120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 55934. [D 20:43:35.449135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 55935. [D 20:43:35.449149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 55936. [D 20:43:35.449163] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ffd0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 55937. [D 20:43:35.449178] openib_check_cq: completed rdma wr_id 2aaaab60fbd0, nic_wr_credit 55937. [D 20:43:35.449192] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 36/70. [D 20:43:35.455118] openib_check_cq: completed rdma wr_id 2aaaab60ffd0, nic_wr_credit 55936. [D 20:43:35.455139] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 37/70. [D 20:43:35.455579] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.455633] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.455647] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.455674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.455687] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.455700] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.470375] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.470395] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.470408] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.470447] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7875 [D 20:43:35.470462] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.470482] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 38/70. [D 20:43:35.470560] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.470575] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.470587] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.580235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.580255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.580268] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.580292] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7879 [D 20:43:35.580306] element 0: offset: 0x62fd10, size: 24 [D 20:43:35.580324] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 39/70. [D 20:43:35.583338] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7879 [D 20:43:35.583404] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 40/70. [D 20:43:35.583462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55936. [D 20:43:35.583490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 55937. [D 20:43:35.583509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 55938. [D 20:43:35.583533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 55939. [D 20:43:35.583547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 55940. [D 20:43:35.583562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 55941. [D 20:43:35.583576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55942. [D 20:43:35.583590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55943. [D 20:43:35.583605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55944. [D 20:43:35.583619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 55945. [D 20:43:35.583633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 55946. [D 20:43:35.583648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 55947. [D 20:43:35.583662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 55948. [D 20:43:35.583677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 55949. [D 20:43:35.583691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55950. [D 20:43:35.583705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55951. [D 20:43:35.583720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55952. [D 20:43:35.583734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 55953. [D 20:43:35.583748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 55954. [D 20:43:35.583763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 55955. [D 20:43:35.583777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 55956. [D 20:43:35.583792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 55957. [D 20:43:35.583806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55958. [D 20:43:35.583820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55959. [D 20:43:35.583835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55960. [D 20:43:35.583851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 55961. [D 20:43:35.583865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 55962. [D 20:43:35.583879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 55963. [D 20:43:35.583892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 55964. [D 20:43:35.583906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 55965. [D 20:43:35.583920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55966. [D 20:43:35.583934] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcf0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55967. [D 20:43:35.594072] openib_check_cq: completed rdma wr_id 2aaaab60fcf0, nic_wr_credit 55967. [D 20:43:35.594094] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 41/70. [D 20:43:35.594233] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.594256] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.594269] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.604362] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.604380] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.604392] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.604428] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7883 [D 20:43:35.604443] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.604460] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 42/70. [D 20:43:35.606716] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.606776] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.606789] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.606829] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7884 [D 20:43:35.606844] element 0: offset: 0x658610, size: 24 [D 20:43:35.606863] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 43/70. [D 20:43:35.610843] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7883 [D 20:43:35.610921] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 44/70. [D 20:43:35.610979] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7884 [D 20:43:35.610996] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 45/70. [D 20:43:35.611062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55967. [D 20:43:35.611086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 55968. [D 20:43:35.611101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 55969. [D 20:43:35.611115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 55970. [D 20:43:35.611129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 55971. [D 20:43:35.611143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 55972. [D 20:43:35.611157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55973. [D 20:43:35.611172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55974. [D 20:43:35.611186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55975. [D 20:43:35.611200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 55976. [D 20:43:35.611215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 55977. [D 20:43:35.611229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 55978. [D 20:43:35.611243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 55979. [D 20:43:35.611258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 55980. [D 20:43:35.611272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55981. [D 20:43:35.611286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55982. [D 20:43:35.611301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55983. [D 20:43:35.611315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 55984. [D 20:43:35.611329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 55985. [D 20:43:35.611343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 55986. [D 20:43:35.611358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 55987. [D 20:43:35.611372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 55988. [D 20:43:35.611386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55989. [D 20:43:35.611401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55990. [D 20:43:35.611415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55991. [D 20:43:35.611429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 55992. [D 20:43:35.611443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 55993. [D 20:43:35.611458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 55994. [D 20:43:35.611472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 55995. [D 20:43:35.611486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 55996. [D 20:43:35.611500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55997. [D 20:43:35.611515] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcf0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55998. [D 20:43:35.611531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 55999. [D 20:43:35.611546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56000. [D 20:43:35.611560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56001. [D 20:43:35.611575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56002. [D 20:43:35.611589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56003. [D 20:43:35.611603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56004. [D 20:43:35.611618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56005. [D 20:43:35.611633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56006. [D 20:43:35.611647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56007. [D 20:43:35.611661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56008. [D 20:43:35.611675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56009. [D 20:43:35.611690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56010. [D 20:43:35.611704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56011. [D 20:43:35.611736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56012. [D 20:43:35.611751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56013. [D 20:43:35.611765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56014. [D 20:43:35.611779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56015. [D 20:43:35.611793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56016. [D 20:43:35.611808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56017. [D 20:43:35.611822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56018. [D 20:43:35.611836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56019. [D 20:43:35.611850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56020. [D 20:43:35.611893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56021. [D 20:43:35.611908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56022. [D 20:43:35.611922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56023. [D 20:43:35.611936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56024. [D 20:43:35.611950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56025. [D 20:43:35.611964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56026. [D 20:43:35.611978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56027. [D 20:43:35.611992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56028. [D 20:43:35.612006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56029. [D 20:43:35.612020] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fe50 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56030. [D 20:43:35.622681] openib_check_cq: completed rdma wr_id 2aaaab60fcf0, nic_wr_credit 56030. [D 20:43:35.622703] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 46/70. [D 20:43:35.632260] openib_check_cq: completed rdma wr_id 2aaaab60fe50, nic_wr_credit 56029. [D 20:43:35.632277] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 47/70. [D 20:43:35.632348] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.632371] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.632386] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.632416] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.632429] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.632442] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.645955] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.645972] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.645985] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.646023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7889 [D 20:43:35.646037] element 0: offset: 0x658610, size: 24 [D 20:43:35.646054] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 48/70. [D 20:43:35.646092] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.646106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.646118] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.646137] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7890 [D 20:43:35.646152] element 0: offset: 0x62fd10, size: 24 [D 20:43:35.646166] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 49/70. [D 20:43:35.652297] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7889 [D 20:43:35.652377] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 50/70. [D 20:43:35.652404] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7890 [D 20:43:35.652419] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 51/70. [D 20:43:35.652445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56029. [D 20:43:35.652473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56030. [D 20:43:35.652488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56031. [D 20:43:35.652502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56032. [D 20:43:35.652516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56033. [D 20:43:35.652531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56034. [D 20:43:35.652545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56035. [D 20:43:35.652559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56036. [D 20:43:35.652573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56037. [D 20:43:35.652587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56038. [D 20:43:35.652602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56039. [D 20:43:35.652616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56040. [D 20:43:35.652630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56041. [D 20:43:35.652645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56042. [D 20:43:35.652659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56043. [D 20:43:35.652673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56044. [D 20:43:35.652687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56045. [D 20:43:35.652701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56046. [D 20:43:35.652717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56047. [D 20:43:35.652731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56048. [D 20:43:35.652745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56049. [D 20:43:35.652759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56050. [D 20:43:35.652773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56051. [D 20:43:35.652788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56052. [D 20:43:35.652802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56053. [D 20:43:35.652816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56054. [D 20:43:35.652830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56055. [D 20:43:35.652844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56056. [D 20:43:35.652858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56057. [D 20:43:35.652873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56058. [D 20:43:35.652887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56059. [D 20:43:35.652901] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcf0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56060. [D 20:43:35.652918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56061. [D 20:43:35.652932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56062. [D 20:43:35.652946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56063. [D 20:43:35.652960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56064. [D 20:43:35.652974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56065. [D 20:43:35.652988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56066. [D 20:43:35.653003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56067. [D 20:43:35.653017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56068. [D 20:43:35.653031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56069. [D 20:43:35.653045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56070. [D 20:43:35.653059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56071. [D 20:43:35.653073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56072. [D 20:43:35.653088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56073. [D 20:43:35.653102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56074. [D 20:43:35.653116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56075. [D 20:43:35.653131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56076. [D 20:43:35.653145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56077. [D 20:43:35.653159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56078. [D 20:43:35.653173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56079. [D 20:43:35.653188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56080. [D 20:43:35.653202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56081. [D 20:43:35.653216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56082. [D 20:43:35.653242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56083. [D 20:43:35.653256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56084. [D 20:43:35.653270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56085. [D 20:43:35.653285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56086. [D 20:43:35.653299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56087. [D 20:43:35.653313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56088. [D 20:43:35.653327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56089. [D 20:43:35.653342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56090. [D 20:43:35.653356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56091. [D 20:43:35.653370] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fe50 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56092. [D 20:43:35.663278] openib_check_cq: completed rdma wr_id 2aaaab60fcf0, nic_wr_credit 56092. [D 20:43:35.663300] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 52/70. [D 20:43:35.674894] openib_check_cq: completed rdma wr_id 2aaaab60fe50, nic_wr_credit 56091. [D 20:43:35.674915] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 53/70. [D 20:43:35.674985] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.675007] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.675020] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.675050] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.675064] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.675077] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.688696] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.688714] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.688727] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.688767] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7894 [D 20:43:35.688782] element 0: offset: 0x62fd10, size: 24 [D 20:43:35.688799] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 54/70. [D 20:43:35.688836] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.688850] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.688863] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.688882] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7897 [D 20:43:35.688896] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.688913] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 55/70. [D 20:43:35.692288] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7894 [D 20:43:35.692361] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 56/70. [D 20:43:35.692418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56091. [D 20:43:35.692443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56092. [D 20:43:35.692462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56093. [D 20:43:35.692476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56094. [D 20:43:35.692491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56095. [D 20:43:35.692505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56096. [D 20:43:35.692520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56097. [D 20:43:35.692534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56098. [D 20:43:35.692549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56099. [D 20:43:35.692563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56100. [D 20:43:35.692577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56101. [D 20:43:35.692592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56102. [D 20:43:35.692606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56103. [D 20:43:35.692621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56104. [D 20:43:35.692635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56105. [D 20:43:35.692649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56106. [D 20:43:35.692664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56107. [D 20:43:35.692678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56108. [D 20:43:35.692693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56109. [D 20:43:35.692707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56110. [D 20:43:35.692722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56111. [D 20:43:35.692736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56112. [D 20:43:35.692751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56113. [D 20:43:35.692765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56114. [D 20:43:35.692779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56115. [D 20:43:35.692794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56116. [D 20:43:35.692808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56117. [D 20:43:35.692823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56118. [D 20:43:35.692839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56119. [D 20:43:35.692853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56120. [D 20:43:35.692867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56121. [D 20:43:35.692881] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fcf0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56122. [D 20:43:35.695269] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7897 [D 20:43:35.695338] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 57/70. [D 20:43:35.698414] openib_check_cq: completed rdma wr_id 2aaaab60fcf0, nic_wr_credit 56122. [D 20:43:35.698440] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 58/70. [D 20:43:35.698457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56122. [D 20:43:35.698471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56123. [D 20:43:35.698486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56124. [D 20:43:35.698500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56125. [D 20:43:35.698514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56126. [D 20:43:35.698529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56127. [D 20:43:35.698543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56128. [D 20:43:35.698557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56129. [D 20:43:35.698571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56130. [D 20:43:35.698585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56131. [D 20:43:35.698600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56132. [D 20:43:35.698614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56133. [D 20:43:35.698628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56134. [D 20:43:35.698642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56135. [D 20:43:35.698656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56136. [D 20:43:35.698671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56137. [D 20:43:35.698685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56138. [D 20:43:35.698699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56139. [D 20:43:35.698713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56140. [D 20:43:35.698727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56141. [D 20:43:35.698742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56142. [D 20:43:35.698756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56143. [D 20:43:35.698771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56144. [D 20:43:35.698785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56145. [D 20:43:35.698800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56146. [D 20:43:35.698814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56147. [D 20:43:35.698828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56148. [D 20:43:35.698842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56149. [D 20:43:35.698857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56150. [D 20:43:35.698871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56151. [D 20:43:35.698885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56152. [D 20:43:35.698899] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60fe50 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56153. [D 20:43:35.698970] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.698992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.699005] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.710333] openib_check_cq: completed rdma wr_id 2aaaab60fe50, nic_wr_credit 56153. [D 20:43:35.710358] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 59/70. [D 20:43:35.710468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.710488] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.710501] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.729624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.729643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.729655] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.729693] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7901 [D 20:43:35.729708] element 0: offset: 0x636ca0, size: 24 [D 20:43:35.729724] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 60/70. [D 20:43:35.729764] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.729778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.729791] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.729811] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7902 [D 20:43:35.729825] element 0: offset: 0x2aaaab60ffb0, size: 24 [D 20:43:35.729842] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 0/70. [D 20:43:35.735919] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7901 [D 20:43:35.735997] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 1/70. [D 20:43:35.736057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56153. [D 20:43:35.736078] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7902 [D 20:43:35.736083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56154. [D 20:43:35.736117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56155. [D 20:43:35.736131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56156. [D 20:43:35.736146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56157. [D 20:43:35.736160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56158. [D 20:43:35.736175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56159. [D 20:43:35.736189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56160. [D 20:43:35.736204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56161. [D 20:43:35.736218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56162. [D 20:43:35.736237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56163. [D 20:43:35.736253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56164. [D 20:43:35.736266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56165. [D 20:43:35.736281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56166. [D 20:43:35.736295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56167. [D 20:43:35.736310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56168. [D 20:43:35.736324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56169. [D 20:43:35.736338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56170. [D 20:43:35.736353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56171. [D 20:43:35.736367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56172. [D 20:43:35.736381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56173. [D 20:43:35.736395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56174. [D 20:43:35.736409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56175. [D 20:43:35.736423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56176. [D 20:43:35.736438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56177. [D 20:43:35.736452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56178. [D 20:43:35.736469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56179. [D 20:43:35.736484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56180. [D 20:43:35.736498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56181. [D 20:43:35.736512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56182. [D 20:43:35.736526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56183. [D 20:43:35.736541] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609970 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56184. [D 20:43:35.736571] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 2/70. [D 20:43:35.747150] openib_check_cq: completed rdma wr_id 2aaaab609970, nic_wr_credit 56184. [D 20:43:35.747175] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 3/70. [D 20:43:35.747194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56184. [D 20:43:35.747210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56185. [D 20:43:35.747224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56186. [D 20:43:35.747238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56187. [D 20:43:35.747253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56188. [D 20:43:35.747267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56189. [D 20:43:35.747282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56190. [D 20:43:35.747296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56191. [D 20:43:35.747310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56192. [D 20:43:35.747324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56193. [D 20:43:35.747339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56194. [D 20:43:35.747353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56195. [D 20:43:35.747367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56196. [D 20:43:35.747381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56197. [D 20:43:35.747396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56198. [D 20:43:35.747410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56199. [D 20:43:35.747424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56200. [D 20:43:35.747438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56201. [D 20:43:35.747453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56202. [D 20:43:35.747467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56203. [D 20:43:35.747481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56204. [D 20:43:35.747496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56205. [D 20:43:35.747510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56206. [D 20:43:35.747524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56207. [D 20:43:35.747539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56208. [D 20:43:35.747553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56209. [D 20:43:35.747567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56210. [D 20:43:35.747581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56211. [D 20:43:35.747596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56212. [D 20:43:35.747610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56213. [D 20:43:35.747625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56214. [D 20:43:35.747639] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609b70 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56215. [D 20:43:35.747710] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.747732] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.747745] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.758860] openib_check_cq: completed rdma wr_id 2aaaab609b70, nic_wr_credit 56215. [D 20:43:35.758886] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 4/70. [D 20:43:35.759001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.759021] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.759034] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.772835] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.772852] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.772865] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.772904] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7906 [D 20:43:35.772919] element 0: offset: 0x2aaaab010740, size: 24 [D 20:43:35.772935] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 5/70. [D 20:43:35.772971] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.772985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.772997] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.773018] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7909 [D 20:43:35.773032] element 0: offset: 0x2aaaab026ff0, size: 24 [D 20:43:35.773046] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 6/70. [D 20:43:35.776059] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7906 [D 20:43:35.776133] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 7/70. [D 20:43:35.776194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56215. [D 20:43:35.776218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56216. [D 20:43:35.776240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56217. [D 20:43:35.776270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56218. [D 20:43:35.776285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56219. [D 20:43:35.776299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56220. [D 20:43:35.776314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56221. [D 20:43:35.776328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56222. [D 20:43:35.776342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56223. [D 20:43:35.776357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56224. [D 20:43:35.776371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56225. [D 20:43:35.776385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56226. [D 20:43:35.776400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56227. [D 20:43:35.776414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56228. [D 20:43:35.776429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56229. [D 20:43:35.776444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56230. [D 20:43:35.776462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56231. [D 20:43:35.776477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56232. [D 20:43:35.776491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56233. [D 20:43:35.776505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56234. [D 20:43:35.776520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56235. [D 20:43:35.776534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56236. [D 20:43:35.776548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56237. [D 20:43:35.776562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56238. [D 20:43:35.776576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56239. [D 20:43:35.776590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56240. [D 20:43:35.776605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56241. [D 20:43:35.776619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56242. [D 20:43:35.776633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56243. [D 20:43:35.776647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56244. [D 20:43:35.776661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56245. [D 20:43:35.776675] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609aa0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56246. [D 20:43:35.779495] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7909 [D 20:43:35.779572] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 8/70. [D 20:43:35.782084] openib_check_cq: completed rdma wr_id 2aaaab609aa0, nic_wr_credit 56246. [D 20:43:35.782109] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 9/70. [D 20:43:35.782124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56246. [D 20:43:35.782139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56247. [D 20:43:35.782153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56248. [D 20:43:35.782168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56249. [D 20:43:35.782182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56250. [D 20:43:35.782196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56251. [D 20:43:35.782210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56252. [D 20:43:35.782225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56253. [D 20:43:35.782240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56254. [D 20:43:35.782254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56255. [D 20:43:35.782268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56256. [D 20:43:35.782282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56257. [D 20:43:35.782297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56258. [D 20:43:35.782311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56259. [D 20:43:35.782325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56260. [D 20:43:35.782339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56261. [D 20:43:35.782353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56262. [D 20:43:35.782367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56263. [D 20:43:35.782381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56264. [D 20:43:35.782396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56265. [D 20:43:35.782410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56266. [D 20:43:35.782424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56267. [D 20:43:35.782438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56268. [D 20:43:35.782452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56269. [D 20:43:35.782466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56270. [D 20:43:35.782481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56271. [D 20:43:35.782495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56272. [D 20:43:35.782509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56273. [D 20:43:35.782523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56274. [D 20:43:35.782537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56275. [D 20:43:35.782551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56276. [D 20:43:35.782565] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab609970 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56277. [D 20:43:35.782635] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.782656] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.782669] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.793857] openib_check_cq: completed rdma wr_id 2aaaab609970, nic_wr_credit 56277. [D 20:43:35.793883] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 10/70. [D 20:43:35.794000] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.794021] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.794033] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.813781] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.813799] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.813812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.813851] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7913 [D 20:43:35.813866] element 0: offset: 0x644470, size: 24 [D 20:43:35.813882] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 11/70. [D 20:43:35.813917] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.813930] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.813943] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.813964] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7914 [D 20:43:35.813978] element 0: offset: 0x2aaaab60fd60, size: 24 [D 20:43:35.813996] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 12/70. [D 20:43:35.820117] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7913 [D 20:43:35.820197] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 13/70. [D 20:43:35.820255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56277. [D 20:43:35.820280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56278. [D 20:43:35.820288] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7914 [D 20:43:35.820295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56279. [D 20:43:35.820341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56280. [D 20:43:35.820356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56281. [D 20:43:35.820370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56282. [D 20:43:35.820384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56283. [D 20:43:35.820399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56284. [D 20:43:35.820413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56285. [D 20:43:35.820427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56286. [D 20:43:35.820441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56287. [D 20:43:35.820456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56288. [D 20:43:35.820473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56289. [D 20:43:35.820487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56290. [D 20:43:35.820502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56291. [D 20:43:35.820516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56292. [D 20:43:35.820530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56293. [D 20:43:35.820544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56294. [D 20:43:35.820559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56295. [D 20:43:35.820573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56296. [D 20:43:35.820587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56297. [D 20:43:35.864101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56298. [D 20:43:35.864171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56299. [D 20:43:35.864596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56300. [D 20:43:35.864614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56301. [D 20:43:35.864628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56302. [D 20:43:35.864643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56303. [D 20:43:35.864657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56304. [D 20:43:35.864686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56305. [D 20:43:35.864701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56306. [D 20:43:35.864715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56307. [D 20:43:35.864730] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab615180 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56308. [D 20:43:35.864996] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 14/70. [D 20:43:35.866434] openib_check_cq: completed rdma wr_id 2aaaab615180, nic_wr_credit 56308. [D 20:43:35.866462] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 15/70. [D 20:43:35.866478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56308. [D 20:43:35.866493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56309. [D 20:43:35.866507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56310. [D 20:43:35.866521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56311. [D 20:43:35.866536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56312. [D 20:43:35.866564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56313. [D 20:43:35.866578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56314. [D 20:43:35.866592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56315. [D 20:43:35.866607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56316. [D 20:43:35.866621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56317. [D 20:43:35.866635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56318. [D 20:43:35.866715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56319. [D 20:43:35.866741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56320. [D 20:43:35.867175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56321. [D 20:43:35.867192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56322. [D 20:43:35.867206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56323. [D 20:43:35.867220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56324. [D 20:43:35.867234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56325. [D 20:43:35.867249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56326. [D 20:43:35.867263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56327. [D 20:43:35.867277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56328. [D 20:43:35.867291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56329. [D 20:43:35.867306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56330. [D 20:43:35.867320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56331. [D 20:43:35.867334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56332. [D 20:43:35.867348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56333. [D 20:43:35.867362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56334. [D 20:43:35.867376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56335. [D 20:43:35.867390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56336. [D 20:43:35.867405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56337. [D 20:43:35.867419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56338. [D 20:43:35.867433] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c8f0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56339. [D 20:43:35.867639] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.867662] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.867676] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.872402] openib_check_cq: completed rdma wr_id 2aaaab60c8f0, nic_wr_credit 56339. [D 20:43:35.872426] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 16/70. [D 20:43:35.872711] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.872733] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.872745] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.878308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.878328] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.878341] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.878379] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7918 [D 20:43:35.878393] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:35.878410] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 17/70. [D 20:43:35.880866] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.880929] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.880942] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:35.880983] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7920 [D 20:43:35.880998] element 0: offset: 0x2aaaab60c150, size: 24 [D 20:43:35.881017] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 18/70. [D 20:43:35.884959] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7920 [D 20:43:35.885034] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 19/70. [D 20:43:35.885111] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7918 [D 20:43:35.885128] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 20/70. [D 20:43:35.885178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56339. [D 20:43:35.885203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56340. [D 20:43:35.885218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56341. [D 20:43:35.885232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56342. [D 20:43:35.885246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56343. [D 20:43:35.885260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56344. [D 20:43:35.885274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56345. [D 20:43:35.885289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56346. [D 20:43:35.885303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56347. [D 20:43:35.885317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56348. [D 20:43:35.885331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56349. [D 20:43:35.885345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56350. [D 20:43:35.885360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56351. [D 20:43:35.885374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56352. [D 20:43:35.885388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56353. [D 20:43:35.885402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56354. [D 20:43:35.885416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56355. [D 20:43:35.885431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56356. [D 20:43:35.885445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56357. [D 20:43:35.885459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56358. [D 20:43:35.885473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56359. [D 20:43:35.885488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56360. [D 20:43:35.885502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56361. [D 20:43:35.885516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56362. [D 20:43:35.885530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56363. [D 20:43:35.885544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56364. [D 20:43:35.885559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56365. [D 20:43:35.885573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56366. [D 20:43:35.885589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56367. [D 20:43:35.885603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56368. [D 20:43:35.885617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56369. [D 20:43:35.885631] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c580 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56370. [D 20:43:35.885647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56371. [D 20:43:35.885662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56372. [D 20:43:35.885676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56373. [D 20:43:35.885690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56374. [D 20:43:35.885704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56375. [D 20:43:35.885718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56376. [D 20:43:35.885732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56377. [D 20:43:35.885746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56378. [D 20:43:35.885760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56379. [D 20:43:35.885774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56380. [D 20:43:35.885788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56381. [D 20:43:35.885821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56382. [D 20:43:35.885836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56383. [D 20:43:35.885850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56384. [D 20:43:35.885864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56385. [D 20:43:35.885878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56386. [D 20:43:35.885896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56387. [D 20:43:35.885911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56388. [D 20:43:35.885925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56389. [D 20:43:35.885939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56390. [D 20:43:35.885953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56391. [D 20:43:35.885968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56392. [D 20:43:35.885982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56393. [D 20:43:35.885996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56394. [D 20:43:35.886028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56395. [D 20:43:35.886055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56396. [D 20:43:35.886071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56397. [D 20:43:35.886085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56398. [D 20:43:35.886099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56399. [D 20:43:35.886113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56400. [D 20:43:35.886127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56401. [D 20:43:35.886141] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c430 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56402. [D 20:43:35.896840] openib_check_cq: completed rdma wr_id 2aaaab60c580, nic_wr_credit 56402. [D 20:43:35.896861] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 21/70. [D 20:43:35.906506] openib_check_cq: completed rdma wr_id 2aaaab60c430, nic_wr_credit 56401. [D 20:43:35.906523] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 22/70. [D 20:43:35.906591] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.906614] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.906627] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:35.906658] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.906671] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.906683] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:35.920304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:35.920322] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.920335] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:35.920372] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7923 [D 20:43:35.920387] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:35.920404] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 23/70. [D 20:43:35.923677] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7923 [D 20:43:35.923753] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 24/70. [D 20:43:35.923812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56401. [D 20:43:35.923836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56402. [D 20:43:35.923850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56403. [D 20:43:35.923865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56404. [D 20:43:35.923879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 56405. [D 20:43:35.923893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 56406. [D 20:43:35.923907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 56407. [D 20:43:35.923922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56408. [D 20:43:35.923936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56409. [D 20:43:35.923950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56410. [D 20:43:35.923964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 56411. [D 20:43:35.923979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 56412. [D 20:43:35.923994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 56413. [D 20:43:35.924008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 56414. [D 20:43:35.924022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 56415. [D 20:43:35.924037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56416. [D 20:43:35.924051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56417. [D 20:43:35.924065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56418. [D 20:43:35.924080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 56419. [D 20:43:35.924094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 56420. [D 20:43:35.924108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 56421. [D 20:43:35.924123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 56422. [D 20:43:35.924137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 56423. [D 20:43:35.924152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56424. [D 20:43:35.924166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56425. [D 20:43:35.924181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56426. [D 20:43:35.924195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 56427. [D 20:43:35.924209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 56428. [D 20:43:35.924224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 56429. [D 20:43:35.924242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 56430. [D 20:43:35.924257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 56431. [D 20:43:35.924272] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c4d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56432. [D 20:43:35.934117] openib_check_cq: completed rdma wr_id 2aaaab60c4d0, nic_wr_credit 56432. [D 20:43:35.934136] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 25/70. [D 20:43:35.934266] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:35.934288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:35.934302] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.057770] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.057789] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.057802] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.057840] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7927 [D 20:43:36.057856] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:36.057871] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 26/70. [D 20:43:36.064661] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7927 [D 20:43:36.064739] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 27/70. [D 20:43:36.064880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 56432. [D 20:43:36.064901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56433. [D 20:43:36.064916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56434. [D 20:43:36.064930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56435. [D 20:43:36.064944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56436. [D 20:43:36.064958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56437. [D 20:43:36.064973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56438. [D 20:43:36.064987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56439. [D 20:43:36.065001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56440. [D 20:43:36.065015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56441. [D 20:43:36.065029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56442. [D 20:43:36.065043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56443. [D 20:43:36.065058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56444. [D 20:43:36.065072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56445. [D 20:43:36.065086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56446. [D 20:43:36.065100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56447. [D 20:43:36.065114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56448. [D 20:43:36.065128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56449. [D 20:43:36.065142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56450. [D 20:43:36.065156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56451. [D 20:43:36.065170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56452. [D 20:43:36.065185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56453. [D 20:43:36.065199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56454. [D 20:43:36.065213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56455. [D 20:43:36.065227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56456. [D 20:43:36.065241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56457. [D 20:43:36.065255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56458. [D 20:43:36.065269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56459. [D 20:43:36.065283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56460. [D 20:43:36.065298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56461. [D 20:43:36.065313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56462. [D 20:43:36.065326] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bda0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56463. [D 20:43:36.071190] openib_check_cq: completed rdma wr_id 2aaaab60bda0, nic_wr_credit 56463. [D 20:43:36.071213] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 28/70. [D 20:43:36.074263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.074279] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.074292] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.083863] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.083880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.083893] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.083930] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7931 [D 20:43:36.083945] element 0: offset: 0x2aaaab60fd80, size: 24 [D 20:43:36.083961] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 29/70. [D 20:43:36.083986] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.084000] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.084012] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.084031] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7932 [D 20:43:36.084045] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:36.084059] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 30/70. [D 20:43:36.088746] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 262144, tag: 7932 [D 20:43:36.088824] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 31/70. [D 20:43:36.088967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56463. [D 20:43:36.089049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56464. [D 20:43:36.089065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 56465. [D 20:43:36.089081] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d390 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 56466. [D 20:43:36.090385] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7931 [D 20:43:36.090438] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 32/70. [D 20:43:36.090572] openib_check_cq: completed rdma wr_id 2aaaab60d390, nic_wr_credit 56466. [D 20:43:36.090594] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 33/70. [D 20:43:36.090627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 56466. [D 20:43:36.090642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56467. [D 20:43:36.090656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56468. [D 20:43:36.090670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56469. [D 20:43:36.090684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56470. [D 20:43:36.090699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56471. [D 20:43:36.090713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56472. [D 20:43:36.090727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56473. [D 20:43:36.090740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56474. [D 20:43:36.090754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56475. [D 20:43:36.090770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56476. [D 20:43:36.090784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56477. [D 20:43:36.090799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56478. [D 20:43:36.090813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56479. [D 20:43:36.090827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56480. [D 20:43:36.090842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56481. [D 20:43:36.090856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56482. [D 20:43:36.091183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56483. [D 20:43:36.091204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56484. [D 20:43:36.091218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56485. [D 20:43:36.091233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56486. [D 20:43:36.091247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56487. [D 20:43:36.091261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56488. [D 20:43:36.091275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56489. [D 20:43:36.091290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56490. [D 20:43:36.091304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56491. [D 20:43:36.091318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56492. [D 20:43:36.091333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56493. [D 20:43:36.091347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56494. [D 20:43:36.091361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56495. [D 20:43:36.091375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56496. [D 20:43:36.091390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60bda0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56497. [D 20:43:36.091462] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.091482] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.091495] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.101268] openib_check_cq: completed rdma wr_id 2aaaab60bda0, nic_wr_credit 56497. [D 20:43:36.101292] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 34/70. [D 20:43:36.101352] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.101372] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.101385] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.110351] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.110368] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.110380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.110422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7936 [D 20:43:36.110439] element 0: offset: 0x2aaaab026ff0, size: 24 [D 20:43:36.110457] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 35/70. [D 20:43:36.110508] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.110522] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.110535] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.110556] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7939 [D 20:43:36.110570] element 0: offset: 0x644470, size: 24 [D 20:43:36.110585] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 36/70. [D 20:43:36.110685] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.110699] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.110712] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.115163] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7939 [D 20:43:36.115228] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 37/70. [D 20:43:36.115290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56497. [D 20:43:36.115315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56498. [D 20:43:36.115330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56499. [D 20:43:36.115344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56500. [D 20:43:36.115358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56501. [D 20:43:36.115372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56502. [D 20:43:36.115387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56503. [D 20:43:36.115401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56504. [D 20:43:36.115415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56505. [D 20:43:36.115429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56506. [D 20:43:36.115443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56507. [D 20:43:36.115458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56508. [D 20:43:36.115472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56509. [D 20:43:36.115486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56510. [D 20:43:36.115500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56511. [D 20:43:36.115514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56512. [D 20:43:36.115529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56513. [D 20:43:36.115543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56514. [D 20:43:36.115557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56515. [D 20:43:36.115571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56516. [D 20:43:36.115586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56517. [D 20:43:36.115600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56518. [D 20:43:36.115615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56519. [D 20:43:36.115629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56520. [D 20:43:36.115643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56521. [D 20:43:36.115658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56522. [D 20:43:36.115672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56523. [D 20:43:36.115687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56524. [D 20:43:36.115701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56525. [D 20:43:36.115715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56526. [D 20:43:36.115729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56527. [D 20:43:36.115744] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56528. [D 20:43:36.125331] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56528. [D 20:43:36.125352] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 38/70. [D 20:43:36.125483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.125505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.125518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.135160] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.135177] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.135189] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.135227] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7942 [D 20:43:36.135242] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.135258] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 39/70. [D 20:43:36.138264] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7942 [D 20:43:36.138332] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 40/70. [D 20:43:36.138404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56528. [D 20:43:36.138430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56529. [D 20:43:36.138444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56530. [D 20:43:36.138459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56531. [D 20:43:36.138473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56532. [D 20:43:36.138487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56533. [D 20:43:36.138502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56534. [D 20:43:36.138516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56535. [D 20:43:36.138530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56536. [D 20:43:36.138544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56537. [D 20:43:36.138559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56538. [D 20:43:36.138574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56539. [D 20:43:36.138588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56540. [D 20:43:36.138603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56541. [D 20:43:36.138617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56542. [D 20:43:36.138631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56543. [D 20:43:36.138645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56544. [D 20:43:36.138659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56545. [D 20:43:36.138674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56546. [D 20:43:36.138688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56547. [D 20:43:36.138702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56548. [D 20:43:36.138716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56549. [D 20:43:36.138731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56550. [D 20:43:36.138745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56551. [D 20:43:36.138759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56552. [D 20:43:36.138773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56553. [D 20:43:36.138787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56554. [D 20:43:36.138802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56555. [D 20:43:36.138816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56556. [D 20:43:36.138830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56557. [D 20:43:36.138844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56558. [D 20:43:36.138859] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56559. [D 20:43:36.147906] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56559. [D 20:43:36.147928] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 41/70. [D 20:43:36.148062] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.148084] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.148096] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.158404] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.158422] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.158434] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.158471] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7945 [D 20:43:36.158486] element 0: offset: 0x61e5f0, size: 24 [D 20:43:36.158503] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 42/70. [D 20:43:36.161557] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7945 [D 20:43:36.161630] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 43/70. [D 20:43:36.161688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56559. [D 20:43:36.161712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56560. [D 20:43:36.161727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56561. [D 20:43:36.161741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56562. [D 20:43:36.161756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56563. [D 20:43:36.161770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56564. [D 20:43:36.161785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56565. [D 20:43:36.161799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56566. [D 20:43:36.161813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56567. [D 20:43:36.161828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56568. [D 20:43:36.161842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56569. [D 20:43:36.161856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56570. [D 20:43:36.161871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56571. [D 20:43:36.161885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56572. [D 20:43:36.161899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56573. [D 20:43:36.161914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56574. [D 20:43:36.161928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56575. [D 20:43:36.161942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56576. [D 20:43:36.161957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56577. [D 20:43:36.161971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56578. [D 20:43:36.161985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56579. [D 20:43:36.162000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56580. [D 20:43:36.162014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56581. [D 20:43:36.162028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56582. [D 20:43:36.162043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56583. [D 20:43:36.162057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56584. [D 20:43:36.162071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56585. [D 20:43:36.162085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56586. [D 20:43:36.162100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56587. [D 20:43:36.162115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56588. [D 20:43:36.162129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56589. [D 20:43:36.162144] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56590. [D 20:43:36.172088] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56590. [D 20:43:36.172110] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 44/70. [D 20:43:36.172243] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.172265] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.172278] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.181674] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.181692] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.181705] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.181741] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7948 [D 20:43:36.181756] element 0: offset: 0x636ca0, size: 24 [D 20:43:36.181773] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 45/70. [D 20:43:36.184788] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7948 [D 20:43:36.184853] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 46/70. [D 20:43:36.184937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56590. [D 20:43:36.184963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56591. [D 20:43:36.184977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56592. [D 20:43:36.184991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56593. [D 20:43:36.185006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56594. [D 20:43:36.185020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56595. [D 20:43:36.185034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56596. [D 20:43:36.185048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56597. [D 20:43:36.185063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56598. [D 20:43:36.185077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56599. [D 20:43:36.185091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56600. [D 20:43:36.185105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56601. [D 20:43:36.185120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56602. [D 20:43:36.185134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56603. [D 20:43:36.185148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56604. [D 20:43:36.185162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56605. [D 20:43:36.185176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56606. [D 20:43:36.185191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56607. [D 20:43:36.185206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56608. [D 20:43:36.185220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56609. [D 20:43:36.185234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56610. [D 20:43:36.185248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56611. [D 20:43:36.185262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56612. [D 20:43:36.185277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56613. [D 20:43:36.185291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56614. [D 20:43:36.185305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56615. [D 20:43:36.185319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56616. [D 20:43:36.185333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56617. [D 20:43:36.185347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56618. [D 20:43:36.185362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56619. [D 20:43:36.185376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56620. [D 20:43:36.185390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56621. [D 20:43:36.195331] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56621. [D 20:43:36.195352] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 47/70. [D 20:43:36.195483] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.195505] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.195518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.204788] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.204805] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.204818] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.204855] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7951 [D 20:43:36.204870] element 0: offset: 0x644470, size: 24 [D 20:43:36.204886] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 48/70. [D 20:43:36.207866] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7951 [D 20:43:36.207932] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 49/70. [D 20:43:36.208043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56621. [D 20:43:36.208068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56622. [D 20:43:36.208083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56623. [D 20:43:36.208097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56624. [D 20:43:36.208111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56625. [D 20:43:36.208125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56626. [D 20:43:36.208140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56627. [D 20:43:36.208155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56628. [D 20:43:36.208169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56629. [D 20:43:36.208183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56630. [D 20:43:36.208197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56631. [D 20:43:36.208212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56632. [D 20:43:36.208226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56633. [D 20:43:36.208245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56634. [D 20:43:36.208259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56635. [D 20:43:36.208273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56636. [D 20:43:36.208287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56637. [D 20:43:36.208301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56638. [D 20:43:36.208316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56639. [D 20:43:36.208330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56640. [D 20:43:36.208344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56641. [D 20:43:36.208358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56642. [D 20:43:36.208372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56643. [D 20:43:36.208386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56644. [D 20:43:36.208400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56645. [D 20:43:36.208414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56646. [D 20:43:36.208428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56647. [D 20:43:36.208442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56648. [D 20:43:36.208456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56649. [D 20:43:36.208470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56650. [D 20:43:36.208487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56651. [D 20:43:36.208501] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56652. [D 20:43:36.218192] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56652. [D 20:43:36.218213] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 50/70. [D 20:43:36.218342] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.218365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.218378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.228094] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.321937] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.321955] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.321994] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7954 [D 20:43:36.322008] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.322024] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 51/70. [D 20:43:36.325324] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7954 [D 20:43:36.325397] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 52/70. [D 20:43:36.326619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56652. [D 20:43:36.326646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56653. [D 20:43:36.326660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56654. [D 20:43:36.326675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56655. [D 20:43:36.326693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56656. [D 20:43:36.326707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56657. [D 20:43:36.326721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56658. [D 20:43:36.326735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56659. [D 20:43:36.326749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56660. [D 20:43:36.326764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56661. [D 20:43:36.326778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 56662. [D 20:43:36.326792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 56663. [D 20:43:36.326806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 56664. [D 20:43:36.326820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 56665. [D 20:43:36.326834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56666. [D 20:43:36.326848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56667. [D 20:43:36.326863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56668. [D 20:43:36.326877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 56669. [D 20:43:36.326891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 56670. [D 20:43:36.326905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 56671. [D 20:43:36.326919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 56672. [D 20:43:36.326934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 56673. [D 20:43:36.326948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56674. [D 20:43:36.326962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56675. [D 20:43:36.326976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56676. [D 20:43:36.326991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 56677. [D 20:43:36.327006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 56678. [D 20:43:36.327020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 56679. [D 20:43:36.327034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 56680. [D 20:43:36.327048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 56681. [D 20:43:36.327062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56682. [D 20:43:36.327088] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56683. [D 20:43:36.332588] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56683. [D 20:43:36.332608] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 53/70. [D 20:43:36.335783] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.335801] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.335814] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.471295] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.471316] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.471334] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.471376] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7957 [D 20:43:36.471392] element 0: offset: 0x61e5f0, size: 24 [D 20:43:36.471407] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 54/70. [D 20:43:36.472545] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 655360, tag: 7957 [D 20:43:36.472626] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 55/70. [D 20:43:36.472694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 56683. [D 20:43:36.472717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 56684. [D 20:43:36.472731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 56685. [D 20:43:36.472746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 56686. [D 20:43:36.472761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 56687. [D 20:43:36.472775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 56688. [D 20:43:36.472790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56689. [D 20:43:36.472809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56690. [D 20:43:36.472829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56691. [D 20:43:36.472846] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60f7e0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 56692. [D 20:43:36.476386] openib_check_cq: completed rdma wr_id 2aaaab60f7e0, nic_wr_credit 56692. [D 20:43:36.476403] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 56/70. [D 20:43:36.479468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.479483] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.479496] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.484775] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.484793] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.484806] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.484828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7960 [D 20:43:36.484842] element 0: offset: 0x636ca0, size: 24 [D 20:43:36.484856] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 57/70. [D 20:43:36.484934] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.484950] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.484962] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.500286] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.500304] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.500317] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.503287] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7962 [D 20:43:36.503303] element 0: offset: 0x644320, size: 24 [D 20:43:36.503317] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 58/70. [D 20:43:36.503433] BMI_post_recv: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7962 [D 20:43:36.503452] openib_post_sr: 10.1.4.240:43806 bh 0 len 48 wr 59/70. [D 20:43:36.504513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7962 [D 20:43:36.504529] element 0: offset: 0x644320, size: 24 [D 20:43:36.507246] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 60/70. [D 20:43:36.507304] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.507319] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.507333] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.628312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.628339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.628353] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.628395] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7970 [D 20:43:36.628410] element 0: offset: 0x658610, size: 24 [D 20:43:36.628429] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 0/70. [D 20:43:36.628464] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.628479] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.628491] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.628513] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7971 [D 20:43:36.628528] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:36.628544] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 1/70. [D 20:43:36.628571] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.628585] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.628598] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.628629] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.628642] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.628655] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.628674] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7975 [D 20:43:36.628688] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:36.628705] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 2/70. [D 20:43:36.628954] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7973 [D 20:43:36.628971] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:36.628986] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 3/70. [D 20:43:36.629083] BMI_post_recv: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7973 [D 20:43:36.629118] openib_post_sr: 10.1.4.240:43806 bh 6 len 48 wr 4/70. [D 20:43:36.636301] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7970 [D 20:43:36.636390] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 5/70. [D 20:43:36.636533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56692. [D 20:43:36.636561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 56693. [D 20:43:36.636576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 56694. [D 20:43:36.636590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 56695. [D 20:43:36.636604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 56696. [D 20:43:36.636618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 56697. [D 20:43:36.636632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56698. [D 20:43:36.636647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56699. [D 20:43:36.636661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56700. [D 20:43:36.636675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 56701. [D 20:43:36.636689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 56702. [D 20:43:36.636703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 56703. [D 20:43:36.636717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 56704. [D 20:43:36.636733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 56705. [D 20:43:36.636747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56706. [D 20:43:36.636761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56707. [D 20:43:36.636775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56708. [D 20:43:36.636789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 56709. [D 20:43:36.636803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 56710. [D 20:43:36.636817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 56711. [D 20:43:36.636832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 56712. [D 20:43:36.636846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 56713. [D 20:43:36.636860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56714. [D 20:43:36.636874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56715. [D 20:43:36.636888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56716. [D 20:43:36.636902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 56717. [D 20:43:36.636916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 56718. [D 20:43:36.636930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 56719. [D 20:43:36.636944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 56720. [D 20:43:36.636958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 56721. [D 20:43:36.636972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56722. [D 20:43:36.636986] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6089e0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56723. [D 20:43:36.638171] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7971 [D 20:43:36.638226] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 6/70. [D 20:43:36.638257] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7975 [D 20:43:36.638274] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 7/70. [D 20:43:36.640221] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7973 [D 20:43:36.640254] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:36.640271] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 8/70. [D 20:43:36.647557] openib_check_cq: completed rdma wr_id 2aaaab6089e0, nic_wr_credit 56723. [D 20:43:36.647584] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 9/70. [D 20:43:36.647601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 56723. [D 20:43:36.647615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 56724. [D 20:43:36.647629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 56725. [D 20:43:36.647643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 56726. [D 20:43:36.647657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 56727. [D 20:43:36.647672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 56728. [D 20:43:36.647686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 56729. [D 20:43:36.647700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 56730. [D 20:43:36.647714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 56731. [D 20:43:36.647728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 56732. [D 20:43:36.647742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 56733. [D 20:43:36.647756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 56734. [D 20:43:36.647770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 56735. [D 20:43:36.647784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 56736. [D 20:43:36.647798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 56737. [D 20:43:36.647812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 56738. [D 20:43:36.647826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 56739. [D 20:43:36.647840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 56740. [D 20:43:36.647854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 56741. [D 20:43:36.647868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 56742. [D 20:43:36.647882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 56743. [D 20:43:36.647896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 56744. [D 20:43:36.647910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 56745. [D 20:43:36.647924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 56746. [D 20:43:36.647938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 56747. [D 20:43:36.647952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 56748. [D 20:43:36.647966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 56749. [D 20:43:36.647980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 56750. [D 20:43:36.647994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 56751. [D 20:43:36.648008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 56752. [D 20:43:36.648022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 56753. [D 20:43:36.648036] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607d10 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 56754. [D 20:43:36.648052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 56755. [D 20:43:36.648066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 56756. [D 20:43:36.648085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 56757. [D 20:43:36.648099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 56758. [D 20:43:36.648113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 56759. [D 20:43:36.648128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 56760. [D 20:43:36.648142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 56761. [D 20:43:36.648156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 56762. [D 20:43:36.648170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 56763. [D 20:43:36.648184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 56764. [D 20:43:36.648199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 56765. [D 20:43:36.648213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 56766. [D 20:43:36.648227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 56767. [D 20:43:36.648246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 56768. [D 20:43:36.648260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 56769. [D 20:43:36.648274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 56770. [D 20:43:36.648289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 56771. [D 20:43:36.648303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 56772. [D 20:43:36.648317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 56773. [D 20:43:36.648331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 56774. [D 20:43:36.648346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 56775. [D 20:43:36.648360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 56776. [D 20:43:36.648374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 56777. [D 20:43:36.648388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 56778. [D 20:43:36.648402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 56779. [D 20:43:36.648417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 56780. [D 20:43:36.648431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 56781. [D 20:43:36.648445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 56782. [D 20:43:36.648459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 56783. [D 20:43:36.648474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 56784. [D 20:43:36.648488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 56785. [D 20:43:36.648503] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab608330 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 56786. [D 20:43:36.648567] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.648588] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.648601] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.648624] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.648637] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.648649] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.655469] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.655485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.655497] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.655532] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7979 [D 20:43:36.655546] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:36.655561] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 10/70. [D 20:43:36.659400] openib_check_cq: completed rdma wr_id 2aaaab607d10, nic_wr_credit 56786. [D 20:43:36.659426] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 11/70. [D 20:43:36.666339] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.666360] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.666373] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.666484] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7981 [D 20:43:36.666500] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:36.666515] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 12/70. [D 20:43:36.666890] openib_check_cq: completed rdma wr_id 2aaaab608330, nic_wr_credit 56785. [D 20:43:36.666913] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 13/70. [D 20:43:36.666964] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.666981] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.666994] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.667080] BMI_post_recv: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7981 [D 20:43:36.667104] openib_post_sr: 10.1.4.240:43806 bh 16 len 48 wr 14/70. [D 20:43:36.667135] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.667149] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.667161] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.670313] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7979 [D 20:43:36.670386] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 15/70. [D 20:43:36.674073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56785. [D 20:43:36.674099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 56786. [D 20:43:36.674113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 56787. [D 20:43:36.674128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 56788. [D 20:43:36.674142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 56789. [D 20:43:36.674157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 56790. [D 20:43:36.674171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56791. [D 20:43:36.674186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56792. [D 20:43:36.674200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56793. [D 20:43:36.674215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 56794. [D 20:43:36.674230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 56795. [D 20:43:36.674244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 56796. [D 20:43:36.674259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 56797. [D 20:43:36.674273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 56798. [D 20:43:36.674287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56799. [D 20:43:36.674302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56800. [D 20:43:36.674316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56801. [D 20:43:36.674331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 56802. [D 20:43:36.674345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 56803. [D 20:43:36.674360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 56804. [D 20:43:36.674374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 56805. [D 20:43:36.674389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 56806. [D 20:43:36.674403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56807. [D 20:43:36.674417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56808. [D 20:43:36.674432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56809. [D 20:43:36.674446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 56810. [D 20:43:36.674460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 56811. [D 20:43:36.674475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 56812. [D 20:43:36.674489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 56813. [D 20:43:36.674503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 56814. [D 20:43:36.674518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56815. [D 20:43:36.674532] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cf20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56816. [D 20:43:36.680234] openib_check_cq: completed rdma wr_id 2aaaab60cf20, nic_wr_credit 56816. [D 20:43:36.680255] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 16/70. [D 20:43:36.680343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.680365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.680378] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.680977] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7981 [D 20:43:36.680997] element 0: offset: 0x2aaaab60ca80, size: 24 [D 20:43:36.681017] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 17/70. [D 20:43:36.681063] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.681077] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.681089] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.685406] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.685426] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.685439] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.685474] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7985 [D 20:43:36.685492] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:36.685508] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 18/70. [D 20:43:36.685541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.685554] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.685567] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.685587] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7987 [D 20:43:36.685601] element 0: offset: 0x2aaaab615250, size: 24 [D 20:43:36.685618] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 19/70. [D 20:43:36.688795] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.688863] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.688877] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.688922] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7992 [D 20:43:36.688937] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:36.688956] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 20/70. [D 20:43:36.689001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.689015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.689027] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.689047] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7993 [D 20:43:36.689061] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:36.689077] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 21/70. [D 20:43:36.696299] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 7985 [D 20:43:36.696384] openib_post_sr: 10.1.4.240:43806 bh 4 len 32 wr 22/70. [D 20:43:36.696412] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 7992 [D 20:43:36.696428] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 23/70. [D 20:43:36.696443] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 7987 [D 20:43:36.696458] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 24/70. [D 20:43:36.696530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 56816. [D 20:43:36.696557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 56817. [D 20:43:36.696571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 56818. [D 20:43:36.696586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 56819. [D 20:43:36.696600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 56820. [D 20:43:36.696615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 56821. [D 20:43:36.696629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 56822. [D 20:43:36.696643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 56823. [D 20:43:36.696657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 56824. [D 20:43:36.696672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 56825. [D 20:43:36.696686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 56826. [D 20:43:36.696700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 56827. [D 20:43:36.696714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 56828. [D 20:43:36.696730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 56829. [D 20:43:36.696745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 56830. [D 20:43:36.696759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 56831. [D 20:43:36.696773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 56832. [D 20:43:36.696788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 56833. [D 20:43:36.696802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 56834. [D 20:43:36.696817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 56835. [D 20:43:36.696831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 56836. [D 20:43:36.696846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 56837. [D 20:43:36.696860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 56838. [D 20:43:36.696874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 56839. [D 20:43:36.696889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 56840. [D 20:43:36.696904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 56841. [D 20:43:36.696918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 56842. [D 20:43:36.696932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 56843. [D 20:43:36.696947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 56844. [D 20:43:36.696961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 56845. [D 20:43:36.696976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 56846. [D 20:43:36.696990] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cee0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 56847. [D 20:43:36.697007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56848. [D 20:43:36.697022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 56849. [D 20:43:36.697036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 56850. [D 20:43:36.697051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 56851. [D 20:43:36.697065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 56852. [D 20:43:36.697080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 56853. [D 20:43:36.697094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56854. [D 20:43:36.697108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56855. [D 20:43:36.697123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56856. [D 20:43:36.697137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 56857. [D 20:43:36.697152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 56858. [D 20:43:36.697167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 56859. [D 20:43:36.697181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 56860. [D 20:43:36.697195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 56861. [D 20:43:36.697210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56862. [D 20:43:36.697224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56863. [D 20:43:36.697238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56864. [D 20:43:36.697253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 56865. [D 20:43:36.697267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 56866. [D 20:43:36.697281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 56867. [D 20:43:36.697296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 56868. [D 20:43:36.697311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 56869. [D 20:43:36.697325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56870. [D 20:43:36.697339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56871. [D 20:43:36.697354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56872. [D 20:43:36.697368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 56873. [D 20:43:36.697382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 56874. [D 20:43:36.697397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 56875. [D 20:43:36.697411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 56876. [D 20:43:36.697425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 56877. [D 20:43:36.697440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56878. [D 20:43:36.697454] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6175f0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56879. [D 20:43:36.697470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 56880. [D 20:43:36.697485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 56881. [D 20:43:36.697499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 56882. [D 20:43:36.697513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 56883. [D 20:43:36.697528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 56884. [D 20:43:36.697542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 56885. [D 20:43:36.697557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 56886. [E 20:43:36.697577] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 56887, block for 10 ms. [D 20:43:36.698849] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7993 [D 20:43:36.708327] openib_check_cq: completed rdma wr_id 2aaaab60cee0, nic_wr_credit 56886. [D 20:43:36.708352] openib_post_sr: 10.1.4.240:43806 bh 7 len 16 wr 25/70. [D 20:43:36.708366] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 56885. [D 20:43:36.708381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 56886. [D 20:43:36.708396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 56887. [D 20:43:36.708410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 56888. [D 20:43:36.708425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 56889. [D 20:43:36.708439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 56890. [D 20:43:36.708453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 56891. [D 20:43:36.708468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 56892. [D 20:43:36.708482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 56893. [D 20:43:36.708496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 56894. [D 20:43:36.708514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 56895. [D 20:43:36.708529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 56896. [D 20:43:36.708543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 56897. [D 20:43:36.708558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 56898. [D 20:43:36.708572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 56899. [D 20:43:36.708586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 56900. [D 20:43:36.708601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 56901. [D 20:43:36.708615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 56902. [D 20:43:36.708629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 56903. [D 20:43:36.708644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 56904. [D 20:43:36.708658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 56905. [D 20:43:36.708672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 56906. [D 20:43:36.708687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 56907. [D 20:43:36.708701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 56908. [D 20:43:36.708715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 56909. [D 20:43:36.708729] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61ae20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 56910. [D 20:43:36.708766] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 26/70. [D 20:43:36.720059] openib_check_cq: completed rdma wr_id 2aaaab6175f0, nic_wr_credit 56910. [D 20:43:36.720081] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 27/70. [D 20:43:36.722293] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.722313] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.722327] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.731765] openib_check_cq: completed rdma wr_id 2aaaab61ae20, nic_wr_credit 56909. [D 20:43:36.731790] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 28/70. [D 20:43:36.731839] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.731860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.731873] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.731900] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.731913] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.731925] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.734715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56909. [D 20:43:36.734734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56910. [D 20:43:36.734749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 56911. [D 20:43:36.734763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 56912. [D 20:43:36.734777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 56913. [D 20:43:36.734791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 56914. [D 20:43:36.734806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 56915. [D 20:43:36.734820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56916. [D 20:43:36.734834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56917. [D 20:43:36.734848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56918. [D 20:43:36.734863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 56919. [D 20:43:36.734877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 56920. [D 20:43:36.734891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 56921. [D 20:43:36.734905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 56922. [D 20:43:36.734920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 56923. [D 20:43:36.734934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56924. [D 20:43:36.734948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56925. [D 20:43:36.734963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56926. [D 20:43:36.734977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 56927. [D 20:43:36.734991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 56928. [D 20:43:36.735005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 56929. [D 20:43:36.735021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 56930. [D 20:43:36.735035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 56931. [D 20:43:36.735049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56932. [D 20:43:36.735064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56933. [D 20:43:36.735078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56934. [D 20:43:36.735092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 56935. [D 20:43:36.735107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 56936. [D 20:43:36.735121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 56937. [D 20:43:36.735135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 56938. [D 20:43:36.735149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 56939. [D 20:43:36.735164] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab608140 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56940. [D 20:43:36.741223] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.741244] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.741257] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.741297] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 7996 [D 20:43:36.741312] element 0: offset: 0x2aaaab6081d0, size: 24 [D 20:43:36.741329] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 29/70. [D 20:43:36.741353] openib_check_cq: completed rdma wr_id 2aaaab608140, nic_wr_credit 56940. [D 20:43:36.741386] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 30/70. [D 20:43:36.741498] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.741516] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.741529] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.744601] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 7996 [D 20:43:36.744661] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 31/70. [D 20:43:36.746493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 56940. [D 20:43:36.746517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 56941. [D 20:43:36.746532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 56942. [D 20:43:36.746546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 56943. [D 20:43:36.746560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 56944. [D 20:43:36.746575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 56945. [D 20:43:36.746589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 56946. [D 20:43:36.746603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 56947. [D 20:43:36.746618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 56948. [D 20:43:36.746632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 56949. [D 20:43:36.746647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 56950. [D 20:43:36.746661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 56951. [D 20:43:36.746676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 56952. [D 20:43:36.746690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 56953. [D 20:43:36.746704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 56954. [D 20:43:36.746718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 56955. [D 20:43:36.746733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 56956. [D 20:43:36.746746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 56957. [D 20:43:36.746761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 56958. [D 20:43:36.746775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 56959. [D 20:43:36.746789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 56960. [D 20:43:36.746803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 56961. [D 20:43:36.746818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 56962. [D 20:43:36.746832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 56963. [D 20:43:36.746846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 56964. [D 20:43:36.746860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 56965. [D 20:43:36.746874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 56966. [D 20:43:36.746889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 56967. [D 20:43:36.746903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 56968. [D 20:43:36.746917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 56969. [D 20:43:36.746931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 56970. [D 20:43:36.746945] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 56971. [D 20:43:36.753045] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.753070] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.753083] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.753124] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8001 [D 20:43:36.753139] element 0: offset: 0x2aaaab0368a0, size: 24 [D 20:43:36.753156] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 32/70. [D 20:43:36.755525] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.755541] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.755554] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.755577] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8003 [D 20:43:36.755591] element 0: offset: 0x2aaaab036e70, size: 24 [D 20:43:36.755606] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 33/70. [D 20:43:36.756713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.756732] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.756745] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.756767] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8005 [D 20:43:36.756781] element 0: offset: 0x2aaaab0148e0, size: 24 [D 20:43:36.756798] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 34/70. [D 20:43:36.758149] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 56971. [D 20:43:36.758175] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 35/70. [D 20:43:36.758349] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.758370] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.758383] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.761829] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8001 [D 20:43:36.761898] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 36/70. [D 20:43:36.764127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56971. [D 20:43:36.764152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 56972. [D 20:43:36.764166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 56973. [D 20:43:36.764181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 56974. [D 20:43:36.764195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 56975. [D 20:43:36.764210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 56976. [D 20:43:36.764225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56977. [D 20:43:36.764239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56978. [D 20:43:36.764305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56979. [D 20:43:36.764322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 56980. [D 20:43:36.764336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 56981. [D 20:43:36.764351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 56982. [D 20:43:36.764365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 56983. [D 20:43:36.764383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 56984. [D 20:43:36.764398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56985. [D 20:43:36.764412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56986. [D 20:43:36.764427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56987. [D 20:43:36.764441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 56988. [D 20:43:36.764456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 56989. [D 20:43:36.764471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 56990. [D 20:43:36.764485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 56991. [D 20:43:36.764500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 56992. [D 20:43:36.764518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56993. [D 20:43:36.764532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56994. [D 20:43:36.764546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56995. [D 20:43:36.764570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 56996. [D 20:43:36.764586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 56997. [D 20:43:36.764600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 56998. [D 20:43:36.764614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 56999. [D 20:43:36.764628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 57000. [D 20:43:36.764642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57001. [D 20:43:36.764656] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57002. [D 20:43:36.766847] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.766921] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.766935] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.766980] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8008 [D 20:43:36.766996] element 0: offset: 0x644320, size: 24 [D 20:43:36.767018] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 37/70. [D 20:43:36.768843] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8003 [D 20:43:36.768903] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 38/70. [D 20:43:36.768981] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8005 [D 20:43:36.768999] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 39/70. [D 20:43:36.775453] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57002. [D 20:43:36.775481] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 40/70. [D 20:43:36.775499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57002. [D 20:43:36.775514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57003. [D 20:43:36.775528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57004. [D 20:43:36.775542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57005. [D 20:43:36.775556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57006. [D 20:43:36.775570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57007. [D 20:43:36.775584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57008. [D 20:43:36.775598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57009. [D 20:43:36.775612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57010. [D 20:43:36.775626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57011. [D 20:43:36.775640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57012. [D 20:43:36.775654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57013. [D 20:43:36.775668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57014. [D 20:43:36.775683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57015. [D 20:43:36.775697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57016. [D 20:43:36.775712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57017. [D 20:43:36.775726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57018. [D 20:43:36.775741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57019. [D 20:43:36.775755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57020. [D 20:43:36.775770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57021. [D 20:43:36.775785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57022. [D 20:43:36.775799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57023. [D 20:43:36.775814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57024. [D 20:43:36.775828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57025. [D 20:43:36.775843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57026. [D 20:43:36.775857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57027. [D 20:43:36.775872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57028. [D 20:43:36.775886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57029. [D 20:43:36.775901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57030. [D 20:43:36.775915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57031. [D 20:43:36.775930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57032. [D 20:43:36.775944] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57033. [D 20:43:36.775961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57034. [D 20:43:36.775976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57035. [D 20:43:36.775990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57036. [D 20:43:36.776005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57037. [D 20:43:36.776019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57038. [D 20:43:36.776034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57039. [D 20:43:36.776048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57040. [D 20:43:36.776063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57041. [D 20:43:36.776077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57042. [D 20:43:36.776093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57043. [D 20:43:36.776107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57044. [D 20:43:36.776121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57045. [D 20:43:36.776135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57046. [D 20:43:36.776149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57047. [D 20:43:36.776163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57048. [D 20:43:36.776177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57049. [D 20:43:36.776191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57050. [D 20:43:36.776205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57051. [D 20:43:36.776219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57052. [D 20:43:36.776233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57053. [D 20:43:36.776251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57054. [D 20:43:36.776265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57055. [D 20:43:36.776280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57056. [D 20:43:36.776295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57057. [D 20:43:36.776309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57058. [D 20:43:36.776323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57059. [D 20:43:36.776337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57060. [D 20:43:36.776351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57061. [D 20:43:36.776365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57062. [D 20:43:36.776379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57063. [D 20:43:36.776393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57064. [D 20:43:36.776407] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612950 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57065. [D 20:43:36.776481] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.776504] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.776518] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.779629] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8008 [D 20:43:36.779696] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 41/70. [D 20:43:36.787300] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 57065. [D 20:43:36.787326] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 42/70. [D 20:43:36.798891] openib_check_cq: completed rdma wr_id 2aaaab612950, nic_wr_credit 57064. [D 20:43:36.798917] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 43/70. [D 20:43:36.798949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57064. [D 20:43:36.798967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57065. [D 20:43:36.798983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57066. [D 20:43:36.798992] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.798997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57067. [D 20:43:36.799022] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.799037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57068. [D 20:43:36.799073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57069. [D 20:43:36.799057] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.799097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57070. [D 20:43:36.799138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57071. [D 20:43:36.799154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57072. [D 20:43:36.799173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57073. [D 20:43:36.799191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57074. [D 20:43:36.799208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57075. [D 20:43:36.799226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57076. [D 20:43:36.799243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57077. [D 20:43:36.799260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57078. [D 20:43:36.799278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57079. [D 20:43:36.799296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57080. [D 20:43:36.799313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57081. [D 20:43:36.799331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57082. [D 20:43:36.799348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57083. [D 20:43:36.799366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57084. [D 20:43:36.799384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57085. [D 20:43:36.799402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57086. [D 20:43:36.799419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57087. [D 20:43:36.799436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57088. [D 20:43:36.799452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57089. [D 20:43:36.799466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57090. [D 20:43:36.799481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57091. [D 20:43:36.799495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57092. [D 20:43:36.799509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57093. [D 20:43:36.799524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57094. [D 20:43:36.799538] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57095. [D 20:43:36.799582] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.799603] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.799616] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.805081] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57095. [D 20:43:36.805107] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 44/70. [D 20:43:36.805184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.805204] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.805217] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:36.821391] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.821408] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.821421] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:36.821460] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8013 [D 20:43:36.821475] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.821492] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 45/70. [D 20:43:36.823878] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.823943] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.823956] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.823998] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8017 [D 20:43:36.824013] element 0: offset: 0x658610, size: 24 [D 20:43:36.824034] openib_post_sr: 10.1.4.240:43806 bh 8 len 40 wr 46/70. [D 20:43:36.824077] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.824092] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.824104] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.824125] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8018 [D 20:43:36.824139] element 0: offset: 0x636ca0, size: 24 [D 20:43:36.824153] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 47/70. [D 20:43:36.824174] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.824188] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.824200] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.824220] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8020 [D 20:43:36.824234] element 0: offset: 0x641f50, size: 24 [D 20:43:36.824263] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 48/70. [D 20:43:36.828311] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8013 [D 20:43:36.828340] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 49/70. [D 20:43:36.828479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 57095. [D 20:43:36.828497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 57096. [D 20:43:36.828512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57097. [D 20:43:36.828531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57098. [D 20:43:36.828546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57099. [D 20:43:36.828560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57100. [D 20:43:36.828574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57101. [D 20:43:36.828589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57102. [D 20:43:36.828603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57103. [D 20:43:36.828617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57104. [D 20:43:36.828632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57105. [D 20:43:36.828646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57106. [D 20:43:36.828660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57107. [D 20:43:36.828674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57108. [D 20:43:36.828689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57109. [D 20:43:36.828703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57110. [D 20:43:36.828717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57111. [D 20:43:36.828731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57112. [D 20:43:36.828746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57113. [D 20:43:36.828760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57114. [D 20:43:36.828774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57115. [D 20:43:36.828788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57116. [D 20:43:36.828803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57117. [D 20:43:36.828817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57118. [D 20:43:36.828831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57119. [D 20:43:36.828846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57120. [D 20:43:36.828860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57121. [D 20:43:36.828874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57122. [D 20:43:36.828888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57123. [D 20:43:36.828902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57124. [D 20:43:36.828917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57125. [D 20:43:36.828931] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57126. [D 20:43:36.832071] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8018 [D 20:43:36.832087] openib_post_sr: 10.1.4.240:43806 bh 12 len 32 wr 50/70. [D 20:43:36.832103] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8017 [D 20:43:36.832118] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 51/70. [D 20:43:36.835351] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8020 [D 20:43:36.835431] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 52/70. [D 20:43:36.837591] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57126. [D 20:43:36.837618] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 53/70. [D 20:43:36.837637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57126. [D 20:43:36.837652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57127. [D 20:43:36.837667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57128. [D 20:43:36.837681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57129. [D 20:43:36.837695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57130. [D 20:43:36.837709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57131. [D 20:43:36.837724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57132. [D 20:43:36.837738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57133. [D 20:43:36.837752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57134. [D 20:43:36.837766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57135. [D 20:43:36.837780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57136. [D 20:43:36.837794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57137. [D 20:43:36.837808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57138. [D 20:43:36.837823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57139. [D 20:43:36.837837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57140. [D 20:43:36.837851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57141. [D 20:43:36.837865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57142. [D 20:43:36.837880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57143. [D 20:43:36.837894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57144. [D 20:43:36.837908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57145. [D 20:43:36.837922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57146. [D 20:43:36.837936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57147. [D 20:43:36.837950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57148. [D 20:43:36.837965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57149. [D 20:43:36.837981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57150. [D 20:43:36.837995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57151. [D 20:43:36.838010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57152. [D 20:43:36.838024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57153. [D 20:43:36.838038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57154. [D 20:43:36.838053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57155. [D 20:43:36.838067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57156. [D 20:43:36.838081] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab614d60 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57157. [D 20:43:36.838098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57158. [D 20:43:36.838113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 57159. [D 20:43:36.838128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 57160. [D 20:43:36.838142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 57161. [D 20:43:36.838156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 57162. [D 20:43:36.838171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 57163. [D 20:43:36.838185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57164. [D 20:43:36.838199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57165. [D 20:43:36.838213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57166. [D 20:43:36.838228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 57167. [D 20:43:36.838242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 57168. [D 20:43:36.838256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 57169. [D 20:43:36.838270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 57170. [D 20:43:36.838285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 57171. [D 20:43:36.838299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57172. [D 20:43:36.838313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57173. [D 20:43:36.838328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57174. [D 20:43:36.838342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 57175. [D 20:43:36.838356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 57176. [D 20:43:36.838370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 57177. [D 20:43:36.838385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 57178. [D 20:43:36.838400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 57179. [D 20:43:36.838414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57180. [D 20:43:36.838428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57181. [D 20:43:36.838442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57182. [D 20:43:36.838457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 57183. [D 20:43:36.838471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 57184. [D 20:43:36.838485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 57185. [D 20:43:36.838499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 57186. [D 20:43:36.838513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 57187. [D 20:43:36.838528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57188. [D 20:43:36.838542] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57189. [D 20:43:36.838558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57190. [D 20:43:36.838572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57191. [D 20:43:36.838586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57192. [D 20:43:36.838600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57193. [D 20:43:36.838615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57194. [D 20:43:36.838629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57195. [E 20:43:36.838648] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57196, block for 10 ms. [D 20:43:36.838679] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57195. [D 20:43:36.838695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57196. [E 20:43:36.838710] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57197, block for 10 ms. [D 20:43:36.846373] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57196. [E 20:43:36.846402] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57197, block for 10 ms. [D 20:43:36.849357] openib_check_cq: completed rdma wr_id 2aaaab614d60, nic_wr_credit 57196. [D 20:43:36.849380] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 54/70. [D 20:43:36.849394] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57195. [D 20:43:36.849409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57196. [D 20:43:36.849423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57197. [D 20:43:36.849437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57198. [D 20:43:36.849452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57199. [D 20:43:36.849467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57200. [D 20:43:36.849481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57201. [D 20:43:36.849495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57202. [D 20:43:36.849510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57203. [D 20:43:36.849524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57204. [D 20:43:36.849538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57205. [D 20:43:36.849553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57206. [D 20:43:36.849567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57207. [D 20:43:36.849581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57208. [D 20:43:36.849596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57209. [D 20:43:36.849610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57210. [D 20:43:36.849625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57211. [D 20:43:36.849639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57212. [D 20:43:36.849653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57213. [D 20:43:36.849668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57214. [D 20:43:36.849682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57215. [D 20:43:36.849696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57216. [D 20:43:36.849710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57217. [D 20:43:36.849725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57218. [D 20:43:36.849739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57219. [D 20:43:36.849753] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6129c0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57220. [D 20:43:36.849844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.849909] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.849922] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.849959] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.849973] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.849986] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.850025] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8023 [D 20:43:36.850040] element 0: offset: 0x644470, size: 24 [D 20:43:36.850059] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 55/70. [D 20:43:36.861021] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 57220. [D 20:43:36.861047] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 56/70. [D 20:43:36.863230] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.863250] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.863263] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.870445] openib_check_cq: completed rdma wr_id 2aaaab6129c0, nic_wr_credit 57219. [D 20:43:36.870467] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 57/70. [D 20:43:36.870517] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.870536] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.870548] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.870629] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.870643] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.870655] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:36.873714] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8023 [D 20:43:36.873740] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 58/70. [D 20:43:36.884084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 57219. [D 20:43:36.884106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 57220. [D 20:43:36.884121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57221. [D 20:43:36.884135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57222. [D 20:43:36.884150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57223. [D 20:43:36.884164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57224. [D 20:43:36.884178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57225. [D 20:43:36.884193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57226. [D 20:43:36.884207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57227. [D 20:43:36.884222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57228. [D 20:43:36.884236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57229. [D 20:43:36.884255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57230. [D 20:43:36.884269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57231. [D 20:43:36.884284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57232. [D 20:43:36.884299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57233. [D 20:43:36.884313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57234. [D 20:43:36.884328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57235. [D 20:43:36.884342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57236. [D 20:43:36.884357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57237. [D 20:43:36.884371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57238. [D 20:43:36.884385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57239. [D 20:43:36.884400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57240. [D 20:43:36.884414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57241. [D 20:43:36.884429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57242. [D 20:43:36.884444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57243. [D 20:43:36.884459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57244. [D 20:43:36.884473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57245. [D 20:43:36.884487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57246. [D 20:43:36.884501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57247. [D 20:43:36.884516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57248. [D 20:43:36.884533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57249. [D 20:43:36.884547] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57250. [D 20:43:36.886771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.886831] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.886845] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:36.886890] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8028 [D 20:43:36.886906] element 0: offset: 0x61f760, size: 24 [D 20:43:36.886926] openib_post_sr: 10.1.4.240:43806 bh 1 len 40 wr 59/70. [D 20:43:36.886968] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.886982] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.886995] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.887016] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8031 [D 20:43:36.887030] element 0: offset: 0x644320, size: 24 [D 20:43:36.887043] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 60/70. [D 20:43:36.887301] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.887318] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.887330] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.887352] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8032 [D 20:43:36.887366] element 0: offset: 0x62fd10, size: 24 [D 20:43:36.887382] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 0/70. [D 20:43:36.889981] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57250. [D 20:43:36.890005] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 1/70. [D 20:43:36.890184] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.890203] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.890215] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.896708] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8031 [D 20:43:36.896788] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 2/70. [D 20:43:36.896817] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8028 [D 20:43:36.896833] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 3/70. [D 20:43:36.896848] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8032 [D 20:43:36.896863] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 4/70. [D 20:43:36.896929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57250. [D 20:43:36.896948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 57251. [D 20:43:36.896962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 57252. [D 20:43:36.897000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 57253. [D 20:43:36.897016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 57254. [D 20:43:36.897031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 57255. [D 20:43:36.897062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57256. [D 20:43:36.897077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57257. [D 20:43:36.897091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57258. [D 20:43:36.897106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 57259. [D 20:43:36.897120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 57260. [D 20:43:36.897152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 57261. [D 20:43:36.897166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 57262. [D 20:43:36.897181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 57263. [D 20:43:36.897195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57264. [D 20:43:36.897225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57265. [D 20:43:36.897241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57266. [D 20:43:36.897255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 57267. [D 20:43:36.897270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 57268. [D 20:43:36.897284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 57269. [D 20:43:36.897299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 57270. [D 20:43:36.897335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 57271. [D 20:43:36.897349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57272. [D 20:43:36.897364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57273. [D 20:43:36.897378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57274. [D 20:43:36.897396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 57275. [D 20:43:36.897410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 57276. [D 20:43:36.897425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 57277. [D 20:43:36.897439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 57278. [D 20:43:36.897453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 57279. [D 20:43:36.897468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57280. [D 20:43:36.897482] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57281. [D 20:43:36.897500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57282. [D 20:43:36.897516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57283. [D 20:43:36.897530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57284. [D 20:43:36.897544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57285. [D 20:43:36.897559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57286. [D 20:43:36.897573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57287. [D 20:43:36.897587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57288. [D 20:43:36.897601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57289. [D 20:43:36.897616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57290. [D 20:43:36.897630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57291. [D 20:43:36.897644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57292. [D 20:43:36.897659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57293. [D 20:43:36.897673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57294. [D 20:43:36.897687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57295. [D 20:43:36.897701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57296. [D 20:43:36.897716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57297. [D 20:43:36.897730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57298. [D 20:43:36.897744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57299. [D 20:43:36.897758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57300. [D 20:43:36.897773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57301. [D 20:43:36.897787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57302. [D 20:43:36.897801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57303. [D 20:43:36.897815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57304. [D 20:43:36.897830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57305. [D 20:43:36.897844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57306. [D 20:43:36.897858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57307. [D 20:43:36.897872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57308. [D 20:43:36.897887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57309. [D 20:43:36.897901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57310. [D 20:43:36.897915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57311. [D 20:43:36.897930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57312. [D 20:43:36.897945] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607cd0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57313. [D 20:43:36.897961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57314. [D 20:43:36.897975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57315. [D 20:43:36.897990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57316. [D 20:43:36.898004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57317. [D 20:43:36.898018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57318. [D 20:43:36.898033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57319. [D 20:43:36.898047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57320. [E 20:43:36.898066] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57321, block for 10 ms. [D 20:43:36.898679] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57320. [E 20:43:36.898710] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57321, block for 10 ms. [D 20:43:36.908802] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57320. [D 20:43:36.908825] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 5/70. [D 20:43:36.908839] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57319. [D 20:43:36.908854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57320. [D 20:43:36.908869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57321. [D 20:43:36.908883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57322. [D 20:43:36.908897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57323. [D 20:43:36.908912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57324. [D 20:43:36.908926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57325. [D 20:43:36.908940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57326. [D 20:43:36.908954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57327. [D 20:43:36.908969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57328. [D 20:43:36.908983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57329. [D 20:43:36.908997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57330. [D 20:43:36.909012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57331. [D 20:43:36.909026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57332. [D 20:43:36.909041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57333. [D 20:43:36.909055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57334. [D 20:43:36.909070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57335. [D 20:43:36.909084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57336. [D 20:43:36.909098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57337. [D 20:43:36.909113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57338. [D 20:43:36.909127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57339. [D 20:43:36.909141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57340. [D 20:43:36.909155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57341. [D 20:43:36.909170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57342. [D 20:43:36.909184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57343. [D 20:43:36.909198] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61fac0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57344. [D 20:43:36.909267] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.909331] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.909344] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.909388] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8035 [D 20:43:36.909403] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:36.909427] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 6/70. [D 20:43:36.920423] openib_check_cq: completed rdma wr_id 2aaaab607cd0, nic_wr_credit 57344. [D 20:43:36.920449] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 7/70. [D 20:43:36.922649] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.922669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.922682] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.930396] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.930414] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.930427] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.930450] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8039 [D 20:43:36.930465] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:36.930483] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 8/70. [D 20:43:36.931242] openib_check_cq: completed rdma wr_id 2aaaab61fac0, nic_wr_credit 57343. [D 20:43:36.931266] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 9/70. [D 20:43:36.931325] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.931344] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.931357] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.931468] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.931484] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.931496] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.934875] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8035 [D 20:43:36.934907] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 10/70. [D 20:43:36.936516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 57343. [D 20:43:36.936538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 57344. [D 20:43:36.936552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57345. [D 20:43:36.936567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57346. [D 20:43:36.936585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57347. [D 20:43:36.936599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57348. [D 20:43:36.936614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57349. [D 20:43:36.936628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57350. [D 20:43:36.936642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57351. [D 20:43:36.936656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57352. [D 20:43:36.936671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57353. [D 20:43:36.936685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57354. [D 20:43:36.936699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57355. [D 20:43:36.936713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57356. [D 20:43:36.936727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57357. [D 20:43:36.936742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57358. [D 20:43:36.936756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57359. [D 20:43:36.936770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57360. [D 20:43:36.936784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57361. [D 20:43:36.936799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57362. [D 20:43:36.936813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57363. [D 20:43:36.936827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57364. [D 20:43:36.936841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57365. [D 20:43:36.936856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57366. [D 20:43:36.936870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57367. [D 20:43:36.936884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57368. [D 20:43:36.936898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57369. [D 20:43:36.936912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57370. [D 20:43:36.936926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57371. [D 20:43:36.936940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57372. [D 20:43:36.936954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57373. [D 20:43:36.936969] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57374. [D 20:43:36.938802] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8039 [D 20:43:36.938892] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 11/70. [D 20:43:36.945105] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.945126] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.945139] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:36.945183] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8042 [D 20:43:36.945198] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:36.945217] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 12/70. [D 20:43:36.945255] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:36.945269] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.945281] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:36.945301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8044 [D 20:43:36.945315] element 0: offset: 0x2aaaab60fb50, size: 24 [D 20:43:36.945333] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 13/70. [D 20:43:36.948323] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57374. [D 20:43:36.948348] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 14/70. [D 20:43:36.948379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57374. [D 20:43:36.948398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 57375. [D 20:43:36.948413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 57376. [D 20:43:36.948427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 57377. [D 20:43:36.948442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 57378. [D 20:43:36.948457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 57379. [D 20:43:36.948472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57380. [D 20:43:36.948486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57381. [D 20:43:36.948501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57382. [D 20:43:36.948516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 57383. [D 20:43:36.948534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 57384. [D 20:43:36.948549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 57385. [D 20:43:36.948563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 57386. [D 20:43:36.948578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 57387. [D 20:43:36.948592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57388. [D 20:43:36.948607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57389. [D 20:43:36.948621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57390. [D 20:43:36.948636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 57391. [D 20:43:36.948650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 57392. [D 20:43:36.948665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 57393. [D 20:43:36.948679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 57394. [D 20:43:36.948695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 57395. [D 20:43:36.948709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57396. [D 20:43:36.948724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57397. [D 20:43:36.948738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57398. [D 20:43:36.948752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 57399. [D 20:43:36.948767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 57400. [D 20:43:36.948781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 57401. [D 20:43:36.948795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 57402. [D 20:43:36.948810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 57403. [D 20:43:36.948824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57404. [D 20:43:36.948839] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607cd0 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57405. [D 20:43:36.948906] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.948935] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.948948] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:36.952288] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8042 [D 20:43:36.952311] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 15/70. [D 20:43:36.954795] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8044 [D 20:43:36.954813] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 16/70. [D 20:43:36.960001] openib_check_cq: completed rdma wr_id 2aaaab607cd0, nic_wr_credit 57405. [D 20:43:36.960017] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 17/70. [D 20:43:36.960107] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:36.960171] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:36.960184] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:36.965763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57405. [D 20:43:36.965784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57406. [D 20:43:36.965798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57407. [D 20:43:36.965812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57408. [D 20:43:36.965826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57409. [D 20:43:36.965840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57410. [D 20:43:36.965854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57411. [D 20:43:36.965868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57412. [D 20:43:36.965882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57413. [D 20:43:36.965896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57414. [D 20:43:36.965910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57415. [D 20:43:36.965925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57416. [D 20:43:36.965939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57417. [D 20:43:36.965953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57418. [D 20:43:36.965967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57419. [D 20:43:36.965981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57420. [D 20:43:36.965995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57421. [D 20:43:36.966009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57422. [D 20:43:36.966023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57423. [D 20:43:36.966037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57424. [D 20:43:36.966051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57425. [D 20:43:36.966065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57426. [D 20:43:36.966079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57427. [D 20:43:36.966094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57428. [D 20:43:36.966108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57429. [D 20:43:36.966122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57430. [D 20:43:36.966136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57431. [D 20:43:36.966150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57432. [D 20:43:36.966164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57433. [D 20:43:36.966178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57434. [D 20:43:36.966192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57435. [D 20:43:36.966206] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57436. [D 20:43:36.966222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57437. [D 20:43:36.966236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57438. [D 20:43:36.966250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57439. [D 20:43:36.966264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57440. [D 20:43:36.966278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57441. [D 20:43:36.966292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57442. [D 20:43:36.966306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57443. [D 20:43:36.966320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57444. [D 20:43:37.192866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57445. [D 20:43:37.192964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57446. [D 20:43:37.193085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57447. [D 20:43:37.193469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57448. [D 20:43:37.193487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57449. [D 20:43:37.193502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57450. [D 20:43:37.193516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57451. [D 20:43:37.193530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57452. [D 20:43:37.193548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57453. [D 20:43:37.193563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57454. [D 20:43:37.193577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57455. [D 20:43:37.193591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57456. [D 20:43:37.193606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57457. [D 20:43:37.193620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57458. [D 20:43:37.193634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57459. [D 20:43:37.193661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57460. [D 20:43:37.193676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57461. [D 20:43:37.193690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57462. [D 20:43:37.193704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57463. [D 20:43:37.193719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57464. [D 20:43:37.193733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57465. [D 20:43:37.193747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57466. [D 20:43:37.193761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57467. [D 20:43:37.193831] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57468. [D 20:43:37.193877] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57468. [D 20:43:37.194357] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 18/70. [D 20:43:37.194771] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.194795] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.194808] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.194849] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8048 [D 20:43:37.194864] element 0: offset: 0x2aaaab60ff90, size: 24 [D 20:43:37.194885] openib_post_sr: 10.1.4.240:43806 bh 2 len 40 wr 19/70. [D 20:43:37.194922] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.194936] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.194948] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.194968] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8051 [D 20:43:37.194983] element 0: offset: 0x2aaaab609c90, size: 24 [D 20:43:37.194997] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 20/70. [D 20:43:37.197494] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 57467. [D 20:43:37.197519] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 21/70. [D 20:43:37.197573] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.197593] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.197605] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.197817] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.197833] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.197845] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.206432] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8048 [D 20:43:37.206463] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 22/70. [D 20:43:37.208340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57467. [D 20:43:37.208360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57468. [D 20:43:37.208375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57469. [D 20:43:37.208389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57470. [D 20:43:37.208404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57471. [D 20:43:37.208418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57472. [D 20:43:37.208432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57473. [D 20:43:37.208447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57474. [D 20:43:37.208461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57475. [D 20:43:37.208476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57476. [D 20:43:37.208490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57477. [D 20:43:37.208505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57478. [D 20:43:37.208519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57479. [D 20:43:37.208533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57480. [D 20:43:37.208551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57481. [D 20:43:37.208566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57482. [D 20:43:37.208580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57483. [D 20:43:37.208595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57484. [D 20:43:37.208609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57485. [D 20:43:37.208624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57486. [D 20:43:37.208638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57487. [D 20:43:37.208652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57488. [D 20:43:37.208667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57489. [D 20:43:37.208681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57490. [D 20:43:37.208696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57491. [D 20:43:37.208710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57492. [D 20:43:37.208725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57493. [D 20:43:37.208739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57494. [D 20:43:37.208753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57495. [D 20:43:37.208768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57496. [D 20:43:37.208782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57497. [D 20:43:37.208813] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57498. [D 20:43:37.211006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.211078] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.211093] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.211140] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8054 [D 20:43:37.211155] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:37.211175] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 23/70. [D 20:43:37.211221] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.211235] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.211248] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.211267] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8056 [D 20:43:37.211282] element 0: offset: 0x2aaaab615250, size: 24 [D 20:43:37.211304] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 24/70. [D 20:43:37.211281] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8051 [D 20:43:37.211393] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 25/70. [D 20:43:37.216258] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 57498. [D 20:43:37.216286] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 26/70. [D 20:43:37.216305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57498. [D 20:43:37.216320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f440c000 rkey 4a4004e nic_wr_credit 57499. [D 20:43:37.216335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f442c000 rkey 4a4004e nic_wr_credit 57500. [D 20:43:37.216349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f444c000 rkey 4a4004e nic_wr_credit 57501. [D 20:43:37.216363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f446c000 rkey 4a4004e nic_wr_credit 57502. [D 20:43:37.216378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f448c000 rkey 4a4004e nic_wr_credit 57503. [D 20:43:37.216392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57504. [D 20:43:37.216407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57505. [D 20:43:37.216422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57506. [D 20:43:37.216436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f450c000 rkey 4a4004e nic_wr_credit 57507. [D 20:43:37.216450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f452c000 rkey 4a4004e nic_wr_credit 57508. [D 20:43:37.216464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f454c000 rkey 4a4004e nic_wr_credit 57509. [D 20:43:37.216479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f456c000 rkey 4a4004e nic_wr_credit 57510. [D 20:43:37.216493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f458c000 rkey 4a4004e nic_wr_credit 57511. [D 20:43:37.216508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57512. [D 20:43:37.216522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57513. [D 20:43:37.216537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57514. [D 20:43:37.216552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f460c000 rkey 4a4004e nic_wr_credit 57515. [D 20:43:37.216566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f462c000 rkey 4a4004e nic_wr_credit 57516. [D 20:43:37.216581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f464c000 rkey 4a4004e nic_wr_credit 57517. [D 20:43:37.216600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f466c000 rkey 4a4004e nic_wr_credit 57518. [D 20:43:37.216615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f468c000 rkey 4a4004e nic_wr_credit 57519. [D 20:43:37.216629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57520. [D 20:43:37.216644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57521. [D 20:43:37.216660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57522. [D 20:43:37.216674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f470c000 rkey 4a4004e nic_wr_credit 57523. [D 20:43:37.216689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f472c000 rkey 4a4004e nic_wr_credit 57524. [D 20:43:37.216703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f474c000 rkey 4a4004e nic_wr_credit 57525. [D 20:43:37.216718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f476c000 rkey 4a4004e nic_wr_credit 57526. [D 20:43:37.216733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f478c000 rkey 4a4004e nic_wr_credit 57527. [D 20:43:37.216747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57528. [D 20:43:37.216762] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607830 to 10.1.4.240:43806 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57529. [D 20:43:37.219809] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.219825] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.219841] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.224287] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8054 [D 20:43:37.224316] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 27/70. [D 20:43:37.225122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.225198] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.225212] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.225258] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8059 [D 20:43:37.225274] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:37.225296] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 28/70. [D 20:43:37.228111] openib_check_cq: completed rdma wr_id 2aaaab607830, nic_wr_credit 57529. [D 20:43:37.228137] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 29/70. [D 20:43:37.228166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57529. [D 20:43:37.228183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57530. [D 20:43:37.228198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57531. [D 20:43:37.228212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57532. [D 20:43:37.228230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57533. [D 20:43:37.228244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57534. [D 20:43:37.228336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57535. [D 20:43:37.228351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57536. [D 20:43:37.228365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57537. [D 20:43:37.228379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57538. [D 20:43:37.228393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57539. [D 20:43:37.228407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57540. [D 20:43:37.228421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57541. [D 20:43:37.228435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57542. [D 20:43:37.228449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57543. [D 20:43:37.228463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57544. [D 20:43:37.228477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57545. [D 20:43:37.228490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57546. [D 20:43:37.228504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57547. [D 20:43:37.228518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57548. [D 20:43:37.228532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57549. [D 20:43:37.228550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57550. [D 20:43:37.228564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57551. [D 20:43:37.228578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57552. [D 20:43:37.228592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57553. [D 20:43:37.228606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57554. [D 20:43:37.228620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57555. [D 20:43:37.228635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57556. [D 20:43:37.228649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57557. [D 20:43:37.228663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57558. [D 20:43:37.228678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57559. [D 20:43:37.228692] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61d700 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57560. [D 20:43:37.228773] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.228823] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.228837] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.228304] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8056 [D 20:43:37.231911] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 30/70. [D 20:43:37.231931] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8059 [D 20:43:37.231948] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 31/70. [D 20:43:37.238719] openib_check_cq: completed rdma wr_id 2aaaab61d700, nic_wr_credit 57560. [D 20:43:37.238740] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 32/70. [D 20:43:37.238755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57560. [D 20:43:37.238770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57561. [D 20:43:37.238784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57562. [D 20:43:37.238798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57563. [D 20:43:37.238813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57564. [D 20:43:37.238827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57565. [D 20:43:37.238841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57566. [D 20:43:37.238855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57567. [D 20:43:37.238869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57568. [D 20:43:37.238884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57569. [D 20:43:37.238898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57570. [D 20:43:37.238912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57571. [D 20:43:37.238926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57572. [D 20:43:37.238941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57573. [D 20:43:37.238955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57574. [D 20:43:37.238969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57575. [D 20:43:37.238983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57576. [D 20:43:37.238998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57577. [D 20:43:37.239013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57578. [D 20:43:37.239028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57579. [D 20:43:37.239042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57580. [D 20:43:37.239056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57581. [D 20:43:37.239071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57582. [D 20:43:37.239085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57583. [D 20:43:37.239099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57584. [D 20:43:37.239113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57585. [D 20:43:37.239128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57586. [D 20:43:37.239142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57587. [D 20:43:37.239156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57588. [D 20:43:37.239171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57589. [D 20:43:37.239185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57590. [D 20:43:37.239199] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607cd0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57591. [D 20:43:37.239215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57592. [D 20:43:37.239230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57593. [D 20:43:37.239244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57594. [D 20:43:37.239258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57595. [D 20:43:37.239273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57596. [D 20:43:37.239287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57597. [D 20:43:37.239301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57598. [D 20:43:37.239315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57599. [D 20:43:37.239330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57600. [D 20:43:37.239344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57601. [D 20:43:37.239358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57602. [D 20:43:37.239373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57603. [D 20:43:37.239387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57604. [D 20:43:37.239401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57605. [D 20:43:37.239415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57606. [D 20:43:37.239430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57607. [D 20:43:37.239445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57608. [D 20:43:37.239459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57609. [D 20:43:37.239473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57610. [D 20:43:37.239487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57611. [D 20:43:37.239502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57612. [D 20:43:37.239516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57613. [D 20:43:37.239530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57614. [D 20:43:37.239544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57615. [D 20:43:37.239558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57616. [D 20:43:37.239573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57617. [D 20:43:37.239587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57618. [D 20:43:37.239601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57619. [D 20:43:37.239615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57620. [D 20:43:37.239629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57621. [D 20:43:37.239644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57622. [D 20:43:37.239658] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6083e0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57623. [D 20:43:37.239732] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.239778] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.239791] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.245076] openib_check_cq: completed rdma wr_id 2aaaab607cd0, nic_wr_credit 57623. [D 20:43:37.245100] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 33/70. [D 20:43:37.246755] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.246775] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.246788] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.246828] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8062 [D 20:43:37.246843] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:37.246863] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 34/70. [D 20:43:37.256392] openib_check_cq: completed rdma wr_id 2aaaab6083e0, nic_wr_credit 57622. [D 20:43:37.256418] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 35/70. [D 20:43:37.256470] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.256490] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.256503] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.256583] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.256598] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.256610] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:37.259582] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8062 [D 20:43:37.259607] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 36/70. [D 20:43:37.262004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57622. [D 20:43:37.262022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57623. [D 20:43:37.262036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 57624. [D 20:43:37.262050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 57625. [D 20:43:37.262064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 57626. [D 20:43:37.262079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 57627. [D 20:43:37.262093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 57628. [D 20:43:37.262107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57629. [D 20:43:37.262122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57630. [D 20:43:37.262136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57631. [D 20:43:37.262150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 57632. [D 20:43:37.262164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 57633. [D 20:43:37.262178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 57634. [D 20:43:37.262193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 57635. [D 20:43:37.262207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 57636. [D 20:43:37.262221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57637. [D 20:43:37.262235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57638. [D 20:43:37.262249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57639. [D 20:43:37.262264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 57640. [D 20:43:37.262278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 57641. [D 20:43:37.262292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 57642. [D 20:43:37.262307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 57643. [D 20:43:37.262321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 57644. [D 20:43:37.262335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57645. [D 20:43:37.262349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57646. [D 20:43:37.262364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57647. [D 20:43:37.262378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 57648. [D 20:43:37.262392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 57649. [D 20:43:37.262406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 57650. [D 20:43:37.262421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 57651. [D 20:43:37.262435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 57652. [D 20:43:37.262450] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab607cd0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57653. [D 20:43:37.271948] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.271997] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.272011] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:37.272053] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8065 [D 20:43:37.272069] element 0: offset: 0x2aaaab6176f0, size: 24 [D 20:43:37.272089] openib_post_sr: 10.1.4.240:43806 bh 0 len 40 wr 37/70. [D 20:43:37.274138] openib_check_cq: completed rdma wr_id 2aaaab607cd0, nic_wr_credit 57653. [D 20:43:37.274162] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 38/70. [D 20:43:37.274268] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.274287] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.274299] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:37.277313] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8065 [D 20:43:37.277338] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 39/70. [D 20:43:37.300655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 57653. [D 20:43:37.300676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 57654. [D 20:43:37.300691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 57655. [D 20:43:37.300704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 57656. [D 20:43:37.300719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 57657. [D 20:43:37.300733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 57658. [D 20:43:37.300747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 57659. [D 20:43:37.300761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57660. [D 20:43:37.300775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57661. [D 20:43:37.300789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57662. [D 20:43:37.300803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 57663. [D 20:43:37.300818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 57664. [D 20:43:37.300832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 57665. [D 20:43:37.300846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 57666. [D 20:43:37.300860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 57667. [D 20:43:37.300874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57668. [D 20:43:37.300888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57669. [D 20:43:37.300902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57670. [D 20:43:37.300917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 57671. [D 20:43:37.300931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 57672. [D 20:43:37.300946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 57673. [D 20:43:37.300960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 57674. [D 20:43:37.300974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 57675. [D 20:43:37.300988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57676. [D 20:43:37.301002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57677. [D 20:43:37.301017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57678. [D 20:43:37.301031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 57679. [D 20:43:37.301045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 57680. [D 20:43:37.301059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 57681. [D 20:43:37.301073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 57682. [D 20:43:37.301087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 57683. [D 20:43:37.301101] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57684. [D 20:43:37.312409] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57684. [D 20:43:37.312430] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 40/70. [D 20:43:37.312513] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.312564] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.312577] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:37.362728] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.362745] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.362757] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:37.362796] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8069 [D 20:43:37.362811] element 0: offset: 0x2aaaab60fb50, size: 24 [D 20:43:37.362830] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 41/70. [D 20:43:37.363066] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.363081] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.363094] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:37.363116] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8071 [D 20:43:37.363130] element 0: offset: 0x2aaaab615250, size: 24 [D 20:43:37.363145] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 42/70. [D 20:43:37.366428] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8071 [D 20:43:37.366453] openib_post_sr: 10.1.4.240:43806 bh 6 len 32 wr 43/70. [D 20:43:37.366510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57684. [D 20:43:37.366526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57685. [D 20:43:37.366541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 57686. [D 20:43:37.366555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 57687. [D 20:43:37.366570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 57688. [D 20:43:37.366584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 57689. [D 20:43:37.366598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 57690. [D 20:43:37.366612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57691. [D 20:43:37.366627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57692. [D 20:43:37.366641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57693. [D 20:43:37.366655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 57694. [D 20:43:37.366669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 57695. [D 20:43:37.366684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 57696. [D 20:43:37.366698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 57697. [D 20:43:37.366712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 57698. [D 20:43:37.366727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57699. [D 20:43:37.366741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57700. [D 20:43:37.366755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57701. [D 20:43:37.366770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 57702. [D 20:43:37.366784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 57703. [D 20:43:37.366798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 57704. [D 20:43:37.366812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 57705. [D 20:43:37.366827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 57706. [D 20:43:37.366841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57707. [D 20:43:37.366855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57708. [D 20:43:37.366869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57709. [D 20:43:37.366884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 57710. [D 20:43:37.366898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 57711. [D 20:43:37.366912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 57712. [D 20:43:37.366926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 57713. [D 20:43:37.366941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 57714. [D 20:43:37.366955] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6083e0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57715. [D 20:43:37.369298] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8069 [D 20:43:37.370157] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 44/70. [D 20:43:37.377652] openib_check_cq: completed rdma wr_id 2aaaab6083e0, nic_wr_credit 57715. [D 20:43:37.377673] openib_post_sr: 10.1.4.240:43806 bh 8 len 16 wr 45/70. [D 20:43:37.377703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 57715. [D 20:43:37.377717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 57716. [D 20:43:37.377732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 57717. [D 20:43:37.377746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 57718. [D 20:43:37.377760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 57719. [D 20:43:37.377774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 57720. [D 20:43:37.377788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57721. [D 20:43:37.377803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57722. [D 20:43:37.377817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57723. [D 20:43:37.377831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 57724. [D 20:43:37.377845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 57725. [D 20:43:37.377860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 57726. [D 20:43:37.377874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 57727. [D 20:43:37.377888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 57728. [D 20:43:37.377902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57729. [D 20:43:37.377916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57730. [D 20:43:37.377930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57731. [D 20:43:37.377945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 57732. [D 20:43:37.377959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 57733. [D 20:43:37.377973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 57734. [D 20:43:37.377987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 57735. [D 20:43:37.378001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 57736. [D 20:43:37.378016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57737. [D 20:43:37.378029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57738. [D 20:43:37.378044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57739. [D 20:43:37.378058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 57740. [D 20:43:37.378072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 57741. [D 20:43:37.378086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 57742. [D 20:43:37.378101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 57743. [D 20:43:37.378116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 57744. [D 20:43:37.378130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57745. [D 20:43:37.378144] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57746. [D 20:43:37.378228] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.378299] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.378312] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:37.389483] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57746. [D 20:43:37.389507] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 46/70. [D 20:43:37.389615] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.389635] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.389648] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:37.403868] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.403885] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.403897] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:37.403937] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8076 [D 20:43:37.403952] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:37.403971] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 47/70. [D 20:43:37.404017] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.404031] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.404043] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:37.404068] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8079 [D 20:43:37.404082] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:37.404097] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 48/70. [D 20:43:37.404187] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.404202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.404214] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.404235] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8080 [D 20:43:37.404255] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:37.404270] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 49/70. [D 20:43:37.408283] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8076 [D 20:43:37.408310] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 50/70. [D 20:43:37.408434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57746. [D 20:43:37.408453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57747. [D 20:43:37.408467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57748. [D 20:43:37.408481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57749. [D 20:43:37.408496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57750. [D 20:43:37.408510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57751. [D 20:43:37.408524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57752. [D 20:43:37.408539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57753. [D 20:43:37.408556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57754. [D 20:43:37.408571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57755. [D 20:43:37.408586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57756. [D 20:43:37.408600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57757. [D 20:43:37.408614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57758. [D 20:43:37.408628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57759. [D 20:43:37.408643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57760. [D 20:43:37.408657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57761. [D 20:43:37.408671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57762. [D 20:43:37.408686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57763. [D 20:43:37.408700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57764. [D 20:43:37.408714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57765. [D 20:43:37.408729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57766. [D 20:43:37.408743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57767. [D 20:43:37.408757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57768. [D 20:43:37.408771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57769. [D 20:43:37.408785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57770. [D 20:43:37.408800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57771. [D 20:43:37.408814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57772. [D 20:43:37.408828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57773. [D 20:43:37.408843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57774. [D 20:43:37.408857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57775. [D 20:43:37.408871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57776. [D 20:43:37.408885] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60ff00 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57777. [D 20:43:37.411882] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8079 [D 20:43:37.411899] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 51/70. [D 20:43:37.415577] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8080 [D 20:43:37.415659] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 52/70. [D 20:43:37.420096] openib_check_cq: completed rdma wr_id 2aaaab60ff00, nic_wr_credit 57777. [D 20:43:37.420116] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 53/70. [D 20:43:37.420135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 57777. [D 20:43:37.420151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 57778. [D 20:43:37.420167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 57779. [D 20:43:37.420181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 57780. [D 20:43:37.420196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 57781. [D 20:43:37.420210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 57782. [D 20:43:37.420224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57783. [D 20:43:37.420238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57784. [D 20:43:37.420257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57785. [D 20:43:37.420272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 57786. [D 20:43:37.420286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 57787. [D 20:43:37.420300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 57788. [D 20:43:37.420315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 57789. [D 20:43:37.420328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 57790. [D 20:43:37.420343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57791. [D 20:43:37.420357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57792. [D 20:43:37.420371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57793. [D 20:43:37.420385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 57794. [D 20:43:37.420400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 57795. [D 20:43:37.420414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 57796. [D 20:43:37.420428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 57797. [D 20:43:37.420442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 57798. [D 20:43:37.420457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57799. [D 20:43:37.420471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57800. [D 20:43:37.420485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57801. [D 20:43:37.420499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 57802. [D 20:43:37.420514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 57803. [D 20:43:37.420528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 57804. [D 20:43:37.420542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 57805. [D 20:43:37.420560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 57806. [D 20:43:37.420574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57807. [D 20:43:37.643684] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60d300 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57808. [D 20:43:37.643713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57809. [D 20:43:37.643728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57810. [D 20:43:37.643742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 57811. [D 20:43:37.643757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 57812. [D 20:43:37.643771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 57813. [D 20:43:37.643785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 57814. [D 20:43:37.643800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 57815. [D 20:43:37.643814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57816. [D 20:43:37.643828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57817. [D 20:43:37.643842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57818. [D 20:43:37.643856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 57819. [D 20:43:37.643871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 57820. [D 20:43:37.643885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 57821. [D 20:43:37.643899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 57822. [D 20:43:37.643913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 57823. [D 20:43:37.643927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57824. [D 20:43:37.643942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57825. [D 20:43:37.643956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57826. [D 20:43:37.643970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 57827. [D 20:43:37.643984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 57828. [D 20:43:37.643999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 57829. [D 20:43:37.644013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 57830. [D 20:43:37.644027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 57831. [D 20:43:37.644041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57832. [D 20:43:37.644055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57833. [D 20:43:37.644070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57834. [D 20:43:37.644083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 57835. [D 20:43:37.644098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 57836. [D 20:43:37.644113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 57837. [D 20:43:37.644127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 57838. [D 20:43:37.644141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 57839. [D 20:43:37.644155] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57840. [D 20:43:37.644174] openib_check_cq: completed rdma wr_id 2aaaab60d300, nic_wr_credit 57840. [D 20:43:37.644190] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 54/70. [D 20:43:37.644282] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.644347] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.644361] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.645549] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.645566] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.645579] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.645619] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8083 [D 20:43:37.645634] element 0: offset: 0x2aaaab60c570, size: 24 [D 20:43:37.645654] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 55/70. [D 20:43:37.645699] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.645713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.645725] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.645746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8086 [D 20:43:37.645760] element 0: offset: 0x2aaaab615250, size: 24 [D 20:43:37.645775] openib_post_sr: 10.1.4.240:43806 bh 19 len 40 wr 56/70. [D 20:43:37.649911] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57839. [D 20:43:37.649935] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 57/70. [D 20:43:37.652849] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.652864] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.652877] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.652975] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.652991] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.653003] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.658919] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8083 [D 20:43:37.658951] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 58/70. [D 20:43:37.658972] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8086 [D 20:43:37.658993] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 59/70. [D 20:43:37.660880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57839. [D 20:43:37.660948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57840. [D 20:43:37.660964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57841. [D 20:43:37.660979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57842. [D 20:43:37.660993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57843. [D 20:43:37.661007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57844. [D 20:43:37.661022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57845. [D 20:43:37.661036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57846. [D 20:43:37.661051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57847. [D 20:43:37.661065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57848. [D 20:43:37.661080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57849. [D 20:43:37.661094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57850. [D 20:43:37.661108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57851. [D 20:43:37.661122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57852. [D 20:43:37.661137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57853. [D 20:43:37.661151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57854. [D 20:43:37.661165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57855. [D 20:43:37.661179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57856. [D 20:43:37.661193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57857. [D 20:43:37.661207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57858. [D 20:43:37.661222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57859. [D 20:43:37.661236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57860. [D 20:43:37.661250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57861. [D 20:43:37.661264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57862. [D 20:43:37.661279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57863. [D 20:43:37.661293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57864. [D 20:43:37.661307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57865. [D 20:43:37.661321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57866. [D 20:43:37.661336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57867. [D 20:43:37.661350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57868. [D 20:43:37.661364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57869. [D 20:43:37.661379] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57870. [D 20:43:37.661398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57871. [D 20:43:37.661412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57872. [D 20:43:37.661427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57873. [D 20:43:37.661441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57874. [D 20:43:37.661456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57875. [D 20:43:37.661471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 57876. [D 20:43:37.661486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 57877. [D 20:43:37.661500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 57878. [D 20:43:37.661514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 57879. [D 20:43:37.661528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 57880. [D 20:43:37.661543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 57881. [D 20:43:37.661557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 57882. [D 20:43:37.661571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 57883. [D 20:43:37.661585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 57884. [D 20:43:37.661599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 57885. [D 20:43:37.661614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 57886. [D 20:43:37.661628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 57887. [D 20:43:37.661642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 57888. [D 20:43:37.661656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 57889. [D 20:43:37.661670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 57890. [D 20:43:37.661685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 57891. [D 20:43:37.661699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 57892. [D 20:43:37.661713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 57893. [D 20:43:37.661727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 57894. [D 20:43:37.661741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 57895. [D 20:43:37.661756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 57896. [D 20:43:37.661770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 57897. [D 20:43:37.661784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 57898. [D 20:43:37.661798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 57899. [D 20:43:37.661812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 57900. [D 20:43:37.661826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 57901. [D 20:43:37.661841] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab612b20 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 57902. [D 20:43:37.666822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.666839] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.666840] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57902. [D 20:43:37.666858] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.666889] openib_post_sr: 10.1.4.240:43806 bh 3 len 16 wr 60/70. [D 20:43:37.666927] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8091 [D 20:43:37.666946] element 0: offset: 0x2aaaab60cdb0, size: 24 [D 20:43:37.666965] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 0/70. [D 20:43:37.666999] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.667013] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.667025] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.667045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8092 [D 20:43:37.667059] element 0: offset: 0x2aaaab6176f0, size: 24 [D 20:43:37.667074] openib_post_sr: 10.1.4.240:43806 bh 5 len 40 wr 1/70. [D 20:43:37.677300] openib_check_cq: completed rdma wr_id 2aaaab612b20, nic_wr_credit 57901. [D 20:43:37.677325] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 2/70. [D 20:43:37.677385] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.677405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.677418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.677529] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.677544] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.677556] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.683497] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8091 [D 20:43:37.683524] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 3/70. [D 20:43:37.683544] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8092 [D 20:43:37.683558] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 4/70. [D 20:43:37.688765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 57901. [D 20:43:37.688788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 57902. [D 20:43:37.688802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 57903. [D 20:43:37.688816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 57904. [D 20:43:37.688831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 57905. [D 20:43:37.688845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 57906. [D 20:43:37.688859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57907. [D 20:43:37.688874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57908. [D 20:43:37.688888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57909. [D 20:43:37.688902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 57910. [D 20:43:37.688917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 57911. [D 20:43:37.688931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 57912. [D 20:43:37.688945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 57913. [D 20:43:37.688959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 57914. [D 20:43:37.688974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57915. [D 20:43:37.688988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57916. [D 20:43:37.689003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57917. [D 20:43:37.689018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 57918. [D 20:43:37.689032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 57919. [D 20:43:37.689047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 57920. [D 20:43:37.689061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 57921. [D 20:43:37.689075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 57922. [D 20:43:37.689090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57923. [D 20:43:37.689104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57924. [D 20:43:37.689118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57925. [D 20:43:37.689133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 57926. [D 20:43:37.689147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 57927. [D 20:43:37.689173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 57928. [D 20:43:37.689187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 57929. [D 20:43:37.689201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 57930. [D 20:43:37.689216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57931. [D 20:43:37.689230] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57932. [D 20:43:37.689247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57933. [D 20:43:37.689261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57934. [D 20:43:37.689276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 57935. [D 20:43:37.689290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 57936. [D 20:43:37.689304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 57937. [D 20:43:37.689319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 57938. [D 20:43:37.689333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 57939. [D 20:43:37.689347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57940. [D 20:43:37.689362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57941. [D 20:43:37.689376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57942. [D 20:43:37.689390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 57943. [D 20:43:37.689404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 57944. [D 20:43:37.689419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 57945. [D 20:43:37.689434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 57946. [D 20:43:37.689448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 57947. [D 20:43:37.689462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57948. [D 20:43:37.689476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57949. [D 20:43:37.689490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57950. [D 20:43:37.689505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 57951. [D 20:43:37.689519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 57952. [D 20:43:37.689533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 57953. [D 20:43:37.689547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 57954. [D 20:43:37.689561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 57955. [D 20:43:37.689575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57956. [D 20:43:37.689589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57957. [D 20:43:37.689604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57958. [D 20:43:37.689618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 57959. [D 20:43:37.689632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 57960. [D 20:43:37.689646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 57961. [D 20:43:37.689660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 57962. [D 20:43:37.689674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 57963. [D 20:43:37.689688] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57964. [D 20:43:37.691412] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.691480] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.691495] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.691539] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8096 [D 20:43:37.691554] element 0: offset: 0x2aaaab60fb50, size: 24 [D 20:43:37.691573] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 5/70. [D 20:43:37.691616] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.691630] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.691642] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.691663] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8098 [D 20:43:37.691677] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:37.691691] openib_post_sr: 10.1.4.240:43806 bh 10 len 40 wr 6/70. [D 20:43:37.694655] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 57964. [D 20:43:37.694682] openib_post_sr: 10.1.4.240:43806 bh 11 len 16 wr 7/70. [D 20:43:37.705144] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 57963. [D 20:43:37.705166] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 8/70. [D 20:43:37.705232] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.705254] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.705267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.705382] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.705396] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.705408] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.711293] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8096 [D 20:43:37.711366] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 9/70. [D 20:43:37.711444] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8098 [D 20:43:37.711461] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 10/70. [D 20:43:37.716113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 57963. [D 20:43:37.716139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 57964. [D 20:43:37.716154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 57965. [D 20:43:37.716168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 57966. [D 20:43:37.716182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 57967. [D 20:43:37.716196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 57968. [D 20:43:37.716210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 57969. [D 20:43:37.716224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 57970. [D 20:43:37.716239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 57971. [D 20:43:37.716256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 57972. [D 20:43:37.716271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 57973. [D 20:43:37.716285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 57974. [D 20:43:37.716300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 57975. [D 20:43:37.716314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 57976. [D 20:43:37.716329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 57977. [D 20:43:37.716342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 57978. [D 20:43:37.716357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 57979. [D 20:43:37.716371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 57980. [D 20:43:37.716385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 57981. [D 20:43:37.716400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 57982. [D 20:43:37.716414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 57983. [D 20:43:37.716428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 57984. [D 20:43:37.716443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 57985. [D 20:43:37.716457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 57986. [D 20:43:37.716472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 57987. [D 20:43:37.716486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 57988. [D 20:43:37.716511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 57989. [D 20:43:37.716525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 57990. [D 20:43:37.716539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 57991. [D 20:43:37.716553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 57992. [D 20:43:37.716567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 57993. [D 20:43:37.716585] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 57994. [D 20:43:37.716601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 57995. [D 20:43:37.716615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 57996. [D 20:43:37.716629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 57997. [D 20:43:37.716643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 57998. [D 20:43:37.716658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 57999. [D 20:43:37.716672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58000. [D 20:43:37.716686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58001. [D 20:43:37.716700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58002. [D 20:43:37.716714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58003. [D 20:43:37.716728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58004. [D 20:43:37.716742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58005. [D 20:43:37.716756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58006. [D 20:43:37.716770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58007. [D 20:43:37.716784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58008. [D 20:43:37.716798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58009. [D 20:43:37.716813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58010. [D 20:43:37.716827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58011. [D 20:43:37.716841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58012. [D 20:43:37.716855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58013. [D 20:43:37.716869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58014. [D 20:43:37.716883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58015. [D 20:43:37.716899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58016. [D 20:43:37.716912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58017. [D 20:43:37.716926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58018. [D 20:43:37.716941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58019. [D 20:43:37.716955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58020. [D 20:43:37.716969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58021. [D 20:43:37.716983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58022. [D 20:43:37.716998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58023. [D 20:43:37.717012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58024. [D 20:43:37.717026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58025. [D 20:43:37.717040] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58026. [D 20:43:37.718784] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.718807] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.718820] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.718862] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8103 [D 20:43:37.718877] element 0: offset: 0x2aaaab61bda0, size: 24 [D 20:43:37.718910] openib_post_sr: 10.1.4.240:43806 bh 15 len 40 wr 11/70. [D 20:43:37.718948] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.718962] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.718974] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.718995] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8104 [D 20:43:37.719009] element 0: offset: 0x2aaaab608460, size: 24 [D 20:43:37.719023] openib_post_sr: 10.1.4.240:43806 bh 16 len 40 wr 12/70. [D 20:43:37.722007] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58026. [D 20:43:37.722034] openib_post_sr: 10.1.4.240:43806 bh 17 len 16 wr 13/70. [D 20:43:37.732313] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58025. [D 20:43:37.732335] openib_post_sr: 10.1.4.240:43806 bh 18 len 16 wr 14/70. [D 20:43:37.732397] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.732417] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.732430] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.732542] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.732557] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.732570] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.736295] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8103 [D 20:43:37.736322] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 15/70. [D 20:43:37.738127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 58025. [D 20:43:37.738144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 58026. [D 20:43:37.738159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 58027. [D 20:43:37.738173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 58028. [D 20:43:37.738189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 58029. [D 20:43:37.738203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 58030. [D 20:43:37.738217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58031. [D 20:43:37.738232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58032. [D 20:43:37.738246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58033. [D 20:43:37.738260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 58034. [D 20:43:37.738275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 58035. [D 20:43:37.738289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 58036. [D 20:43:37.738303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 58037. [D 20:43:37.738318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 58038. [D 20:43:37.738332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58039. [D 20:43:37.738346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58040. [D 20:43:37.738361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58041. [D 20:43:37.738375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 58042. [D 20:43:37.738390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 58043. [D 20:43:37.738405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 58044. [D 20:43:37.738420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 58045. [D 20:43:37.738434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 58046. [D 20:43:37.738448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58047. [D 20:43:37.738462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58048. [D 20:43:37.738477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58049. [D 20:43:37.738491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 58050. [D 20:43:37.738505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 58051. [D 20:43:37.738519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 58052. [D 20:43:37.738534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 58053. [D 20:43:37.738548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 58054. [D 20:43:37.738562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58055. [D 20:43:37.738576] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58056. [D 20:43:37.741566] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8104 [D 20:43:37.741584] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 16/70. [D 20:43:37.745442] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58056. [D 20:43:37.745462] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 17/70. [D 20:43:37.745477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 58056. [D 20:43:37.745491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 58057. [D 20:43:37.745506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 58058. [D 20:43:37.745520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 58059. [D 20:43:37.745535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 58060. [D 20:43:37.745549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 58061. [D 20:43:37.745563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 58062. [D 20:43:37.745577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 58063. [D 20:43:37.745591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 58064. [D 20:43:37.745606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 58065. [D 20:43:37.745620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 58066. [D 20:43:37.745635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 58067. [D 20:43:37.745649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 58068. [D 20:43:37.745663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 58069. [D 20:43:37.745677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 58070. [D 20:43:37.745691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 58071. [D 20:43:37.745706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 58072. [D 20:43:37.745720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 58073. [D 20:43:37.745734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 58074. [D 20:43:37.745748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 58075. [D 20:43:37.745763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 58076. [D 20:43:37.745777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 58077. [D 20:43:37.745791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 58078. [D 20:43:37.745805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 58079. [D 20:43:37.745819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 58080. [D 20:43:37.745834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 58081. [D 20:43:37.745848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 58082. [D 20:43:37.745862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 58083. [D 20:43:37.745877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 58084. [D 20:43:37.745891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 58085. [D 20:43:37.745905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 58086. [D 20:43:37.745919] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 58087. [D 20:43:37.746001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.746058] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.746072] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:37.751355] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.751374] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.751387] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:37.751406] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58087. [D 20:43:37.751430] openib_post_sr: 10.1.4.240:43806 bh 2 len 16 wr 18/70. [D 20:43:37.751428] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8108 [D 20:43:37.751464] element 0: offset: 0x2aaaab61bda0, size: 24 [D 20:43:37.751486] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 19/70. [D 20:43:37.751531] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.751545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.751557] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.751578] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8110 [D 20:43:37.751592] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:37.751710] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 20/70. [D 20:43:37.751748] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.751762] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.751775] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.755298] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8108 [D 20:43:37.755335] openib_post_sr: 10.1.4.240:43806 bh 5 len 32 wr 21/70. [D 20:43:37.757003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 58087. [D 20:43:37.757023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 58088. [D 20:43:37.757037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 58089. [D 20:43:37.757051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 58090. [D 20:43:37.757066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 58091. [D 20:43:37.757080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 58092. [D 20:43:37.757094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 58093. [D 20:43:37.757108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 58094. [D 20:43:37.757123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 58095. [D 20:43:37.757137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 58096. [D 20:43:37.757151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 58097. [D 20:43:37.757165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 58098. [D 20:43:37.757183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 58099. [D 20:43:37.757197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 58100. [D 20:43:37.757211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 58101. [D 20:43:37.757226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 58102. [D 20:43:37.757240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 58103. [D 20:43:37.757254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 58104. [D 20:43:37.757268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 58105. [D 20:43:37.757282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 58106. [D 20:43:37.757296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 58107. [D 20:43:37.757310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 58108. [D 20:43:37.757324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 58109. [D 20:43:37.757338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 58110. [D 20:43:37.757352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 58111. [D 20:43:37.757366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 58112. [D 20:43:37.757380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 58113. [D 20:43:37.757394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 58114. [D 20:43:37.757408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 58115. [D 20:43:37.757423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 58116. [D 20:43:37.757437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 58117. [D 20:43:37.757451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 58118. [D 20:43:37.757541] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.757615] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.757629] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.757674] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8114 [D 20:43:37.757689] element 0: offset: 0x2aaaab60fb50, size: 24 [D 20:43:37.757710] openib_post_sr: 10.1.4.240:43806 bh 6 len 40 wr 22/70. [D 20:43:37.757756] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.757770] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.757783] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.757803] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8116 [D 20:43:37.757817] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:37.757834] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 23/70. [D 20:43:37.760149] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8110 [D 20:43:37.760224] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 24/70. [D 20:43:37.768764] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58118. [D 20:43:37.768787] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 25/70. [D 20:43:37.768812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 58118. [D 20:43:37.768828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 58119. [D 20:43:37.768843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 58120. [D 20:43:37.768857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 58121. [D 20:43:37.768870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 58122. [D 20:43:37.768885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58123. [D 20:43:37.768898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58124. [D 20:43:37.768913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58125. [D 20:43:37.768927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58126. [D 20:43:37.768941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58127. [D 20:43:37.768955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58128. [D 20:43:37.768969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58129. [D 20:43:37.768983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58130. [D 20:43:37.768997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58131. [D 20:43:37.769011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58132. [D 20:43:37.769025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58133. [D 20:43:37.769039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58134. [D 20:43:37.769053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58135. [D 20:43:37.769067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58136. [D 20:43:37.769081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58137. [D 20:43:37.769095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58138. [D 20:43:37.769109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58139. [D 20:43:37.769123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58140. [D 20:43:37.769137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58141. [D 20:43:37.769151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58142. [D 20:43:37.769165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58143. [D 20:43:37.769180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58144. [D 20:43:37.769193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58145. [D 20:43:37.769207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58146. [D 20:43:37.769222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58147. [D 20:43:37.769237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58148. [D 20:43:37.769251] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61bd10 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58149. [D 20:43:37.769311] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.769335] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.769348] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.775307] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8114 [D 20:43:37.775386] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 26/70. [D 20:43:37.775466] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8116 [D 20:43:37.775483] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 27/70. [D 20:43:37.780281] openib_check_cq: completed rdma wr_id 2aaaab61bd10, nic_wr_credit 58149. [D 20:43:37.780305] openib_post_sr: 10.1.4.240:43806 bh 12 len 16 wr 28/70. [D 20:43:37.780387] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.780410] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.780423] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.785572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 58149. [D 20:43:37.785593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 58150. [D 20:43:37.785607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 58151. [D 20:43:37.785621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 58152. [D 20:43:37.785635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 58153. [D 20:43:37.785649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 58154. [D 20:43:37.785664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58155. [D 20:43:37.785678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58156. [D 20:43:37.785692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58157. [D 20:43:37.785706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 58158. [D 20:43:37.785720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 58159. [D 20:43:37.785735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 58160. [D 20:43:37.785749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 58161. [D 20:43:37.785763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 58162. [D 20:43:37.785777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58163. [D 20:43:37.785792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58164. [D 20:43:37.785806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58165. [D 20:43:37.785820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 58166. [D 20:43:37.785834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 58167. [D 20:43:37.785850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 58168. [D 20:43:37.785864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 58169. [D 20:43:37.785878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 58170. [D 20:43:37.785892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58171. [D 20:43:37.785906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58172. [D 20:43:37.785920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58173. [D 20:43:37.785935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 58174. [D 20:43:37.785949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 58175. [D 20:43:37.785963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 58176. [D 20:43:37.785977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 58177. [D 20:43:37.785991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 58178. [D 20:43:37.786006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58179. [D 20:43:37.786020] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58180. [D 20:43:37.786036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 58181. [D 20:43:37.786050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 58182. [D 20:43:37.786064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 58183. [D 20:43:37.786078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 58184. [D 20:43:37.786092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 58185. [D 20:43:37.786106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 58186. [D 20:43:37.786120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 58187. [D 20:43:37.786134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 58188. [D 20:43:37.786149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 58189. [D 20:43:37.786163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 58190. [D 20:43:37.786177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 58191. [D 20:43:37.786191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 58192. [D 20:43:37.786205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 58193. [D 20:43:37.786219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 58194. [D 20:43:37.786233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 58195. [D 20:43:37.786247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 58196. [D 20:43:37.786262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 58197. [D 20:43:37.786276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 58198. [D 20:43:37.786290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 58199. [D 20:43:37.786305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 58200. [D 20:43:37.786319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 58201. [D 20:43:37.786333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 58202. [D 20:43:37.786347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 58203. [D 20:43:37.786362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 58204. [D 20:43:37.786376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 58205. [D 20:43:37.786390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 58206. [D 20:43:37.786404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 58207. [D 20:43:37.786419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 58208. [D 20:43:37.786433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 58209. [D 20:43:37.786447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 58210. [D 20:43:37.786461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 58211. [D 20:43:37.786476] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 58212. [D 20:43:37.791946] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.791969] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.791982] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:37.792023] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8120 [D 20:43:37.792038] element 0: offset: 0x2aaaab6176f0, size: 24 [D 20:43:37.792054] openib_post_sr: 10.1.4.240:43806 bh 13 len 40 wr 29/70. [D 20:43:37.792092] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:37.792106] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.792118] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:37.792139] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8122 [D 20:43:37.792152] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:37.792170] openib_post_sr: 10.1.4.240:43806 bh 14 len 40 wr 30/70. [D 20:43:37.797339] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58212. [D 20:43:37.797361] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 31/70. [D 20:43:37.808997] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58211. [D 20:43:37.809013] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 32/70. [D 20:43:37.809072] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.809093] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.809106] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:37.809219] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:37.809234] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:37.809246] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:37.812597] BMI_post_send: addr: 6811200, offset: 0x2aaaaade6010, size: 2097152, tag: 8120 [D 20:43:38.089195] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.089217] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.089231] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:38.089274] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8127 [D 20:43:38.089290] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:38.089310] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 33/70. [D 20:43:38.089353] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.089367] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.089380] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:38.089400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8128 [D 20:43:38.089414] element 0: offset: 0x2aaaab607480, size: 24 [D 20:43:38.089430] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 34/70. [D 20:43:38.092590] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 35/70. [D 20:43:38.092673] BMI_post_send: addr: 6811200, offset: 0x2aaaaabe5010, size: 2097152, tag: 8122 [D 20:43:38.092696] openib_post_sr: 10.1.4.240:43806 bh 0 len 32 wr 36/70. [D 20:43:38.093280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 58211. [D 20:43:38.093302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 58212. [D 20:43:38.093317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 58213. [D 20:43:38.093331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 58214. [D 20:43:38.093357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 58215. [D 20:43:38.093372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 58216. [D 20:43:38.093386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 58217. [D 20:43:38.093400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 58218. [D 20:43:38.093414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 58219. [D 20:43:38.093428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 58220. [D 20:43:38.093442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 58221. [D 20:43:38.093457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 58222. [D 20:43:38.093470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 58223. [D 20:43:38.093485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 58224. [D 20:43:38.093499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 58225. [D 20:43:38.093513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 58226. [D 20:43:38.094137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 58227. [D 20:43:38.094154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 58228. [D 20:43:38.094168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 58229. [D 20:43:38.094183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 58230. [D 20:43:38.094197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 58231. [D 20:43:38.094211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 58232. [D 20:43:38.094237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 58233. [D 20:43:38.094252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 58234. [D 20:43:38.094266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 58235. [D 20:43:38.094280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 58236. [D 20:43:38.094294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 58237. [D 20:43:38.094309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 58238. [D 20:43:38.094898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 58239. [D 20:43:38.094913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 58240. [D 20:43:38.094927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 58241. [D 20:43:38.094954] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab61bb10 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 58242. [D 20:43:38.094972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 58243. [D 20:43:38.094986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 58244. [D 20:43:38.095001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 58245. [D 20:43:38.095015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 58246. [D 20:43:38.095029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 58247. [D 20:43:38.095043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58248. [D 20:43:38.095058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58249. [D 20:43:38.095072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58250. [D 20:43:38.095086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58251. [D 20:43:38.095690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58252. [D 20:43:38.095707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58253. [D 20:43:38.095721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58254. [D 20:43:38.095736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58255. [D 20:43:38.095750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58256. [D 20:43:38.095764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58257. [D 20:43:38.095778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58258. [D 20:43:38.095792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58259. [D 20:43:38.095806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58260. [D 20:43:38.095820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58261. [D 20:43:38.095834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58262. [D 20:43:38.095848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58263. [D 20:43:38.095862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58264. [D 20:43:38.096371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58265. [D 20:43:38.096385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58266. [D 20:43:38.096399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58267. [D 20:43:38.096413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58268. [D 20:43:38.096427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58269. [D 20:43:38.096441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58270. [D 20:43:38.096455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58271. [D 20:43:38.096469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58272. [D 20:43:38.096483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58273. [D 20:43:38.096497] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58274. [D 20:43:38.099368] openib_check_cq: completed rdma wr_id 2aaaab61bb10, nic_wr_credit 58274. [D 20:43:38.099390] openib_post_sr: 10.1.4.240:43806 bh 1 len 16 wr 37/70. [D 20:43:38.104233] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8127 [D 20:43:38.104303] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 38/70. [D 20:43:38.104331] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8128 [D 20:43:38.104346] openib_post_sr: 10.1.4.240:43806 bh 3 len 32 wr 39/70. [D 20:43:38.105001] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58273. [D 20:43:38.105019] openib_post_sr: 10.1.4.240:43806 bh 4 len 16 wr 40/70. [D 20:43:38.105035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 58273. [D 20:43:38.105050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 58274. [D 20:43:38.105065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 58275. [D 20:43:38.105079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 58276. [D 20:43:38.105093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 58277. [D 20:43:38.105107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 58278. [D 20:43:38.105122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58279. [D 20:43:38.105137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58280. [D 20:43:38.105151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58281. [D 20:43:38.105165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 58282. [D 20:43:38.105180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 58283. [D 20:43:38.105195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 58284. [D 20:43:38.105209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 58285. [D 20:43:38.105223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 58286. [D 20:43:38.105238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58287. [D 20:43:38.105252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58288. [D 20:43:38.105267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58289. [D 20:43:38.105282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 58290. [D 20:43:38.105296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 58291. [D 20:43:38.105310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 58292. [D 20:43:38.105324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 58293. [D 20:43:38.105339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 58294. [D 20:43:38.105353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58295. [D 20:43:38.105368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58296. [D 20:43:38.105382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58297. [D 20:43:38.105395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 58298. [D 20:43:38.105411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 58299. [D 20:43:38.105425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 58300. [D 20:43:38.105439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 58301. [D 20:43:38.105454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 58302. [D 20:43:38.105468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58303. [D 20:43:38.105483] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58304. [D 20:43:38.105499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 58305. [D 20:43:38.105625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 58306. [D 20:43:38.105640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 58307. [D 20:43:38.105654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 58308. [D 20:43:38.105668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 58309. [D 20:43:38.105682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 58310. [D 20:43:38.105696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 58311. [D 20:43:38.105710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 58312. [D 20:43:38.105724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 58313. [D 20:43:38.105738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 58314. [D 20:43:38.105752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 58315. [D 20:43:38.105766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 58316. [D 20:43:38.105779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 58317. [D 20:43:38.105793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 58318. [D 20:43:38.105807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 58319. [D 20:43:38.105821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 58320. [D 20:43:38.105836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 58321. [D 20:43:38.105850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 58322. [D 20:43:38.105864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 58323. [D 20:43:38.105878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 58324. [D 20:43:38.105892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 58325. [D 20:43:38.105905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 58326. [D 20:43:38.105920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 58327. [D 20:43:38.105934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 58328. [D 20:43:38.105951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 58329. [D 20:43:38.105964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 58330. [D 20:43:38.105978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 58331. [D 20:43:38.105993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 58332. [D 20:43:38.106007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 58333. [D 20:43:38.106023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 58334. [D 20:43:38.106037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 58335. [D 20:43:38.106051] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 58336. [D 20:43:38.106138] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.106205] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.106218] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:38.106244] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.106257] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.106272] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:38.111021] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58336. [D 20:43:38.111042] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 41/70. [D 20:43:38.116896] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58335. [D 20:43:38.116911] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 42/70. [D 20:43:38.116974] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.116994] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.117007] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:38.117034] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.117048] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.117060] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:38.117095] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.117109] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.117122] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:38.117160] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8132 [D 20:43:38.117175] element 0: offset: 0x2aaaab6176f0, size: 24 [D 20:43:38.117195] openib_post_sr: 10.1.4.240:43806 bh 7 len 40 wr 43/70. [D 20:43:38.120506] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8132 [D 20:43:38.120532] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 44/70. [D 20:43:38.123001] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.123066] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.123080] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 2 [D 20:43:38.123123] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8134 [D 20:43:38.123138] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:38.123158] openib_post_sr: 10.1.4.240:43806 bh 9 len 40 wr 45/70. [D 20:43:38.126322] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8134 [D 20:43:38.126430] openib_post_sr: 10.1.4.240:43806 bh 10 len 32 wr 46/70. [D 20:43:38.128383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 58335. [D 20:43:38.128404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 58336. [D 20:43:38.128418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 58337. [D 20:43:38.128433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 58338. [D 20:43:38.128447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 58339. [D 20:43:38.128461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 58340. [D 20:43:38.128475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 58341. [D 20:43:38.128490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 58342. [D 20:43:38.128504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 58343. [D 20:43:38.128518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 58344. [D 20:43:38.128532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 58345. [D 20:43:38.128546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 58346. [D 20:43:38.128561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 58347. [D 20:43:38.128711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 58348. [D 20:43:38.129059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 58349. [D 20:43:38.129075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 58350. [D 20:43:38.129101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 58351. [D 20:43:38.129115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 58352. [D 20:43:38.129129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 58353. [D 20:43:38.129144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 58354. [D 20:43:38.129182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 58355. [D 20:43:38.129227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 58356. [D 20:43:38.129243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 58357. [D 20:43:38.129257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 58358. [D 20:43:38.129280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 58359. [D 20:43:38.129295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 58360. [D 20:43:38.129323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 58361. [D 20:43:38.129337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 58362. [D 20:43:38.129352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 58363. [D 20:43:38.129366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 58364. [D 20:43:38.129380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 58365. [D 20:43:38.129397] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 58366. [D 20:43:38.129414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 58367. [D 20:43:38.129428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 58368. [D 20:43:38.129443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 58369. [D 20:43:38.129457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 58370. [D 20:43:38.129471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 58371. [D 20:43:38.129485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58372. [D 20:43:38.129499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58373. [D 20:43:38.129513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58374. [D 20:43:38.129528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58375. [D 20:43:38.129542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58376. [D 20:43:38.129556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58377. [D 20:43:38.129571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58378. [D 20:43:38.129585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58379. [D 20:43:38.129599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58380. [D 20:43:38.129613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58381. [D 20:43:38.129627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58382. [D 20:43:38.129642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58383. [D 20:43:38.129656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58384. [D 20:43:38.129670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58385. [D 20:43:38.129684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58386. [D 20:43:38.129698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58387. [D 20:43:38.129712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58388. [D 20:43:38.129727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58389. [D 20:43:38.129741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58390. [D 20:43:38.129754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58391. [D 20:43:38.129769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58392. [D 20:43:38.129783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58393. [D 20:43:38.129797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58394. [D 20:43:38.129811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58395. [D 20:43:38.129825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58396. [D 20:43:38.129839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58397. [D 20:43:38.129853] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58398. [D 20:43:38.129920] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.129986] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.130000] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:38.130043] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8139 [D 20:43:38.130058] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:38.130078] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 47/70. [D 20:43:38.130122] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.130136] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.130148] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:38.130169] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8140 [D 20:43:38.130183] element 0: offset: 0x2aaaab60d640, size: 24 [D 20:43:38.130197] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 48/70. [D 20:43:38.139973] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58398. [D 20:43:38.139999] openib_post_sr: 10.1.4.240:43806 bh 13 len 16 wr 49/70. [D 20:43:38.151595] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58397. [D 20:43:38.151616] openib_post_sr: 10.1.4.240:43806 bh 14 len 16 wr 50/70. [D 20:43:38.151678] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.151700] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.151713] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:38.151824] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.151840] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.151852] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:38.154895] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8139 [D 20:43:38.154920] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 51/70. [D 20:43:38.158009] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8140 [D 20:43:38.158054] openib_post_sr: 10.1.4.240:43806 bh 16 len 32 wr 52/70. [D 20:43:38.162904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40042 nic_wr_credit 58397. [D 20:43:38.162926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 58398. [D 20:43:38.162940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 58399. [D 20:43:38.162954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 58400. [D 20:43:38.162968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 58401. [D 20:43:38.162982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 58402. [D 20:43:38.162996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58403. [D 20:43:38.163011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58404. [D 20:43:38.163025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58405. [D 20:43:38.163039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 58406. [D 20:43:38.163053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 58407. [D 20:43:38.163068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 58408. [D 20:43:38.163082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 58409. [D 20:43:38.163096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 58410. [D 20:43:38.163110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58411. [D 20:43:38.163124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58412. [D 20:43:38.163138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58413. [D 20:43:38.163153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 58414. [D 20:43:38.163167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 58415. [D 20:43:38.163181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 58416. [D 20:43:38.163195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 58417. [D 20:43:38.163210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 58418. [D 20:43:38.163225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58419. [D 20:43:38.163239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58420. [D 20:43:38.163253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58421. [D 20:43:38.163267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 58422. [D 20:43:38.163281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 58423. [D 20:43:38.163295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 58424. [D 20:43:38.163309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 58425. [D 20:43:38.163324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 58426. [D 20:43:38.163338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58427. [D 20:43:38.163352] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab6096d0 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58428. [D 20:43:38.163367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 58429. [D 20:43:38.163382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 58430. [D 20:43:38.163396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 58431. [D 20:43:38.163410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 58432. [D 20:43:38.163424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 58433. [D 20:43:38.163438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 58434. [D 20:43:38.163453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 58435. [D 20:43:38.163467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 58436. [D 20:43:38.163481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 58437. [D 20:43:38.163495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 58438. [D 20:43:38.163509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 58439. [D 20:43:38.163523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 58440. [D 20:43:38.163537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 58441. [D 20:43:38.163551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 58442. [D 20:43:38.163565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 58443. [D 20:43:38.163579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 58444. [D 20:43:38.163593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 58445. [D 20:43:38.163608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 58446. [D 20:43:38.163622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 58447. [D 20:43:38.163653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 58448. [D 20:43:38.163668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 58449. [D 20:43:38.163682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 58450. [D 20:43:38.163710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 58451. [D 20:43:38.163725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 58452. [D 20:43:38.163739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 58453. [D 20:43:38.163759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 58454. [D 20:43:38.163773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 58455. [D 20:43:38.163790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 58456. [D 20:43:38.163805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 58457. [D 20:43:38.163819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 58458. [D 20:43:38.163833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 58459. [D 20:43:38.163850] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 58460. [D 20:43:38.163919] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.163987] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.164001] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:38.164045] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8144 [D 20:43:38.164060] element 0: offset: 0x2aaaab607480, size: 24 [D 20:43:38.164080] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 53/70. [D 20:43:38.164118] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.164132] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.164144] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:38.164164] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8146 [D 20:43:38.164178] element 0: offset: 0x2aaaab6176f0, size: 24 [D 20:43:38.164192] openib_post_sr: 10.1.4.240:43806 bh 18 len 40 wr 54/70. [D 20:43:38.174671] openib_check_cq: completed rdma wr_id 2aaaab6096d0, nic_wr_credit 58460. [D 20:43:38.174696] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 55/70. [D 20:43:38.186351] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58459. [D 20:43:38.186371] openib_post_sr: 10.1.4.240:43806 bh 0 len 16 wr 56/70. [D 20:43:38.186437] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.186458] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.186471] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:38.186589] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.186604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.186616] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:38.192314] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8144 [D 20:43:38.192339] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 57/70. [D 20:43:38.195374] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8146 [D 20:43:38.195391] openib_post_sr: 10.1.4.240:43806 bh 2 len 32 wr 58/70. [D 20:43:38.197673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 58459. [D 20:43:38.197695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 58460. [D 20:43:38.197710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 58461. [D 20:43:38.197724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 58462. [D 20:43:38.197738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 58463. [D 20:43:38.197752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 58464. [D 20:43:38.197766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 58465. [D 20:43:38.197781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 58466. [D 20:43:38.197795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 58467. [D 20:43:38.197809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 58468. [D 20:43:38.197823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 58469. [D 20:43:38.197837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 58470. [D 20:43:38.197851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 58471. [D 20:43:38.197866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 58472. [D 20:43:38.197880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 58473. [D 20:43:38.197894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 58474. [D 20:43:38.197908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 58475. [D 20:43:38.197922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 58476. [D 20:43:38.197936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 58477. [D 20:43:38.197951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 58478. [D 20:43:38.197965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 58479. [D 20:43:38.197979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 58480. [D 20:43:38.197993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 58481. [D 20:43:38.198007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 58482. [D 20:43:38.198022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 58483. [D 20:43:38.198036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 58484. [D 20:43:38.198050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 58485. [D 20:43:38.198064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 58486. [D 20:43:38.198078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 58487. [D 20:43:38.198092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 58488. [D 20:43:38.198107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 58489. [D 20:43:38.198121] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 58490. [D 20:43:38.198137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 58491. [D 20:43:38.198151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 58492. [D 20:43:38.198166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 58493. [D 20:43:38.198180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 58494. [D 20:43:38.198194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 58495. [D 20:43:38.198208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58496. [D 20:43:38.198222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58497. [D 20:43:38.198236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58498. [D 20:43:38.198251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58499. [D 20:43:38.198265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58500. [D 20:43:38.198279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58501. [D 20:43:38.198293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58502. [D 20:43:38.198323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58503. [D 20:43:38.198338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58504. [D 20:43:38.198353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58505. [D 20:43:38.198367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58506. [D 20:43:38.198395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58507. [D 20:43:38.198409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58508. [D 20:43:38.198423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58509. [D 20:43:38.198438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58510. [D 20:43:38.198535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58511. [D 20:43:38.198551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58512. [D 20:43:38.198565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58513. [D 20:43:38.198579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58514. [D 20:43:38.198849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58515. [D 20:43:38.198867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58516. [D 20:43:38.198881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58517. [D 20:43:38.198896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58518. [D 20:43:38.198910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58519. [D 20:43:38.198924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58520. [D 20:43:38.198938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58521. [D 20:43:38.198952] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58522. [D 20:43:38.199022] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.199087] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.199101] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:38.199145] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8151 [D 20:43:38.199160] element 0: offset: 0x2aaaab614f80, size: 24 [D 20:43:38.199180] openib_post_sr: 10.1.4.240:43806 bh 3 len 40 wr 59/70. [D 20:43:38.199222] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.199235] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.199248] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:38.199270] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8152 [D 20:43:38.199284] element 0: offset: 0x2aaaab60c360, size: 24 [D 20:43:38.199298] openib_post_sr: 10.1.4.240:43806 bh 4 len 40 wr 60/70. [D 20:43:38.209449] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58522. [D 20:43:38.209475] openib_post_sr: 10.1.4.240:43806 bh 5 len 16 wr 0/70. [D 20:43:38.221076] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58521. [D 20:43:38.221092] openib_post_sr: 10.1.4.240:43806 bh 6 len 16 wr 1/70. [D 20:43:38.221159] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.221181] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.221194] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:38.221308] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.221323] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.221336] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:38.224619] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8151 [D 20:43:38.224702] openib_post_sr: 10.1.4.240:43806 bh 7 len 32 wr 2/70. [D 20:43:38.230376] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8152 [D 20:43:38.230399] openib_post_sr: 10.1.4.240:43806 bh 8 len 32 wr 3/70. [D 20:43:38.232395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fec000 rkey 4a40044 nic_wr_credit 58521. [D 20:43:38.232460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f400c000 rkey 4a40044 nic_wr_credit 58522. [D 20:43:38.232475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f402c000 rkey 4a40044 nic_wr_credit 58523. [D 20:43:38.232490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f404c000 rkey 4a40044 nic_wr_credit 58524. [D 20:43:38.232505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f406c000 rkey 4a40044 nic_wr_credit 58525. [D 20:43:38.232519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f408c000 rkey 4a40044 nic_wr_credit 58526. [D 20:43:38.232533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58527. [D 20:43:38.232547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58528. [D 20:43:38.232562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58529. [D 20:43:38.232581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f410c000 rkey 4a40044 nic_wr_credit 58530. [D 20:43:38.232595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f412c000 rkey 4a40044 nic_wr_credit 58531. [D 20:43:38.232615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f414c000 rkey 4a40044 nic_wr_credit 58532. [D 20:43:38.232630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f416c000 rkey 4a40044 nic_wr_credit 58533. [D 20:43:38.232644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f418c000 rkey 4a40044 nic_wr_credit 58534. [D 20:43:38.232659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58535. [D 20:43:38.232673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58536. [D 20:43:38.232688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58537. [D 20:43:38.232702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f420c000 rkey 4a40044 nic_wr_credit 58538. [D 20:43:38.232716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f422c000 rkey 4a40044 nic_wr_credit 58539. [D 20:43:38.232731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f424c000 rkey 4a40044 nic_wr_credit 58540. [D 20:43:38.232745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f426c000 rkey 4a40044 nic_wr_credit 58541. [D 20:43:38.232760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f428c000 rkey 4a40044 nic_wr_credit 58542. [D 20:43:38.232774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58543. [D 20:43:38.232789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58544. [D 20:43:38.232803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58545. [D 20:43:38.232818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f430c000 rkey 4a40044 nic_wr_credit 58546. [D 20:43:38.232832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f432c000 rkey 4a40044 nic_wr_credit 58547. [D 20:43:38.232847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f434c000 rkey 4a40044 nic_wr_credit 58548. [D 20:43:38.232861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f436c000 rkey 4a40044 nic_wr_credit 58549. [D 20:43:38.232875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f438c000 rkey 4a40044 nic_wr_credit 58550. [D 20:43:38.232890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58551. [D 20:43:38.232904] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58552. [D 20:43:38.232922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43dc000 rkey 4a4004e nic_wr_credit 58553. [D 20:43:38.232937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f43fc000 rkey 4a4004e nic_wr_credit 58554. [D 20:43:38.232952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f441c000 rkey 4a4004e nic_wr_credit 58555. [D 20:43:38.232966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f443c000 rkey 4a4004e nic_wr_credit 58556. [D 20:43:38.232981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f445c000 rkey 4a4004e nic_wr_credit 58557. [D 20:43:38.232995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f447c000 rkey 4a4004e nic_wr_credit 58558. [D 20:43:38.233010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f449c000 rkey 4a4004e nic_wr_credit 58559. [D 20:43:38.233025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44bc000 rkey 4a4004e nic_wr_credit 58560. [D 20:43:38.233039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44dc000 rkey 4a4004e nic_wr_credit 58561. [D 20:43:38.233053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f44fc000 rkey 4a4004e nic_wr_credit 58562. [D 20:43:38.233068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f451c000 rkey 4a4004e nic_wr_credit 58563. [D 20:43:38.233082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f453c000 rkey 4a4004e nic_wr_credit 58564. [D 20:43:38.233097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f455c000 rkey 4a4004e nic_wr_credit 58565. [D 20:43:38.233111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f457c000 rkey 4a4004e nic_wr_credit 58566. [D 20:43:38.233162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f459c000 rkey 4a4004e nic_wr_credit 58567. [D 20:43:38.233178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45bc000 rkey 4a4004e nic_wr_credit 58568. [D 20:43:38.233192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45dc000 rkey 4a4004e nic_wr_credit 58569. [D 20:43:38.233221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f45fc000 rkey 4a4004e nic_wr_credit 58570. [D 20:43:38.233236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f461c000 rkey 4a4004e nic_wr_credit 58571. [D 20:43:38.233250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f463c000 rkey 4a4004e nic_wr_credit 58572. [D 20:43:38.233265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f465c000 rkey 4a4004e nic_wr_credit 58573. [D 20:43:38.233279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f467c000 rkey 4a4004e nic_wr_credit 58574. [D 20:43:38.233296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f469c000 rkey 4a4004e nic_wr_credit 58575. [D 20:43:38.233311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46bc000 rkey 4a4004e nic_wr_credit 58576. [D 20:43:38.233326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46dc000 rkey 4a4004e nic_wr_credit 58577. [D 20:43:38.233340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f46fc000 rkey 4a4004e nic_wr_credit 58578. [D 20:43:38.233355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f471c000 rkey 4a4004e nic_wr_credit 58579. [D 20:43:38.233369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f473c000 rkey 4a4004e nic_wr_credit 58580. [D 20:43:38.233384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f475c000 rkey 4a4004e nic_wr_credit 58581. [D 20:43:38.233420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f477c000 rkey 4a4004e nic_wr_credit 58582. [D 20:43:38.233434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f479c000 rkey 4a4004e nic_wr_credit 58583. [D 20:43:38.233449] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f47bc000 rkey 4a4004e nic_wr_credit 58584. [D 20:43:38.233667] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.233690] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.233703] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 3 [D 20:43:38.233744] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8156 [D 20:43:38.233759] element 0: offset: 0x2aaaab60d030, size: 24 [D 20:43:38.244201] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58584. [D 20:43:38.533844] openib_post_sr: 10.1.4.240:43806 bh 9 len 16 wr 4/70. [D 20:43:38.533868] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58583. [D 20:43:38.533883] openib_post_sr: 10.1.4.240:43806 bh 10 len 16 wr 5/70. [D 20:43:38.534238] openib_post_sr: 10.1.4.240:43806 bh 11 len 40 wr 6/70. [D 20:43:38.534292] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.534307] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.534320] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 4 [D 20:43:38.534344] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8158 [D 20:43:38.534359] element 0: offset: 0x2aaaab029430, size: 24 [D 20:43:38.534373] openib_post_sr: 10.1.4.240:43806 bh 12 len 40 wr 7/70. [D 20:43:38.534422] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.534436] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.534449] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 3 [D 20:43:38.534471] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.534485] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.534497] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 2 [D 20:43:38.539396] BMI_post_send: addr: 6811200, offset: 0x2aaaab301010, size: 2097152, tag: 8156 [D 20:43:38.539476] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 8/70. [D 20:43:38.544646] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8158 [D 20:43:38.544728] openib_post_sr: 10.1.4.240:43806 bh 14 len 32 wr 9/70. [D 20:43:38.552890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47dc000 rkey 4a4004f nic_wr_credit 58583. [D 20:43:38.552914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f47fc000 rkey 4a4004f nic_wr_credit 58584. [D 20:43:38.552929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f481c000 rkey 4a4004f nic_wr_credit 58585. [D 20:43:38.552943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f483c000 rkey 4a4004f nic_wr_credit 58586. [D 20:43:38.552962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f485c000 rkey 4a4004f nic_wr_credit 58587. [D 20:43:38.552976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f487c000 rkey 4a4004f nic_wr_credit 58588. [D 20:43:38.552990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f489c000 rkey 4a4004f nic_wr_credit 58589. [D 20:43:38.553005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48bc000 rkey 4a4004f nic_wr_credit 58590. [D 20:43:38.553019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48dc000 rkey 4a4004f nic_wr_credit 58591. [D 20:43:38.553033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f48fc000 rkey 4a4004f nic_wr_credit 58592. [D 20:43:38.553047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f491c000 rkey 4a4004f nic_wr_credit 58593. [D 20:43:38.553061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f493c000 rkey 4a4004f nic_wr_credit 58594. [D 20:43:38.553076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f495c000 rkey 4a4004f nic_wr_credit 58595. [D 20:43:38.553090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f497c000 rkey 4a4004f nic_wr_credit 58596. [D 20:43:38.553104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f499c000 rkey 4a4004f nic_wr_credit 58597. [D 20:43:38.553118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49bc000 rkey 4a4004f nic_wr_credit 58598. [D 20:43:38.553133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49dc000 rkey 4a4004f nic_wr_credit 58599. [D 20:43:38.553148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f49fc000 rkey 4a4004f nic_wr_credit 58600. [D 20:43:38.553162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 58601. [D 20:43:38.553176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 58602. [D 20:43:38.553191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 58603. [D 20:43:38.553205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 58604. [D 20:43:38.553219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 58605. [D 20:43:38.553234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4abc000 rkey 4a4004f nic_wr_credit 58606. [D 20:43:38.553248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4adc000 rkey 4a4004f nic_wr_credit 58607. [D 20:43:38.553262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4afc000 rkey 4a4004f nic_wr_credit 58608. [D 20:43:38.553276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 58609. [D 20:43:38.553291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 58610. [D 20:43:38.553305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 58611. [D 20:43:38.553319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 58612. [D 20:43:38.553333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 58613. [D 20:43:38.553348] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 58614. [D 20:43:38.553365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 58615. [D 20:43:38.553380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 58616. [D 20:43:38.553394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 58617. [D 20:43:38.553409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 58618. [D 20:43:38.553423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 58619. [D 20:43:38.553437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 58620. [D 20:43:38.553451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 58621. [D 20:43:38.553466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 58622. [D 20:43:38.553480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 58623. [D 20:43:38.553494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 58624. [D 20:43:38.553508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 58625. [D 20:43:38.553523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 58626. [D 20:43:38.553537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 58627. [D 20:43:38.553551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 58628. [D 20:43:38.553566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 58629. [D 20:43:38.553581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 58630. [D 20:43:38.553595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 58631. [D 20:43:38.553609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 58632. [D 20:43:38.553623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 58633. [D 20:43:38.553637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 58634. [D 20:43:38.553651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 58635. [D 20:43:38.553665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 58636. [D 20:43:38.553679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 58637. [D 20:43:38.553693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 58638. [D 20:43:38.553707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4edc000 rkey 4a40050 nic_wr_credit 58639. [D 20:43:38.553721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4efc000 rkey 4a40050 nic_wr_credit 58640. [D 20:43:38.553735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 58641. [D 20:43:38.553749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 58642. [D 20:43:38.553763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 58643. [D 20:43:38.553777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 58644. [D 20:43:38.553791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 58645. [D 20:43:38.553805] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60cd40 to 10.1.4.240:43806 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 58646. [D 20:43:38.558810] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58646. [D 20:43:38.558831] openib_post_sr: 10.1.4.240:43806 bh 15 len 16 wr 10/70. [D 20:43:38.564713] openib_check_cq: completed rdma wr_id 2aaaab60cd40, nic_wr_credit 58645. [D 20:43:38.564733] openib_post_sr: 10.1.4.240:43806 bh 16 len 16 wr 11/70. [D 20:43:38.564809] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.564835] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.564849] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 1 [D 20:43:38.564874] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.564888] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.564900] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:38.587189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:38.587212] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.587225] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:38.587263] BMI_post_send_list: addr: 6811200, count: 1, total_size: 24, tag: 8161 [D 20:43:38.587278] element 0: offset: 0x2aaaab035270, size: 24 [D 20:43:38.587300] openib_post_sr: 10.1.4.240:43806 bh 17 len 40 wr 12/70. [D 20:43:38.590532] BMI_post_send: addr: 6811200, offset: 0x2aaaab100010, size: 2097152, tag: 8161 [D 20:43:38.590612] openib_post_sr: 10.1.4.240:43806 bh 18 len 32 wr 13/70. [D 20:43:38.590766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 58645. [D 20:43:38.590792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 58646. [D 20:43:38.590808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f401c000 rkey 4a40044 nic_wr_credit 58647. [D 20:43:38.590822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f403c000 rkey 4a40044 nic_wr_credit 58648. [D 20:43:38.590836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f405c000 rkey 4a40044 nic_wr_credit 58649. [D 20:43:38.590850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f407c000 rkey 4a40044 nic_wr_credit 58650. [D 20:43:38.590864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f409c000 rkey 4a40044 nic_wr_credit 58651. [D 20:43:38.590878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58652. [D 20:43:38.590892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58653. [D 20:43:38.590906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58654. [D 20:43:38.590919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f411c000 rkey 4a40044 nic_wr_credit 58655. [D 20:43:38.590933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f413c000 rkey 4a40044 nic_wr_credit 58656. [D 20:43:38.590947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f415c000 rkey 4a40044 nic_wr_credit 58657. [D 20:43:38.590961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f417c000 rkey 4a40044 nic_wr_credit 58658. [D 20:43:38.590975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f419c000 rkey 4a40044 nic_wr_credit 58659. [D 20:43:38.590989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58660. [D 20:43:38.591003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58661. [D 20:43:38.591016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58662. [D 20:43:38.591030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f421c000 rkey 4a40044 nic_wr_credit 58663. [D 20:43:38.591044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f423c000 rkey 4a40044 nic_wr_credit 58664. [D 20:43:38.591058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f425c000 rkey 4a40044 nic_wr_credit 58665. [D 20:43:38.591072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f427c000 rkey 4a40044 nic_wr_credit 58666. [D 20:43:38.591086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f429c000 rkey 4a40044 nic_wr_credit 58667. [D 20:43:38.591100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58668. [D 20:43:38.591114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58669. [D 20:43:38.591128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58670. [D 20:43:38.591141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f431c000 rkey 4a40044 nic_wr_credit 58671. [D 20:43:38.591155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f433c000 rkey 4a40044 nic_wr_credit 58672. [D 20:43:38.591169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f435c000 rkey 4a40044 nic_wr_credit 58673. [D 20:43:38.591184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f437c000 rkey 4a40044 nic_wr_credit 58674. [D 20:43:38.591198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:43806 remote addr f439c000 rkey 4a40044 nic_wr_credit 58675. [D 20:43:38.591212] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab60c1a0 to 10.1.4.240:43806 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58676. [D 20:43:38.601492] openib_check_cq: completed rdma wr_id 2aaaab60c1a0, nic_wr_credit 58676. [D 20:43:38.601514] openib_post_sr: 10.1.4.240:43806 bh 19 len 16 wr 14/70. [D 20:43:38.601594] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:38.601617] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:38.601630] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.647656] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.647679] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.647692] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.647734] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8175 [D 20:43:39.647749] element 0: offset: 0x661650, size: 72 [D 20:43:39.647766] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 15/70. [D 20:43:39.647906] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.647921] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.647934] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.648710] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.648730] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.648744] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.648979] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8179 [D 20:43:39.648997] element 0: offset: 0x661650, size: 72 [D 20:43:39.649012] openib_post_sr: 10.1.4.240:43806 bh 1 len 88 wr 16/70. [D 20:43:39.649212] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.649230] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.649243] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.661312] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.661333] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.661346] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.661370] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8186 [D 20:43:39.661385] element 0: offset: 0x661650, size: 72 [D 20:43:39.661403] openib_post_sr: 10.1.4.240:43806 bh 2 len 88 wr 17/70. [D 20:43:39.661490] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.661506] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.661519] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.669713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.669732] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.669745] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.669770] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8191 [D 20:43:39.669784] element 0: offset: 0x661650, size: 72 [D 20:43:39.669799] openib_post_sr: 10.1.4.240:43806 bh 3 len 88 wr 18/70. [D 20:43:39.669887] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.669903] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.669916] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.675822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.675842] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.675855] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.675879] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8198 [D 20:43:39.675893] element 0: offset: 0x661650, size: 72 [D 20:43:39.675911] openib_post_sr: 10.1.4.240:43806 bh 4 len 88 wr 19/70. [D 20:43:39.676258] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.676282] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.676295] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.686330] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.686350] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.686362] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.686387] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8203 [D 20:43:39.686401] element 0: offset: 0x661650, size: 72 [D 20:43:39.686416] openib_post_sr: 10.1.4.240:43806 bh 5 len 88 wr 20/70. [D 20:43:39.686503] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.686519] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.686531] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.695343] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.695362] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.695375] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.695400] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8209 [D 20:43:39.695414] element 0: offset: 0x661650, size: 72 [D 20:43:39.695432] openib_post_sr: 10.1.4.240:43806 bh 6 len 88 wr 21/70. [D 20:43:39.695520] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.695537] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.695549] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.711145] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.711166] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.711178] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.711203] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8216 [D 20:43:39.711217] element 0: offset: 0x661650, size: 72 [D 20:43:39.711236] openib_post_sr: 10.1.4.240:43806 bh 7 len 88 wr 22/70. [D 20:43:39.711322] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.711339] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.711351] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.721588] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.721608] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.721621] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.721645] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8222 [D 20:43:39.721659] element 0: offset: 0x661650, size: 72 [D 20:43:39.721675] openib_post_sr: 10.1.4.240:43806 bh 8 len 88 wr 23/70. [D 20:43:39.721842] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.721859] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.721871] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.731439] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.731459] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.731472] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.731496] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8228 [D 20:43:39.731510] element 0: offset: 0x661650, size: 72 [D 20:43:39.731527] openib_post_sr: 10.1.4.240:43806 bh 9 len 88 wr 24/70. [D 20:43:39.731735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.731754] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.731766] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.741929] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.741949] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.741962] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.741985] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8234 [D 20:43:39.742000] element 0: offset: 0x661650, size: 72 [D 20:43:39.742019] openib_post_sr: 10.1.4.240:43806 bh 10 len 88 wr 25/70. [D 20:43:39.742361] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.742382] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.742394] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.750263] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.750283] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.750296] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.750320] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8240 [D 20:43:39.750335] element 0: offset: 0x661650, size: 72 [D 20:43:39.750352] openib_post_sr: 10.1.4.240:43806 bh 11 len 88 wr 26/70. [D 20:43:39.750691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.750711] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.750723] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.758576] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.758597] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.758610] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.758633] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8246 [D 20:43:39.758647] element 0: offset: 0x661650, size: 72 [D 20:43:39.758665] openib_post_sr: 10.1.4.240:43806 bh 12 len 88 wr 27/70. [D 20:43:39.758751] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.758768] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.758780] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.768808] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.768828] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.768841] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.768865] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8253 [D 20:43:39.768879] element 0: offset: 0x661650, size: 72 [D 20:43:39.768894] openib_post_sr: 10.1.4.240:43806 bh 13 len 88 wr 28/70. [D 20:43:39.768980] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.768996] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.769009] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.779260] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.779280] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.779293] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.779317] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8259 [D 20:43:39.779331] element 0: offset: 0x661650, size: 72 [D 20:43:39.779348] openib_post_sr: 10.1.4.240:43806 bh 14 len 88 wr 29/70. [D 20:43:39.779434] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.779450] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.779463] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.787521] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.787540] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.787553] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.787577] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8264 [D 20:43:39.787591] element 0: offset: 0x661650, size: 72 [D 20:43:39.787609] openib_post_sr: 10.1.4.240:43806 bh 15 len 88 wr 30/70. [D 20:43:39.787696] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.787713] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.787725] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.795763] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.795783] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.795795] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.795819] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8270 [D 20:43:39.795833] element 0: offset: 0x661650, size: 72 [D 20:43:39.795850] openib_post_sr: 10.1.4.240:43806 bh 16 len 88 wr 31/70. [D 20:43:39.796194] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.796214] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.796227] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.804006] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.804027] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.804040] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.804063] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8276 [D 20:43:39.804077] element 0: offset: 0x661650, size: 72 [D 20:43:39.804092] openib_post_sr: 10.1.4.240:43806 bh 17 len 88 wr 32/70. [D 20:43:39.804177] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.804193] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.804206] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.812182] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.812202] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.812214] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.812238] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8282 [D 20:43:39.812252] element 0: offset: 0x661650, size: 72 [D 20:43:39.812274] openib_post_sr: 10.1.4.240:43806 bh 18 len 88 wr 33/70. [D 20:43:39.812417] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.812434] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.812446] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.822628] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.822648] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.822661] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.822685] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8289 [D 20:43:39.822699] element 0: offset: 0x661650, size: 72 [D 20:43:39.822715] openib_post_sr: 10.1.4.240:43806 bh 19 len 88 wr 34/70. [D 20:43:39.822800] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.822816] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.822828] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.830877] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.830897] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.830910] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.830934] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8295 [D 20:43:39.830948] element 0: offset: 0x661650, size: 72 [D 20:43:39.830966] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 35/70. [D 20:43:39.831051] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.831067] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.831080] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.844650] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.844669] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.844682] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.844707] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8303 [D 20:43:39.844721] element 0: offset: 0x661650, size: 72 [D 20:43:39.844736] openib_post_sr: 10.1.4.240:43806 bh 1 len 88 wr 36/70. [D 20:43:39.844822] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.844838] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.844851] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.855189] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.855209] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.855222] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.855246] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8309 [D 20:43:39.855260] element 0: offset: 0x661650, size: 72 [D 20:43:39.855277] openib_post_sr: 10.1.4.240:43806 bh 2 len 88 wr 37/70. [D 20:43:39.855608] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.855628] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.855641] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.863556] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.863576] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.863589] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.863613] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8316 [D 20:43:39.863627] element 0: offset: 0x661650, size: 72 [D 20:43:39.863643] openib_post_sr: 10.1.4.240:43806 bh 3 len 88 wr 38/70. [D 20:43:39.863984] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.864004] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.864017] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.872827] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.872846] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.872859] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.872883] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8321 [D 20:43:39.872897] element 0: offset: 0x661650, size: 72 [D 20:43:39.872913] openib_post_sr: 10.1.4.240:43806 bh 4 len 88 wr 39/70. [D 20:43:39.872999] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.873015] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.873028] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.883364] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.883384] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.883397] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.883421] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8328 [D 20:43:39.883435] element 0: offset: 0x661650, size: 72 [D 20:43:39.883450] openib_post_sr: 10.1.4.240:43806 bh 5 len 88 wr 40/70. [D 20:43:39.883535] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.883551] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.883564] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.891564] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.891584] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.891597] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.891621] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8333 [D 20:43:39.891635] element 0: offset: 0x661650, size: 72 [D 20:43:39.891650] openib_post_sr: 10.1.4.240:43806 bh 6 len 88 wr 41/70. [D 20:43:39.891735] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.891751] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.891764] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.901972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.901992] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.902005] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.902029] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8339 [D 20:43:39.902043] element 0: offset: 0x661650, size: 72 [D 20:43:39.902059] openib_post_sr: 10.1.4.240:43806 bh 7 len 88 wr 42/70. [D 20:43:39.902144] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.902160] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.902173] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.915532] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.915552] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.915564] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.915588] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8346 [D 20:43:39.915602] element 0: offset: 0x661650, size: 72 [D 20:43:39.915618] openib_post_sr: 10.1.4.240:43806 bh 8 len 88 wr 43/70. [D 20:43:39.915949] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.915970] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.915982] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.916673] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.916693] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.916707] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.917518] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8349 [D 20:43:39.917540] element 0: offset: 0x2aaaab0270f0, size: 16 [D 20:43:39.917557] openib_post_sr: 10.1.4.240:43806 bh 9 len 32 wr 44/70. [D 20:43:39.917706] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.917725] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.917737] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.980330] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.980349] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.980362] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:39.980388] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8356 [D 20:43:39.980402] element 0: offset: 0x661650, size: 72 [D 20:43:39.980417] openib_post_sr: 10.1.4.240:43806 bh 10 len 88 wr 45/70. [D 20:43:39.980587] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:39.980604] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.980617] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:39.983271] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:39.983291] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:39.983304] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.230668] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8359 [D 20:43:40.230737] element 0: offset: 0x2aaaab026e20, size: 16 [D 20:43:40.230762] openib_post_sr: 10.1.4.240:43806 bh 11 len 32 wr 46/70. [D 20:43:40.230864] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.230880] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.230893] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.241782] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.241800] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.241812] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.241850] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8366 [D 20:43:40.241864] element 0: offset: 0x661650, size: 72 [D 20:43:40.241882] openib_post_sr: 10.1.4.240:43806 bh 12 len 88 wr 47/70. [D 20:43:40.241994] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.242008] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.242021] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.242544] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.242558] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.242571] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.371494] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8369 [D 20:43:40.371558] element 0: offset: 0x2aaaab036e70, size: 16 [D 20:43:40.371582] openib_post_sr: 10.1.4.240:43806 bh 13 len 32 wr 48/70. [D 20:43:40.371691] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.371706] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.371719] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.382657] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.382675] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.382688] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.382726] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8377 [D 20:43:40.382740] element 0: offset: 0x661650, size: 72 [D 20:43:40.382756] openib_post_sr: 10.1.4.240:43806 bh 14 len 88 wr 49/70. [D 20:43:40.382859] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.382874] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.382886] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.383411] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.383425] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.383437] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.526333] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8380 [D 20:43:40.526395] element 0: offset: 0x2aaaab034c70, size: 16 [D 20:43:40.526417] openib_post_sr: 10.1.4.240:43806 bh 15 len 32 wr 50/70. [D 20:43:40.526529] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.526545] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.526558] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.539445] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.539466] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.539479] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.539517] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8386 [D 20:43:40.539531] element 0: offset: 0x661650, size: 72 [D 20:43:40.539547] openib_post_sr: 10.1.4.240:43806 bh 16 len 88 wr 51/70. [D 20:43:40.539683] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.539698] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.539710] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.540235] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.540249] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.540261] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.675653] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8389 [D 20:43:40.675715] element 0: offset: 0x2aaaab001ce0, size: 16 [D 20:43:40.675737] openib_post_sr: 10.1.4.240:43806 bh 17 len 32 wr 52/70. [D 20:43:40.675844] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.675860] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.675872] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.686356] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.686374] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.686386] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.686422] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8396 [D 20:43:40.686437] element 0: offset: 0x661650, size: 72 [D 20:43:40.686452] openib_post_sr: 10.1.4.240:43806 bh 18 len 88 wr 53/70. [D 20:43:40.686585] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.686599] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.686612] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.689103] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.689118] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.689130] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.690628] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8399 [D 20:43:40.690649] element 0: offset: 0x2aaaab002070, size: 16 [D 20:43:40.690666] openib_post_sr: 10.1.4.240:43806 bh 19 len 32 wr 54/70. [D 20:43:40.690802] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.690819] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.690832] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.715965] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.715985] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.716002] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.716027] BMI_post_send_list: addr: 6811200, count: 1, total_size: 72, tag: 8407 [D 20:43:40.716041] element 0: offset: 0x661650, size: 72 [D 20:43:40.716056] openib_post_sr: 10.1.4.240:43806 bh 0 len 88 wr 55/70. [D 20:43:40.716116] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.716131] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.716143] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:40.718886] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:40.718904] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.718916] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:40.720332] BMI_post_send_list: addr: 6811200, count: 1, total_size: 16, tag: 8410 [D 20:43:40.720353] element 0: offset: 0x2aaaab034740, size: 16 [D 20:43:40.720371] openib_post_sr: 10.1.4.240:43806 bh 1 len 32 wr 56/70. [D 20:43:40.723347] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:40.723365] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:40.723382] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:43:45.489972] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:43:45.489998] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:45.490011] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:43:45.490063] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8413 [D 20:43:45.490077] element 0: offset: 0x2aaaab035310, size: 104 [D 20:43:45.490092] openib_post_sr: 10.1.4.240:43806 bh 2 len 120 wr 57/70. [D 20:43:45.490241] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:43:45.490255] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:43:45.490267] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:44:30.513216] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:44:30.513245] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:44:30.513259] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:44:30.513301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8416 [D 20:44:30.513315] element 0: offset: 0x2aaaab029200, size: 104 [D 20:44:30.513331] openib_post_sr: 10.1.4.240:43806 bh 3 len 120 wr 58/70. [D 20:44:30.513391] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:44:30.513405] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:44:30.513418] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:45:15.541213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:45:15.541288] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:45:15.541304] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:45:15.541384] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8419 [D 20:45:15.541400] element 0: offset: 0x2aaaab029200, size: 104 [D 20:45:15.541417] openib_post_sr: 10.1.4.240:43806 bh 4 len 120 wr 59/70. [D 20:45:15.544713] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:45:15.544732] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:45:15.544745] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:46:00.619828] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:46:00.619896] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:46:00.619911] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:46:00.619983] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8422 [D 20:46:00.619999] element 0: offset: 0x2aaaab021d70, size: 104 [D 20:46:00.620021] openib_post_sr: 10.1.4.240:43806 bh 5 len 120 wr 60/70. [D 20:46:00.620358] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:46:00.620377] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:46:00.620390] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:46:45.648973] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:46:45.649119] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:46:45.649151] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:46:45.649301] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8425 [D 20:46:45.649324] element 0: offset: 0x2aaaab021d70, size: 104 [D 20:46:45.649363] openib_post_sr: 10.1.4.240:43806 bh 6 len 120 wr 0/70. [D 20:46:45.652458] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:46:45.652611] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:46:45.652648] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:47:30.676213] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:47:30.676268] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:47:30.676285] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:47:30.676365] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8428 [D 20:47:30.676382] element 0: offset: 0x2aaaab035310, size: 104 [D 20:47:30.676400] openib_post_sr: 10.1.4.240:43806 bh 7 len 120 wr 1/70. [D 20:47:30.676505] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:47:30.676522] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:47:30.676536] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:48:15.704577] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:48:15.704651] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:48:15.704666] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:48:15.704746] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8431 [D 20:48:15.704762] element 0: offset: 0x2aaaab035310, size: 104 [D 20:48:15.704782] openib_post_sr: 10.1.4.240:43806 bh 8 len 120 wr 2/70. [D 20:48:15.704998] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:48:15.705017] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:48:15.705030] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:49:00.728458] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:49:00.728525] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:49:00.728540] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:49:00.728615] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8434 [D 20:49:00.728630] element 0: offset: 0x2aaaab029200, size: 104 [D 20:49:00.728650] openib_post_sr: 10.1.4.240:43806 bh 9 len 120 wr 3/70. [D 20:49:00.728951] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:49:00.728971] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:49:00.728984] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0 [D 20:49:45.753565] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 5 [D 20:49:45.753618] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:49:45.753633] [BMI CONTROL]: BMI_set_info: incremented ref 6811200 to: 1 [D 20:49:45.753707] BMI_post_send_list: addr: 6811200, count: 1, total_size: 104, tag: 8437 [D 20:49:45.753723] element 0: offset: 0x2aaaab029200, size: 104 [D 20:49:45.753743] openib_post_sr: 10.1.4.240:43806 bh 10 len 120 wr 4/70. [D 20:49:45.753856] [BMI CONTROL]: BMI_set_info: set_info: 6811200 option: 6 [D 20:49:45.753874] [BMI CONTROL]: BMI_set_info: searching for ref 6811200 [D 20:49:45.753887] [BMI CONTROL]: BMI_set_info: decremented ref 6811200 to: 0